2024-09-21T08:40:53.523 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T08:40:53.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:40:53.618 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7913200' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9490 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2NsRqX6fNFh4R/b/TO3Ya2mw/z7nOlLwD0oohMD38R6YcaO47Wx1uzqa7gj9r0ChoXCDlhjJcQpTvDeNGK8J4= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsvE4D86fVLx6b6tfjt4E6iQSxFcsodLqzGa6gw8y3wBaP0DfbrXuXkfE+CpVykE5noqy+LND95Gz7LNuGxCTU= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:40:05 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T08:40:53.618 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T08:40:53.619 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T08:40:53.619 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T08:40:53.621 INFO:teuthology.task.internal:Checking packages... 2024-09-21T08:40:53.641 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-21T08:40:53.641 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T08:40:53.641 INFO:teuthology.packaging:ref: None 2024-09-21T08:40:53.641 INFO:teuthology.packaging:tag: None 2024-09-21T08:40:53.641 INFO:teuthology.packaging:branch: squid 2024-09-21T08:40:53.641 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:40:53.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T08:40:53.877 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-21T08:40:53.879 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T08:40:53.886 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T08:40:53.886 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T08:40:53.895 INFO:teuthology.task.internal:Saving configuration 2024-09-21T08:40:53.907 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T08:40:53.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T08:40:53.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:35:39.246444', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2NsRqX6fNFh4R/b/TO3Ya2mw/z7nOlLwD0oohMD38R6YcaO47Wx1uzqa7gj9r0ChoXCDlhjJcQpTvDeNGK8J4='} 2024-09-21T08:40:53.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:35:39.244715', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsvE4D86fVLx6b6tfjt4E6iQSxFcsodLqzGa6gw8y3wBaP0DfbrXuXkfE+CpVykE5noqy+LND95Gz7LNuGxCTU='} 2024-09-21T08:40:53.960 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T08:40:53.967 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-21T08:40:53.967 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-21T08:40:53.967 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T08:40:54.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee7fe54160>, signals=[15]) 2024-09-21T08:40:54.024 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T08:40:54.031 INFO:teuthology.task.internal:Opening connections... 2024-09-21T08:40:54.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T08:40:54.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:40:54.111 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:40:54.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:40:54.188 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T08:40:54.196 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-09-21T08:40:54.215 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-09-21T08:40:54.215 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-09-21T08:40:54.272 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-09-21T08:40:54.272 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-09-21T08:40:54.272 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-09-21T08:40:54.272 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-09-21T08:40:54.272 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T08:40:54.273 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T08:40:54.274 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-09-21T08:40:54.304 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-09-21T08:40:54.322 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-09-21T08:40:54.322 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-09-21T08:40:54.379 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-09-21T08:40:54.379 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-09-21T08:40:54.379 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T08:40:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T08:40:54.381 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-09-21T08:40:54.404 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T08:40:54.420 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T08:40:54.440 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T08:40:54.440 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:40:54.442 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:40:54.459 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T08:40:54.473 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T08:40:54.473 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:40:54.499 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:40:54.611 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T08:40:54.669 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T08:40:54.684 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T08:40:54.684 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T08:40:54.684 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:40:54.685 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:40:54.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:40:54.702 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-21T08:40:54.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:40:54.703 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-21T08:40:54.759 INFO:teuthology.orchestra.run.smithi196.stdout:5.14.0-503.el9.x86_64 2024-09-21T08:40:54.759 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.14.0-503.el9.x86_64 2024-09-21T08:40:54.759 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum install -y kernel 2024-09-21T08:40:54.760 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-503.el9.x86_64 2024-09-21T08:40:54.760 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-503.el9.x86_64 2024-09-21T08:40:54.760 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-09-21T08:40:58.416 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T08:41:00.521 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-21T08:41:01.980 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.3 MB 00:05 2024-09-21T08:41:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-21T08:41:05.045 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T08:41:06.722 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-21T08:41:07.696 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T08:41:07.980 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T08:41:09.356 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 117 kB/s | 19 kB 00:00 2024-09-21T08:41:10.218 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T08:41:13.311 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T08:41:15.327 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T08:41:15.327 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T08:41:15.439 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T08:41:15.455 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 79 M 2024-09-21T08:41:15.456 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 126 M 2024-09-21T08:41:15.457 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:41:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 504 kB/s | 36 kB 00:00 2024-09-21T08:41:15.657 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T08:41:16.133 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T08:41:16.775 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-21T08:41:17.575 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-21T08:41:17.575 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:41:17.576 INFO:teuthology.orchestra.run.smithi029.stdout:Total 37 MB/s | 79 MB 00:02 2024-09-21T08:41:17.589 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T08:41:17.589 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T08:41:17.676 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T08:41:17.682 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout:Install 4 Packages 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:41:17.683 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 79 M 2024-09-21T08:41:17.684 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 126 M 2024-09-21T08:41:17.684 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:41:18.292 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:41:18.517 INFO:teuthology.orchestra.run.smithi196.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 61 kB/s | 36 kB 00:00 2024-09-21T08:41:18.709 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:41:18.709 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:41:19.309 INFO:teuthology.orchestra.run.smithi196.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T08:41:19.686 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:41:19.686 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:41:19.967 INFO:teuthology.orchestra.run.smithi196.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T08:41:20.769 INFO:teuthology.orchestra.run.smithi196.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-21T08:41:20.770 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:41:20.770 INFO:teuthology.orchestra.run.smithi196.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-21T08:41:21.456 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:41:21.813 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:41:21.813 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:41:22.241 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:41:22.825 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:41:22.825 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:41:22.977 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:41:23.081 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:41:25.275 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:41:25.857 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:41:25.897 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:41:25.986 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:41:26.050 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:41:28.744 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:41:28.879 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:41:31.172 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:41:31.215 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:41:33.683 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:41:33.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:41:36.423 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:41:38.688 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:17.235 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:17.279 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:17.693 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:17.693 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:42:17.693 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:42:17.693 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:42:18.051 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:18.094 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:18.526 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:18.526 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T08:42:18.526 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T08:42:18.526 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:42:18.563 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:42:18.929 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:42:19.020 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.021 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:42:19.021 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T08:42:19.021 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:42:19.021 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:42:19.021 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-21T08:42:19.021 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:42:19.021 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:42:19.080 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.080 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:42:19.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.06 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 82.el9 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2024-09-21T08:42:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Group : Unspecified 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 8274670 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : builder@centos.org 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T08:42:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T08:42:19.114 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T08:42:19.114 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2024-09-21T08:42:19.114 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:42:19.114 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T08:42:19.115 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T08:42:19.115 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 5.14.0-508.el9.x86_64 2024-09-21T08:42:19.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:42:19.586 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:42:19.737 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-09-21T08:42:20.043 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:42:20.151 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:20.151 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:42:20.151 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T08:42:20.152 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:42:20.152 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:42:20.152 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T08:42:20.152 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:42:20.152 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T08:42:20.212 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T08:42:20.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T08:42:20.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 82.el9 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8274670 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T08:42:20.244 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:42:20.245 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T08:42:20.246 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T08:42:20.246 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-508.el9.x86_64 2024-09-21T08:42:20.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T08:42:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-09-21T08:42:21.084 INFO:teuthology.orchestra.run.smithi196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T08:42:21.115 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-09-21T08:42:21.117 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-09-21T08:42:21.133 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.eNU6dxPeR2 2024-09-21T08:42:21.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eNU6dxPeR2 2024-09-21T08:42:21.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.eNU6dxPeR2 2024-09-21T08:42:21.343 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.eNU6dxPeR2 is 6KB 2024-09-21T08:42:21.391 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.eNU6dxPeR2 2024-09-21T08:42:21.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T08:42:21.468 INFO:teuthology.orchestra.run.smithi196.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T08:42:21.469 INFO:teuthology.orchestra.run.smithi196.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T08:42:21.469 INFO:teuthology.orchestra.run.smithi196.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T08:42:21.469 INFO:teuthology.orchestra.run.smithi196.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T08:42:21.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T08:42:21.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-09-21T08:42:22.663 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T08:42:22.686 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-09-21T08:42:22.687 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-21T08:42:22.702 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.EYdGRwCyyw 2024-09-21T08:42:22.703 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EYdGRwCyyw 2024-09-21T08:42:22.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.EYdGRwCyyw 2024-09-21T08:42:22.930 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.EYdGRwCyyw is 6KB 2024-09-21T08:42:22.950 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.EYdGRwCyyw 2024-09-21T08:42:22.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T08:42:23.037 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T08:42:23.037 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T08:42:23.037 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T08:42:23.037 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T08:42:23.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T08:42:23.189 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-09-21T08:42:51.640 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-21T08:42:51.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:42:51.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:42:53.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T08:42:53.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:42:53.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:43:10.191 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-09-21T08:43:11.727 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-09-21T08:43:19.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:43:19.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:43:20.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:43:20.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:44:19.259 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T08:44:20.734 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T08:44:31.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:44:31.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:44:31.520 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-21T08:44:31.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:44:31.896 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-21T08:44:31.896 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-21T08:44:31.911 INFO:teuthology.orchestra.run.smithi196.stdout:5.14.0-508.el9.x86_64 2024-09-21T08:44:31.911 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T08:44:31.912 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T08:44:31.912 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T08:44:32.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:44:32.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:44:32.913 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-21T08:44:32.913 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T08:44:32.996 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-09-21T08:44:33.023 DEBUG:teuthology.parallel:result is None 2024-09-21T08:44:33.138 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-21T08:44:33.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:44:33.529 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T08:44:33.530 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-21T08:44:33.547 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-508.el9.x86_64 2024-09-21T08:44:33.547 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T08:44:33.547 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T08:44:33.547 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T08:44:34.548 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T08:44:34.548 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T08:44:34.623 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-09-21T08:44:34.647 DEBUG:teuthology.parallel:result is None 2024-09-21T08:44:34.647 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T08:44:34.655 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T08:44:34.655 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T08:44:34.658 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T08:44:34.677 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T08:44:34.683 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T08:44:34.695 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T08:44:34.695 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T08:44:34.717 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T08:44:34.812 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T08:44:34.822 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T08:44:34.822 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T08:44:34.824 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T08:44:34.857 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:44:34.860 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:44:34.868 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:44:34.871 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T08:44:34.873 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T08:44:34.883 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T08:44:34.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T08:44:34.913 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T08:44:34.941 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T08:44:34.951 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T08:44:34.951 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T08:44:34.982 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T08:44:34.999 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:44:35.081 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:44:35.144 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:44:35.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:44:35.229 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:44:35.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T08:44:35.296 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:44:35.340 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T08:44:35.406 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:44:35.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T08:44:35.492 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:44:35.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T08:44:35.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-09-21T08:44:35.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-09-21T08:44:35.611 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:44:35.647 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:44:36.119 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T08:44:36.128 INFO:teuthology.task.internal:Starting timer... 2024-09-21T08:44:36.128 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T08:44:36.190 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T08:44:36.206 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-21T08:44:36.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-09-21T08:44:36.298 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-09-21T08:44:36.300 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-09-21T08:44:36.347 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-09-21T08:44:36.349 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T08:44:36.350 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-09-21T08:44:36.377 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-09-21T08:44:36.377 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-09-21T08:44:36.407 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-09-21T08:44:36.408 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-09-21T08:44:36.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:44:36.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:44:36.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:44:36.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:44:36.473 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T08:44:36.473 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-09-21T08:44:36.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-09-21T08:44:36.565 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T08:44:36.578 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T08:44:36.589 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T08:44:36.590 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T08:48:25.585 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-09-21T08:48:25.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:48:25.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:48:25.664 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-21T08:48:25.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T08:48:25.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:48:25.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:48:25.834 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-21T08:48:25.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-21T08:48:25.915 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T08:48:25.925 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T08:48:25.925 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T08:48:25.926 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:48:25.928 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T08:48:25.928 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:48:25.961 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T08:48:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T08:48:25.985 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T08:48:26.000 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T08:48:26.006 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-09-21T08:48:26.018 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-09-21T08:48:26.026 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-09-21T08:48:26.034 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T08:48:26.037 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-09-21T08:48:26.049 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T08:48:26.052 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T08:48:26.066 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T08:48:26.116 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.119 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.127 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.130 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:48:26.131 INFO:teuthology.run_tasks:Running task install... 2024-09-21T08:48:26.144 DEBUG:teuthology.task.install:project ceph 2024-09-21T08:48:26.144 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-21T08:48:26.144 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-21T08:48:26.144 INFO:teuthology.task.install:Using flavor: default 2024-09-21T08:48:26.153 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T08:48:26.153 INFO:teuthology.task.install:extra packages: [] 2024-09-21T08:48:26.154 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T08:48:26.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:48:26.155 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'tag': None, 'wait_for_package': False} 2024-09-21T08:48:26.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:48:26.297 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/ 2024-09-21T08:48:26.297 INFO:teuthology.task.install.rpm:Package version is 19.1.1-367.g9e2ac70b 2024-09-21T08:48:26.305 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/ 2024-09-21T08:48:26.305 INFO:teuthology.task.install.rpm:Package version is 19.1.1-367.g9e2ac70b 2024-09-21T08:48:26.409 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T08:48:26.409 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:48:26.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T08:48:26.419 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T08:48:26.419 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:48:26.419 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T08:48:26.437 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T08:48:26.437 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9e2ac70bb7aea67d34f0d50002344abbe7803736/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T08:48:26.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T08:48:26.445 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9e2ac70bb7aea67d34f0d50002344abbe7803736/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T08:48:26.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T08:48:26.511 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T08:48:26.581 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T08:48:26.586 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T08:48:26.646 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-09-21T08:48:26.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-09-21T08:48:26.650 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-09-21T08:48:26.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-09-21T08:48:26.883 INFO:teuthology.orchestra.run.smithi029.stdout:45 files removed 2024-09-21T08:48:26.883 INFO:teuthology.orchestra.run.smithi196.stdout:45 files removed 2024-09-21T08:48:26.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw 2024-09-21T08:48:26.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw 2024-09-21T08:48:27.469 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-21T08:48:27.491 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-21T08:48:27.753 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T08:48:27.784 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-21T08:48:28.020 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T08:48:28.051 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T08:48:28.802 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-21T08:48:29.920 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-21T08:48:31.280 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-21T08:48:33.063 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-21T08:48:35.709 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T08:48:37.436 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T08:48:37.488 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T08:48:38.408 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T08:48:39.281 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-21T08:48:40.044 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T08:48:44.142 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 7.8 kB/s | 1.7 kB 00:00 2024-09-21T08:48:45.449 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T08:48:46.572 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 11 M 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.4 M 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.2 M 2024-09-21T08:48:46.593 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.4 M 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 21 M 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 25 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 752 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 506 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.3 M 2024-09-21T08:48:46.594 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 45 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 136 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 161 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 320 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 301 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 99 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T08:48:46.595 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:Install 30 Packages 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 60 M 2024-09-21T08:48:46.596 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:48:47.345 INFO:teuthology.orchestra.run.smithi029.stdout:(1/32): ceph-base-19.1.1-367.g9e2ac70b.el9.x86_ 9.6 MB/s | 5.4 MB 00:00 2024-09-21T08:48:47.445 INFO:teuthology.orchestra.run.smithi029.stdout:(2/32): ceph-selinux-19.1.1-367.g9e2ac70b.el9.x 252 kB/s | 25 kB 00:00 2024-09-21T08:48:47.537 INFO:teuthology.orchestra.run.smithi029.stdout:(3/32): libcephfs2-19.1.1-367.g9e2ac70b.el9.x86 8.0 MB/s | 752 kB 00:00 2024-09-21T08:48:47.684 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:48:47.697 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 11 M 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.4 M 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.2 M 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.4 M 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 21 M 2024-09-21T08:48:47.698 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 25 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 752 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 506 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 5.3 M 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T08:48:47.699 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 45 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 136 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 161 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 320 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 301 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 99 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:48:47.700 INFO:teuthology.orchestra.run.smithi196.stdout:Install 30 Packages 2024-09-21T08:48:47.701 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 2 Packages 2024-09-21T08:48:47.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:48:47.701 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 60 M 2024-09-21T08:48:47.701 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:48:47.729 INFO:teuthology.orchestra.run.smithi029.stdout:(4/32): ceph-radosgw-19.1.1-367.g9e2ac70b.el9.x 11 MB/s | 11 MB 00:00 2024-09-21T08:48:47.763 INFO:teuthology.orchestra.run.smithi029.stdout:(5/32): libradosstriper1-19.1.1-367.g9e2ac70b.e 2.2 MB/s | 506 kB 00:00 2024-09-21T08:48:47.814 INFO:teuthology.orchestra.run.smithi029.stdout:(6/32): python3-ceph-argparse-19.1.1-367.g9e2ac 899 kB/s | 45 kB 00:00 2024-09-21T08:48:47.889 INFO:teuthology.orchestra.run.smithi029.stdout:(7/32): python3-ceph-common-19.1.1-367.g9e2ac70 1.8 MB/s | 136 kB 00:00 2024-09-21T08:48:47.966 INFO:teuthology.orchestra.run.smithi029.stdout:(8/32): python3-cephfs-19.1.1-367.g9e2ac70b.el9 2.1 MB/s | 161 kB 00:00 2024-09-21T08:48:48.309 INFO:teuthology.orchestra.run.smithi029.stdout:(9/32): ceph-common-19.1.1-367.g9e2ac70b.el9.x8 14 MB/s | 21 MB 00:01 2024-09-21T08:48:48.342 INFO:teuthology.orchestra.run.smithi029.stdout:(10/32): python3-rados-19.1.1-367.g9e2ac70b.el9 853 kB/s | 320 kB 00:00 2024-09-21T08:48:48.376 INFO:teuthology.orchestra.run.smithi029.stdout:(11/32): python3-rbd-19.1.1-367.g9e2ac70b.el9.x 4.4 MB/s | 301 kB 00:00 2024-09-21T08:48:48.494 INFO:teuthology.orchestra.run.smithi029.stdout:(12/32): librgw2-19.1.1-367.g9e2ac70b.el9.x86_6 7.0 MB/s | 5.3 MB 00:00 2024-09-21T08:48:48.527 INFO:teuthology.orchestra.run.smithi029.stdout:(13/32): python3-rgw-19.1.1-367.g9e2ac70b.el9.x 537 kB/s | 99 kB 00:00 2024-09-21T08:48:48.628 INFO:teuthology.orchestra.run.smithi029.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-21T08:48:48.653 INFO:teuthology.orchestra.run.smithi029.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T08:48:48.679 INFO:teuthology.orchestra.run.smithi029.stdout:(16/32): boost-program-options-1.75.0-8.el9.x86 354 kB/s | 107 kB 00:00 2024-09-21T08:48:48.738 INFO:teuthology.orchestra.run.smithi029.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T08:48:48.763 INFO:teuthology.orchestra.run.smithi029.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 503 kB/s | 42 kB 00:00 2024-09-21T08:48:48.797 INFO:teuthology.orchestra.run.smithi029.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.8 MB/s | 662 kB 00:00 2024-09-21T08:48:48.822 INFO:teuthology.orchestra.run.smithi029.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-21T08:48:48.848 INFO:teuthology.orchestra.run.smithi029.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 424 kB/s | 36 kB 00:00 2024-09-21T08:48:48.867 INFO:teuthology.orchestra.run.smithi196.stdout:(1/32): ceph-base-19.1.1-367.g9e2ac70b.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-21T08:48:48.874 INFO:teuthology.orchestra.run.smithi029.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 621 kB/s | 47 kB 00:00 2024-09-21T08:48:48.925 INFO:teuthology.orchestra.run.smithi196.stdout:(2/32): ceph-selinux-19.1.1-367.g9e2ac70b.el9.x 433 kB/s | 25 kB 00:00 2024-09-21T08:48:48.941 INFO:teuthology.orchestra.run.smithi029.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2024-09-21T08:48:48.968 INFO:teuthology.orchestra.run.smithi029.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 333 kB/s | 26 kB 00:00 2024-09-21T08:48:48.993 INFO:teuthology.orchestra.run.smithi029.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 933 kB/s | 49 kB 00:00 2024-09-21T08:48:49.017 INFO:teuthology.orchestra.run.smithi196.stdout:(3/32): libcephfs2-19.1.1-367.g9e2ac70b.el9.x86 8.0 MB/s | 752 kB 00:00 2024-09-21T08:48:49.019 INFO:teuthology.orchestra.run.smithi029.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T08:48:49.070 INFO:teuthology.orchestra.run.smithi029.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T08:48:49.103 INFO:teuthology.orchestra.run.smithi029.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T08:48:49.171 INFO:teuthology.orchestra.run.smithi029.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T08:48:49.176 INFO:teuthology.orchestra.run.smithi196.stdout:(4/32): ceph-radosgw-19.1.1-367.g9e2ac70b.el9.x 13 MB/s | 11 MB 00:00 2024-09-21T08:48:49.201 INFO:teuthology.orchestra.run.smithi196.stdout:(5/32): libradosstriper1-19.1.1-367.g9e2ac70b.e 2.7 MB/s | 506 kB 00:00 2024-09-21T08:48:49.269 INFO:teuthology.orchestra.run.smithi196.stdout:(6/32): python3-ceph-argparse-19.1.1-367.g9e2ac 675 kB/s | 45 kB 00:00 2024-09-21T08:48:49.297 INFO:teuthology.orchestra.run.smithi029.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-09-21T08:48:49.377 INFO:teuthology.orchestra.run.smithi196.stdout:(7/32): python3-ceph-common-19.1.1-367.g9e2ac70 1.2 MB/s | 136 kB 00:00 2024-09-21T08:48:49.477 INFO:teuthology.orchestra.run.smithi196.stdout:(8/32): python3-cephfs-19.1.1-367.g9e2ac70b.el9 1.6 MB/s | 161 kB 00:00 2024-09-21T08:48:49.530 INFO:teuthology.orchestra.run.smithi029.stdout:(31/32): librados2-19.1.1-367.g9e2ac70b.el9.x86 8.0 MB/s | 3.4 MB 00:00 2024-09-21T08:48:49.553 INFO:teuthology.orchestra.run.smithi196.stdout:(9/32): librgw2-19.1.1-367.g9e2ac70b.el9.x86_64 14 MB/s | 5.3 MB 00:00 2024-09-21T08:48:49.586 INFO:teuthology.orchestra.run.smithi196.stdout:(10/32): python3-rados-19.1.1-367.g9e2ac70b.el9 2.9 MB/s | 320 kB 00:00 2024-09-21T08:48:49.605 INFO:teuthology.orchestra.run.smithi029.stdout:(32/32): librbd1-19.1.1-367.g9e2ac70b.el9.x86_6 7.3 MB/s | 3.2 MB 00:00 2024-09-21T08:48:49.611 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:48:49.611 INFO:teuthology.orchestra.run.smithi029.stdout:Total 20 MB/s | 60 MB 00:03 2024-09-21T08:48:49.719 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:48:49.761 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:48:49.761 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:48:49.786 INFO:teuthology.orchestra.run.smithi196.stdout:(11/32): ceph-common-19.1.1-367.g9e2ac70b.el9.x 15 MB/s | 21 MB 00:01 2024-09-21T08:48:49.812 INFO:teuthology.orchestra.run.smithi196.stdout:(12/32): python3-rbd-19.1.1-367.g9e2ac70b.el9.x 1.1 MB/s | 301 kB 00:00 2024-09-21T08:48:49.837 INFO:teuthology.orchestra.run.smithi196.stdout:(13/32): python3-rgw-19.1.1-367.g9e2ac70b.el9.x 396 kB/s | 99 kB 00:00 2024-09-21T08:48:49.929 INFO:teuthology.orchestra.run.smithi196.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 752 kB/s | 107 kB 00:00 2024-09-21T08:48:49.946 INFO:teuthology.orchestra.run.smithi196.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-21T08:48:49.971 INFO:teuthology.orchestra.run.smithi196.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T08:48:50.013 INFO:teuthology.orchestra.run.smithi196.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T08:48:50.055 INFO:teuthology.orchestra.run.smithi196.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-21T08:48:50.089 INFO:teuthology.orchestra.run.smithi196.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T08:48:50.106 INFO:teuthology.orchestra.run.smithi196.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 716 kB/s | 36 kB 00:00 2024-09-21T08:48:50.131 INFO:teuthology.orchestra.run.smithi196.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T08:48:50.148 INFO:teuthology.orchestra.run.smithi196.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-09-21T08:48:50.207 INFO:teuthology.orchestra.run.smithi196.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-21T08:48:50.223 INFO:teuthology.orchestra.run.smithi196.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 3.2 MB/s | 49 kB 00:00 2024-09-21T08:48:50.241 INFO:teuthology.orchestra.run.smithi196.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 336 kB/s | 26 kB 00:00 2024-09-21T08:48:50.266 INFO:teuthology.orchestra.run.smithi196.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-21T08:48:50.299 INFO:teuthology.orchestra.run.smithi196.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-21T08:48:50.358 INFO:teuthology.orchestra.run.smithi196.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T08:48:50.400 INFO:teuthology.orchestra.run.smithi196.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T08:48:50.475 INFO:teuthology.orchestra.run.smithi196.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T08:48:50.584 INFO:teuthology.orchestra.run.smithi196.stdout:(31/32): librados2-19.1.1-367.g9e2ac70b.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-21T08:48:50.617 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:48:50.618 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:48:50.692 INFO:teuthology.orchestra.run.smithi196.stdout:(32/32): librbd1-19.1.1-367.g9e2ac70b.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-21T08:48:50.697 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:48:50.697 INFO:teuthology.orchestra.run.smithi196.stdout:Total 20 MB/s | 60 MB 00:02 2024-09-21T08:48:50.799 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:48:50.835 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:48:50.835 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:48:51.507 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:48:51.507 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:48:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:48:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T08:48:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T08:48:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T08:48:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T08:48:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T08:48:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T08:48:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T08:48:52.988 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:48:53.075 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T08:48:53.106 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T08:48:53.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T08:48:53.131 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T08:48:53.162 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T08:48:53.184 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T08:48:53.330 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:48:53.373 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T08:48:53.424 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:48:53.514 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 8/34 2024-09-21T08:48:53.550 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T08:48:53.561 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T08:48:53.613 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T08:48:53.651 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T08:48:53.700 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 11/34 2024-09-21T08:48:53.767 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T08:48:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:48:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:48:53.897 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T08:48:53.991 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T08:48:54.018 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T08:48:54.049 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T08:48:54.090 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T08:48:54.108 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:48:54.123 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T08:48:54.163 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T08:48:54.192 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:48:54.196 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T08:48:54.282 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 8/34 2024-09-21T08:48:54.310 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T08:48:54.373 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 9/34 2024-09-21T08:48:54.409 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T08:48:54.453 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 11/34 2024-09-21T08:48:54.530 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T08:48:54.533 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T08:48:54.562 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:48:54.585 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T08:48:54.626 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:48:54.661 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T08:48:54.677 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T08:48:54.708 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 23/34 2024-09-21T08:48:54.752 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T08:48:54.780 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T08:48:54.812 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T08:48:54.853 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T08:48:54.893 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T08:48:54.947 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T08:48:54.985 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T08:48:55.260 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T08:48:55.292 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T08:48:55.294 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T08:48:55.343 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T08:48:55.363 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T08:48:55.425 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 22/34 2024-09-21T08:48:55.444 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 27/34 2024-09-21T08:48:55.456 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 23/34 2024-09-21T08:48:55.479 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 28/34 2024-09-21T08:48:55.501 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T08:48:55.982 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T08:48:56.020 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T08:48:56.083 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 26/34 2024-09-21T08:48:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 27/34 2024-09-21T08:48:56.189 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 28/34 2024-09-21T08:48:57.921 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:57.965 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:58.487 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:58.519 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:58.555 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:58.598 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T08:48:58.694 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T08:48:58.694 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T08:48:58.694 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T08:48:58.694 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:48:58.734 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:48:59.089 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 29/34 2024-09-21T08:48:59.123 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T08:48:59.214 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 30/34 2024-09-21T08:48:59.215 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T08:48:59.215 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T08:48:59.215 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:48:59.249 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:49:09.429 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:49:09.429 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-09-21T08:49:09.429 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-09-21T08:49:09.429 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-09-21T08:49:09.430 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-09-21T08:49:09.430 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-09-21T08:49:09.430 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-09-21T08:49:09.430 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-09-21T08:49:09.430 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:10.427 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T08:49:10.452 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T08:49:10.452 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:10.452 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T08:49:10.452 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T08:49:10.452 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T08:49:10.453 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:10.454 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T08:49:10.521 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T08:49:10.521 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-09-21T08:49:11.548 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:11.738 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:11.738 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/34 2024-09-21T08:49:11.738 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/34 2024-09-21T08:49:11.738 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 6/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 8/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 9/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 10/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 11/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T08:49:11.739 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:49:11.740 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T08:49:11.741 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/34 2024-09-21T08:49:12.561 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T08:49:12.587 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 32/34 2024-09-21T08:49:12.587 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:12.588 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T08:49:12.588 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T08:49:12.588 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T08:49:12.588 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:12.590 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T08:49:12.673 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T08:49:12.673 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:12.736 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T08:49:12.737 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.738 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:12.739 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:13.092 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-test 2024-09-21T08:49:13.677 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:13.809 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:13.809 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:13.809 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:49:13.809 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 49 M 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 163 k 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout:Install 4 Packages 2024-09-21T08:49:13.810 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:13.811 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 49 M 2024-09-21T08:49:13.811 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 209 M 2024-09-21T08:49:13.811 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:14.018 INFO:teuthology.orchestra.run.smithi196.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-21T08:49:14.043 INFO:teuthology.orchestra.run.smithi196.stdout:(2/4): libcephsqlite-19.1.1-367.g9e2ac70b.el9.x 777 kB/s | 163 kB 00:00 2024-09-21T08:49:14.060 INFO:teuthology.orchestra.run.smithi196.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 6/34 2024-09-21T08:49:14.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 7/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x 8/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86 9/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 10/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 11/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 12/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 13/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T08:49:14.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 31/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T08:49:14.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/34 2024-09-21T08:49:15.561 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T08:49:15.562 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T08:49:15.563 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:15.610 INFO:teuthology.orchestra.run.smithi196.stdout:(4/4): ceph-test-19.1.1-367.g9e2ac70b.el9.x86_6 27 MB/s | 49 MB 00:01 2024-09-21T08:49:15.612 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:15.613 INFO:teuthology.orchestra.run.smithi196.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-21T08:49:15.640 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:15.660 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:15.660 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:15.997 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-test 2024-09-21T08:49:16.039 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:16.040 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:16.581 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:16.603 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:32 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:16.671 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T08:49:16.725 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T08:49:16.748 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 49 M 2024-09-21T08:49:16.749 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 163 k 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:16.750 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 49 M 2024-09-21T08:49:16.751 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 209 M 2024-09-21T08:49:16.751 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:16.762 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T08:49:17.027 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): libcephsqlite-19.1.1-367.g9e2ac70b.el9.x 712 kB/s | 163 kB 00:00 2024-09-21T08:49:17.494 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 136 kB/s | 64 kB 00:00 2024-09-21T08:49:17.578 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 390 kB/s | 304 kB 00:00 2024-09-21T08:49:18.620 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): ceph-test-19.1.1-367.g9e2ac70b.el9.x86_6 27 MB/s | 49 MB 00:01 2024-09-21T08:49:18.622 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:18.622 INFO:teuthology.orchestra.run.smithi029.stdout:Total 26 MB/s | 49 MB 00:01 2024-09-21T08:49:18.650 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:49:18.673 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:49:18.673 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:49:19.076 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:49:19.077 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:49:19.671 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:49:19.781 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T08:49:19.831 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T08:49:19.859 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T08:49:21.391 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T08:49:21.486 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T08:49:23.846 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T08:49:23.846 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/4 2024-09-21T08:49:23.846 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/4 2024-09-21T08:49:23.847 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T08:49:24.186 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T08:49:24.186 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:24.187 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:24.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph 2024-09-21T08:49:24.754 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/4 2024-09-21T08:49:24.840 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T08:49:25.054 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:40 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:25.191 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:25.193 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:25.193 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 6.5 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 2.4 M 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 1.5 M 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 249 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 4.7 M 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 17 M 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T08:49:25.194 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T08:49:25.195 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T08:49:25.196 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:Install 37 Packages 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 30 M 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 108 M 2024-09-21T08:49:25.197 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:25.670 INFO:teuthology.orchestra.run.smithi196.stdout:(1/37): ceph-19.1.1-367.g9e2ac70b.el9.x86_64.rp 52 kB/s | 6.5 kB 00:00 2024-09-21T08:49:25.837 INFO:teuthology.orchestra.run.smithi196.stdout:(2/37): ceph-mgr-19.1.1-367.g9e2ac70b.el9.x86_6 5.2 MB/s | 1.5 MB 00:00 2024-09-21T08:49:25.912 INFO:teuthology.orchestra.run.smithi196.stdout:(3/37): ceph-mds-19.1.1-367.g9e2ac70b.el9.x86_6 6.5 MB/s | 2.4 MB 00:00 2024-09-21T08:49:26.004 INFO:teuthology.orchestra.run.smithi196.stdout:(4/37): ceph-mon-19.1.1-367.g9e2ac70b.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-21T08:49:26.029 INFO:teuthology.orchestra.run.smithi196.stdout:(5/37): ceph-mgr-modules-core-19.1.1-367.g9e2ac 2.1 MB/s | 249 kB 00:00 2024-09-21T08:49:26.146 INFO:teuthology.orchestra.run.smithi196.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-21T08:49:26.188 INFO:teuthology.orchestra.run.smithi196.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T08:49:26.230 INFO:teuthology.orchestra.run.smithi196.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 6.1 MB/s | 1.2 MB 00:00 2024-09-21T08:49:26.255 INFO:teuthology.orchestra.run.smithi196.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-21T08:49:26.281 INFO:teuthology.orchestra.run.smithi196.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-21T08:49:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-21T08:49:26.493 INFO:teuthology.orchestra.run.smithi196.stdout:(12/37): ceph-osd-19.1.1-367.g9e2ac70b.el9.x86_ 26 MB/s | 17 MB 00:00 2024-09-21T08:49:26.544 INFO:teuthology.orchestra.run.smithi196.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 726 kB/s | 172 kB 00:00 2024-09-21T08:49:26.569 INFO:teuthology.orchestra.run.smithi196.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 655 kB/s | 188 kB 00:00 2024-09-21T08:49:26.594 INFO:teuthology.orchestra.run.smithi196.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-21T08:49:26.620 INFO:teuthology.orchestra.run.smithi196.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-21T08:49:26.653 INFO:teuthology.orchestra.run.smithi196.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-21T08:49:26.679 INFO:teuthology.orchestra.run.smithi196.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-09-21T08:49:26.704 INFO:teuthology.orchestra.run.smithi196.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 381 kB/s | 42 kB 00:00 2024-09-21T08:49:26.754 INFO:teuthology.orchestra.run.smithi196.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 580 kB/s | 43 kB 00:00 2024-09-21T08:49:26.779 INFO:teuthology.orchestra.run.smithi196.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-09-21T08:49:26.804 INFO:teuthology.orchestra.run.smithi196.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-21T08:49:26.830 INFO:teuthology.orchestra.run.smithi196.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-21T08:49:26.855 INFO:teuthology.orchestra.run.smithi196.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-21T08:49:26.880 INFO:teuthology.orchestra.run.smithi196.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 929 kB/s | 23 kB 00:00 2024-09-21T08:49:26.905 INFO:teuthology.orchestra.run.smithi196.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-21T08:49:26.930 INFO:teuthology.orchestra.run.smithi196.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-21T08:49:26.956 INFO:teuthology.orchestra.run.smithi196.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T08:49:26.981 INFO:teuthology.orchestra.run.smithi196.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-09-21T08:49:27.006 INFO:teuthology.orchestra.run.smithi196.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T08:49:27.032 INFO:teuthology.orchestra.run.smithi196.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T08:49:27.057 INFO:teuthology.orchestra.run.smithi196.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-21T08:49:27.082 INFO:teuthology.orchestra.run.smithi196.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-21T08:49:27.107 INFO:teuthology.orchestra.run.smithi196.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T08:49:27.133 INFO:teuthology.orchestra.run.smithi196.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-21T08:49:27.158 INFO:teuthology.orchestra.run.smithi196.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T08:49:27.183 INFO:teuthology.orchestra.run.smithi196.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T08:49:27.187 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:27.187 INFO:teuthology.orchestra.run.smithi196.stdout:Total 15 MB/s | 30 MB 00:01 2024-09-21T08:49:27.336 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:27.377 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:27.377 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:27.886 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:27.886 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:28.696 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/4 2024-09-21T08:49:28.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/4 2024-09-21T08:49:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/4 2024-09-21T08:49:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T08:49:29.032 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T08:49:29.033 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:29.033 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:29.234 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:29.303 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T08:49:29.344 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T08:49:29.365 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph 2024-09-21T08:49:29.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T08:49:29.460 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T08:49:29.521 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T08:49:29.554 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T08:49:29.645 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T08:49:29.732 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T08:49:29.782 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T08:49:29.825 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T08:49:29.863 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T08:49:29.898 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T08:49:29.931 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T08:49:29.971 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T08:49:29.972 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:45 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:30.007 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T08:49:30.041 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T08:49:30.089 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T08:49:30.118 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 6.5 k 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 2.4 M 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 1.5 M 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 249 k 2024-09-21T08:49:30.121 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 4.7 M 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 17 M 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T08:49:30.122 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T08:49:30.123 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout:Install 37 Packages 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:30.124 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T08:49:30.125 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 30 M 2024-09-21T08:49:30.125 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 108 M 2024-09-21T08:49:30.125 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:30.196 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T08:49:30.335 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T08:49:30.416 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T08:49:30.477 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T08:49:30.517 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T08:49:30.571 INFO:teuthology.orchestra.run.smithi029.stdout:(1/37): ceph-19.1.1-367.g9e2ac70b.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2024-09-21T08:49:30.574 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T08:49:30.638 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T08:49:30.772 INFO:teuthology.orchestra.run.smithi029.stdout:(2/37): ceph-mgr-19.1.1-367.g9e2ac70b.el9.x86_6 4.6 MB/s | 1.5 MB 00:00 2024-09-21T08:49:30.834 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T08:49:30.855 INFO:teuthology.orchestra.run.smithi029.stdout:(3/37): ceph-mds-19.1.1-367.g9e2ac70b.el9.x86_6 5.7 MB/s | 2.4 MB 00:00 2024-09-21T08:49:30.879 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T08:49:30.923 INFO:teuthology.orchestra.run.smithi029.stdout:(4/37): ceph-mgr-modules-core-19.1.1-367.g9e2ac 3.6 MB/s | 249 kB 00:00 2024-09-21T08:49:30.957 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T08:49:31.032 INFO:teuthology.orchestra.run.smithi029.stdout:(5/37): ceph-mon-19.1.1-367.g9e2ac70b.el9.x86_6 10 MB/s | 4.7 MB 00:00 2024-09-21T08:49:31.054 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T08:49:31.095 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T08:49:31.149 INFO:teuthology.orchestra.run.smithi029.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T08:49:31.191 INFO:teuthology.orchestra.run.smithi029.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T08:49:31.211 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T08:49:31.241 INFO:teuthology.orchestra.run.smithi029.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-21T08:49:31.267 INFO:teuthology.orchestra.run.smithi029.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-21T08:49:31.301 INFO:teuthology.orchestra.run.smithi029.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-09-21T08:49:31.326 INFO:teuthology.orchestra.run.smithi029.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.5 MB/s | 215 kB 00:00 2024-09-21T08:49:31.360 INFO:teuthology.orchestra.run.smithi029.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T08:49:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 32/37 2024-09-21T08:49:31.394 INFO:teuthology.orchestra.run.smithi029.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T08:49:31.397 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T08:49:31.420 INFO:teuthology.orchestra.run.smithi029.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 588 kB/s | 35 kB 00:00 2024-09-21T08:49:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T08:49:31.423 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:31.423 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T08:49:31.424 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T08:49:31.424 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T08:49:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:31.445 INFO:teuthology.orchestra.run.smithi029.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T08:49:31.464 INFO:teuthology.orchestra.run.smithi029.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 51 kB 00:00 2024-09-21T08:49:31.490 INFO:teuthology.orchestra.run.smithi029.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 943 kB/s | 42 kB 00:00 2024-09-21T08:49:31.782 INFO:teuthology.orchestra.run.smithi029.stdout:(18/37): ceph-osd-19.1.1-367.g9e2ac70b.el9.x86_ 17 MB/s | 17 MB 00:01 2024-09-21T08:49:31.824 INFO:teuthology.orchestra.run.smithi029.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 453 kB/s | 151 kB 00:00 2024-09-21T08:49:31.858 INFO:teuthology.orchestra.run.smithi029.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 593 kB/s | 43 kB 00:00 2024-09-21T08:49:31.884 INFO:teuthology.orchestra.run.smithi029.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 53 kB/s | 22 kB 00:00 2024-09-21T08:49:31.909 INFO:teuthology.orchestra.run.smithi029.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T08:49:31.951 INFO:teuthology.orchestra.run.smithi029.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 532 kB/s | 18 kB 00:00 2024-09-21T08:49:31.985 INFO:teuthology.orchestra.run.smithi029.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 106 kB/s | 11 kB 00:00 2024-09-21T08:49:32.002 INFO:teuthology.orchestra.run.smithi029.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 476 kB/s | 23 kB 00:00 2024-09-21T08:49:32.028 INFO:teuthology.orchestra.run.smithi029.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 776 kB/s | 19 kB 00:00 2024-09-21T08:49:32.053 INFO:teuthology.orchestra.run.smithi029.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T08:49:32.087 INFO:teuthology.orchestra.run.smithi029.stdout:(28/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-21T08:49:32.112 INFO:teuthology.orchestra.run.smithi029.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 548 kB/s | 46 kB 00:00 2024-09-21T08:49:32.138 INFO:teuthology.orchestra.run.smithi029.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 933 kB/s | 79 kB 00:00 2024-09-21T08:49:32.163 INFO:teuthology.orchestra.run.smithi029.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T08:49:32.189 INFO:teuthology.orchestra.run.smithi029.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-21T08:49:32.224 INFO:teuthology.orchestra.run.smithi029.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-09-21T08:49:32.258 INFO:teuthology.orchestra.run.smithi029.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T08:49:32.292 INFO:teuthology.orchestra.run.smithi029.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T08:49:32.317 INFO:teuthology.orchestra.run.smithi029.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 339 kB/s | 20 kB 00:00 2024-09-21T08:49:32.351 INFO:teuthology.orchestra.run.smithi029.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-21T08:49:32.356 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:32.356 INFO:teuthology.orchestra.run.smithi029.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-21T08:49:32.514 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:49:32.557 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:49:32.557 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:49:32.882 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T08:49:32.910 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T08:49:32.910 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:32.910 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T08:49:32.910 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T08:49:32.911 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T08:49:32.911 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:33.083 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:49:33.084 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:49:33.357 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T08:49:33.381 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T08:49:33.381 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:33.381 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T08:49:33.381 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T08:49:33.381 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T08:49:33.382 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:33.608 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T08:49:33.632 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:33.698 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T08:49:34.473 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:49:34.571 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T08:49:34.615 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T08:49:34.651 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T08:49:34.733 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T08:49:34.784 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T08:49:34.827 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T08:49:34.932 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T08:49:35.010 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T08:49:35.074 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T08:49:35.118 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T08:49:35.148 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T08:49:35.183 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T08:49:35.235 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T08:49:35.285 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T08:49:35.329 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T08:49:35.363 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T08:49:35.422 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T08:49:35.461 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T08:49:35.541 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 6/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T08:49:35.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T08:49:35.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T08:49:35.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T08:49:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T08:49:35.718 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T08:49:35.812 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T08:49:35.871 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T08:49:35.917 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T08:49:35.978 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T08:49:36.042 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T08:49:36.240 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T08:49:36.307 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T08:49:36.388 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T08:49:36.487 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T08:49:36.534 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T08:49:36.568 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T08:49:36.569 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:36.570 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:36.668 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T08:49:36.840 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 32/37 2024-09-21T08:49:36.871 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T08:49:36.898 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 33/37 2024-09-21T08:49:36.898 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:36.898 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T08:49:36.898 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T08:49:36.899 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T08:49:36.899 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:37.020 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-base 2024-09-21T08:49:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:37.695 INFO:teuthology.orchestra.run.smithi196.stdout:Package ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:49:37.737 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:37.738 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:49:37.738 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:37.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install cephadm 2024-09-21T08:49:38.390 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:38.440 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 34/37 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T08:49:38.469 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:38.521 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 765 k 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:38.522 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 765 k 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 771 k 2024-09-21T08:49:38.523 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:38.783 INFO:teuthology.orchestra.run.smithi196.stdout:cephadm-19.1.1-367.g9e2ac70b.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-21T08:49:38.783 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:38.784 INFO:teuthology.orchestra.run.smithi196.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-21T08:49:38.784 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:38.789 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:38.789 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:38.795 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:38.795 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:38.871 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:38.934 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 35/37 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T08:49:38.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:39.202 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T08:49:39.227 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 36/37 2024-09-21T08:49:39.227 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:39.228 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T08:49:39.228 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T08:49:39.228 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T08:49:39.228 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:39.294 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T08:49:39.323 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:39.412 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:39.778 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:40.052 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:40.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T08:49:40.873 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:41.012 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 145 k 2024-09-21T08:49:41.013 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:41.013 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:41.013 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:41.013 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:49:41.013 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:41.014 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 145 k 2024-09-21T08:49:41.014 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 436 k 2024-09-21T08:49:41.014 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:41.223 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-immutable-object-cache-19.1.1-367.g9e2ac70 694 kB/s | 145 kB 00:00 2024-09-21T08:49:41.223 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:41.224 INFO:teuthology.orchestra.run.smithi196.stdout:Total 689 kB/s | 145 kB 00:00 2024-09-21T08:49:41.224 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:41.231 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:41.231 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:41.294 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:41.294 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:41.452 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:41.541 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:41.566 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:41.566 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:41.566 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T08:49:41.566 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:42.116 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 37/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 3/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 4/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 5/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.n 6/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T08:49:42.117 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T08:49:42.118 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T08:49:42.119 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T08:49:42.500 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:42.501 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:42.501 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:42.501 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:42.501 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:42.501 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:42.742 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr 2024-09-21T08:49:43.163 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T08:49:43.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:43.163 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:43.163 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:43.163 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T08:49:43.164 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T08:49:43.165 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T08:49:43.166 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T08:49:43.166 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T08:49:43.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:43.166 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:43.332 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:43.425 INFO:teuthology.orchestra.run.smithi196.stdout:Package ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:49:43.542 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:43.542 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:49:43.542 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:43.548 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T08:49:43.596 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-base 2024-09-21T08:49:44.125 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:44.205 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:44.257 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 3.6 M 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 32 k 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 16 k 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T08:49:44.259 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout:Install 12 Packages 2024-09-21T08:49:44.260 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:44.261 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 8.7 M 2024-09-21T08:49:44.261 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 105 M 2024-09-21T08:49:44.261 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:44.311 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-base-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:49:44.356 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:49:44.357 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:44.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install cephadm 2024-09-21T08:49:44.835 INFO:teuthology.orchestra.run.smithi196.stdout:(1/12): ceph-grafana-dashboards-19.1.1-367.g9e2 214 kB/s | 32 kB 00:00 2024-09-21T08:49:44.860 INFO:teuthology.orchestra.run.smithi196.stdout:(2/12): ceph-prometheus-alerts-19.1.1-367.g9e2a 95 kB/s | 16 kB 00:00 2024-09-21T08:49:45.029 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:45.069 INFO:teuthology.orchestra.run.smithi196.stdout:(3/12): ceph-mgr-dashboard-19.1.1-367.g9e2ac70b 9.3 MB/s | 3.6 MB 00:00 2024-09-21T08:49:45.166 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 765 k 2024-09-21T08:49:45.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 765 k 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 771 k 2024-09-21T08:49:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:45.360 INFO:teuthology.orchestra.run.smithi196.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.9 MB/s | 863 kB 00:00 2024-09-21T08:49:45.411 INFO:teuthology.orchestra.run.smithi196.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 489 kB/s | 269 kB 00:00 2024-09-21T08:49:45.444 INFO:teuthology.orchestra.run.smithi196.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T08:49:45.455 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm-19.1.1-367.g9e2ac70b.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-21T08:49:45.456 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:45.456 INFO:teuthology.orchestra.run.smithi029.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-21T08:49:45.456 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:49:45.463 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:49:45.463 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:49:45.469 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:49:45.469 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:49:45.478 INFO:teuthology.orchestra.run.smithi196.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-21T08:49:45.512 INFO:teuthology.orchestra.run.smithi196.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T08:49:45.537 INFO:teuthology.orchestra.run.smithi196.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T08:49:45.542 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:49:45.579 INFO:teuthology.orchestra.run.smithi196.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2024-09-21T08:49:45.604 INFO:teuthology.orchestra.run.smithi196.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.7 MB/s | 188 kB 00:00 2024-09-21T08:49:45.679 INFO:teuthology.orchestra.run.smithi196.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-21T08:49:45.684 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:45.684 INFO:teuthology.orchestra.run.smithi196.stdout:Total 6.1 MB/s | 8.7 MB 00:01 2024-09-21T08:49:45.733 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:45.751 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:45.751 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:45.962 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:45.963 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:46.035 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:46.134 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:46.493 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:46.578 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:46.580 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T08:49:46.624 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T08:49:46.670 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T08:49:46.701 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T08:49:46.794 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:46.840 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:46.926 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T08:49:47.039 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T08:49:47.080 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T08:49:47.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T08:49:47.117 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T08:49:47.149 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 10/12 2024-09-21T08:49:47.695 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:03 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:47.833 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 145 k 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:49:47.834 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:47.835 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 145 k 2024-09-21T08:49:47.835 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 436 k 2024-09-21T08:49:47.835 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:48.013 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-immutable-object-cache-19.1.1-367.g9e2ac70 815 kB/s | 145 kB 00:00 2024-09-21T08:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:Total 807 kB/s | 145 kB 00:00 2024-09-21T08:49:48.014 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:49:48.022 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:49:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:49:48.089 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:49:48.089 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:49:48.211 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 11/12 2024-09-21T08:49:48.241 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T08:49:48.254 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:49:48.357 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:48.384 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:48.384 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:49:48.384 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T08:49:48.384 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:49.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.e 1/1 2024-09-21T08:49:49.354 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:49.355 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:49.355 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:49:49.355 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:49.355 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:49.627 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T08:49:49.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 1/12 2024-09-21T08:49:49.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 2/12 2024-09-21T08:49:49.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 3/12 2024-09-21T08:49:49.627 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T08:49:49.628 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T08:49:49.633 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr 2024-09-21T08:49:49.957 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T08:49:49.957 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:49.957 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:49:49.957 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:49.958 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:49:50.209 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T08:49:50.239 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:50.332 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-mgr-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:49:50.379 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:50.380 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:49:50.380 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:50.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T08:49:50.792 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:05 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:49:50.924 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:49:50.925 INFO:teuthology.orchestra.run.smithi196.stdout:====================================================================================== 2024-09-21T08:49:50.925 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:49:50.925 INFO:teuthology.orchestra.run.smithi196.stdout:====================================================================================== 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 7.4 M 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T08:49:50.926 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout:====================================================================================== 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout:Install 12 Packages 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:49:50.927 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 38 M 2024-09-21T08:49:50.928 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 212 M 2024-09-21T08:49:50.928 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:49:51.092 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:07 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:51.231 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 3.6 M 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 32 k 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 16 k 2024-09-21T08:49:51.232 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout:Install 12 Packages 2024-09-21T08:49:51.233 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:51.234 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 8.7 M 2024-09-21T08:49:51.234 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 105 M 2024-09-21T08:49:51.234 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:51.263 INFO:teuthology.orchestra.run.smithi196.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-21T08:49:51.305 INFO:teuthology.orchestra.run.smithi196.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 5.2 MB/s | 801 kB 00:00 2024-09-21T08:49:51.346 INFO:teuthology.orchestra.run.smithi196.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-21T08:49:51.388 INFO:teuthology.orchestra.run.smithi196.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-21T08:49:51.439 INFO:teuthology.orchestra.run.smithi196.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-21T08:49:51.572 INFO:teuthology.orchestra.run.smithi196.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-09-21T08:49:51.664 INFO:teuthology.orchestra.run.smithi196.stdout:(7/12): ceph-mgr-diskprediction-local-19.1.1-36 15 MB/s | 7.4 MB 00:00 2024-09-21T08:49:51.698 INFO:teuthology.orchestra.run.smithi196.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-21T08:49:51.733 INFO:teuthology.orchestra.run.smithi029.stdout:(1/12): ceph-prometheus-alerts-19.1.1-367.g9e2a 100 kB/s | 16 kB 00:00 2024-09-21T08:49:51.758 INFO:teuthology.orchestra.run.smithi029.stdout:(2/12): ceph-grafana-dashboards-19.1.1-367.g9e2 167 kB/s | 32 kB 00:00 2024-09-21T08:49:51.781 INFO:teuthology.orchestra.run.smithi196.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-21T08:49:51.807 INFO:teuthology.orchestra.run.smithi196.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-21T08:49:51.884 INFO:teuthology.orchestra.run.smithi029.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-21T08:49:51.984 INFO:teuthology.orchestra.run.smithi029.stdout:(4/12): ceph-mgr-dashboard-19.1.1-367.g9e2ac70b 8.6 MB/s | 3.6 MB 00:00 2024-09-21T08:49:52.026 INFO:teuthology.orchestra.run.smithi029.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-21T08:49:52.049 INFO:teuthology.orchestra.run.smithi196.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2024-09-21T08:49:52.077 INFO:teuthology.orchestra.run.smithi029.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 461 kB/s | 19 kB 00:00 2024-09-21T08:49:52.111 INFO:teuthology.orchestra.run.smithi029.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.2 MB/s | 548 kB 00:00 2024-09-21T08:49:52.136 INFO:teuthology.orchestra.run.smithi029.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-21T08:49:52.157 INFO:teuthology.orchestra.run.smithi196.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-21T08:49:52.158 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:52.158 INFO:teuthology.orchestra.run.smithi196.stdout:Total 31 MB/s | 38 MB 00:01 2024-09-21T08:49:52.162 INFO:teuthology.orchestra.run.smithi029.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T08:49:52.196 INFO:teuthology.orchestra.run.smithi029.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-21T08:49:52.271 INFO:teuthology.orchestra.run.smithi029.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-21T08:49:52.313 INFO:teuthology.orchestra.run.smithi029.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.0 MB/s | 863 kB 00:00 2024-09-21T08:49:52.318 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:49:52.318 INFO:teuthology.orchestra.run.smithi029.stdout:Total 8.0 MB/s | 8.7 MB 00:01 2024-09-21T08:49:52.372 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:49:52.393 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:49:52.393 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:49:52.515 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:49:52.541 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:49:52.541 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:49:52.618 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:49:52.619 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:49:52.965 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:49:52.966 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:49:53.166 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:49:53.250 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T08:49:53.294 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T08:49:53.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T08:49:53.388 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T08:49:53.521 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T08:49:53.679 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T08:49:53.728 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:49:53.777 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T08:49:53.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T08:49:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T08:49:53.847 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T08:49:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T08:49:53.905 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 10/12 2024-09-21T08:49:53.955 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T08:49:54.006 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T08:49:54.192 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T08:49:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T08:49:54.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T08:49:54.985 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T08:49:55.028 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 11/12 2024-09-21T08:49:55.066 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T08:49:55.111 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T08:49:56.343 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 12/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9 1/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noar 2/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9. 3/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T08:49:57.059 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T08:49:57.060 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T08:49:57.377 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T08:49:57.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T08:49:57.388 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T08:49:57.389 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:57.390 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:49:57.405 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T08:49:57.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T08:49:58.344 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:14 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:49:58.482 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:49:58.483 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-21T08:49:58.483 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 7.4 M 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T08:49:58.484 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout:Install 12 Packages 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 38 M 2024-09-21T08:49:58.485 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 212 M 2024-09-21T08:49:58.486 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:49:58.893 INFO:teuthology.orchestra.run.smithi029.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T08:49:58.960 INFO:teuthology.orchestra.run.smithi029.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-21T08:49:58.996 INFO:teuthology.orchestra.run.smithi029.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 319 kB/s | 33 kB 00:00 2024-09-21T08:49:59.046 INFO:teuthology.orchestra.run.smithi029.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-09-21T08:49:59.113 INFO:teuthology.orchestra.run.smithi029.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-21T08:49:59.298 INFO:teuthology.orchestra.run.smithi029.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-36 14 MB/s | 7.4 MB 00:00 2024-09-21T08:49:59.381 INFO:teuthology.orchestra.run.smithi029.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.1 MB/s | 3.0 MB 00:00 2024-09-21T08:49:59.482 INFO:teuthology.orchestra.run.smithi029.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-21T08:49:59.549 INFO:teuthology.orchestra.run.smithi029.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-09-21T08:49:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-21T08:49:59.825 INFO:teuthology.orchestra.run.smithi029.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.9 MB/s | 4.9 MB 00:00 2024-09-21T08:50:00.072 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 1/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T08:50:00.073 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T08:50:00.325 INFO:teuthology.orchestra.run.smithi029.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T08:50:00.327 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:00.327 INFO:teuthology.orchestra.run.smithi029.stdout:Total 21 MB/s | 38 MB 00:01 2024-09-21T08:50:00.468 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T08:50:00.468 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:00.468 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:00.468 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:00.468 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:00.469 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:00.696 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:00.723 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:00.723 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:00.909 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-rook 2024-09-21T08:50:01.177 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:01.177 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:01.499 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:16 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:01.632 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 49 k 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T08:50:01.633 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:01.634 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:01.635 INFO:teuthology.orchestra.run.smithi196.stdout:Install 13 Packages 2024-09-21T08:50:01.635 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:01.635 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 2.2 M 2024-09-21T08:50:01.635 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 26 M 2024-09-21T08:50:01.635 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:01.969 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:02.056 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T08:50:02.082 INFO:teuthology.orchestra.run.smithi196.stdout:(1/13): ceph-mgr-rook-19.1.1-367.g9e2ac70b.el9. 296 kB/s | 49 kB 00:00 2024-09-21T08:50:02.104 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T08:50:02.216 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T08:50:02.263 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T08:50:02.440 INFO:teuthology.orchestra.run.smithi196.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 36 kB/s | 19 kB 00:00 2024-09-21T08:50:02.458 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T08:50:02.474 INFO:teuthology.orchestra.run.smithi196.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-21T08:50:02.487 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T08:50:02.579 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T08:50:02.832 INFO:teuthology.orchestra.run.smithi196.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 296 kB/s | 222 kB 00:00 2024-09-21T08:50:03.216 INFO:teuthology.orchestra.run.smithi196.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-21T08:50:03.241 INFO:teuthology.orchestra.run.smithi196.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 363 kB/s | 279 kB 00:00 2024-09-21T08:50:03.275 INFO:teuthology.orchestra.run.smithi196.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 555 kB/s | 32 kB 00:00 2024-09-21T08:50:03.285 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T08:50:03.292 INFO:teuthology.orchestra.run.smithi196.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 334 kB/s | 14 kB 00:00 2024-09-21T08:50:03.325 INFO:teuthology.orchestra.run.smithi196.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.5 MB/s | 220 kB 00:00 2024-09-21T08:50:03.342 INFO:teuthology.orchestra.run.smithi196.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T08:50:03.368 INFO:teuthology.orchestra.run.smithi196.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-21T08:50:03.401 INFO:teuthology.orchestra.run.smithi196.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 9.4 MB/s | 1.0 MB 00:00 2024-09-21T08:50:03.421 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T08:50:03.451 INFO:teuthology.orchestra.run.smithi196.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 87 kB/s | 54 kB 00:00 2024-09-21T08:50:03.455 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:03.455 INFO:teuthology.orchestra.run.smithi196.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-09-21T08:50:03.525 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:03.541 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:03.541 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:03.632 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:03.634 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:04.144 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:04.315 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T08:50:04.370 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T08:50:04.433 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T08:50:04.471 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T08:50:04.512 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T08:50:04.614 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T08:50:04.716 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T08:50:04.748 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T08:50:04.764 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T08:50:05.491 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T08:50:05.544 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T08:50:05.582 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T08:50:05.635 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T08:50:05.673 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T08:50:05.880 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T08:50:05.910 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 1/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T08:50:06.446 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T08:50:06.447 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T08:50:06.447 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T08:50:06.807 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T08:50:06.807 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:06.807 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:06.807 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:06.807 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:06.808 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:07.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T08:50:07.659 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:22 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:07.792 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 146 k 2024-09-21T08:50:07.793 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout:Install 6 Packages 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 7.0 M 2024-09-21T08:50:07.794 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 33 M 2024-09-21T08:50:07.795 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:08.062 INFO:teuthology.orchestra.run.smithi196.stdout:(1/6): ceph-mgr-cephadm-19.1.1-367.g9e2ac70b.el 680 kB/s | 146 kB 00:00 2024-09-21T08:50:08.112 INFO:teuthology.orchestra.run.smithi196.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T08:50:08.138 INFO:teuthology.orchestra.run.smithi196.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-21T08:50:08.163 INFO:teuthology.orchestra.run.smithi196.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-21T08:50:08.355 INFO:teuthology.orchestra.run.smithi196.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 489 kB/s | 248 kB 00:00 2024-09-21T08:50:09.497 INFO:teuthology.orchestra.run.smithi196.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-21T08:50:09.499 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:09.499 INFO:teuthology.orchestra.run.smithi196.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-09-21T08:50:09.570 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:09.580 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:09.580 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:09.681 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:09.681 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:09.984 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 12/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac7 1/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T08:50:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T08:50:10.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T08:50:10.153 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T08:50:10.207 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T08:50:10.588 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T08:50:10.588 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:10.588 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:10.588 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T08:50:10.589 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:10.590 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:10.736 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T08:50:10.827 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T08:50:10.890 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T08:50:10.919 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T08:50:11.025 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-rook 2024-09-21T08:50:11.638 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/6 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T08:50:11.663 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T08:50:11.776 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 49 k 2024-09-21T08:50:11.777 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T08:50:11.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:Install 13 Packages 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 2.2 M 2024-09-21T08:50:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 26 M 2024-09-21T08:50:11.780 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:11.936 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T08:50:11.936 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:11.936 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:11.936 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:11.936 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:11.937 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:12.007 INFO:teuthology.orchestra.run.smithi029.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 278 kB/s | 26 kB 00:00 2024-09-21T08:50:12.033 INFO:teuthology.orchestra.run.smithi029.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 163 kB/s | 19 kB 00:00 2024-09-21T08:50:12.100 INFO:teuthology.orchestra.run.smithi029.stdout:(3/13): ceph-mgr-rook-19.1.1-367.g9e2ac70b.el9. 266 kB/s | 49 kB 00:00 2024-09-21T08:50:12.127 INFO:teuthology.orchestra.run.smithi029.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.8 MB/s | 222 kB 00:00 2024-09-21T08:50:12.152 INFO:teuthology.orchestra.run.smithi029.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T08:50:12.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-fuse 2024-09-21T08:50:12.195 INFO:teuthology.orchestra.run.smithi029.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 773 kB/s | 32 kB 00:00 2024-09-21T08:50:12.220 INFO:teuthology.orchestra.run.smithi029.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 577 kB/s | 54 kB 00:00 2024-09-21T08:50:12.246 INFO:teuthology.orchestra.run.smithi029.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 277 kB/s | 14 kB 00:00 2024-09-21T08:50:12.288 INFO:teuthology.orchestra.run.smithi029.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-21T08:50:12.330 INFO:teuthology.orchestra.run.smithi029.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-21T08:50:12.356 INFO:teuthology.orchestra.run.smithi029.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 904 kB/s | 59 kB 00:00 2024-09-21T08:50:12.381 INFO:teuthology.orchestra.run.smithi029.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T08:50:12.423 INFO:teuthology.orchestra.run.smithi029.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2024-09-21T08:50:12.426 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:12.426 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T08:50:12.495 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:12.511 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:12.511 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:12.612 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:12.613 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:12.777 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:12.911 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 896 k 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout:Install 2 Packages 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 976 k 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 2.9 M 2024-09-21T08:50:12.915 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:13.118 INFO:teuthology.orchestra.run.smithi196.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 512 kB/s | 80 kB 00:00 2024-09-21T08:50:13.146 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:13.249 INFO:teuthology.orchestra.run.smithi196.stdout:(2/2): ceph-fuse-19.1.1-367.g9e2ac70b.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-09-21T08:50:13.250 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:13.250 INFO:teuthology.orchestra.run.smithi196.stdout:Total 2.8 MB/s | 976 kB 00:00 2024-09-21T08:50:13.262 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:13.283 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:13.283 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:13.331 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T08:50:13.364 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:13.365 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:13.397 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T08:50:13.469 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T08:50:13.505 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T08:50:13.548 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T08:50:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:13.665 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T08:50:13.695 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T08:50:13.765 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T08:50:13.776 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T08:50:13.838 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T08:50:14.455 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T08:50:14.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/2 2024-09-21T08:50:14.604 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T08:50:14.672 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T08:50:14.707 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:14.756 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T08:50:14.786 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T08:50:15.066 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-volume 2024-09-21T08:50:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:15.803 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 285 k 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:15.804 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 285 k 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 1.3 M 2024-09-21T08:50:15.805 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 13/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 1/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T08:50:15.833 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T08:50:15.834 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T08:50:15.834 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T08:50:15.834 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T08:50:16.046 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-volume-19.1.1-367.g9e2ac70b.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-21T08:50:16.047 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:16.047 INFO:teuthology.orchestra.run.smithi196.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-21T08:50:16.047 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:16.055 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:16.055 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:16.090 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:16.090 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:16.179 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T08:50:16.179 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:16.179 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:16.179 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:16.179 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:16.180 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:16.311 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:16.373 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:16.389 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:16.389 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:50:16.389 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T08:50:16.389 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:16.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T08:50:17.115 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:17.252 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:17.253 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:17.253 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:50:17.253 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 146 k 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout:Install 6 Packages 2024-09-21T08:50:17.254 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:17.255 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 7.0 M 2024-09-21T08:50:17.255 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 33 M 2024-09-21T08:50:17.255 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:17.396 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:17.709 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librados-devel 2024-09-21T08:50:17.917 INFO:teuthology.orchestra.run.smithi029.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-21T08:50:17.943 INFO:teuthology.orchestra.run.smithi029.stdout:(2/6): ceph-mgr-cephadm-19.1.1-367.g9e2ac70b.el 677 kB/s | 146 kB 00:00 2024-09-21T08:50:18.002 INFO:teuthology.orchestra.run.smithi029.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T08:50:18.027 INFO:teuthology.orchestra.run.smithi029.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 686 kB/s | 58 kB 00:00 2024-09-21T08:50:18.052 INFO:teuthology.orchestra.run.smithi029.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-21T08:50:18.203 INFO:teuthology.orchestra.run.smithi029.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-21T08:50:18.206 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:18.207 INFO:teuthology.orchestra.run.smithi029.stdout:Total 7.4 MB/s | 7.0 MB 00:00 2024-09-21T08:50:18.283 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:18.295 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:18.296 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:18.307 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:18.403 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:18.403 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:18.441 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 127 k 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:18.442 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:18.443 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:18.443 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:18.443 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 127 k 2024-09-21T08:50:18.443 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 456 k 2024-09-21T08:50:18.443 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:18.627 INFO:teuthology.orchestra.run.smithi196.stdout:librados-devel-19.1.1-367.g9e2ac70b.el9.x86_64. 689 kB/s | 127 kB 00:00 2024-09-21T08:50:18.627 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:18.627 INFO:teuthology.orchestra.run.smithi196.stdout:Total 684 kB/s | 127 kB 00:00 2024-09-21T08:50:18.628 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:18.633 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:18.633 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:18.696 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:18.697 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:18.719 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:18.850 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:18.902 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T08:50:18.950 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:18.958 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T08:50:19.350 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:19.524 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:19.611 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:19.625 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T08:50:19.706 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T08:50:19.741 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T08:50:19.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install libcephfs2 2024-09-21T08:50:20.438 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:20.529 INFO:teuthology.orchestra.run.smithi196.stdout:Package libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:20.574 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:20.575 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:20.575 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:20.647 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install libcephfs-devel 2024-09-21T08:50:20.810 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 6/6 2024-09-21T08:50:20.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 1/6 2024-09-21T08:50:20.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T08:50:20.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T08:50:20.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T08:50:20.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T08:50:21.093 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:21.094 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:21.229 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:21.361 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 32 k 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 32 k 2024-09-21T08:50:21.362 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 142 k 2024-09-21T08:50:21.363 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:21.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-fuse 2024-09-21T08:50:21.530 INFO:teuthology.orchestra.run.smithi196.stdout:libcephfs-devel-19.1.1-367.g9e2ac70b.el9.x86_64 189 kB/s | 32 kB 00:00 2024-09-21T08:50:21.531 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:21.531 INFO:teuthology.orchestra.run.smithi196.stdout:Total 188 kB/s | 32 kB 00:00 2024-09-21T08:50:21.531 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:21.534 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:21.535 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:21.550 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:21.550 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:21.640 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:21.752 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:22.010 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:22.091 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 896 k 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T08:50:22.149 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout:Install 2 Packages 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:22.150 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 976 k 2024-09-21T08:50:22.151 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 2.9 M 2024-09-21T08:50:22.151 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:22.326 INFO:teuthology.orchestra.run.smithi029.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 518 kB/s | 80 kB 00:00 2024-09-21T08:50:22.343 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:22.343 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:22.343 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:22.343 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:22.344 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:22.344 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:22.468 INFO:teuthology.orchestra.run.smithi029.stdout:(2/2): ceph-fuse-19.1.1-367.g9e2ac70b.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-09-21T08:50:22.468 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:22.469 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-21T08:50:22.480 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:22.503 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:22.503 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:22.534 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librados2 2024-09-21T08:50:22.589 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:22.589 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:22.778 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:22.927 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T08:50:23.007 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T08:50:23.114 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:23.203 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:23.247 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:23.248 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:23.248 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:23.324 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install librbd1 2024-09-21T08:50:23.793 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2/2 2024-09-21T08:50:23.793 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/2 2024-09-21T08:50:23.917 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:24.006 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:24.050 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:24.051 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:24.051 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:24.104 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T08:50:24.104 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:24.105 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:24.105 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T08:50:24.105 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:24.105 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:24.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rados 2024-09-21T08:50:24.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-volume 2024-09-21T08:50:24.708 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:24.798 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:24.841 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:24.842 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:24.842 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:24.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rgw 2024-09-21T08:50:25.118 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:25.257 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:25.258 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:25.258 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T08:50:25.258 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.1.1-367.g9e2ac70b.el9 ceph-noarch 285 k 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 285 k 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 1.3 M 2024-09-21T08:50:25.259 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:25.464 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-volume-19.1.1-367.g9e2ac70b.el9.noarch.rpm 1.4 MB/s | 285 kB 00:00 2024-09-21T08:50:25.465 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:25.465 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-21T08:50:25.465 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:25.475 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:25.475 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:25.506 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:25.506 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:25.511 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:25.601 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:25.644 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:25.645 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:25.645 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:25.715 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-cephfs 2024-09-21T08:50:25.740 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:25.812 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:25.829 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:25.829 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:50:25.829 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T08:50:25.829 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:26.299 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:26.388 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:26.431 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:26.432 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:26.432 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:26.505 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install python3-rbd 2024-09-21T08:50:26.951 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 1/1 2024-09-21T08:50:26.952 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:26.952 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:26.952 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.1.1-367.g9e2ac70b.el9.noarch 2024-09-21T08:50:26.952 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:26.952 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:27.085 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:27.175 INFO:teuthology.orchestra.run.smithi196.stdout:Package python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:27.218 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:27.219 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-09-21T08:50:27.219 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:27.287 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-fuse 2024-09-21T08:50:27.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados-devel 2024-09-21T08:50:27.881 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:27.978 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:28.023 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:28.023 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 85 k 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:28.024 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:28.025 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 85 k 2024-09-21T08:50:28.025 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 231 k 2024-09-21T08:50:28.025 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:28.115 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 127 k 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:28.116 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:28.117 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 127 k 2024-09-21T08:50:28.117 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 456 k 2024-09-21T08:50:28.117 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:28.218 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-fuse-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 444 kB/s | 85 kB 00:00 2024-09-21T08:50:28.218 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:28.218 INFO:teuthology.orchestra.run.smithi196.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-21T08:50:28.219 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:28.226 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:28.226 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:28.292 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:28.292 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:28.311 INFO:teuthology.orchestra.run.smithi029.stdout:librados-devel-19.1.1-367.g9e2ac70b.el9.x86_64. 654 kB/s | 127 kB 00:00 2024-09-21T08:50:28.312 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:28.312 INFO:teuthology.orchestra.run.smithi029.stdout:Total 649 kB/s | 127 kB 00:00 2024-09-21T08:50:28.312 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:28.317 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:28.318 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:28.385 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:28.385 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:28.438 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:28.546 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:28.548 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:28.664 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:28.943 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:29.133 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:29.227 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:29.227 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:29.228 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:29.228 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:29.228 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:29.228 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:29.399 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:29.399 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:29.400 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:29.400 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:29.400 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:29.400 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:29.502 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-mirror 2024-09-21T08:50:29.670 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs2 2024-09-21T08:50:30.106 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:30.240 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:30.241 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:30.241 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repo Size 2024-09-21T08:50:30.241 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:30.241 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.1 M 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 3.1 M 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 13 M 2024-09-21T08:50:30.242 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:30.284 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:30.377 INFO:teuthology.orchestra.run.smithi029.stdout:Package libcephfs2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:30.424 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:30.425 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:30.425 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:30.496 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs-devel 2024-09-21T08:50:30.588 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-mirror-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-21T08:50:30.589 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:30.589 INFO:teuthology.orchestra.run.smithi196.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-21T08:50:30.589 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:30.598 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:30.598 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:30.680 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:30.680 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:31.105 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:31.117 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:31.189 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:31.214 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:31.215 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:50:31.215 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T08:50:31.215 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T08:50:31.215 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T08:50:31.215 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:31.242 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:31.242 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 32 k 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:31.243 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:31.244 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 32 k 2024-09-21T08:50:31.244 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 142 k 2024-09-21T08:50:31.244 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:31.397 INFO:teuthology.orchestra.run.smithi029.stdout:libcephfs-devel-19.1.1-367.g9e2ac70b.el9.x86_64 208 kB/s | 32 kB 00:00 2024-09-21T08:50:31.398 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:31.398 INFO:teuthology.orchestra.run.smithi029.stdout:Total 205 kB/s | 32 kB 00:00 2024-09-21T08:50:31.398 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:31.401 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:31.401 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:31.423 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:31.423 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:31.513 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:31.631 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:32.063 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:32.308 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:32.308 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:32.308 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:32.308 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:32.308 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:32.309 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:32.369 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:32.369 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:32.369 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:32.369 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:32.369 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:32.370 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:32.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados2 2024-09-21T08:50:32.625 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install rbd-nbd 2024-09-21T08:50:33.184 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:33.219 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 08:48:45 AM UTC. 2024-09-21T08:50:33.276 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:33.322 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:33.323 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:33.323 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:33.356 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 170 k 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-09-21T08:50:33.357 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-09-21T08:50:33.358 INFO:teuthology.orchestra.run.smithi196.stdout:Install 1 Package 2024-09-21T08:50:33.358 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:33.358 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 170 k 2024-09-21T08:50:33.358 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 494 k 2024-09-21T08:50:33.358 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-09-21T08:50:33.402 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librbd1 2024-09-21T08:50:33.567 INFO:teuthology.orchestra.run.smithi196.stdout:rbd-nbd-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 816 kB/s | 170 kB 00:00 2024-09-21T08:50:33.567 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:33.568 INFO:teuthology.orchestra.run.smithi196.stdout:Total 810 kB/s | 170 kB 00:00 2024-09-21T08:50:33.568 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-09-21T08:50:33.575 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-09-21T08:50:33.576 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-09-21T08:50:33.639 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-09-21T08:50:33.640 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-09-21T08:50:33.795 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-09-21T08:50:33.906 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:34.011 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:34.104 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:34.150 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:34.151 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:34.151 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:34.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rados 2024-09-21T08:50:34.317 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:34.585 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-09-21T08:50:34.837 DEBUG:teuthology.parallel:result is None 2024-09-21T08:50:34.840 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:34.933 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rados-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:34.979 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:34.980 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:34.980 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:35.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rgw 2024-09-21T08:50:35.666 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:51 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:35.758 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rgw-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:35.805 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:35.806 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:35.806 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:35.884 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-cephfs 2024-09-21T08:50:36.497 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:36.589 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-cephfs-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:36.634 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:36.635 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:36.636 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:36.712 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rbd 2024-09-21T08:50:37.328 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:53 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:37.421 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 is already installed. 2024-09-21T08:50:37.466 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:37.467 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2024-09-21T08:50:37.467 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:37.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-fuse 2024-09-21T08:50:38.141 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:54 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:38.279 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:38.279 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 85 k 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 85 k 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 231 k 2024-09-21T08:50:38.280 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:38.472 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-fuse-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 445 kB/s | 85 kB 00:00 2024-09-21T08:50:38.472 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:38.473 INFO:teuthology.orchestra.run.smithi029.stdout:Total 442 kB/s | 85 kB 00:00 2024-09-21T08:50:38.473 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:38.480 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:38.481 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:38.547 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:38.548 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:38.696 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:38.799 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:39.217 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:39.483 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:39.484 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:39.484 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:39.484 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:39.484 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:39.484 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:39.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-mirror 2024-09-21T08:50:40.407 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:56 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:40.546 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 3.1 M 2024-09-21T08:50:40.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 3.1 M 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 13 M 2024-09-21T08:50:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:40.916 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-mirror-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 8.4 MB/s | 3.1 MB 00:00 2024-09-21T08:50:40.917 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:40.917 INFO:teuthology.orchestra.run.smithi029.stdout:Total 8.4 MB/s | 3.1 MB 00:00 2024-09-21T08:50:40.918 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:40.927 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:40.928 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:41.015 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:41.016 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:41.465 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:41.535 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:41.561 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:41.562 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T08:50:41.562 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T08:50:41.562 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T08:50:41.562 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T08:50:41.562 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:42.791 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:43.079 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-nbd 2024-09-21T08:50:43.691 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:59 ago on Sat 21 Sep 2024 08:48:44 AM UTC. 2024-09-21T08:50:43.830 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T08:50:43.831 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:43.831 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-21T08:50:43.831 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:43.831 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T08:50:43.831 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.1.1-367.g9e2ac70b.el9 ceph 170 k 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 170 k 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 494 k 2024-09-21T08:50:43.832 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T08:50:44.052 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-nbd-19.1.1-367.g9e2ac70b.el9.x86_64.rpm 773 kB/s | 170 kB 00:00 2024-09-21T08:50:44.053 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T08:50:44.053 INFO:teuthology.orchestra.run.smithi029.stdout:Total 768 kB/s | 170 kB 00:00 2024-09-21T08:50:44.053 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T08:50:44.062 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T08:50:44.062 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T08:50:44.130 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T08:50:44.131 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T08:50:44.291 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T08:50:44.404 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:44.874 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 1/1 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.1.1-367.g9e2ac70b.el9.x86_64 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:45.149 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T08:50:45.424 DEBUG:teuthology.parallel:result is None 2024-09-21T08:50:45.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:50:45.562 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T08:50:45.585 INFO:teuthology.orchestra.run.smithi029.stdout:19.1.1-367.g9e2ac70b.el9 2024-09-21T08:50:45.585 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367.g9e2ac70b.el9 2024-09-21T08:50:45.585 INFO:teuthology.task.install:The correct ceph version 19.1.1-367.g9e2ac70b is installed. 2024-09-21T08:50:45.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:50:45.725 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T08:50:45.751 INFO:teuthology.orchestra.run.smithi196.stdout:19.1.1-367.g9e2ac70b.el9 2024-09-21T08:50:45.751 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367.g9e2ac70b.el9 2024-09-21T08:50:45.751 INFO:teuthology.task.install:The correct ceph version 19.1.1-367.g9e2ac70b is installed. 2024-09-21T08:50:45.753 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T08:50:45.753 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:45.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T08:50:45.783 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:45.783 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T08:50:45.821 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T08:50:45.821 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:45.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T08:50:45.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T08:50:45.920 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:45.920 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T08:50:45.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T08:50:46.015 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T08:50:46.015 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:46.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T08:50:46.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T08:50:46.110 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:46.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T08:50:46.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T08:50:46.203 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T08:50:46.203 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:46.203 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T08:50:46.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T08:50:46.302 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:46.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T08:50:46.328 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T08:50:46.394 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T08:50:46.465 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T08:50:46.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-09-21T08:50:46.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-09-21T08:50:46.494 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T08:50:46.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T08:50:46.535 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T08:50:46.560 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T08:50:46.561 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T08:50:46.603 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T08:50:46.635 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T08:50:46.635 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T08:50:46.635 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7913200', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9490, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2NsRqX6fNFh4R/b/TO3Ya2mw/z7nOlLwD0oohMD38R6YcaO47Wx1uzqa7gj9r0ChoXCDlhjJcQpTvDeNGK8J4=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEsvE4D86fVLx6b6tfjt4E6iQSxFcsodLqzGa6gw8y3wBaP0DfbrXuXkfE+CpVykE5noqy+LND95Gz7LNuGxCTU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_21:40:05', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T08:50:46.635 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T08:50:46.669 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T08:50:46.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T08:50:46.725 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T08:50:46.750 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:46.750 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T08:50:46.806 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T08:50:46.807 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 08:50:41.812076892 +0000 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 08:48:07.035025146 +0000 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 08:48:07.035025146 +0000 2024-09-21T08:50:46.863 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 08:48:07.035025146 +0000 2024-09-21T08:50:46.864 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T08:50:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T08:50:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T08:50:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000104608 s, 4.9 MB/s 2024-09-21T08:50:46.928 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T08:50:46.986 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 08:50:41.812076892 +0000 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 08:48:07.352019768 +0000 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 08:48:07.352019768 +0000 2024-09-21T08:50:47.042 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 08:48:07.352019768 +0000 2024-09-21T08:50:47.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T08:50:47.106 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T08:50:47.106 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T08:50:47.106 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 8.1375e-05 s, 6.3 MB/s 2024-09-21T08:50:47.107 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T08:50:47.165 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-09-21T08:50:47.220 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 08:50:41.813076875 +0000 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 08:48:07.667014423 +0000 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 08:48:07.667014423 +0000 2024-09-21T08:50:47.221 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 08:48:07.667014423 +0000 2024-09-21T08:50:47.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T08:50:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T08:50:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T08:50:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.6874e-05 s, 5.3 MB/s 2024-09-21T08:50:47.286 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T08:50:47.342 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-09-21T08:50:47.398 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T08:50:47.398 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.398 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T08:50:47.398 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.399 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.399 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 08:50:41.813076875 +0000 2024-09-21T08:50:47.399 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 08:48:07.990008943 +0000 2024-09-21T08:50:47.399 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 08:48:07.990008943 +0000 2024-09-21T08:50:47.399 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 08:48:07.990008943 +0000 2024-09-21T08:50:47.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T08:50:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T08:50:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T08:50:47.461 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000101219 s, 5.1 MB/s 2024-09-21T08:50:47.463 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T08:50:47.519 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-21T08:50:47.519 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:47.520 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T08:50:47.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T08:50:47.538 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-21 08:50:31.464798654 +0000 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-21 08:47:55.687710656 +0000 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-21 08:47:55.687710656 +0000 2024-09-21T08:50:47.596 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-09-21 08:47:55.687710656 +0000 2024-09-21T08:50:47.597 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T08:50:47.662 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-21T08:50:47.662 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-21T08:50:47.662 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000222494 s, 2.3 MB/s 2024-09-21T08:50:47.663 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T08:50:47.722 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-09-21T08:50:47.778 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T08:50:47.778 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-21 08:50:31.464798654 +0000 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-21 08:47:56.018703437 +0000 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-21 08:47:56.018703437 +0000 2024-09-21T08:50:47.779 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-09-21 08:47:56.018703437 +0000 2024-09-21T08:50:47.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T08:50:47.842 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-21T08:50:47.843 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-21T08:50:47.843 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000197472 s, 2.6 MB/s 2024-09-21T08:50:47.844 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T08:50:47.901 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:47.957 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-21 08:50:31.465798632 +0000 2024-09-21T08:50:47.958 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-21 08:47:56.337696480 +0000 2024-09-21T08:50:47.958 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-21 08:47:56.337696480 +0000 2024-09-21T08:50:47.958 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-09-21 08:47:56.337696480 +0000 2024-09-21T08:50:47.958 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T08:50:48.021 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-21T08:50:48.022 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-21T08:50:48.022 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000217835 s, 2.4 MB/s 2024-09-21T08:50:48.023 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T08:50:48.080 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-09-21T08:50:48.136 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T08:50:48.136 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T08:50:48.136 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T08:50:48.136 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T08:50:48.136 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T08:50:48.137 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-21 08:50:31.465798632 +0000 2024-09-21T08:50:48.137 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-21 08:47:56.663689371 +0000 2024-09-21T08:50:48.137 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-21 08:47:56.663689371 +0000 2024-09-21T08:50:48.137 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-09-21 08:47:56.663689371 +0000 2024-09-21T08:50:48.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T08:50:48.199 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-21T08:50:48.199 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-21T08:50:48.200 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000191553 s, 2.7 MB/s 2024-09-21T08:50:48.201 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T08:50:48.257 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T08:50:48.257 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-21T08:50:48.258 INFO:tasks.ceph:Generating config... 2024-09-21T08:50:48.259 INFO:tasks.ceph:[client] debug ms = 1 2024-09-21T08:50:48.259 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-21T08:50:48.259 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-21T08:50:48.259 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-21T08:50:48.259 INFO:tasks.ceph:[client] setuser = ceph 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T08:50:48.259 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T08:50:48.260 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T08:50:48.260 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T08:50:48.260 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T08:50:48.260 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T08:50:48.260 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T08:50:48.260 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T08:50:48.260 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T08:50:48.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T08:50:48.333 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T08:50:48.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T08:50:48.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T08:50:48.408 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29')] 2024-09-21T08:50:48.408 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-21T08:50:48.409 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:48.409 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T08:50:48.464 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:48.544 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-09-21T08:50:48.545 INFO:teuthology.orchestra.run.smithi029.stdout:fsid cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-09-21T08:50:48.544718+0000 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-21T08:50:48.544718+0000 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T08:50:48.546 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-21T08:50:48.547 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T08:50:48.603 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a... 2024-09-21T08:50:48.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T08:50:48.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.688 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-09-21T08:50:48.689 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.690 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = 172.21.15.29 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.691 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-09-21T08:50:48.692 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.693 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug objclass = 20 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-09-21T08:50:48.694 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-09-21T08:50:48.695 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T08:50:48.696 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-09-21T08:50:48.697 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: rgw gc obj min wait = 15 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: debug rgw = 20 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: setgroup = ceph 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout: setuser = ceph 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-09-21T08:50:48.698 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.699 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-09-21T08:50:48.700 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = 172.21.15.29 2024-09-21T08:50:48.701 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-09-21T08:50:48.702 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-09-21T08:50:48.703 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug objclass = 20 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T08:50:48.704 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-09-21T08:50:48.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.706 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T08:50:48.707 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-21T08:50:48.708 INFO:teuthology.orchestra.run.smithi196.stdout: rgw gc obj min wait = 15 2024-09-21T08:50:48.708 INFO:teuthology.orchestra.run.smithi196.stdout: debug rgw = 20 2024-09-21T08:50:48.708 INFO:teuthology.orchestra.run.smithi196.stdout: setgroup = ceph 2024-09-21T08:50:48.708 INFO:teuthology.orchestra.run.smithi196.stdout: setuser = ceph 2024-09-21T08:50:48.708 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-09-21T08:50:48.709 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T08:50:48.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T08:50:48.805 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T08:50:48.805 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:48.805 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T08:50:48.820 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:48.820 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T08:50:48.880 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T08:50:48.881 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:48.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T08:50:48.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T08:50:48.956 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:50:48.956 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:49.012 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:50:49.012 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:49.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T08:50:49.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T08:50:49.048 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:50:49.048 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:49.104 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T08:50:49.104 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T08:50:49.105 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T08:50:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T08:50:49.211 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T08:50:49.211 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T08:50:49.211 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T08:50:49.253 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T08:50:49.265 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T08:50:49.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-21T08:50:49.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T08:50:49.292 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-21T08:50:49.292 INFO:tasks.ceph:role: osd.0 2024-09-21T08:50:49.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T08:50:49.292 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T08:50:49.358 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T08:50:49.359 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T08:50:49.359 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T08:50:49.390 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-21T08:50:49.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-21T08:50:49.392 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T08:50:49.463 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T08:50:49.534 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:50:49.627+0000 7f76d4e15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T08:50:49.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:50:49.627+0000 7f76d4e15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T08:50:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:50:49.627+0000 7f76d4e15640 -1 bdev(0x562d2dd8f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T08:50:49.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:50:49.627+0000 7f76d4e15640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T08:50:53.547 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T08:50:53.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T08:50:53.608 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T08:50:53.608 INFO:tasks.ceph:role: osd.1 2024-09-21T08:50:53.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:50:53.608 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T08:50:53.684 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T08:50:53.684 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T08:50:53.684 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T08:50:53.684 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T08:50:53.685 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T08:50:54.201 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-21T08:50:54.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-21T08:50:54.204 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-21T08:50:54.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T08:50:54.356 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T08:50:54.424 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T08:50:54.424 INFO:tasks.ceph:role: osd.2 2024-09-21T08:50:54.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:50:54.424 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T08:50:54.498 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T08:50:54.498 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T08:50:54.498 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T08:50:54.498 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T08:50:54.499 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T08:50:54.949 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-21T08:50:54.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-21T08:50:54.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-21T08:50:55.037 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T08:50:55.107 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T08:50:55.179 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-21T08:50:55.179 INFO:tasks.ceph:role: osd.3 2024-09-21T08:50:55.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:50:55.179 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T08:50:55.251 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T08:50:55.252 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T08:50:55.769 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-21T08:50:55.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-21T08:50:55.772 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-21T08:50:55.914 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T08:50:55.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:50:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:50:56.053+0000 7f8b2300b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T08:50:56.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:50:56.057+0000 7f8b2300b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T08:50:56.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:50:56.057+0000 7f8b2300b640 -1 bdev(0x561a0528d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T08:50:56.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:50:56.057+0000 7f8b2300b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T08:50:59.955 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T08:50:59.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:51:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:00.073+0000 7fb81e9bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T08:51:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:00.074+0000 7fb81e9bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T08:51:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:00.074+0000 7fb81e9bf640 -1 bdev(0x56214ea95800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T08:51:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:00.074+0000 7fb81e9bf640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T08:51:03.976 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T08:51:04.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:51:04.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:04.094+0000 7fab4be16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T08:51:04.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:04.094+0000 7fab4be16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T08:51:04.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:04.094+0000 7fab4be16640 -1 bdev(0x561b3f6f7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T08:51:04.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:04.094+0000 7fab4be16640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T08:51:08.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T08:51:08.039 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T08:51:08.040 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:51:08.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T08:51:08.072 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:08.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T08:51:08.108 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:08.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T08:51:08.177 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:08.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T08:51:08.245 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:08.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T08:51:08.312 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:08.312 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T08:51:08.368 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T08:51:08.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDpiO5m2Rd7JRAA2LVT6HzXfW7pI3fZ2KvK1g== 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDpiO5mR0JpDBAAMGlc/Be1XU7jV8cP6/i9Vw== 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDwiO5ml/U9AxAAkQYrjHwHbgnFwqkvGEp6hw== 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD0iO5mnTF0BBAA5Gg+XMjlyU84Q3orEQSgTg== 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD4iO5mOpGtBRAAfRgo2gO+a/moh8EYKkMb6g== 2024-09-21T08:51:08.398 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-09-21T08:51:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDpiO5mMtgRDxAAXnQQvFJI+yXHi5WKFKeTIQ== 2024-09-21T08:51:08.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T08:51:08.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T08:51:08.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T08:51:08.608 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T08:51:08.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T08:51:08.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T08:51:08.766 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T08:51:08.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T08:51:08.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T08:51:08.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T08:51:08.914 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T08:51:08.970 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T08:51:08.970 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T08:51:08.970 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T08:51:09.012 INFO:tasks.ceph.mon.a:Started 2024-09-21T08:51:09.013 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T08:51:09.013 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T08:51:09.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T08:51:09.015 INFO:tasks.ceph.mgr.x:Started 2024-09-21T08:51:09.016 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T08:51:09.016 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T08:51:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.115+0000 7f01b9b76640 1 Processor -- start 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.115+0000 7f01b9b76640 1 -- start start 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b9b76640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01b409bd50 0x7f01b409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b9b76640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b409d3b0 con 0x7f01b409c670 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b9b76640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f01b4098230 con 0x7f01b409bd50 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01b409bd50 0x7f01b409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b2ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f01b409c670 0x7f01b40990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36844/0 (socket says 172.21.15.29:36844) 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b2ffd640 1 -- 172.21.15.29:0/3528867153 learned_addr learned my addr 172.21.15.29:0/3528867153 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01b409bd50 0x7f01b409c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44854/0 (socket says 172.21.15.29:44854) 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b37fe640 1 -- 172.21.15.29:0/3528867153 >> v1:172.21.15.29:6789/0 conn(0x7f01b409c670 legacy=0x7f01b40990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b37fe640 1 -- 172.21.15.29:0/3528867153 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b40983e0 con 0x7f01b409bd50 2024-09-21T08:51:09.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.116+0000 7f01b27fc640 1 -- 172.21.15.29:0/3528867153 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096176015 0 0) 0x7f01a8001110 con 0x7f01b409c670 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.117+0000 7f01b37fe640 1 --2- 172.21.15.29:0/3528867153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b409c130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009720 tx=0x7f01a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef35c8212af8840b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.117+0000 7f01b27fc640 1 -- 172.21.15.29:0/3528867153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a4037070 con 0x7f01b409bd50 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.117+0000 7f01b27fc640 1 -- 172.21.15.29:0/3528867153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a402ad90 con 0x7f01b409bd50 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.117+0000 7f01b27fc640 1 -- 172.21.15.29:0/3528867153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a4032590 con 0x7f01b409bd50 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 -- 172.21.15.29:0/3528867153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 msgr2=0x7f01b409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 --2- 172.21.15.29:0/3528867153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b409c130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009720 tx=0x7f01a402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 -- 172.21.15.29:0/3528867153 shutdown_connections 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 --2- 172.21.15.29:0/3528867153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b409c130 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 -- 172.21.15.29:0/3528867153 >> 172.21.15.29:0/3528867153 conn(0x7f01b406d4a0 msgr2=0x7f01b406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 -- 172.21.15.29:0/3528867153 shutdown_connections 2024-09-21T08:51:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.118+0000 7f01b9b76640 1 -- 172.21.15.29:0/3528867153 wait complete. 2024-09-21T08:51:09.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.119+0000 7f01b9b76640 1 Processor -- start 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.119+0000 7f01b9b76640 1 -- start start 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.119+0000 7f01b9b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.119+0000 7f01b9b76640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4099b90 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44858/0 (socket says 172.21.15.29:44858) 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b37fe640 1 -- 172.21.15.29:0/2273692876 learned_addr learned my addr 172.21.15.29:0/2273692876 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b37fe640 1 -- 172.21.15.29:0/2273692876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b41b2620 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b37fe640 1 --2- 172.21.15.29:0/2273692876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009720 tx=0x7f01a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a4041070 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a403c460 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b4097b20 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a4037040 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b41b1480 con 0x7f01b409bd50 2024-09-21T08:51:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01a4044070 con 0x7f01b409bd50 2024-09-21T08:51:09.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.120+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01a4046a50 con 0x7f01b409bd50 2024-09-21T08:51:09.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.121+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b4097cf0 con 0x7f01b409bd50 2024-09-21T08:51:09.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.123+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f01a403c740 con 0x7f01b409bd50 2024-09-21T08:51:09.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.187+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f01b409a130 con 0x7f01b409bd50 2024-09-21T08:51:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.188+0000 7f019bfff640 1 -- 172.21.15.29:0/2273692876 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f01a403c920 con 0x7f01b409bd50 2024-09-21T08:51:09.190 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 msgr2=0x7f01b41b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 --2- 172.21.15.29:0/2273692876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009720 tx=0x7f01a40046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 shutdown_connections 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 --2- 172.21.15.29:0/2273692876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01b409bd50 0x7f01b41b0d60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 >> 172.21.15.29:0/2273692876 conn(0x7f01b406d4a0 msgr2=0x7f01b41b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 shutdown_connections 2024-09-21T08:51:09.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:09.189+0000 7f01b9b76640 1 -- 172.21.15.29:0/2273692876 wait complete. 2024-09-21T08:51:09.201 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T08:51:09.201 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T08:51:09.202 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T08:51:09.202 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T08:51:09.202 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.200+0000 7f02fa410040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T08:51:09.228 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:09.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T08:51:09.243 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.241+0000 7f02fa410040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T08:51:09.254 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:09.254 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T08:51:09.319 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-21T08:51:09.319 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T08:51:09.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 714d784d-ac09-47ed-8d27-1cb6f40cc329 0 2024-09-21T08:51:09.388 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.386+0000 7f02fa410040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T08:51:09.442 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.439+0000 7f02fa410040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.484+0000 7f38de9af640 1 Processor -- start 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.484+0000 7f38de9af640 1 -- start start 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.484+0000 7f38de9af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38d8118b30 0x7f38d811af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.484+0000 7f38de9af640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d811b460 con 0x7f38d8114cf0 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.484+0000 7f38de9af640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f38d811c640 con 0x7f38d8118b30 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.485+0000 7f38d77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38d8118b30 0x7f38d811af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.485+0000 7f38d77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38d8118b30 0x7f38d811af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35242/0 (socket says 172.21.15.196:35242) 2024-09-21T08:51:09.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.485+0000 7f38d77fe640 1 -- 172.21.15.196:0/2641099110 learned_addr learned my addr 172.21.15.196:0/2641099110 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.485+0000 7f38d77fe640 1 -- 172.21.15.196:0/2641099110 >> v1:172.21.15.29:6789/0 conn(0x7f38d8114cf0 legacy=0x7f38d81150d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.485+0000 7f38d77fe640 1 -- 172.21.15.196:0/2641099110 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d811c7f0 con 0x7f38d8118b30 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38d77fe640 1 --2- 172.21.15.196:0/2641099110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8118b30 0x7f38d811af20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38c80097f0 tx=0x7f38c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef339da28ec59b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38d6ffd640 1 -- 172.21.15.196:0/2641099110 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c8037070 con 0x7f38d8118b30 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38d6ffd640 1 -- 172.21.15.196:0/2641099110 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c8032440 con 0x7f38d8118b30 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38d6ffd640 1 -- 172.21.15.196:0/2641099110 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c8032740 con 0x7f38d8118b30 2024-09-21T08:51:09.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 -- 172.21.15.196:0/2641099110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8118b30 msgr2=0x7f38d811af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 --2- 172.21.15.196:0/2641099110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8118b30 0x7f38d811af20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38c80097f0 tx=0x7f38c802a270 comp rx=0 tx=0).stop 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 -- 172.21.15.196:0/2641099110 shutdown_connections 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 --2- 172.21.15.196:0/2641099110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8118b30 0x7f38d811af20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 -- 172.21.15.196:0/2641099110 >> 172.21.15.196:0/2641099110 conn(0x7f38d8071290 msgr2=0x7f38d80736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.486+0000 7f38de9af640 1 -- 172.21.15.196:0/2641099110 shutdown_connections 2024-09-21T08:51:09.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.487+0000 7f38de9af640 1 -- 172.21.15.196:0/2641099110 wait complete. 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.487+0000 7f38de9af640 1 Processor -- start 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.487+0000 7f38de9af640 1 -- start start 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38de9af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38de9af640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f38d811bb50 con 0x7f38d8114cf0 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35244/0 (socket says 172.21.15.196:35244) 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d7fff640 1 -- 172.21.15.196:0/820534164 learned_addr learned my addr 172.21.15.196:0/820534164 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:09.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d7fff640 1 -- 172.21.15.196:0/820534164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d806db50 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d7fff640 1 --2- 172.21.15.196:0/820534164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c450 tx=0x7f38c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.488+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c0017070 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c0005220 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d806dde0 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c00035f0 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d806e330 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38c001a070 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.489+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f38c0003ad0 con 0x7f38d8114cf0 2024-09-21T08:51:09.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.490+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d811c110 con 0x7f38d8114cf0 2024-09-21T08:51:09.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.492+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f38c0006df0 con 0x7f38d8114cf0 2024-09-21T08:51:09.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.561+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "714d784d-ac09-47ed-8d27-1cb6f40cc329", "id": 0} v 0) -- 0x7f38d8118b30 con 0x7f38d8114cf0 2024-09-21T08:51:09.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.562+0000 7f38d4ff9640 1 -- 172.21.15.196:0/820534164 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "714d784d-ac09-47ed-8d27-1cb6f40cc329", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f38c0003dd0 con 0x7f38d8114cf0 2024-09-21T08:51:09.565 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 msgr2=0x7f38d806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 --2- 172.21.15.196:0/820534164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c450 tx=0x7f38c000c910 comp rx=0 tx=0).stop 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 shutdown_connections 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 --2- 172.21.15.196:0/820534164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38d8114cf0 0x7f38d806d610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 >> 172.21.15.196:0/820534164 conn(0x7f38d8071290 msgr2=0x7f38d810f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 shutdown_connections 2024-09-21T08:51:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.563+0000 7f38de9af640 1 -- 172.21.15.196:0/820534164 wait complete. 2024-09-21T08:51:09.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new bf1b1902-3d56-41a8-875d-450faadbaacd 1 2024-09-21T08:51:09.620 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.618+0000 7f02fa410040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc781303640 1 Processor -- start 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc781303640 1 -- start start 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc781303640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc77c117fb0 0x7fc77c118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc781303640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c112960 con 0x7fc77c111da0 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc781303640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc77c118a50 con 0x7fc77c117fb0 2024-09-21T08:51:09.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc77affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc77c117fb0 0x7fc77c118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc77a7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc77c111da0 0x7fc77c112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:35058/0 (socket says 172.21.15.196:35058) 2024-09-21T08:51:09.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.672+0000 7fc77a7fc640 1 -- 172.21.15.196:0/2305607701 learned_addr learned my addr 172.21.15.196:0/2305607701 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:09.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.673+0000 7fc77affd640 1 -- 172.21.15.196:0/2305607701 >> v1:172.21.15.29:6789/0 conn(0x7fc77c111da0 legacy=0x7fc77c112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.673+0000 7fc77affd640 1 -- 172.21.15.196:0/2305607701 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c112b30 con 0x7fc77c117fb0 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.673+0000 7fc77affd640 1 --2- 172.21.15.196:0/2305607701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c117fb0 0x7fc77c118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009720 tx=0x7fc76c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c7614e206fcd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc779ffb640 1 -- 172.21.15.196:0/2305607701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc76c037070 con 0x7fc77c117fb0 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc779ffb640 1 -- 172.21.15.196:0/2305607701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c02ad90 con 0x7fc77c117fb0 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc779ffb640 1 -- 172.21.15.196:0/2305607701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc76c032590 con 0x7fc77c117fb0 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 -- 172.21.15.196:0/2305607701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c117fb0 msgr2=0x7fc77c118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 --2- 172.21.15.196:0/2305607701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c117fb0 0x7fc77c118390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009720 tx=0x7fc76c02a110 comp rx=0 tx=0).stop 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 -- 172.21.15.196:0/2305607701 shutdown_connections 2024-09-21T08:51:09.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 --2- 172.21.15.196:0/2305607701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c117fb0 0x7fc77c118390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 -- 172.21.15.196:0/2305607701 >> 172.21.15.196:0/2305607701 conn(0x7fc77c06e5e0 msgr2=0x7fc77c06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 -- 172.21.15.196:0/2305607701 shutdown_connections 2024-09-21T08:51:09.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.674+0000 7fc781303640 1 -- 172.21.15.196:0/2305607701 wait complete. 2024-09-21T08:51:09.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.675+0000 7fc781303640 1 Processor -- start 2024-09-21T08:51:09.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.675+0000 7fc781303640 1 -- start start 2024-09-21T08:51:09.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.675+0000 7fc781303640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.675+0000 7fc781303640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c11e120 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.675+0000 7fc77affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc77affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35266/0 (socket says 172.21.15.196:35266) 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc77affd640 1 -- 172.21.15.196:0/1079408756 learned_addr learned my addr 172.21.15.196:0/1079408756 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc77affd640 1 -- 172.21.15.196:0/1079408756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c1a7180 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc77affd640 1 --2- 172.21.15.196:0/1079408756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009840 tx=0x7fc76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc76c041070 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c03c460 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c1a7470 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc76c037040 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c1ab460 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc76c044070 con 0x7fc77c111da0 2024-09-21T08:51:09.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.676+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc76c046ab0 con 0x7fc77c111da0 2024-09-21T08:51:09.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.677+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c118410 con 0x7fc77c111da0 2024-09-21T08:51:09.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.680+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc76c03c760 con 0x7fc77c111da0 2024-09-21T08:51:09.735 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:09.733+0000 7f02fa410040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T08:51:09.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.749+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf1b1902-3d56-41a8-875d-450faadbaacd", "id": 1} v 0) -- 0x7fc77c1a7640 con 0x7fc77c111da0 2024-09-21T08:51:09.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.751+0000 7fc7637fe640 1 -- 172.21.15.196:0/1079408756 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf1b1902-3d56-41a8-875d-450faadbaacd", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc76c03c940 con 0x7fc77c111da0 2024-09-21T08:51:09.753 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-09-21T08:51:09.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.751+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 msgr2=0x7fc77c1a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.751+0000 7fc781303640 1 --2- 172.21.15.196:0/1079408756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009840 tx=0x7fc76c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.752+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 shutdown_connections 2024-09-21T08:51:09.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.752+0000 7fc781303640 1 --2- 172.21.15.196:0/1079408756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc77c111da0 0x7fc77c1a6bb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.752+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 >> 172.21.15.196:0/1079408756 conn(0x7fc77c06e5e0 msgr2=0x7fc77c113c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.752+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 shutdown_connections 2024-09-21T08:51:09.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.752+0000 7fc781303640 1 -- 172.21.15.196:0/1079408756 wait complete. 2024-09-21T08:51:09.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d 2 2024-09-21T08:51:09.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.859+0000 7f4f6a731640 1 Processor -- start 2024-09-21T08:51:09.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.859+0000 7f4f6a731640 1 -- start start 2024-09-21T08:51:09.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f6a731640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f6411ac10 0x7f4f6411d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f6a731640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6411d5d0 con 0x7f4f64117fb0 2024-09-21T08:51:09.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f6a731640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6411e7b0 con 0x7f4f6411ac10 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f637fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f6411ac10 0x7f4f6411d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f63fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f64117fb0 0x7f4f64118390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:35072/0 (socket says 172.21.15.196:35072) 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f63fff640 1 -- 172.21.15.196:0/345328018 learned_addr learned my addr 172.21.15.196:0/345328018 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f637fe640 1 -- 172.21.15.196:0/345328018 >> v1:172.21.15.29:6789/0 conn(0x7f4f64117fb0 legacy=0x7f4f64118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.860+0000 7f4f637fe640 1 -- 172.21.15.196:0/345328018 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6411e960 con 0x7f4f6411ac10 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.861+0000 7f4f637fe640 1 --2- 172.21.15.196:0/345328018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f6411ac10 0x7f4f6411d000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009720 tx=0x7f4f4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847eb94ba57585c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.861+0000 7f4f62ffd640 1 -- 172.21.15.196:0/345328018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f4c037070 con 0x7f4f6411ac10 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.861+0000 7f4f62ffd640 1 -- 172.21.15.196:0/345328018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c02ad90 con 0x7f4f6411ac10 2024-09-21T08:51:09.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.861+0000 7f4f62ffd640 1 -- 172.21.15.196:0/345328018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f4c032590 con 0x7f4f6411ac10 2024-09-21T08:51:09.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 -- 172.21.15.196:0/345328018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f6411ac10 msgr2=0x7f4f6411d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 --2- 172.21.15.196:0/345328018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f6411ac10 0x7f4f6411d000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009720 tx=0x7f4f4c02a110 comp rx=0 tx=0).stop 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 -- 172.21.15.196:0/345328018 shutdown_connections 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 --2- 172.21.15.196:0/345328018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f6411ac10 0x7f4f6411d000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 -- 172.21.15.196:0/345328018 >> 172.21.15.196:0/345328018 conn(0x7f4f6406e5e0 msgr2=0x7f4f6406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 -- 172.21.15.196:0/345328018 shutdown_connections 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 -- 172.21.15.196:0/345328018 wait complete. 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.862+0000 7f4f6a731640 1 Processor -- start 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f6a731640 1 -- start start 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f6a731640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f6a731640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6411dcc0 con 0x7f4f64117fb0 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35284/0 (socket says 172.21.15.196:35284) 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f63fff640 1 -- 172.21.15.196:0/31406915 learned_addr learned my addr 172.21.15.196:0/31406915 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:09.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.863+0000 7f4f63fff640 1 -- 172.21.15.196:0/31406915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f641a71d0 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f63fff640 1 --2- 172.21.15.196:0/31406915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4a0 tx=0x7f4f5400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54017070 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54005c10 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f641a74c0 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54007070 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f641ab530 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f5401a070 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.864+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4f54012400 con 0x7f4f64117fb0 2024-09-21T08:51:09.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.865+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f641a76f0 con 0x7f4f64117fb0 2024-09-21T08:51:09.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.867+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4f5401c440 con 0x7f4f64117fb0 2024-09-21T08:51:09.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.937+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d", "id": 2} v 0) -- 0x7f4f6411e280 con 0x7f4f64117fb0 2024-09-21T08:51:09.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.938+0000 7f4f60ff9640 1 -- 172.21.15.196:0/31406915 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4f5401cb50 con 0x7f4f64117fb0 2024-09-21T08:51:09.941 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 msgr2=0x7f4f641a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 --2- 172.21.15.196:0/31406915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4a0 tx=0x7f4f5400c960 comp rx=0 tx=0).stop 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 shutdown_connections 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 --2- 172.21.15.196:0/31406915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64117fb0 0x7f4f641a6c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 >> 172.21.15.196:0/31406915 conn(0x7f4f6406e5e0 msgr2=0x7f4f64110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 shutdown_connections 2024-09-21T08:51:09.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:09.939+0000 7f4f6a731640 1 -- 172.21.15.196:0/31406915 wait complete. 2024-09-21T08:51:09.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca 3 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.045+0000 7faa567db640 1 Processor -- start 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.045+0000 7faa567db640 1 -- start start 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa567db640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa5011ac10 0x7faa5011d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa567db640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5011d5d0 con 0x7faa50117fb0 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa567db640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7faa5011e7b0 con 0x7faa5011ac10 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa5011ac10 0x7faa5011d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faa50117fb0 0x7faa50118390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:35086/0 (socket says 172.21.15.196:35086) 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4ffff640 1 -- 172.21.15.196:0/1746254983 learned_addr learned my addr 172.21.15.196:0/1746254983 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4effd640 1 -- 172.21.15.196:0/1746254983 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009891095 0 0) 0x7faa5011d5d0 con 0x7faa50117fb0 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4effd640 1 -- 172.21.15.196:0/1746254983 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa38003520 con 0x7faa50117fb0 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4f7fe640 1 -- 172.21.15.196:0/1746254983 >> v1:172.21.15.29:6789/0 conn(0x7faa50117fb0 legacy=0x7faa50118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.046+0000 7faa4f7fe640 1 -- 172.21.15.196:0/1746254983 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5011e960 con 0x7faa5011ac10 2024-09-21T08:51:10.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.047+0000 7faa4f7fe640 1 --2- 172.21.15.196:0/1746254983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa5011ac10 0x7faa5011d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa40009720 tx=0x7faa4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269a6c8e2e30b5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa4effd640 1 -- 172.21.15.196:0/1746254983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40037070 con 0x7faa5011ac10 2024-09-21T08:51:10.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa4effd640 1 -- 172.21.15.196:0/1746254983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4002ad90 con 0x7faa5011ac10 2024-09-21T08:51:10.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa4effd640 1 -- 172.21.15.196:0/1746254983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40032590 con 0x7faa5011ac10 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 -- 172.21.15.196:0/1746254983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa5011ac10 msgr2=0x7faa5011d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 --2- 172.21.15.196:0/1746254983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa5011ac10 0x7faa5011d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faa40009720 tx=0x7faa4002a110 comp rx=0 tx=0).stop 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 -- 172.21.15.196:0/1746254983 shutdown_connections 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 --2- 172.21.15.196:0/1746254983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa5011ac10 0x7faa5011d000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 -- 172.21.15.196:0/1746254983 >> 172.21.15.196:0/1746254983 conn(0x7faa5006e5e0 msgr2=0x7faa5006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 -- 172.21.15.196:0/1746254983 shutdown_connections 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.048+0000 7faa567db640 1 -- 172.21.15.196:0/1746254983 wait complete. 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa567db640 1 Processor -- start 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa567db640 1 -- start start 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa567db640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa567db640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faa5011dcc0 con 0x7faa50117fb0 2024-09-21T08:51:10.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa4ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35308/0 (socket says 172.21.15.196:35308) 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.049+0000 7faa4ffff640 1 -- 172.21.15.196:0/3715828417 learned_addr learned my addr 172.21.15.196:0/3715828417 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4ffff640 1 -- 172.21.15.196:0/3715828417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa501a6fa0 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4ffff640 1 --2- 172.21.15.196:0/3715828417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c480 tx=0x7faa4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44017070 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa44005c10 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa501a7290 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44007070 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa501ab340 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa4401a070 con 0x7faa50117fb0 2024-09-21T08:51:10.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.050+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7faa44012890 con 0x7faa50117fb0 2024-09-21T08:51:10.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.051+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5011e280 con 0x7faa50117fb0 2024-09-21T08:51:10.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.053+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faa44021070 con 0x7faa50117fb0 2024-09-21T08:51:10.097 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:10.095+0000 7f02fa410040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T08:51:10.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.123+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca", "id": 3} v 0) -- 0x7faa501a74c0 con 0x7faa50117fb0 2024-09-21T08:51:10.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.124+0000 7faa4cff9640 1 -- 172.21.15.196:0/3715828417 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7faa440125f0 con 0x7faa50117fb0 2024-09-21T08:51:10.126 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-09-21T08:51:10.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 msgr2=0x7faa501a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 --2- 172.21.15.196:0/3715828417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c480 tx=0x7faa4400c940 comp rx=0 tx=0).stop 2024-09-21T08:51:10.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 shutdown_connections 2024-09-21T08:51:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 --2- 172.21.15.196:0/3715828417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa50117fb0 0x7faa501a6a60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 >> 172.21.15.196:0/3715828417 conn(0x7faa5006e5e0 msgr2=0x7faa50110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 shutdown_connections 2024-09-21T08:51:10.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:10.125+0000 7faa567db640 1 -- 172.21.15.196:0/3715828417 wait complete. 2024-09-21T08:51:10.138 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T08:51:10.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T08:51:10.140 INFO:tasks.ceph.osd.0:Started 2024-09-21T08:51:10.140 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T08:51:10.141 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T08:51:10.142 INFO:tasks.ceph.osd.1:Started 2024-09-21T08:51:10.143 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T08:51:10.143 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T08:51:10.145 INFO:tasks.ceph.osd.2:Started 2024-09-21T08:51:10.145 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T08:51:10.145 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T08:51:10.147 INFO:tasks.ceph.osd.3:Started 2024-09-21T08:51:10.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:10.152 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:10.149+0000 7f02fa410040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T08:51:10.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26b8d0640 1 Processor -- start 2024-09-21T08:51:10.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26b8d0640 1 -- start start 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26b8d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff26412e940 0x7ff264130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26b8d0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26406eba0 con 0x7ff26406eda0 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26b8d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff26406d2f0 con 0x7ff26412e940 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff268e6b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff26412e940 0x7ff264130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26966c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff26406eda0 0x7ff26406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36858/0 (socket says 172.21.15.29:36858) 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.254+0000 7ff26966c640 1 -- 172.21.15.29:0/2233644613 learned_addr learned my addr 172.21.15.29:0/2233644613 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff268e6b640 1 -- 172.21.15.29:0/2233644613 >> v1:172.21.15.29:6789/0 conn(0x7ff26406eda0 legacy=0x7ff26406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff268e6b640 1 -- 172.21.15.29:0/2233644613 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264070d50 con 0x7ff26412e940 2024-09-21T08:51:10.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff268e6b640 1 --2- 172.21.15.29:0/2233644613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26412e940 0x7ff264130d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff258009d90 tx=0x7ff25802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0967e990e4cac25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff257fff640 1 -- 172.21.15.29:0/2233644613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff258007670 con 0x7ff26412e940 2024-09-21T08:51:10.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff257fff640 1 -- 172.21.15.29:0/2233644613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258007810 con 0x7ff26412e940 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.255+0000 7ff257fff640 1 -- 172.21.15.29:0/2233644613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff258007b10 con 0x7ff26412e940 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 -- 172.21.15.29:0/2233644613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26412e940 msgr2=0x7ff264130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 --2- 172.21.15.29:0/2233644613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26412e940 0x7ff264130d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff258009d90 tx=0x7ff25802a6f0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 -- 172.21.15.29:0/2233644613 shutdown_connections 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 --2- 172.21.15.29:0/2233644613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26412e940 0x7ff264130d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 -- 172.21.15.29:0/2233644613 >> 172.21.15.29:0/2233644613 conn(0x7ff26409a890 msgr2=0x7ff26409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 -- 172.21.15.29:0/2233644613 shutdown_connections 2024-09-21T08:51:10.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.256+0000 7ff26b8d0640 1 -- 172.21.15.29:0/2233644613 wait complete. 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26b8d0640 1 Processor -- start 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26b8d0640 1 -- start start 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26b8d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26b8d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff26406fcd0 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26966c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26966c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44884/0 (socket says 172.21.15.29:44884) 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.257+0000 7ff26966c640 1 -- 172.21.15.29:0/1973563419 learned_addr learned my addr 172.21.15.29:0/1973563419 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff26966c640 1 -- 172.21.15.29:0/1973563419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264128550 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff26966c640 1 --2- 172.21.15.29:0/1973563419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c4a0 tx=0x7ff26000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff260017070 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260005c10 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff260007070 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2641281a0 con 0x7ff26406eda0 2024-09-21T08:51:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff26001a070 con 0x7ff26406eda0 2024-09-21T08:51:10.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.258+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26412b730 con 0x7ff26406eda0 2024-09-21T08:51:10.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.259+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff260012c60 con 0x7ff26406eda0 2024-09-21T08:51:10.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.259+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264070fc0 con 0x7ff26406eda0 2024-09-21T08:51:10.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.261+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff260022020 con 0x7ff26406eda0 2024-09-21T08:51:10.310 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:10.308+0000 7f02fa410040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T08:51:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.321+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff26406f180 con 0x7ff26406eda0 2024-09-21T08:51:10.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.321+0000 7ff255ffb640 1 -- 172.21.15.29:0/1973563419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7ff2600124b0 con 0x7ff26406eda0 2024-09-21T08:51:10.323 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:10.323 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:10.125422+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:10.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 msgr2=0x7ff26406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 --2- 172.21.15.29:0/1973563419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c4a0 tx=0x7ff26000c960 comp rx=0 tx=0).stop 2024-09-21T08:51:10.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 shutdown_connections 2024-09-21T08:51:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 --2- 172.21.15.29:0/1973563419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff26406eda0 0x7ff26406d910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 >> 172.21.15.29:0/1973563419 conn(0x7ff26409a890 msgr2=0x7ff264097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 shutdown_connections 2024-09-21T08:51:10.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:10.322+0000 7ff26b8d0640 1 -- 172.21.15.29:0/1973563419 wait complete. 2024-09-21T08:51:10.334 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T08:51:10.334 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T08:51:10.737 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:10.831 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.828+0000 7fbba854b640 1 Processor -- start 2024-09-21T08:51:10.831 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.828+0000 7fbba854b640 1 -- start start 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba854b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbba012ef20 0x7fbba012f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba854b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba006be40 con 0x7fbba012f840 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba854b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbba0095cf0 con 0x7fbba012ef20 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba62e7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbba012ef20 0x7fbba012f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba5ae6640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbba012f840 0x7fbba0094360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36872/0 (socket says 172.21.15.29:36872) 2024-09-21T08:51:10.832 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba5ae6640 1 -- 172.21.15.29:0/359362188 learned_addr learned my addr 172.21.15.29:0/359362188 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:10.833 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba62e7640 1 -- 172.21.15.29:0/359362188 >> v1:172.21.15.29:6789/0 conn(0x7fbba012f840 legacy=0x7fbba0094360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.833 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.829+0000 7fbba62e7640 1 -- 172.21.15.29:0/359362188 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba0097000 con 0x7fbba012ef20 2024-09-21T08:51:10.833 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.830+0000 7fbba62e7640 1 --2- 172.21.15.29:0/359362188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba012f300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009720 tx=0x7fbb9c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c285875b0ee00953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.833 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.830+0000 7fbba52e5640 1 -- 172.21.15.29:0/359362188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c037070 con 0x7fbba012ef20 2024-09-21T08:51:10.833 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.830+0000 7fbba52e5640 1 -- 172.21.15.29:0/359362188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c02ad90 con 0x7fbba012ef20 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.830+0000 7fbba52e5640 1 -- 172.21.15.29:0/359362188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c032590 con 0x7fbba012ef20 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 -- 172.21.15.29:0/359362188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 msgr2=0x7fbba012f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 --2- 172.21.15.29:0/359362188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba012f300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009720 tx=0x7fbb9c02a110 comp rx=0 tx=0).stop 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 -- 172.21.15.29:0/359362188 shutdown_connections 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 --2- 172.21.15.29:0/359362188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba012f300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 -- 172.21.15.29:0/359362188 >> 172.21.15.29:0/359362188 conn(0x7fbba009ac90 msgr2=0x7fbba009b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 -- 172.21.15.29:0/359362188 shutdown_connections 2024-09-21T08:51:10.834 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.831+0000 7fbba854b640 1 -- 172.21.15.29:0/359362188 wait complete. 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba854b640 1 Processor -- start 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba854b640 1 -- start start 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba854b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba854b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbba0094bf0 con 0x7fbba012ef20 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba62e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba62e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44900/0 (socket says 172.21.15.29:44900) 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.832+0000 7fbba62e7640 1 -- 172.21.15.29:0/676071172 learned_addr learned my addr 172.21.15.29:0/676071172 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbba62e7640 1 -- 172.21.15.29:0/676071172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba0123120 con 0x7fbba012ef20 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbba62e7640 1 --2- 172.21.15.29:0/676071172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009720 tx=0x7fbb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:10.836 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c041070 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c03c460 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba00735a0 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c037040 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba0072250 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb9c044070 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.833+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fbb9c03d3f0 con 0x7fbba012ef20 2024-09-21T08:51:10.837 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.834+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba0122160 con 0x7fbba012ef20 2024-09-21T08:51:10.838 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.836+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbb9c046450 con 0x7fbba012ef20 2024-09-21T08:51:10.897 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.895+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbba0073c10 con 0x7fbba012ef20 2024-09-21T08:51:10.898 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbb96ffd640 1 -- 172.21.15.29:0/676071172 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fbb9c03c950 con 0x7fbba012ef20 2024-09-21T08:51:10.898 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-21T08:51:10.898 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":6,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:10.125422+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 msgr2=0x7fbba0071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 --2- 172.21.15.29:0/676071172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009720 tx=0x7fbb9c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 shutdown_connections 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 --2- 172.21.15.29:0/676071172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbba012ef20 0x7fbba0071d10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 >> 172.21.15.29:0/676071172 conn(0x7fbba009ac90 msgr2=0x7fbba0090090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 shutdown_connections 2024-09-21T08:51:10.899 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:10.896+0000 7fbba854b640 1 -- 172.21.15.29:0/676071172 wait complete. 2024-09-21T08:51:10.907 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-21T08:51:11.261 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.259+0000 7f02fa410040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T08:51:11.314 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.312+0000 7f02fa410040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T08:51:11.559 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-21T08:51:11.557+0000 7ff525bdd640 -1 Falling back to public interface 2024-09-21T08:51:11.682 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.680+0000 7f02fa410040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T08:51:11.766 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.763+0000 7f02fa410040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T08:51:11.874 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.871+0000 7f02fa410040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T08:51:11.919 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:11.917+0000 7f02fa410040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T08:51:12.031 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.029+0000 7f02fa410040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T08:51:12.084 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.081+0000 7f02fa410040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T08:51:12.100 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-09-21T08:51:12.097+0000 7f93b4a10640 -1 Falling back to public interface 2024-09-21T08:51:12.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-09-21T08:51:12.106+0000 7f662a01a640 -1 Falling back to public interface 2024-09-21T08:51:12.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-21T08:51:12.114+0000 7f6603d58640 -1 Falling back to public interface 2024-09-21T08:51:12.130 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.128+0000 7f02fa410040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T08:51:12.241 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.239+0000 7f02fa410040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T08:51:12.290 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.287+0000 7f02fa410040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T08:51:12.341 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.339+0000 7f02fa410040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T08:51:12.410 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.408+0000 7f02fa410040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T08:51:12.453 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.451+0000 7f02fa410040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T08:51:12.496 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:12.494+0000 7f02fa410040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T08:51:13.142 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:13.140+0000 7f02fa410040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T08:51:14.151 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-21T08:51:14.149+0000 7f029a08a640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T08:51:15.551 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-21T08:51:15.550+0000 7ff525bdd640 -1 osd.0 0 log_to_monitors true 2024-09-21T08:51:15.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-09-21T08:51:15.920+0000 7f662a01a640 -1 osd.1 0 log_to_monitors true 2024-09-21T08:51:16.114 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-09-21T08:51:16.112+0000 7f93b4a10640 -1 osd.3 0 log_to_monitors true 2024-09-21T08:51:16.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-21T08:51:16.418+0000 7f6603d58640 -1 osd.2 0 log_to_monitors true 2024-09-21T08:51:17.311 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.419+0000 7f8e4d38d640 1 Processor -- start 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.419+0000 7f8e4d38d640 1 -- start start 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.419+0000 7f8e4d38d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e48097770 0x7f8e48097b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.419+0000 7f8e4d38d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4809ac90 con 0x7f8e48099540 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.419+0000 7f8e4d38d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8e480a0da0 con 0x7f8e48097770 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.420+0000 7f8e46ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e48097770 0x7f8e48097b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.420+0000 7f8e467fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8e48099540 0x7f8e480999a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34650/0 (socket says 172.21.15.29:34650) 2024-09-21T08:51:17.421 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.420+0000 7f8e467fc640 1 -- 172.21.15.29:0/3469365745 learned_addr learned my addr 172.21.15.29:0/3469365745 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:17.422 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.420+0000 7f8e46ffd640 1 -- 172.21.15.29:0/3469365745 >> v1:172.21.15.29:6789/0 conn(0x7f8e48099540 legacy=0x7f8e480999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:17.422 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.420+0000 7f8e46ffd640 1 -- 172.21.15.29:0/3469365745 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4809e440 con 0x7f8e48097770 2024-09-21T08:51:17.422 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.421+0000 7f8e46ffd640 1 --2- 172.21.15.29:0/3469365745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e48097b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009720 tx=0x7f8e3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a478c37356f4b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:17.423 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.421+0000 7f8e45ffb640 1 -- 172.21.15.29:0/3469365745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e38037070 con 0x7f8e48097770 2024-09-21T08:51:17.423 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.421+0000 7f8e45ffb640 1 -- 172.21.15.29:0/3469365745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3802ad90 con 0x7f8e48097770 2024-09-21T08:51:17.423 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.421+0000 7f8e45ffb640 1 -- 172.21.15.29:0/3469365745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e38032590 con 0x7f8e48097770 2024-09-21T08:51:17.423 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 -- 172.21.15.29:0/3469365745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 msgr2=0x7f8e48097b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/3469365745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e48097b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009720 tx=0x7f8e3802a110 comp rx=0 tx=0).stop 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 -- 172.21.15.29:0/3469365745 shutdown_connections 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/3469365745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e48097b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 -- 172.21.15.29:0/3469365745 >> 172.21.15.29:0/3469365745 conn(0x7f8e480a15f0 msgr2=0x7f8e4809dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 -- 172.21.15.29:0/3469365745 shutdown_connections 2024-09-21T08:51:17.424 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.422+0000 7f8e4d38d640 1 -- 172.21.15.29:0/3469365745 wait complete. 2024-09-21T08:51:17.425 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e4d38d640 1 Processor -- start 2024-09-21T08:51:17.425 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e4d38d640 1 -- start start 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e4d38d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e4d38d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4809a620 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e46ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e46ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39342/0 (socket says 172.21.15.29:39342) 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.423+0000 7f8e46ffd640 1 -- 172.21.15.29:0/1064878355 learned_addr learned my addr 172.21.15.29:0/1064878355 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e46ffd640 1 -- 172.21.15.29:0/1064878355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e48073790 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e46ffd640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009840 tx=0x7f8e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e38041070 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3803c460 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e48072910 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e38037040 con 0x7f8e48097770 2024-09-21T08:51:17.426 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.424+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e48090b50 con 0x7f8e48097770 2024-09-21T08:51:17.427 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.425+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f8e38044070 con 0x7f8e48097770 2024-09-21T08:51:17.427 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.425+0000 7f8e2f7fe640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 0x7f8e3403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:17.428 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.425+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f8e3806b2b0 con 0x7f8e48097770 2024-09-21T08:51:17.428 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.426+0000 7f8e467fc640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 0x7f8e3403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:17.428 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.426+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e48097b50 con 0x7f8e48097770 2024-09-21T08:51:17.428 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.426+0000 7f8e467fc640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 0x7f8e3403a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c007fd0 tx=0x7f8e3c007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:17.432 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.431+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8e3803c760 con 0x7f8e48097770 2024-09-21T08:51:17.636 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.634+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e48090de0 con 0x7f8e48097770 2024-09-21T08:51:17.636 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.635+0000 7f8e2f7fe640 1 -- 172.21.15.29:0/1064878355 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f8e3804e350 con 0x7f8e48097770 2024-09-21T08:51:17.636 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-21T08:51:17.636 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":8,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:17.152574+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:17.638 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 msgr2=0x7f8e3403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 0x7f8e3403a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c007fd0 tx=0x7f8e3c007ac0 comp rx=0 tx=0).stop 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 msgr2=0x7f8e4808f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009840 tx=0x7f8e380046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 shutdown_connections 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e34038210 0x7f8e3403a6d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 --2- 172.21.15.29:0/1064878355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e48097770 0x7f8e4808f3a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 >> 172.21.15.29:0/1064878355 conn(0x7f8e480a15f0 msgr2=0x7f8e4809c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 shutdown_connections 2024-09-21T08:51:17.639 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:17.637+0000 7f8e4d38d640 1 -- 172.21.15.29:0/1064878355 wait complete. 2024-09-21T08:51:17.648 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-21T08:51:17.924 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-21T08:51:17.923+0000 7ff521349640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T08:51:17.937 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-21T08:51:17.936+0000 7ff51997b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:51:18.469 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-09-21T08:51:18.467+0000 7f93afa74640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T08:51:18.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-09-21T08:51:18.489+0000 7f6625786640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T08:51:18.492 INFO:tasks.ceph.osd.3.smithi196.stderr:2024-09-21T08:51:18.490+0000 7f93a80a6640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:51:18.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2024-09-21T08:51:18.525+0000 7f661ddb8640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:51:19.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-21T08:51:19.021+0000 7f66004fb640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T08:51:19.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-21T08:51:19.036+0000 7f65f7af6640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T08:51:24.052 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:24.147 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.145+0000 7fdd028f1640 1 Processor -- start 2024-09-21T08:51:24.147 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.145+0000 7fdd028f1640 1 -- start start 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdd028f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcfc094540 0x7fdcfc130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdd028f1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc127ec0 con 0x7fdcfc128310 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdd028f1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fdcfc06e430 con 0x7fdcfc094540 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcfc094540 0x7fdcfc130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcfc094540 0x7fdcfc130650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39348/0 (socket says 172.21.15.29:39348) 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfbfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdcfc128310 0x7fdcfc1286f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34658/0 (socket says 172.21.15.29:34658) 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfb7fe640 1 -- 172.21.15.29:0/704807829 learned_addr learned my addr 172.21.15.29:0/704807829 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfb7fe640 1 -- 172.21.15.29:0/704807829 >> v1:172.21.15.29:6789/0 conn(0x7fdcfc128310 legacy=0x7fdcfc1286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.148 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.146+0000 7fdcfb7fe640 1 -- 172.21.15.29:0/704807829 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc094970 con 0x7fdcfc094540 2024-09-21T08:51:24.149 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdcfb7fe640 1 --2- 172.21.15.29:0/704807829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00097f0 tx=0x7fdcf002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f27da00c6501be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.149 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdcfaffd640 1 -- 172.21.15.29:0/704807829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf0037070 con 0x7fdcfc094540 2024-09-21T08:51:24.149 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdcfaffd640 1 -- 172.21.15.29:0/704807829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf0032440 con 0x7fdcfc094540 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdcfaffd640 1 -- 172.21.15.29:0/704807829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf002ae60 con 0x7fdcfc094540 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdd028f1640 1 -- 172.21.15.29:0/704807829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 msgr2=0x7fdcfc130650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.147+0000 7fdd028f1640 1 --2- 172.21.15.29:0/704807829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00097f0 tx=0x7fdcf002a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 -- 172.21.15.29:0/704807829 shutdown_connections 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 --2- 172.21.15.29:0/704807829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc130650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 -- 172.21.15.29:0/704807829 >> 172.21.15.29:0/704807829 conn(0x7fdcfc09ac90 msgr2=0x7fdcfc09b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 -- 172.21.15.29:0/704807829 shutdown_connections 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 -- 172.21.15.29:0/704807829 wait complete. 2024-09-21T08:51:24.150 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.148+0000 7fdd028f1640 1 Processor -- start 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdd028f1640 1 -- start start 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdd028f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdd028f1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc130d10 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39356/0 (socket says 172.21.15.29:39356) 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdcfbfff640 1 -- 172.21.15.29:0/870736642 learned_addr learned my addr 172.21.15.29:0/870736642 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdcfbfff640 1 -- 172.21.15.29:0/870736642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc072e30 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.149+0000 7fdcfbfff640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c380 tx=0x7fdcec00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.150+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec007410 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.150+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec0075b0 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.150+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc124850 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.150+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec0047e0 con 0x7fdcfc094540 2024-09-21T08:51:24.152 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.150+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1244d0 con 0x7fdcfc094540 2024-09-21T08:51:24.153 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.151+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7fdcec01a020 con 0x7fdcfc094540 2024-09-21T08:51:24.153 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.151+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc0981e0 con 0x7fdcfc094540 2024-09-21T08:51:24.153 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.151+0000 7fdcf8ff9640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 0x7fdce803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.153 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.151+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fdcec04a750 con 0x7fdcfc094540 2024-09-21T08:51:24.154 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.151+0000 7fdcfb7fe640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 0x7fdce803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.154 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.152+0000 7fdcfb7fe640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 0x7fdce803a6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0034000 tx=0x7fdcf002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.157 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.156+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdcfc0981e0 con 0x7fdcfc094540 2024-09-21T08:51:24.332 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.330+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdcfc123450 con 0x7fdcfc094540 2024-09-21T08:51:24.332 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.331+0000 7fdcf8ff9640 1 -- 172.21.15.29:0/870736642 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8002 (secure 0 0 0) 0x7fdcec01bc30 con 0x7fdcfc094540 2024-09-21T08:51:24.332 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-21T08:51:24.332 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":14,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:23.498711+0000","last_up_change":"2024-09-21T08:51:19.491480+0000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T08:51:21.193119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6801","nonce":3430791726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6803","nonce":3430791726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6807","nonce":3430791726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6805","nonce":3430791726}]},"public_addr":"172.21.15.29:6801/3430791726","cluster_addr":"172.21.15.29:6803/3430791726","heartbeat_back_addr":"172.21.15.29:6807/3430791726","heartbeat_front_addr":"172.21.15.29:6805/3430791726","state":["exists","up"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6809","nonce":2855083704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6811","nonce":2855083704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6815","nonce":2855083704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6813","nonce":2855083704}]},"public_addr":"172.21.15.196:6809/2855083704","cluster_addr":"172.21.15.196:6811/2855083704","heartbeat_back_addr":"172.21.15.196:6815/2855083704","heartbeat_front_addr":"172.21.15.196:6813/2855083704","state":["exists","up"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6817","nonce":3551232799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6819","nonce":3551232799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6823","nonce":3551232799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6821","nonce":3551232799}]},"public_addr":"172.21.15.196:6817/3551232799","cluster_addr":"172.21.15.196:6819/3551232799","heartbeat_back_addr":"172.21.15.196:6823/3551232799","heartbeat_front_addr":"172.21.15.196:6821/3551232799","state":["exists","up"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6801","nonce":127179937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6803","nonce":127179937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6807","nonce":127179937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6805","nonce":127179937}]},"public_addr":"172.21.15.196:6801/127179937","cluster_addr":"172.21.15.196:6803/127179937","heartbeat_back_addr":"172.21.15.196:6807/127179937","heartbeat_front_addr":"172.21.15.196:6805/127179937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.562002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.886611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.464880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.134208+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:24.334 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 msgr2=0x7fdce803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.334 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 0x7fdce803a6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0034000 tx=0x7fdcf002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 msgr2=0x7fdcfc1c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c380 tx=0x7fdcec00c840 comp rx=0 tx=0).stop 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 shutdown_connections 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdce8038210 0x7fdce803a6d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 --2- 172.21.15.29:0/870736642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcfc094540 0x7fdcfc1c1310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 >> 172.21.15.29:0/870736642 conn(0x7fdcfc09ac90 msgr2=0x7fdcfc12b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 shutdown_connections 2024-09-21T08:51:24.335 INFO:teuthology.misc.health.smithi029.stderr:2024-09-21T08:51:24.333+0000 7fdd028f1640 1 -- 172.21.15.29:0/870736642 wait complete. 2024-09-21T08:51:24.344 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-21T08:51:24.344 INFO:tasks.ceph:Creating RBD pool 2024-09-21T08:51:24.344 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T08:51:24.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3fedd640 1 Processor -- start 2024-09-21T08:51:24.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3fedd640 1 -- start start 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3fedd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad3806e080 0x7fad3806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3fedd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3806c740 con 0x7fad3806e9a0 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3fedd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fad3806fca0 con 0x7fad3806e080 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3dc79640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad3806e080 0x7fad3806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3d478640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fad3806e9a0 0x7fad38132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34662/0 (socket says 172.21.15.29:34662) 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.444+0000 7fad3d478640 1 -- 172.21.15.29:0/2622447350 learned_addr learned my addr 172.21.15.29:0/2622447350 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:24.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.445+0000 7fad3dc79640 1 -- 172.21.15.29:0/2622447350 >> v1:172.21.15.29:6789/0 conn(0x7fad3806e9a0 legacy=0x7fad38132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.445+0000 7fad3dc79640 1 -- 172.21.15.29:0/2622447350 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3806bd80 con 0x7fad3806e080 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.445+0000 7fad3dc79640 1 --2- 172.21.15.29:0/2622447350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad3806e460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad34009720 tx=0x7fad3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a655580ac0bb8a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.445+0000 7fad3cc77640 1 -- 172.21.15.29:0/2622447350 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34037070 con 0x7fad3806e080 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.445+0000 7fad3cc77640 1 -- 172.21.15.29:0/2622447350 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3402ad90 con 0x7fad3806e080 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3cc77640 1 -- 172.21.15.29:0/2622447350 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34032590 con 0x7fad3806e080 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 -- 172.21.15.29:0/2622447350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 msgr2=0x7fad3806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 --2- 172.21.15.29:0/2622447350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad3806e460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad34009720 tx=0x7fad3402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 -- 172.21.15.29:0/2622447350 shutdown_connections 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 --2- 172.21.15.29:0/2622447350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad3806e460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:24.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 -- 172.21.15.29:0/2622447350 >> 172.21.15.29:0/2622447350 conn(0x7fad3809dd40 msgr2=0x7fad3809e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:24.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 -- 172.21.15.29:0/2622447350 shutdown_connections 2024-09-21T08:51:24.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.446+0000 7fad3fedd640 1 -- 172.21.15.29:0/2622447350 wait complete. 2024-09-21T08:51:24.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3fedd640 1 Processor -- start 2024-09-21T08:51:24.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3fedd640 1 -- start start 2024-09-21T08:51:24.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3fedd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3fedd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad3806f130 con 0x7fad3806e080 2024-09-21T08:51:24.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3dc79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3dc79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39368/0 (socket says 172.21.15.29:39368) 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.447+0000 7fad3dc79640 1 -- 172.21.15.29:0/3225909651 learned_addr learned my addr 172.21.15.29:0/3225909651 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad3dc79640 1 -- 172.21.15.29:0/3225909651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad38094e30 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad3dc79640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad34009840 tx=0x7fad340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34041020 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3403d550 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad38096240 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34037040 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.448+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad380939d0 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.449+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7fad34044020 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.449+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3806e460 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.449+0000 7fad2e7fc640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 0x7fad1c03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.449+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fad3406b670 con 0x7fad3806e080 2024-09-21T08:51:24.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.449+0000 7fad3d478640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 0x7fad1c03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:24.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.450+0000 7fad3d478640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 0x7fad1c03a6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad28007fd0 tx=0x7fad28007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:24.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.454+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fad3404b030 con 0x7fad3806e080 2024-09-21T08:51:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:24.632+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fad380973e0 con 0x7fad3806e080 2024-09-21T08:51:25.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.504+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7fad3403d870 con 0x7fad3806e080 2024-09-21T08:51:25.506 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.507+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 msgr2=0x7fad1c03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.507+0000 7fad3fedd640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 0x7fad1c03a6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad28007fd0 tx=0x7fad28007ac0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.507+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 msgr2=0x7fad38093490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad2e7fc640 1 -- 172.21.15.29:0/3225909651 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fad3403b3f0 con 0x7fad3806e080 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad34009840 tx=0x7fad340046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 shutdown_connections 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c038210 0x7fad1c03a6d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3806e080 0x7fad38093490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 >> 172.21.15.29:0/3225909651 conn(0x7fad3809dd40 msgr2=0x7fad38071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad2e7fc640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c0386c0 0x7fad1c03d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 shutdown_connections 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 --2- 172.21.15.29:0/3225909651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fad1c0386c0 0x7fad1c03d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.508+0000 7fad3fedd640 1 -- 172.21.15.29:0/3225909651 wait complete. 2024-09-21T08:51:25.523 DEBUG:teuthology.orchestra.run.smithi029:> rbd --cluster ceph pool init rbd 2024-09-21T08:51:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.585+0000 7fdb12210d80 1 Processor -- start 2024-09-21T08:51:25.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.585+0000 7fdb12210d80 1 -- start start 2024-09-21T08:51:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb12210d80 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5626d061cc10 0x5626d06b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb12210d80 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5626d048e050 con 0x5626d061c120 2024-09-21T08:51:25.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb12210d80 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5626d049c930 con 0x5626d061cc10 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0f723640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5626d061cc10 0x5626d06b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0f723640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5626d061cc10 0x5626d06b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43602/0 (socket says 172.21.15.29:43602) 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0ff24640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5626d061c120 0x5626d061c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53086/0 (socket says 172.21.15.29:53086) 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0f723640 1 -- 172.21.15.29:0/4135078908 learned_addr learned my addr 172.21.15.29:0/4135078908 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0f723640 1 -- 172.21.15.29:0/4135078908 >> v1:172.21.15.29:6789/0 conn(0x5626d061c120 legacy=0x5626d061c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0f723640 1 -- 172.21.15.29:0/4135078908 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d0477ce0 con 0x5626d061cc10 2024-09-21T08:51:25.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.586+0000 7fdb0ef22640 1 -- 172.21.15.29:0/4135078908 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904072224 0 0) 0x5626d048e050 con 0x5626d061c120 2024-09-21T08:51:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.588+0000 7fdb0f723640 1 --2- 172.21.15.29:0/4135078908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061cc10 0x5626d06b75b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400a520 tx=0x7fdb04045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b62deb5c28d496b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:25.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.588+0000 7fdb0ef22640 1 -- 172.21.15.29:0/4135078908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb04055070 con 0x5626d061cc10 2024-09-21T08:51:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.588+0000 7fdb0ef22640 1 -- 172.21.15.29:0/4135078908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb040515b0 con 0x5626d061cc10 2024-09-21T08:51:25.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.588+0000 7fdb0ef22640 1 -- 172.21.15.29:0/4135078908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb040518d0 con 0x5626d061cc10 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 -- 172.21.15.29:0/4135078908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061cc10 msgr2=0x5626d06b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 --2- 172.21.15.29:0/4135078908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061cc10 0x5626d06b75b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400a520 tx=0x7fdb04045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 -- 172.21.15.29:0/4135078908 shutdown_connections 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 --2- 172.21.15.29:0/4135078908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061cc10 0x5626d06b75b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 -- 172.21.15.29:0/4135078908 >> 172.21.15.29:0/4135078908 conn(0x5626d0625060 msgr2=0x5626d06214a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 -- 172.21.15.29:0/4135078908 shutdown_connections 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.589+0000 7fdb12210d80 1 -- 172.21.15.29:0/4135078908 wait complete. 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb12210d80 1 Processor -- start 2024-09-21T08:51:25.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb12210d80 1 -- start start 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb12210d80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb12210d80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5626d049e540 con 0x5626d061c120 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb0ff24640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb0ff24640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43608/0 (socket says 172.21.15.29:43608) 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.590+0000 7fdb0ff24640 1 -- 172.21.15.29:0/2726375701 learned_addr learned my addr 172.21.15.29:0/2726375701 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:25.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdb0ff24640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d06a4070 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdb0ff24640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001e50 tx=0x7fdb00009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb00008070 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0000f430 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d06af5c0 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb0000f770 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.591+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d06a0ff0 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.592+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb0000f910 con 0x5626d061c120 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.592+0000 7fdafffff640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 0x7fdaf4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:25.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.592+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7fdb00049f80 con 0x5626d061c120 2024-09-21T08:51:25.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.592+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5626d06a1550 con 0x5626d061c120 2024-09-21T08:51:25.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.592+0000 7fdb0f723640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 0x7fdaf4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:25.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:25.593+0000 7fdb0f723640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 0x7fdaf4039050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb04057000 tx=0x7fdb04052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:26.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.505+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7fdb00018370 con 0x5626d061c120 2024-09-21T08:51:26.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.505+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb040515b0 con 0x5626d061c120 2024-09-21T08:51:26.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.507+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fdb00017d90 con 0x5626d061c120 2024-09-21T08:51:26.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.507+0000 7fdb0e721640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fdaec002ae0 con 0x5626d061c120 2024-09-21T08:51:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.510+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 8 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7fdb00019d90 con 0x5626d061c120 2024-09-21T08:51:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.510+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 0x5626d06c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.510+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x5626d06c5130 con 0x5626d061cc10 2024-09-21T08:51:26.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.510+0000 7fdb11186640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 0x5626d06c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:26.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.512+0000 7fdb11186640 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 0x5626d06c4bf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:26.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.515+0000 7fdb11186640 1 -- 172.21.15.29:0/2726375701 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fdb08002040 con 0x5626d061cc10 2024-09-21T08:51:26.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.517+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x5626d07165d0 con 0x5626d061cc10 2024-09-21T08:51:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.518+0000 7fdb11186640 1 -- 172.21.15.29:0/2726375701 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb08002040 con 0x5626d061cc10 2024-09-21T08:51:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x5626d07156e0 con 0x5626d061cc10 2024-09-21T08:51:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.518+0000 7fdb11186640 1 -- 172.21.15.29:0/2726375701 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdb08002040 con 0x5626d061cc10 2024-09-21T08:51:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:26.518+0000 7fdb0df20640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fdaf0001f00 con 0x5626d061c120 2024-09-21T08:51:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.512+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7fdb00045030 con 0x5626d061c120 2024-09-21T08:51:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.512+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fdaf403c740 con 0x5626d061c120 2024-09-21T08:51:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.512+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 10 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7fdb0001a470 con 0x5626d061c120 2024-09-21T08:51:27.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.512+0000 7fdb0e721640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fdaec005680 con 0x5626d061cc10 2024-09-21T08:51:27.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.516+0000 7fdb11186640 1 -- 172.21.15.29:0/2726375701 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb08002040 con 0x5626d061cc10 2024-09-21T08:51:27.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:27.516+0000 7fdb0df20640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7fdaf0003350 con 0x5626d061c120 2024-09-21T08:51:28.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.514+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7fdb00017320 con 0x5626d061c120 2024-09-21T08:51:28.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.514+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7fdaf403c9c0 con 0x5626d061c120 2024-09-21T08:51:28.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.514+0000 7fdafffff640 1 -- 172.21.15.29:0/2726375701 <== mon.0 v2:172.21.15.29:3300/0 12 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7fdb000176a0 con 0x5626d061c120 2024-09-21T08:51:28.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.514+0000 7fdb0e721640 1 -- 172.21.15.29:0/2726375701 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7fdaec005a20 con 0x5626d061cc10 2024-09-21T08:51:28.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.517+0000 7fdb11186640 1 -- 172.21.15.29:0/2726375701 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb08002040 con 0x5626d061cc10 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 msgr2=0x5626d06c4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 0x5626d06c4bf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 msgr2=0x7fdaf4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 0x7fdaf4039050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb04057000 tx=0x7fdb04052000 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 msgr2=0x5626d06a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001e50 tx=0x7fdb00009560 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 shutdown_connections 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5626d061cc10 0x5626d06c4bf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdaf4036b90 0x7fdaf4039050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 --2- 172.21.15.29:0/2726375701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5626d061c120 0x5626d06a0ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 >> 172.21.15.29:0/2726375701 conn(0x5626d0625060 msgr2=0x5626d06afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 shutdown_connections 2024-09-21T08:51:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.518+0000 7fdb12210d80 1 -- 172.21.15.29:0/2726375701 wait complete. 2024-09-21T08:51:28.524 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T08:51:28.525 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T08:51:28.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T08:51:28.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T08:51:28.525 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T08:51:28.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe46a523640 1 Processor -- start 2024-09-21T08:51:28.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe46a523640 1 -- start start 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe46a523640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe46409bd50 0x7fe46409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe46a523640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46409d3b0 con 0x7fe46409c670 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe46a523640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe464098230 con 0x7fe46409bd50 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe463fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe46409bd50 0x7fe46409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe45bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe46409c670 0x7fe4640990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53098/0 (socket says 172.21.15.29:53098) 2024-09-21T08:51:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.636+0000 7fe45bfff640 1 -- 172.21.15.29:0/245047263 learned_addr learned my addr 172.21.15.29:0/245047263 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:28.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe463fff640 1 -- 172.21.15.29:0/245047263 >> v1:172.21.15.29:6789/0 conn(0x7fe46409c670 legacy=0x7fe4640990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe463fff640 1 -- 172.21.15.29:0/245047263 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4640983e0 con 0x7fe46409bd50 2024-09-21T08:51:28.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe463fff640 1 --2- 172.21.15.29:0/245047263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe46409c130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe454009720 tx=0x7fe45402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0bca8c8210e0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe4637fe640 1 -- 172.21.15.29:0/245047263 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454037070 con 0x7fe46409bd50 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe4637fe640 1 -- 172.21.15.29:0/245047263 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45402ad90 con 0x7fe46409bd50 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.637+0000 7fe4637fe640 1 -- 172.21.15.29:0/245047263 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454032590 con 0x7fe46409bd50 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 -- 172.21.15.29:0/245047263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 msgr2=0x7fe46409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 --2- 172.21.15.29:0/245047263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe46409c130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe454009720 tx=0x7fe45402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 -- 172.21.15.29:0/245047263 shutdown_connections 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 --2- 172.21.15.29:0/245047263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe46409c130 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 -- 172.21.15.29:0/245047263 >> 172.21.15.29:0/245047263 conn(0x7fe46406d4a0 msgr2=0x7fe46406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 -- 172.21.15.29:0/245047263 shutdown_connections 2024-09-21T08:51:28.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.638+0000 7fe46a523640 1 -- 172.21.15.29:0/245047263 wait complete. 2024-09-21T08:51:28.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe46a523640 1 Processor -- start 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe46a523640 1 -- start start 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe46a523640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe46a523640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe464099b90 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe463fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe463fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43626/0 (socket says 172.21.15.29:43626) 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.639+0000 7fe463fff640 1 -- 172.21.15.29:0/4048397405 learned_addr learned my addr 172.21.15.29:0/4048397405 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe463fff640 1 -- 172.21.15.29:0/4048397405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe464094eb0 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe463fff640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe454009840 tx=0x7fe4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454041070 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45403c460 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe464095590 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454037040 con 0x7fe46409bd50 2024-09-21T08:51:28.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.640+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4640961c0 con 0x7fe46409bd50 2024-09-21T08:51:28.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.641+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe454044070 con 0x7fe46409bd50 2024-09-21T08:51:28.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.641+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46409a130 con 0x7fe46409bd50 2024-09-21T08:51:28.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.641+0000 7fe4617fa640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 0x7fe44403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.641+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe45406bae0 con 0x7fe46409bd50 2024-09-21T08:51:28.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.642+0000 7fe45bfff640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 0x7fe44403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.642+0000 7fe45bfff640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 0x7fe44403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe44c007fd0 tx=0x7fe44c007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.646+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4640961c0 con 0x7fe46409bd50 2024-09-21T08:51:28.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.867+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe46409d020 con 0x7fe46409bd50 2024-09-21T08:51:28.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.869+0000 7fe4617fa640 1 -- 172.21.15.29:0/4048397405 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87487 (secure 0 0 0) 0x7fe454044360 con 0x7fe46409bd50 2024-09-21T08:51:28.871 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:28.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 msgr2=0x7fe44403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 0x7fe44403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe44c007fd0 tx=0x7fe44c007ac0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 msgr2=0x7fe464093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe454009840 tx=0x7fe4540046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 shutdown_connections 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4440382a0 0x7fe44403a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 --2- 172.21.15.29:0/4048397405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe46409bd50 0x7fe464093570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 >> 172.21.15.29:0/4048397405 conn(0x7fe46406d4a0 msgr2=0x7fe46409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 shutdown_connections 2024-09-21T08:51:28.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.871+0000 7fe46a523640 1 -- 172.21.15.29:0/4048397405 wait complete. 2024-09-21T08:51:28.882 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":482734080},{"type":"v1","addr":"172.21.15.196:6825","nonce":482734080}]},"active_addr":"172.21.15.196:6825/482734080","active_change":"2024-09-21T08:51:13.143404+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3246197353}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2000855407}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3153212518}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1767187004}]}]} 2024-09-21T08:51:28.885 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T08:51:28.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T08:51:28.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.985+0000 7ff605d4b640 1 Processor -- start 2024-09-21T08:51:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.985+0000 7ff605d4b640 1 -- start start 2024-09-21T08:51:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.985+0000 7ff605d4b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff60006eb70 0x7ff600133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.985+0000 7ff605d4b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60006c740 con 0x7ff60006e080 2024-09-21T08:51:28.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.985+0000 7ff605d4b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff60006fca0 con 0x7ff60006eb70 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5feffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff60006eb70 0x7ff600133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5ff7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff60006e080 0x7ff60006e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53100/0 (socket says 172.21.15.29:53100) 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5feffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff60006eb70 0x7ff600133d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43636/0 (socket says 172.21.15.29:43636) 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5ff7fe640 1 -- 172.21.15.29:0/4063648288 learned_addr learned my addr 172.21.15.29:0/4063648288 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5feffd640 1 -- 172.21.15.29:0/4063648288 >> v1:172.21.15.29:6789/0 conn(0x7ff60006e080 legacy=0x7ff60006e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.986+0000 7ff5feffd640 1 -- 172.21.15.29:0/4063648288 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60006bd80 con 0x7ff60006eb70 2024-09-21T08:51:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff5feffd640 1 --2- 172.21.15.29:0/4063648288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006eb70 0x7ff600133d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009720 tx=0x7ff5f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52db1d16136b428 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff5fe7fc640 1 -- 172.21.15.29:0/4063648288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f4037070 con 0x7ff60006eb70 2024-09-21T08:51:28.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff5fe7fc640 1 -- 172.21.15.29:0/4063648288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f402ad90 con 0x7ff60006eb70 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff5fe7fc640 1 -- 172.21.15.29:0/4063648288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f4032590 con 0x7ff60006eb70 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 -- 172.21.15.29:0/4063648288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006eb70 msgr2=0x7ff600133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 --2- 172.21.15.29:0/4063648288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006eb70 0x7ff600133d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009720 tx=0x7ff5f402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 -- 172.21.15.29:0/4063648288 shutdown_connections 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 --2- 172.21.15.29:0/4063648288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006eb70 0x7ff600133d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 -- 172.21.15.29:0/4063648288 >> 172.21.15.29:0/4063648288 conn(0x7ff60009dd40 msgr2=0x7ff60009e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 -- 172.21.15.29:0/4063648288 shutdown_connections 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.987+0000 7ff605d4b640 1 -- 172.21.15.29:0/4063648288 wait complete. 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.988+0000 7ff605d4b640 1 Processor -- start 2024-09-21T08:51:28.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.988+0000 7ff605d4b640 1 -- start start 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff605d4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff605d4b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff60006f130 con 0x7ff60006e080 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43642/0 (socket says 172.21.15.29:43642) 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5ff7fe640 1 -- 172.21.15.29:0/875965554 learned_addr learned my addr 172.21.15.29:0/875965554 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:28.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5ff7fe640 1 -- 172.21.15.29:0/875965554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6001242d0 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5ff7fe640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c4a0 tx=0x7ff5f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0017070 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0005c10 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff600123220 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0007070 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.989+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff600123e20 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.990+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5f001a070 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.991+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff60006e460 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.991+0000 7ff5e7fff640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 0x7ff5ec03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.991+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff5f004a4d0 con 0x7ff60006e080 2024-09-21T08:51:28.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.991+0000 7ff5feffd640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 0x7ff5ec03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:28.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.991+0000 7ff5feffd640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 0x7ff5ec03a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4034000 tx=0x7ff5f402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:28.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:28.996+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff5f001b3b0 con 0x7ff60006e080 2024-09-21T08:51:29.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.172+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff600096da0 con 0x7ff60006e080 2024-09-21T08:51:29.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.173+0000 7ff5e7fff640 1 -- 172.21.15.29:0/875965554 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9902 (secure 0 0 0) 0x7ff5f0010300 con 0x7ff60006e080 2024-09-21T08:51:29.174 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:29.174 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:28.511181+0000","last_up_change":"2024-09-21T08:51:19.491480+0000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T08:51:21.193119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T08:51:24.662885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6801","nonce":3430791726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6803","nonce":3430791726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6807","nonce":3430791726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6805","nonce":3430791726}]},"public_addr":"172.21.15.29:6801/3430791726","cluster_addr":"172.21.15.29:6803/3430791726","heartbeat_back_addr":"172.21.15.29:6807/3430791726","heartbeat_front_addr":"172.21.15.29:6805/3430791726","state":["exists","up"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6809","nonce":2855083704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6811","nonce":2855083704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6815","nonce":2855083704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6813","nonce":2855083704}]},"public_addr":"172.21.15.196:6809/2855083704","cluster_addr":"172.21.15.196:6811/2855083704","heartbeat_back_addr":"172.21.15.196:6815/2855083704","heartbeat_front_addr":"172.21.15.196:6813/2855083704","state":["exists","up"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6817","nonce":3551232799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6819","nonce":3551232799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6823","nonce":3551232799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6821","nonce":3551232799}]},"public_addr":"172.21.15.196:6817/3551232799","cluster_addr":"172.21.15.196:6819/3551232799","heartbeat_back_addr":"172.21.15.196:6823/3551232799","heartbeat_front_addr":"172.21.15.196:6821/3551232799","state":["exists","up"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6801","nonce":127179937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6803","nonce":127179937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6807","nonce":127179937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6805","nonce":127179937}]},"public_addr":"172.21.15.196:6801/127179937","cluster_addr":"172.21.15.196:6803/127179937","heartbeat_back_addr":"172.21.15.196:6807/127179937","heartbeat_front_addr":"172.21.15.196:6805/127179937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.562002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.886611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.464880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.134208+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 msgr2=0x7ff5ec03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 0x7ff5ec03a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4034000 tx=0x7ff5f402e000 comp rx=0 tx=0).stop 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 msgr2=0x7ff6000955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c4a0 tx=0x7ff5f000c960 comp rx=0 tx=0).stop 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 shutdown_connections 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5ec0382a0 0x7ff5ec03a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 --2- 172.21.15.29:0/875965554 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff60006e080 0x7ff6000955c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 >> 172.21.15.29:0/875965554 conn(0x7ff60009dd40 msgr2=0x7ff600071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 shutdown_connections 2024-09-21T08:51:29.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.175+0000 7ff605d4b640 1 -- 172.21.15.29:0/875965554 wait complete. 2024-09-21T08:51:29.187 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T08:51:29.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.287+0000 7f202a645640 1 Processor -- start 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.287+0000 7f202a645640 1 -- start start 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.287+0000 7f202a645640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f202412e940 0x7f2024130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.287+0000 7f202a645640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202406eba0 con 0x7f202406eda0 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.287+0000 7f202a645640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f202406d2f0 con 0x7f202412e940 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f20237fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f202412e940 0x7f2024130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f2023fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f202406eda0 0x7f202406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53106/0 (socket says 172.21.15.29:53106) 2024-09-21T08:51:29.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f2023fff640 1 -- 172.21.15.29:0/832191140 learned_addr learned my addr 172.21.15.29:0/832191140 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f20237fe640 1 -- 172.21.15.29:0/832191140 >> v1:172.21.15.29:6789/0 conn(0x7f202406eda0 legacy=0x7f202406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f20237fe640 1 -- 172.21.15.29:0/832191140 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2024070d50 con 0x7f202412e940 2024-09-21T08:51:29.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.288+0000 7f2022ffd640 1 -- 172.21.15.29:0/832191140 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732647729 0 0) 0x7f202406eba0 con 0x7f202406eda0 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f20237fe640 1 --2- 172.21.15.29:0/832191140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202412e940 0x7f2024130d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2018009720 tx=0x7f201802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a01f1e4c359e097 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f2022ffd640 1 -- 172.21.15.29:0/832191140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018037070 con 0x7f202412e940 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f2022ffd640 1 -- 172.21.15.29:0/832191140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201802ae20 con 0x7f202412e940 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f2022ffd640 1 -- 172.21.15.29:0/832191140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018032590 con 0x7f202412e940 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 -- 172.21.15.29:0/832191140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202412e940 msgr2=0x7f2024130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 --2- 172.21.15.29:0/832191140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202412e940 0x7f2024130d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2018009720 tx=0x7f201802a1a0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 -- 172.21.15.29:0/832191140 shutdown_connections 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 --2- 172.21.15.29:0/832191140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202412e940 0x7f2024130d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 -- 172.21.15.29:0/832191140 >> 172.21.15.29:0/832191140 conn(0x7f202409a890 msgr2=0x7f202409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 -- 172.21.15.29:0/832191140 shutdown_connections 2024-09-21T08:51:29.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.289+0000 7f202a645640 1 -- 172.21.15.29:0/832191140 wait complete. 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.290+0000 7f202a645640 1 Processor -- start 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.290+0000 7f202a645640 1 -- start start 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f202a645640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f202a645640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f202406fcd0 con 0x7f202406eda0 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2023fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2023fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43652/0 (socket says 172.21.15.29:43652) 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2023fff640 1 -- 172.21.15.29:0/431077372 learned_addr learned my addr 172.21.15.29:0/431077372 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2023fff640 1 -- 172.21.15.29:0/431077372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2024125d80 con 0x7f202406eda0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2023fff640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f201400c420 tx=0x7f201400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014018070 con 0x7f202406eda0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20140074d0 con 0x7f202406eda0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20241258c0 con 0x7f202406eda0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2014004950 con 0x7f202406eda0 2024-09-21T08:51:29.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.291+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202412bc00 con 0x7f202406eda0 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.292+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f201401b070 con 0x7f202406eda0 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.293+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202406f180 con 0x7f202406eda0 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.293+0000 7f2020ff9640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 0x7f201003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.293+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f201404a5f0 con 0x7f202406eda0 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.293+0000 7f20237fe640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 0x7f201003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.293+0000 7f20237fe640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 0x7f201003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2018034000 tx=0x7f201802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.297+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2024125d80 con 0x7f202406eda0 2024-09-21T08:51:29.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.475+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f202406bba0 con 0x7f202406eda0 2024-09-21T08:51:29.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.476+0000 7f2020ff9640 1 -- 172.21.15.29:0/431077372 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9902 (secure 0 0 0) 0x7f2014011980 con 0x7f202406eda0 2024-09-21T08:51:29.478 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:29.478 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:51:28.511181+0000","last_up_change":"2024-09-21T08:51:19.491480+0000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T08:51:21.193119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T08:51:24.662885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6801","nonce":3430791726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6803","nonce":3430791726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6807","nonce":3430791726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6805","nonce":3430791726}]},"public_addr":"172.21.15.29:6801/3430791726","cluster_addr":"172.21.15.29:6803/3430791726","heartbeat_back_addr":"172.21.15.29:6807/3430791726","heartbeat_front_addr":"172.21.15.29:6805/3430791726","state":["exists","up"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6809","nonce":2855083704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6811","nonce":2855083704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6815","nonce":2855083704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6813","nonce":2855083704}]},"public_addr":"172.21.15.196:6809/2855083704","cluster_addr":"172.21.15.196:6811/2855083704","heartbeat_back_addr":"172.21.15.196:6815/2855083704","heartbeat_front_addr":"172.21.15.196:6813/2855083704","state":["exists","up"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6817","nonce":3551232799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6819","nonce":3551232799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6823","nonce":3551232799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6821","nonce":3551232799}]},"public_addr":"172.21.15.196:6817/3551232799","cluster_addr":"172.21.15.196:6819/3551232799","heartbeat_back_addr":"172.21.15.196:6823/3551232799","heartbeat_front_addr":"172.21.15.196:6821/3551232799","state":["exists","up"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6801","nonce":127179937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6803","nonce":127179937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6807","nonce":127179937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6805","nonce":127179937}]},"public_addr":"172.21.15.196:6801/127179937","cluster_addr":"172.21.15.196:6803/127179937","heartbeat_back_addr":"172.21.15.196:6807/127179937","heartbeat_front_addr":"172.21.15.196:6805/127179937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.562002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.886611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.464880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.134208+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:51:29.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 msgr2=0x7f201003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 0x7f201003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2018034000 tx=0x7f201802e000 comp rx=0 tx=0).stop 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 msgr2=0x7f20241293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f201400c420 tx=0x7f201400c8e0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 shutdown_connections 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f20100382a0 0x7f201003a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 --2- 172.21.15.29:0/431077372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202406eda0 0x7f20241293b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 >> 172.21.15.29:0/431077372 conn(0x7f202409a890 msgr2=0x7f202412ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 shutdown_connections 2024-09-21T08:51:29.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.478+0000 7f202a645640 1 -- 172.21.15.29:0/431077372 wait complete. 2024-09-21T08:51:29.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T08:51:29.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T08:51:29.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T08:51:29.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T08:51:29.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7fb9f0877640 1 Processor -- start 2024-09-21T08:51:29.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7fb9f0877640 1 -- start start 2024-09-21T08:51:29.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7f4649ff1640 1 Processor -- start 2024-09-21T08:51:29.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7f4649ff1640 1 -- start start 2024-09-21T08:51:29.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7f2139991640 1 Processor -- start 2024-09-21T08:51:29.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7f2139991640 1 -- start start 2024-09-21T08:51:29.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.598+0000 7f188f757640 1 Processor -- start 2024-09-21T08:51:29.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f4649ff1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f464409bd50 0x7f464409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f188f757640 1 -- start start 2024-09-21T08:51:29.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f4649ff1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f464409d3b0 con 0x7f464409c670 2024-09-21T08:51:29.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f4649ff1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4644098230 con 0x7f464409bd50 2024-09-21T08:51:29.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2139991640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2134096840 0x7f2134096c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9f0877640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9ec06d460 0x7fb9ec131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9f0877640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0702f0 con 0x7fb9ec06d080 2024-09-21T08:51:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9f0877640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec06f1f0 con 0x7fb9ec06d460 2024-09-21T08:51:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f4642ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f464409c670 0x7f46440990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53112/0 (socket says 172.21.15.29:53112) 2024-09-21T08:51:29.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f4642ffd640 1 -- 172.21.15.29:0/3332133413 learned_addr learned my addr 172.21.15.29:0/3332133413 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2139991640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213409aaa0 con 0x7f2134097160 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2132ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2134096840 0x7f2134096c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2139991640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f213409e080 con 0x7f2134096840 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9ea59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb9ec06d080 0x7fb9ec096630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53124/0 (socket says 172.21.15.29:53124) 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9ea59c640 1 -- 172.21.15.29:0/182115776 learned_addr learned my addr 172.21.15.29:0/182115776 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2132ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2134096840 0x7f2134096c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43674/0 (socket says 172.21.15.29:43674) 2024-09-21T08:51:29.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f2132ffd640 1 -- 172.21.15.29:0/1300179814 learned_addr learned my addr 172.21.15.29:0/1300179814 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f46437fe640 1 --2- 172.21.15.29:0/3332133413 >> v2:172.21.15.29:3300/0 conn(0x7f464409bd50 0x7f464409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7fb9e9d9b640 1 --2- 172.21.15.29:0/182115776 >> v2:172.21.15.29:3300/0 conn(0x7fb9ec06d460 0x7fb9ec131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.599+0000 7f188f757640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f188806e040 0x7f188806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f46427fc640 1 -- 172.21.15.29:0/3332133413 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084612219 0 0) 0x7f4638001110 con 0x7f464409c670 2024-09-21T08:51:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f2131ffb640 1 -- 172.21.15.29:0/1300179814 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378402962 0 0) 0x7f213409aaa0 con 0x7f2134097160 2024-09-21T08:51:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f46427fc640 1 -- 172.21.15.29:0/3332133413 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f462c003520 con 0x7f464409c670 2024-09-21T08:51:29.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f2131ffb640 1 -- 172.21.15.29:0/1300179814 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f211c003520 con 0x7f2134097160 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188f757640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188806fa40 con 0x7f188806e960 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188f757640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f188806fe90 con 0x7f188806e040 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188ccf2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f188806e960 0x7f18880711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53150/0 (socket says 172.21.15.29:53150) 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188ccf2640 1 -- 172.21.15.29:0/2077469895 learned_addr learned my addr 172.21.15.29:0/2077469895 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7fb9e9d9b640 1 -- 172.21.15.29:0/182115776 >> v1:172.21.15.29:6789/0 conn(0x7fb9ec06d080 legacy=0x7fb9ec096630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f46437fe640 1 -- 172.21.15.29:0/3332133413 >> v1:172.21.15.29:6789/0 conn(0x7f464409c670 legacy=0x7f46440990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7fb9e9d9b640 1 -- 172.21.15.29:0/182115776 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec096d40 con 0x7fb9ec06d460 2024-09-21T08:51:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188d4f3640 1 --2- 172.21.15.29:0/2077469895 >> v2:172.21.15.29:3300/0 conn(0x7f188806e040 0x7f188806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f46437fe640 1 -- 172.21.15.29:0/3332133413 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46440983e0 con 0x7f464409bd50 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f2132ffd640 1 -- 172.21.15.29:0/1300179814 >> v1:172.21.15.29:6789/0 conn(0x7f2134097160 legacy=0x7f2134128340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f2132ffd640 1 -- 172.21.15.29:0/1300179814 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2134074ee0 con 0x7f2134096840 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f187ffff640 1 -- 172.21.15.29:0/2077469895 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11059575 0 0) 0x7f188806fa40 con 0x7f188806e960 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f187ffff640 1 -- 172.21.15.29:0/2077469895 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1874003520 con 0x7f188806e960 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188d4f3640 1 -- 172.21.15.29:0/2077469895 >> v1:172.21.15.29:6789/0 conn(0x7f188806e960 legacy=0x7f18880711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.600+0000 7f188d4f3640 1 -- 172.21.15.29:0/2077469895 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1888070ea0 con 0x7f188806e040 2024-09-21T08:51:29.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7fb9e9d9b640 1 --2- 172.21.15.29:0/182115776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d460 0x7fb9ec131060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1676ec3f5945218d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f46437fe640 1 --2- 172.21.15.29:0/3332133413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f464409c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4634009720 tx=0x7f463402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f404e3450c347e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7fb9e959a640 1 -- 172.21.15.29:0/182115776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e0037070 con 0x7fb9ec06d460 2024-09-21T08:51:29.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7fb9e959a640 1 -- 172.21.15.29:0/182115776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e002ad90 con 0x7fb9ec06d460 2024-09-21T08:51:29.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7fb9e959a640 1 -- 172.21.15.29:0/182115776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e0032590 con 0x7fb9ec06d460 2024-09-21T08:51:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f46427fc640 1 -- 172.21.15.29:0/3332133413 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634037070 con 0x7f464409bd50 2024-09-21T08:51:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f46427fc640 1 -- 172.21.15.29:0/3332133413 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463402ad90 con 0x7f464409bd50 2024-09-21T08:51:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f46427fc640 1 -- 172.21.15.29:0/3332133413 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634037070 con 0x7f464409bd50 2024-09-21T08:51:29.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f2132ffd640 1 --2- 172.21.15.29:0/1300179814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f2134096c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21240097f0 tx=0x7f212402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50695b49289749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f188d4f3640 1 --2- 172.21.15.29:0/2077469895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f188806e420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1884009720 tx=0x7f188402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1271a69b7d5687e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.601+0000 7f2131ffb640 1 -- 172.21.15.29:0/1300179814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124037070 con 0x7f2134096840 2024-09-21T08:51:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f2131ffb640 1 -- 172.21.15.29:0/1300179814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2124032440 con 0x7f2134096840 2024-09-21T08:51:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f2131ffb640 1 -- 172.21.15.29:0/1300179814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124032740 con 0x7f2134096840 2024-09-21T08:51:29.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f187ffff640 1 -- 172.21.15.29:0/2077469895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884037070 con 0x7f188806e040 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f187ffff640 1 -- 172.21.15.29:0/2077469895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188402ad90 con 0x7f188806e040 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f187ffff640 1 -- 172.21.15.29:0/2077469895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884032590 con 0x7f188806e040 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 -- 172.21.15.29:0/182115776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d460 msgr2=0x7fb9ec131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 --2- 172.21.15.29:0/182115776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d460 0x7fb9ec131060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009720 tx=0x7fb9e002a110 comp rx=0 tx=0).stop 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 -- 172.21.15.29:0/182115776 shutdown_connections 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 --2- 172.21.15.29:0/182115776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d460 0x7fb9ec131060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 -- 172.21.15.29:0/182115776 >> 172.21.15.29:0/182115776 conn(0x7fb9ec09a890 msgr2=0x7fb9ec09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 -- 172.21.15.29:0/3332133413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 msgr2=0x7f464409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 --2- 172.21.15.29:0/3332133413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f464409c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4634009720 tx=0x7f463402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 -- 172.21.15.29:0/3332133413 shutdown_connections 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 --2- 172.21.15.29:0/3332133413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f464409c130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 -- 172.21.15.29:0/3332133413 >> 172.21.15.29:0/3332133413 conn(0x7f464406d4a0 msgr2=0x7f464406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 -- 172.21.15.29:0/3332133413 shutdown_connections 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 -- 172.21.15.29:0/182115776 shutdown_connections 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7fb9f0877640 1 -- 172.21.15.29:0/182115776 wait complete. 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f4649ff1640 1 -- 172.21.15.29:0/3332133413 wait complete. 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f2139991640 1 -- 172.21.15.29:0/1300179814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 msgr2=0x7f2134096c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.602+0000 7f2139991640 1 --2- 172.21.15.29:0/1300179814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f2134096c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21240097f0 tx=0x7f212402a1f0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f2139991640 1 -- 172.21.15.29:0/1300179814 shutdown_connections 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f2139991640 1 --2- 172.21.15.29:0/1300179814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f2134096c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f2139991640 1 -- 172.21.15.29:0/1300179814 >> 172.21.15.29:0/1300179814 conn(0x7f213409d850 msgr2=0x7f2134099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 -- 172.21.15.29:0/2077469895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 msgr2=0x7f188806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 --2- 172.21.15.29:0/2077469895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f188806e420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1884009720 tx=0x7f188402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f2139991640 1 -- 172.21.15.29:0/1300179814 shutdown_connections 2024-09-21T08:51:29.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f2139991640 1 -- 172.21.15.29:0/1300179814 wait complete. 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 -- 172.21.15.29:0/2077469895 shutdown_connections 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 --2- 172.21.15.29:0/2077469895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f188806e420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 -- 172.21.15.29:0/2077469895 >> 172.21.15.29:0/2077469895 conn(0x7f188809a680 msgr2=0x7f188809aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 -- 172.21.15.29:0/2077469895 shutdown_connections 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.603+0000 7f188f757640 1 -- 172.21.15.29:0/2077469895 wait complete. 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f2139991640 1 Processor -- start 2024-09-21T08:51:29.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7fb9f0877640 1 Processor -- start 2024-09-21T08:51:29.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188f757640 1 Processor -- start 2024-09-21T08:51:29.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7fb9f0877640 1 -- start start 2024-09-21T08:51:29.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188f757640 1 -- start start 2024-09-21T08:51:29.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f4649ff1640 1 Processor -- start 2024-09-21T08:51:29.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f2139991640 1 -- start start 2024-09-21T08:51:29.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f4649ff1640 1 -- start start 2024-09-21T08:51:29.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188f757640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188f757640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f18880718c0 con 0x7f188806e040 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f2139991640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f2139991640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f21340975b0 con 0x7f2134096840 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188d4f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188d4f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43694/0 (socket says 172.21.15.29:43694) 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7f188d4f3640 1 -- 172.21.15.29:0/2303647785 learned_addr learned my addr 172.21.15.29:0/2303647785 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.604+0000 7fb9f0877640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f2132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7fb9f0877640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec06d9f0 con 0x7fb9ec06d080 2024-09-21T08:51:29.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f2132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43698/0 (socket says 172.21.15.29:43698) 2024-09-21T08:51:29.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f2132ffd640 1 -- 172.21.15.29:0/2717345767 learned_addr learned my addr 172.21.15.29:0/2717345767 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7fb9ea59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7fb9ea59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43710/0 (socket says 172.21.15.29:43710) 2024-09-21T08:51:29.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7fb9ea59c640 1 -- 172.21.15.29:0/3915403619 learned_addr learned my addr 172.21.15.29:0/3915403619 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f188d4f3640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188808c640 con 0x7f188806e040 2024-09-21T08:51:29.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f4649ff1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f2132ffd640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21341229d0 con 0x7f2134096840 2024-09-21T08:51:29.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f188d4f3640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1884009840 tx=0x7f18840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f4649ff1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4644099b90 con 0x7f464409bd50 2024-09-21T08:51:29.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f46437fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f46437fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43716/0 (socket says 172.21.15.29:43716) 2024-09-21T08:51:29.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f46437fe640 1 -- 172.21.15.29:0/79490328 learned_addr learned my addr 172.21.15.29:0/79490328 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f2132ffd640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21240090b0 tx=0x7f21240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7fb9ea59c640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec133450 con 0x7fb9ec06d080 2024-09-21T08:51:29.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884042020 con 0x7f188806e040 2024-09-21T08:51:29.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188403d470 con 0x7f188806e040 2024-09-21T08:51:29.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1884037040 con 0x7f188806e040 2024-09-21T08:51:29.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.605+0000 7f188f757640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18881b17f0 con 0x7f188806e040 2024-09-21T08:51:29.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124041070 con 0x7f2134096840 2024-09-21T08:51:29.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f46437fe640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46441b1e60 con 0x7f464409bd50 2024-09-21T08:51:29.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7fb9ea59c640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c4a0 tx=0x7fb9dc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212403c670 con 0x7f2134096840 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2134093d20 con 0x7f2134096840 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f46437fe640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4634035040 tx=0x7f46340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc017070 con 0x7fb9ec06d080 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005c10 con 0x7fb9ec06d080 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec126c20 con 0x7fb9ec06d080 2024-09-21T08:51:29.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2134123840 con 0x7f2134096840 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124037040 con 0x7f2134096840 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7f188f757640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18881bc3a0 con 0x7f188806e040 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4634037050 con 0x7f464409bd50 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4634043070 con 0x7f464409bd50 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f463403e450 con 0x7f464409bd50 2024-09-21T08:51:29.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.606+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc007070 con 0x7fb9ec06d080 2024-09-21T08:51:29.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec126720 con 0x7fb9ec06d080 2024-09-21T08:51:29.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46441b3860 con 0x7f464409bd50 2024-09-21T08:51:29.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2134096c20 con 0x7f2134096840 2024-09-21T08:51:29.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f188806e420 con 0x7f188806e040 2024-09-21T08:51:29.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.607+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2124044070 con 0x7f2134096840 2024-09-21T08:51:29.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f211bfff640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 0x7f212003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1884045020 con 0x7f188806e040 2024-09-21T08:51:29.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb9dc01a070 con 0x7fb9ec06d080 2024-09-21T08:51:29.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f212406bbf0 con 0x7f2134096840 2024-09-21T08:51:29.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9ec096630 con 0x7fb9ec06d080 2024-09-21T08:51:29.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 0x7f186c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f211bfff640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 0x7f212003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f188406bae0 con 0x7f188806e040 2024-09-21T08:51:29.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 0x7fb9cc03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2124032440 con 0x7f212003dac0 2024-09-21T08:51:29.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 0x7f186c03fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f188400af30 con 0x7f186c03da20 2024-09-21T08:51:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f21327fc640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 0x7f212003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f21337fe640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 0x7f212003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9e9d9b640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 0x7fb9cc03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb9dc011bd0 con 0x7fb9ec06d080 2024-09-21T08:51:29.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f188ccf2640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 0x7f186c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46441b2830 con 0x7f464409bd50 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2124072050 con 0x7f2134096840 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f188dcf4640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 0x7f186c03fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 0x7fb9cc03fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9cc040520 con 0x7fb9cc03d9d0 2024-09-21T08:51:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc050060 con 0x7fb9ec06d080 2024-09-21T08:51:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f463403e5f0 con 0x7f464409bd50 2024-09-21T08:51:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.608+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f18840308f0 con 0x7f188806e040 2024-09-21T08:51:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f464409a130 con 0x7f464409bd50 2024-09-21T08:51:29.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f21337fe640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 0x7f212003ff40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7fb9ead9d640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 0x7fb9cc03fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f462bfff640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 0x7f463003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f463406c2b0 con 0x7f464409bd50 2024-09-21T08:51:29.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f21327fc640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 0x7f212003a800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2128007fd0 tx=0x7f2128007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f462bfff640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 0x7f463003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4630040610 con 0x7f463003dac0 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4634073050 con 0x7f464409bd50 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f4642ffd640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 0x7f463003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7fb9e9d9b640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 0x7fb9cc03a710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0034000 tx=0x7fb9e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f188ccf2640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 0x7f186c03a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1878001d20 tx=0x7f1878001350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f188dcf4640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 0x7f186c03fea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7f4643fff640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 0x7f463003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.609+0000 7fb9ead9d640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 0x7fb9cc03fe50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7f4642ffd640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 0x7f463003a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46380012b0 tx=0x7f4638001120 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7f4643fff640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 0x7f463003ff40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2124032440 con 0x7f212003dac0 2024-09-21T08:51:29.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f188400af30 con 0x7f186c03da20 2024-09-21T08:51:29.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9cc040520 con 0x7fb9cc03d9d0 2024-09-21T08:51:29.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.610+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4630040610 con 0x7f463003dac0 2024-09-21T08:51:29.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.623+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2134097160 con 0x7f212003dac0 2024-09-21T08:51:29.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f211bfff640 1 -- 172.21.15.29:0/2717345767 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2134097160 con 0x7f212003dac0 2024-09-21T08:51:29.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f464409c670 con 0x7f463003dac0 2024-09-21T08:51:29.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f462bfff640 1 -- 172.21.15.29:0/79490328 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f464409c670 con 0x7f463003dac0 2024-09-21T08:51:29.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 msgr2=0x7f212003ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 0x7f212003ff40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 msgr2=0x7f212003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 0x7f212003a800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2128007fd0 tx=0x7f2128007920 comp rx=0 tx=0).stop 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 msgr2=0x7f21340721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21240090b0 tx=0x7f21240046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 shutdown_connections 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f212003dac0 0x7f212003ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 msgr2=0x7f463003ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2120038340 0x7f212003a800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.624+0000 7f2139991640 1 --2- 172.21.15.29:0/2717345767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2134096840 0x7f21340721a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 0x7f463003ff40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 >> 172.21.15.29:0/2717345767 conn(0x7f213409d850 msgr2=0x7f2134099510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 msgr2=0x7f463003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 shutdown_connections 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 0x7f463003a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46380012b0 tx=0x7f4638001120 comp rx=0 tx=0).stop 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 msgr2=0x7f46441b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4634035040 tx=0x7f46340046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 shutdown_connections 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7f463003dac0 0x7f463003ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4630038340 0x7f463003a800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f2139991640 1 -- 172.21.15.29:0/2717345767 wait complete. 2024-09-21T08:51:29.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 --2- 172.21.15.29:0/79490328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f464409bd50 0x7f46441b1020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 >> 172.21.15.29:0/79490328 conn(0x7f464406d4a0 msgr2=0x7f464409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 shutdown_connections 2024-09-21T08:51:29.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.625+0000 7f4649ff1640 1 -- 172.21.15.29:0/79490328 wait complete. 2024-09-21T08:51:29.645 INFO:teuthology.orchestra.run.smithi029.stdout:38654705669 2024-09-21T08:51:29.645 INFO:teuthology.orchestra.run.smithi029.stdout:42949672964 2024-09-21T08:51:29.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T08:51:29.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T08:51:29.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.642+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f188808be30 con 0x7f186c03da20 2024-09-21T08:51:29.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.642+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb9ec126fc0 con 0x7fb9cc03d9d0 2024-09-21T08:51:29.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.642+0000 7fb9daffd640 1 -- 172.21.15.29:0/3915403619 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb9ec126fc0 con 0x7fb9cc03d9d0 2024-09-21T08:51:29.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.642+0000 7f187dffb640 1 -- 172.21.15.29:0/2303647785 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f188808be30 con 0x7f186c03da20 2024-09-21T08:51:29.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 msgr2=0x7fb9cc03fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 0x7fb9cc03fe50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 msgr2=0x7f186c03fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 msgr2=0x7fb9cc03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 0x7fb9cc03a710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0034000 tx=0x7fb9e002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:29.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 msgr2=0x7fb9ec131810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 0x7f186c03fea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c4a0 tx=0x7fb9dc00c960 comp rx=0 tx=0).stop 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 shutdown_connections 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7fb9cc03d9d0 0x7fb9cc03fe50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9cc038250 0x7fb9cc03a710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 --2- 172.21.15.29:0/3915403619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9ec06d080 0x7fb9ec131810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 >> 172.21.15.29:0/3915403619 conn(0x7fb9ec09a890 msgr2=0x7fb9ec071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 shutdown_connections 2024-09-21T08:51:29.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7fb9f0877640 1 -- 172.21.15.29:0/3915403619 wait complete. 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 msgr2=0x7f186c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 0x7f186c03a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1878001d20 tx=0x7f1878001350 comp rx=0 tx=0).stop 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 msgr2=0x7f18881bbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1884009840 tx=0x7f18840046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 shutdown_connections 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7f186c03da20 0x7f186c03fea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f186c0382a0 0x7f186c03a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 --2- 172.21.15.29:0/2303647785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188806e040 0x7f18881bbc80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 >> 172.21.15.29:0/2303647785 conn(0x7f188809a680 msgr2=0x7f18880983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 shutdown_connections 2024-09-21T08:51:29.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.643+0000 7f186b7fe640 1 -- 172.21.15.29:0/2303647785 wait complete. 2024-09-21T08:51:29.659 INFO:teuthology.orchestra.run.smithi029.stdout:42949672966 2024-09-21T08:51:29.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T08:51:29.660 INFO:teuthology.orchestra.run.smithi029.stdout:42949672965 2024-09-21T08:51:29.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T08:51:29.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.756+0000 7fe79be27640 1 Processor -- start 2024-09-21T08:51:29.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.756+0000 7f1d359a6640 1 Processor -- start 2024-09-21T08:51:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.756+0000 7f1d359a6640 1 -- start start 2024-09-21T08:51:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.756+0000 7fe79be27640 1 -- start start 2024-09-21T08:51:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d359a6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d30073180 0x7f1d3006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d359a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3009af00 con 0x7f1d30072da0 2024-09-21T08:51:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe79be27640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe79409a100 0x7fe794133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d359a6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1d30097660 con 0x7f1d30073180 2024-09-21T08:51:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe79be27640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe79409d3b0 con 0x7fe79409bd50 2024-09-21T08:51:29.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe79be27640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe79409c840 con 0x7fe79409a100 2024-09-21T08:51:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1d30072da0 0x7f1d3006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53164/0 (socket says 172.21.15.29:53164) 2024-09-21T08:51:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2effd640 1 -- 172.21.15.29:0/2040904341 learned_addr learned my addr 172.21.15.29:0/2040904341 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe799bc3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe79409bd50 0x7fe79409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53180/0 (socket says 172.21.15.29:53180) 2024-09-21T08:51:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe799bc3640 1 -- 172.21.15.29:0/2289577903 learned_addr learned my addr 172.21.15.29:0/2289577903 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe7993c2640 1 --2- 172.21.15.29:0/2289577903 >> v2:172.21.15.29:3300/0 conn(0x7fe79409a100 0x7fe794133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2e7fc640 1 --2- 172.21.15.29:0/2040904341 >> v2:172.21.15.29:3300/0 conn(0x7f1d30073180 0x7f1d3006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2dffb640 1 -- 172.21.15.29:0/2040904341 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866721061 0 0) 0x7f1d3009af00 con 0x7f1d30072da0 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2dffb640 1 -- 172.21.15.29:0/2040904341 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d18003520 con 0x7f1d30072da0 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334385077 0 0) 0x7fe790001110 con 0x7fe79409bd50 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe780003520 con 0x7fe79409bd50 2024-09-21T08:51:29.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2e7fc640 1 -- 172.21.15.29:0/2040904341 >> v1:172.21.15.29:6789/0 conn(0x7f1d30072da0 legacy=0x7f1d3006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.757+0000 7f1d2e7fc640 1 -- 172.21.15.29:0/2040904341 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3006f240 con 0x7f1d30073180 2024-09-21T08:51:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643980308 0 0) 0x7fe780003520 con 0x7fe79409bd50 2024-09-21T08:51:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7fe7993c2640 1 -- 172.21.15.29:0/2289577903 >> v1:172.21.15.29:6789/0 conn(0x7fe79409bd50 legacy=0x7fe79409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7fe7993c2640 1 -- 172.21.15.29:0/2289577903 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe794098230 con 0x7fe79409a100 2024-09-21T08:51:29.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7f1d2e7fc640 1 --2- 172.21.15.29:0/2040904341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30073180 0x7f1d3006c2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009720 tx=0x7f1d2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fd3d60b39fda5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7f1d2dffb640 1 -- 172.21.15.29:0/2040904341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d24037070 con 0x7f1d30073180 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7f1d2dffb640 1 -- 172.21.15.29:0/2040904341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2402ad90 con 0x7f1d30073180 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.758+0000 7f1d2dffb640 1 -- 172.21.15.29:0/2040904341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d24032570 con 0x7f1d30073180 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7fe7993c2640 1 --2- 172.21.15.29:0/2289577903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409a100 0x7fe794133da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe788009720 tx=0x7fe78802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6591c642f4d1f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe788037070 con 0x7fe79409a100 2024-09-21T08:51:29.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78802ab30 con 0x7fe79409a100 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7fe798bc1640 1 -- 172.21.15.29:0/2289577903 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790001770 con 0x7fe79409a100 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 -- 172.21.15.29:0/2040904341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30073180 msgr2=0x7f1d3006c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 --2- 172.21.15.29:0/2040904341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30073180 0x7f1d3006c2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009720 tx=0x7f1d2402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 -- 172.21.15.29:0/2040904341 shutdown_connections 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 --2- 172.21.15.29:0/2040904341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30073180 0x7f1d3006c2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 -- 172.21.15.29:0/2040904341 >> 172.21.15.29:0/2040904341 conn(0x7f1d3009e0b0 msgr2=0x7f1d3009a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 -- 172.21.15.29:0/2040904341 shutdown_connections 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.759+0000 7f1d359a6640 1 -- 172.21.15.29:0/2040904341 wait complete. 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 -- 172.21.15.29:0/2289577903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409a100 msgr2=0x7fe794133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 --2- 172.21.15.29:0/2289577903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409a100 0x7fe794133da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe788009720 tx=0x7fe78802a0a0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 -- 172.21.15.29:0/2289577903 shutdown_connections 2024-09-21T08:51:29.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 --2- 172.21.15.29:0/2289577903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409a100 0x7fe794133da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 -- 172.21.15.29:0/2289577903 >> 172.21.15.29:0/2289577903 conn(0x7fe79406d4a0 msgr2=0x7fe79406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 -- 172.21.15.29:0/2289577903 shutdown_connections 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7fe79be27640 1 -- 172.21.15.29:0/2289577903 wait complete. 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.760+0000 7f1d359a6640 1 Processor -- start 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7f1d359a6640 1 -- start start 2024-09-21T08:51:29.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7fe79be27640 1 Processor -- start 2024-09-21T08:51:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7fe79be27640 1 -- start start 2024-09-21T08:51:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7f1d359a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7f1d359a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30134c40 con 0x7f1d30072da0 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.761+0000 7fe79be27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe79be27640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe794134670 con 0x7fe79409bd50 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe799bc3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe799bc3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43760/0 (socket says 172.21.15.29:43760) 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe799bc3640 1 -- 172.21.15.29:0/4066443205 learned_addr learned my addr 172.21.15.29:0/4066443205 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7f1d2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7f1d2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43754/0 (socket says 172.21.15.29:43754) 2024-09-21T08:51:29.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7f1d2effd640 1 -- 172.21.15.29:0/3545709570 learned_addr learned my addr 172.21.15.29:0/3545709570 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe799bc3640 1 -- 172.21.15.29:0/4066443205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe794096a10 con 0x7fe79409bd50 2024-09-21T08:51:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe799bc3640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c6b0 tx=0x7fe79000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7f1d2effd640 1 -- 172.21.15.29:0/3545709570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d30125180 con 0x7f1d30072da0 2024-09-21T08:51:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790017070 con 0x7fe79409bd50 2024-09-21T08:51:29.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7900058d0 con 0x7fe79409bd50 2024-09-21T08:51:29.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790005c50 con 0x7fe79409bd50 2024-09-21T08:51:29.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.762+0000 7f1d2effd640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c3b0 tx=0x7f1d2000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe794096570 con 0x7fe79409bd50 2024-09-21T08:51:29.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe794097880 con 0x7fe79409bd50 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20017070 con 0x7f1d30072da0 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d20005c10 con 0x7f1d30072da0 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d200070d0 con 0x7f1d30072da0 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.763+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d30097810 con 0x7f1d30072da0 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.764+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe79001a070 con 0x7fe79409bd50 2024-09-21T08:51:29.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.764+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d30125ff0 con 0x7f1d30072da0 2024-09-21T08:51:29.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.764+0000 7fe7867fc640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.764+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe79004a6e0 con 0x7fe79409bd50 2024-09-21T08:51:29.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.764+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79409c130 con 0x7fe79409bd50 2024-09-21T08:51:29.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7fe7993c2640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1d2001a070 con 0x7f1d30072da0 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7f1d17fff640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 0x7f1d1c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7fe7993c2640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 0x7fe77803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe788034000 tx=0x7fe78802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3006bba0 con 0x7f1d30072da0 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.765+0000 7f1d2e7fc640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 0x7f1d1c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.766+0000 7f1d2e7fc640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 0x7f1d1c03a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009720 tx=0x7f1d2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.773+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f1d20049300 con 0x7f1d30072da0 2024-09-21T08:51:29.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.773+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe794097880 con 0x7fe79409bd50 2024-09-21T08:51:29.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.782+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1d20019dd0 con 0x7f1d30072da0 2024-09-21T08:51:29.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.806+0000 7f0e11f52640 1 Processor -- start 2024-09-21T08:51:29.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.806+0000 7f0e11f52640 1 -- start start 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e11f52640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e0c09a100 0x7f0e0c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e11f52640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0c09d3b0 con 0x7f0e0c09bd50 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e11f52640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0c09c840 con 0x7f0e0c09a100 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e0affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e0c09a100 0x7f0e0c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e0affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e0c09a100 0x7f0e0c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43776/0 (socket says 172.21.15.29:43776) 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e0affd640 1 -- 172.21.15.29:0/3703650349 learned_addr learned my addr 172.21.15.29:0/3703650349 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.807+0000 7f0e0affd640 1 -- 172.21.15.29:0/3703650349 >> v1:172.21.15.29:6789/0 conn(0x7f0e0c09bd50 legacy=0x7f0e0c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.808+0000 7f0e0affd640 1 -- 172.21.15.29:0/3703650349 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c098230 con 0x7f0e0c09a100 2024-09-21T08:51:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.808+0000 7f0e0affd640 1 --2- 172.21.15.29:0/3703650349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c133da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097f0 tx=0x7f0e0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91510d58fb44c754 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.808+0000 7f0e0a7fc640 1 -- 172.21.15.29:0/3703650349 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e00037070 con 0x7f0e0c09a100 2024-09-21T08:51:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e0a7fc640 1 -- 172.21.15.29:0/3703650349 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e00032440 con 0x7f0e0c09a100 2024-09-21T08:51:29.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e0a7fc640 1 -- 172.21.15.29:0/3703650349 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e0002ae60 con 0x7f0e0c09a100 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e11f52640 1 -- 172.21.15.29:0/3703650349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 msgr2=0x7f0e0c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e11f52640 1 --2- 172.21.15.29:0/3703650349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c133da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097f0 tx=0x7f0e0002a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e11f52640 1 -- 172.21.15.29:0/3703650349 shutdown_connections 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e11f52640 1 --2- 172.21.15.29:0/3703650349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c133da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.809+0000 7f0e11f52640 1 -- 172.21.15.29:0/3703650349 >> 172.21.15.29:0/3703650349 conn(0x7f0e0c06d4a0 msgr2=0x7f0e0c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.810+0000 7f0e11f52640 1 -- 172.21.15.29:0/3703650349 shutdown_connections 2024-09-21T08:51:29.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.810+0000 7f0e11f52640 1 -- 172.21.15.29:0/3703650349 wait complete. 2024-09-21T08:51:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.811+0000 7f0e11f52640 1 Processor -- start 2024-09-21T08:51:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.811+0000 7f0e11f52640 1 -- start start 2024-09-21T08:51:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.811+0000 7f0e11f52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e11f52640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c134670 con 0x7f0e0c09a100 2024-09-21T08:51:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e0b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e0b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43788/0 (socket says 172.21.15.29:43788) 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e0b7fe640 1 -- 172.21.15.29:0/2500115727 learned_addr learned my addr 172.21.15.29:0/2500115727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e0b7fe640 1 -- 172.21.15.29:0/2500115727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c0963e0 con 0x7f0e0c09a100 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0e0b7fe640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c380 tx=0x7f0dfc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dfc005200 con 0x7f0e0c09a100 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0053c0 con 0x7f0e0c09a100 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.812+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dfc007190 con 0x7f0e0c09a100 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.813+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0c126090 con 0x7f0e0c09a100 2024-09-21T08:51:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.813+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0c1c3ed0 con 0x7f0e0c09a100 2024-09-21T08:51:29.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f936205e640 1 Processor -- start 2024-09-21T08:51:29.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f936205e640 1 -- start start 2024-09-21T08:51:29.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0c09a760 con 0x7f0e0c09a100 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f936205e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f935c12eba0 0x7f935c12ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f936205e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935c098b00 con 0x7f935c12e770 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f936205e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f935c12f4c0 con 0x7f935c12eba0 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.814+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0dfc007330 con 0x7f0e0c09a100 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f935b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f935c12eba0 0x7f935c12ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f9353fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f935c12e770 0x7f935c12b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53198/0 (socket says 172.21.15.29:53198) 2024-09-21T08:51:29.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f9353fff640 1 -- 172.21.15.29:0/2825423832 learned_addr learned my addr 172.21.15.29:0/2825423832 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:29.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f0df3fff640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 0x7f0df803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0dfc04b070 con 0x7f0e0c09a100 2024-09-21T08:51:29.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f935b7fe640 1 -- 172.21.15.29:0/2825423832 >> v1:172.21.15.29:6789/0 conn(0x7f935c12e770 legacy=0x7f935c12b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f935b7fe640 1 -- 172.21.15.29:0/2825423832 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c0986c0 con 0x7f935c12eba0 2024-09-21T08:51:29.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f0e0affd640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 0x7f0df803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.815+0000 7f0e0affd640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 0x7f0df803a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e00034000 tx=0x7f0e0002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.816+0000 7f935b7fe640 1 --2- 172.21.15.29:0/2825423832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12eba0 0x7f935c12ef80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f934c009720 tx=0x7f934c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a259265e8c8389c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.819+0000 7f935affd640 1 -- 172.21.15.29:0/2825423832 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f934c037070 con 0x7f935c12eba0 2024-09-21T08:51:29.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.819+0000 7f935affd640 1 -- 172.21.15.29:0/2825423832 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c02ad90 con 0x7f935c12eba0 2024-09-21T08:51:29.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.819+0000 7f935affd640 1 -- 172.21.15.29:0/2825423832 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f934c032590 con 0x7f935c12eba0 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.819+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0e0c09a760 con 0x7f0e0c09a100 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 -- 172.21.15.29:0/2825423832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12eba0 msgr2=0x7f935c12ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 --2- 172.21.15.29:0/2825423832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12eba0 0x7f935c12ef80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f934c009720 tx=0x7f934c02a110 comp rx=0 tx=0).stop 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 -- 172.21.15.29:0/2825423832 shutdown_connections 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 --2- 172.21.15.29:0/2825423832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12eba0 0x7f935c12ef80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 -- 172.21.15.29:0/2825423832 >> 172.21.15.29:0/2825423832 conn(0x7f935c06d030 msgr2=0x7f935c06d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:29.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 -- 172.21.15.29:0/2825423832 shutdown_connections 2024-09-21T08:51:29.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.820+0000 7f936205e640 1 -- 172.21.15.29:0/2825423832 wait complete. 2024-09-21T08:51:29.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f936205e640 1 Processor -- start 2024-09-21T08:51:29.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f936205e640 1 -- start start 2024-09-21T08:51:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f936205e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f936205e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f935c09cb70 con 0x7f935c12e770 2024-09-21T08:51:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43806/0 (socket says 172.21.15.29:43806) 2024-09-21T08:51:29.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.821+0000 7f935b7fe640 1 -- 172.21.15.29:0/1393866069 learned_addr learned my addr 172.21.15.29:0/1393866069 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f935b7fe640 1 -- 172.21.15.29:0/1393866069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c08f080 con 0x7f935c12e770 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f935b7fe640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f934c009840 tx=0x7f934c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f934c042020 con 0x7f935c12e770 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934c03d5c0 con 0x7f935c12e770 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f934c037040 con 0x7f935c12e770 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c08e450 con 0x7f935c12e770 2024-09-21T08:51:29.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.822+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1c3bf0 con 0x7f935c12e770 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.823+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f934c045020 con 0x7f935c12e770 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.823+0000 7f9358ff9640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 0x7f933c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.823+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f934c06bc50 con 0x7f935c12e770 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.824+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c09ffa0 con 0x7f935c12e770 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.824+0000 7f9353fff640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 0x7f933c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:29.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.824+0000 7f9353fff640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 0x7f933c03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9344000f60 tx=0x7f9344007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:29.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:29.829+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f934c04c030 con 0x7f935c12e770 2024-09-21T08:51:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.009+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe79409d020 con 0x7fe79409bd50 2024-09-21T08:51:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.010+0000 7fe7867fc640 1 -- 172.21.15.29:0/4066443205 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe79409d3b0 con 0x7fe79409bd50 2024-09-21T08:51:30.011 INFO:teuthology.orchestra.run.smithi029.stdout:42949672963 2024-09-21T08:51:30.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 msgr2=0x7fe77803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 0x7fe77803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe788034000 tx=0x7fe78802e000 comp rx=0 tx=0).stop 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 msgr2=0x7fe794132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c6b0 tx=0x7fe79000cb70 comp rx=0 tx=0).stop 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 shutdown_connections 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 --2- 172.21.15.29:0/4066443205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79409bd50 0x7fe794132910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 >> 172.21.15.29:0/4066443205 conn(0x7fe79406d4a0 msgr2=0x7fe79408d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 shutdown_connections 2024-09-21T08:51:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.013+0000 7fe79be27640 1 -- 172.21.15.29:0/4066443205 wait complete. 2024-09-21T08:51:30.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.022+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1d30125950 con 0x7f1d30072da0 2024-09-21T08:51:30.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.022+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0e0c0971a0 con 0x7f0e0c09a100 2024-09-21T08:51:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.022+0000 7f1d17fff640 1 -- 172.21.15.29:0/3545709570 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d20010900 con 0x7f1d30072da0 2024-09-21T08:51:30.024 INFO:teuthology.orchestra.run.smithi029.stdout:38654705667 2024-09-21T08:51:30.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.022+0000 7f0df3fff640 1 -- 172.21.15.29:0/2500115727 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e0c09d3b0 con 0x7f0e0c09a100 2024-09-21T08:51:30.024 INFO:teuthology.orchestra.run.smithi029.stdout:42949672964 2024-09-21T08:51:30.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 msgr2=0x7f1d1c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f1d359a6640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 0x7f1d1c03a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009720 tx=0x7f1d2402e000 comp rx=0 tx=0).stop 2024-09-21T08:51:30.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 msgr2=0x7f0df803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f0e11f52640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 0x7f0df803a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e00034000 tx=0x7f0e0002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:30.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 msgr2=0x7f0e0c1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.024+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 msgr2=0x7f1d301233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c3b0 tx=0x7f1d2000c870 comp rx=0 tx=0).stop 2024-09-21T08:51:30.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c380 tx=0x7f0dfc00c840 comp rx=0 tx=0).stop 2024-09-21T08:51:30.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 shutdown_connections 2024-09-21T08:51:30.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 shutdown_connections 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1d1c0382a0 0x7f1d1c03a760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 --2- 172.21.15.29:0/3545709570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d30072da0 0x7f1d301233d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 >> 172.21.15.29:0/3545709570 conn(0x7f1d3009e0b0 msgr2=0x7f1d30070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0df80382a0 0x7f0df803a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 --2- 172.21.15.29:0/2500115727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e0c09a100 0x7f0e0c1c3990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 >> 172.21.15.29:0/2500115727 conn(0x7f0e0c06d4a0 msgr2=0x7f0e0c08d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:30.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 shutdown_connections 2024-09-21T08:51:30.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 shutdown_connections 2024-09-21T08:51:30.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f0e11f52640 1 -- 172.21.15.29:0/2500115727 wait complete. 2024-09-21T08:51:30.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.025+0000 7f1d359a6640 1 -- 172.21.15.29:0/3545709570 wait complete. 2024-09-21T08:51:30.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.2 2024-09-21T08:51:30.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.033+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f935c08f250 con 0x7f935c12e770 2024-09-21T08:51:30.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.033+0000 7f9358ff9640 1 -- 172.21.15.29:0/1393866069 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f934c046570 con 0x7f935c12e770 2024-09-21T08:51:30.035 INFO:teuthology.orchestra.run.smithi029.stdout:42949672965 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 msgr2=0x7f933c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 0x7f933c03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9344000f60 tx=0x7f9344007a80 comp rx=0 tx=0).stop 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 msgr2=0x7f935c1c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f934c009840 tx=0x7f934c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 shutdown_connections 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f933c0382a0 0x7f933c03a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 --2- 172.21.15.29:0/1393866069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f935c12e770 0x7f935c1c36b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:30.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.035+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 >> 172.21.15.29:0/1393866069 conn(0x7f935c06d030 msgr2=0x7f935c09a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.036+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 shutdown_connections 2024-09-21T08:51:30.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:30.036+0000 7f936205e640 1 -- 172.21.15.29:0/1393866069 wait complete. 2024-09-21T08:51:30.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-09-21T08:51:30.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-21T08:51:30.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2024-09-21T08:51:31.031 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T08:51:31.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T08:51:31.041 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T08:51:31.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T08:51:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.149+0000 7f0d38277640 1 Processor -- start 2024-09-21T08:51:31.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.149+0000 7f0d38277640 1 -- start start 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d38277640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d3009a100 0x7f0d30133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d38277640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3009d3b0 con 0x7f0d3009bd50 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d38277640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3009c840 con 0x7f0d3009a100 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d36013640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0d3009bd50 0x7f0d3009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53208/0 (socket says 172.21.15.29:53208) 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d35812640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d3009a100 0x7f0d30133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d36013640 1 -- 172.21.15.29:0/1122239197 learned_addr learned my addr 172.21.15.29:0/1122239197 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d35812640 1 -- 172.21.15.29:0/1122239197 >> v1:172.21.15.29:6789/0 conn(0x7f0d3009bd50 legacy=0x7f0d3009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.150+0000 7f0d35812640 1 -- 172.21.15.29:0/1122239197 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d30098230 con 0x7f0d3009a100 2024-09-21T08:51:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.151+0000 7f0d35812640 1 --2- 172.21.15.29:0/1122239197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d30133da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009720 tx=0x7f0d2002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766532e4024d2398 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.151+0000 7f0d35011640 1 -- 172.21.15.29:0/1122239197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d20037070 con 0x7f0d3009a100 2024-09-21T08:51:31.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.151+0000 7f0d35011640 1 -- 172.21.15.29:0/1122239197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2002ad90 con 0x7f0d3009a100 2024-09-21T08:51:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.151+0000 7f0d35011640 1 -- 172.21.15.29:0/1122239197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d20032590 con 0x7f0d3009a100 2024-09-21T08:51:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 -- 172.21.15.29:0/1122239197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 msgr2=0x7f0d30133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 --2- 172.21.15.29:0/1122239197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d30133da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009720 tx=0x7f0d2002a110 comp rx=0 tx=0).stop 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 -- 172.21.15.29:0/1122239197 shutdown_connections 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 --2- 172.21.15.29:0/1122239197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d30133da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 -- 172.21.15.29:0/1122239197 >> 172.21.15.29:0/1122239197 conn(0x7f0d3006d4a0 msgr2=0x7f0d3006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 -- 172.21.15.29:0/1122239197 shutdown_connections 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.152+0000 7f0d38277640 1 -- 172.21.15.29:0/1122239197 wait complete. 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.153+0000 7f0d38277640 1 Processor -- start 2024-09-21T08:51:31.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.153+0000 7f0d38277640 1 -- start start 2024-09-21T08:51:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d38277640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d38277640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30134670 con 0x7f0d3009a100 2024-09-21T08:51:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d36013640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d36013640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43818/0 (socket says 172.21.15.29:43818) 2024-09-21T08:51:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d36013640 1 -- 172.21.15.29:0/3784433996 learned_addr learned my addr 172.21.15.29:0/3784433996 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.154+0000 7f0d36013640 1 -- 172.21.15.29:0/3784433996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d30125ee0 con 0x7f0d3009a100 2024-09-21T08:51:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d36013640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c4a0 tx=0x7f0d2c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c017070 con 0x7f0d3009a100 2024-09-21T08:51:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c005c10 con 0x7f0d3009a100 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c007070 con 0x7f0d3009a100 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d30095510 con 0x7f0d3009a100 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.155+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d300961a0 con 0x7f0d3009a100 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.156+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0d2c01a070 con 0x7f0d3009a100 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.156+0000 7f0d26ffd640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 0x7f0d1403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.156+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0d2c04a530 con 0x7f0d3009a100 2024-09-21T08:51:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.156+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d30096490 con 0x7f0d3009a100 2024-09-21T08:51:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.156+0000 7f0d35812640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 0x7f0d1403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.157+0000 7f0d35812640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 0x7f0d1403a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0d20034000 tx=0x7f0d2002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.161+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0d30096490 con 0x7f0d3009a100 2024-09-21T08:51:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.193+0000 7fe4eb27b640 1 Processor -- start 2024-09-21T08:51:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4eb27b640 1 -- start start 2024-09-21T08:51:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4eb27b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4e409a100 0x7fe4e4133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4eb27b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e409d3b0 con 0x7fe4e409bd50 2024-09-21T08:51:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4eb27b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e409c840 con 0x7fe4e409a100 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4e8816640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4e409a100 0x7fe4e4133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4e8816640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4e409a100 0x7fe4e4133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43826/0 (socket says 172.21.15.29:43826) 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.194+0000 7fe4e8816640 1 -- 172.21.15.29:0/2552882521 learned_addr learned my addr 172.21.15.29:0/2552882521 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.195+0000 7fe4e8816640 1 -- 172.21.15.29:0/2552882521 >> v1:172.21.15.29:6789/0 conn(0x7fe4e409bd50 legacy=0x7fe4e409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.195+0000 7fe4e8816640 1 -- 172.21.15.29:0/2552882521 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e4098230 con 0x7fe4e409a100 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.195+0000 7f2796c27640 1 Processor -- start 2024-09-21T08:51:31.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.195+0000 7f2796c27640 1 -- start start 2024-09-21T08:51:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7fe4e8816640 1 --2- 172.21.15.29:0/2552882521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4133da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40097f0 tx=0x7fe4d402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9547a0a1cde9b97f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f2796c27640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f279006f0b0 0x7f2790130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f2796c27640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2790072780 con 0x7f279006e5c0 2024-09-21T08:51:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f2796c27640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2790070000 con 0x7f279006f0b0 2024-09-21T08:51:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f27949c3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f279006e5c0 0x7f279006e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53220/0 (socket says 172.21.15.29:53220) 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7fe4dbfff640 1 -- 172.21.15.29:0/2552882521 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4037070 con 0x7fe4e409a100 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7fe4dbfff640 1 -- 172.21.15.29:0/2552882521 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d4032440 con 0x7fe4e409a100 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7fe4dbfff640 1 -- 172.21.15.29:0/2552882521 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d4032740 con 0x7fe4e409a100 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f279006f0b0 0x7f2790130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f279006f0b0 0x7f2790130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43842/0 (socket says 172.21.15.29:43842) 2024-09-21T08:51:31.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278ffff640 1 -- 172.21.15.29:0/1670994210 learned_addr learned my addr 172.21.15.29:0/1670994210 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278ffff640 1 -- 172.21.15.29:0/1670994210 >> v1:172.21.15.29:6789/0 conn(0x7f279006e5c0 legacy=0x7f279006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278f7fe640 1 -- 172.21.15.29:0/1670994210 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827447217 0 0) 0x7f2790072780 con 0x7f279006e5c0 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.196+0000 7f278ffff640 1 -- 172.21.15.29:0/1670994210 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2790071460 con 0x7f279006f0b0 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2552882521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 msgr2=0x7fe4e4133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2552882521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4133da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40097f0 tx=0x7fe4d402a1f0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2552882521 shutdown_connections 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2552882521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4133da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2552882521 >> 172.21.15.29:0/2552882521 conn(0x7fe4e406d4a0 msgr2=0x7fe4e406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2552882521 shutdown_connections 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2552882521 wait complete. 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.197+0000 7f278ffff640 1 --2- 172.21.15.29:0/1670994210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006f0b0 0x7f2790130ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f277c0097f0 tx=0x7f277c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab2190fba4f8032 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f278f7fe640 1 -- 172.21.15.29:0/1670994210 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c037070 con 0x7f279006f0b0 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f278f7fe640 1 -- 172.21.15.29:0/1670994210 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c032440 con 0x7f279006f0b0 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f278f7fe640 1 -- 172.21.15.29:0/1670994210 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c02ae60 con 0x7f279006f0b0 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4eb27b640 1 Processor -- start 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4eb27b640 1 -- start start 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4eb27b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4eb27b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e4134670 con 0x7fe4e409a100 2024-09-21T08:51:31.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f2796c27640 1 -- 172.21.15.29:0/1670994210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006f0b0 msgr2=0x7f2790130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f2796c27640 1 --2- 172.21.15.29:0/1670994210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006f0b0 0x7f2790130ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f277c0097f0 tx=0x7f277c02a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4e9017640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4e9017640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43850/0 (socket says 172.21.15.29:43850) 2024-09-21T08:51:31.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7fe4e9017640 1 -- 172.21.15.29:0/2732977352 learned_addr learned my addr 172.21.15.29:0/2732977352 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f2796c27640 1 -- 172.21.15.29:0/1670994210 shutdown_connections 2024-09-21T08:51:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f2796c27640 1 --2- 172.21.15.29:0/1670994210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006f0b0 0x7f2790130ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.198+0000 7f2796c27640 1 -- 172.21.15.29:0/1670994210 >> 172.21.15.29:0/1670994210 conn(0x7f279009aa80 msgr2=0x7f279009ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7f2796c27640 1 -- 172.21.15.29:0/1670994210 shutdown_connections 2024-09-21T08:51:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7f2796c27640 1 -- 172.21.15.29:0/1670994210 wait complete. 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4e9017640 1 -- 172.21.15.29:0/2732977352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e4126130 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4e9017640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c450 tx=0x7fe4e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0017070 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0005220 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e4096540 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00035f0 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.199+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e4096f90 con 0x7fe4e409a100 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.200+0000 7f2796c27640 1 Processor -- start 2024-09-21T08:51:31.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.200+0000 7f2796c27640 1 -- start start 2024-09-21T08:51:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e40a1d10 con 0x7fe4e409a100 2024-09-21T08:51:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f2796c27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f2796c27640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2790131220 con 0x7f279006e5c0 2024-09-21T08:51:31.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f27949c3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4e001a070 con 0x7fe4e409a100 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7fe4d9ffb640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 0x7fe4c803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe4e004a510 con 0x7fe4e409a100 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f27949c3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43858/0 (socket says 172.21.15.29:43858) 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f27949c3640 1 -- 172.21.15.29:0/4030895080 learned_addr learned my addr 172.21.15.29:0/4030895080 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f3e73733640 1 Processor -- start 2024-09-21T08:51:31.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f27949c3640 1 -- 172.21.15.29:0/4030895080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2790096750 con 0x7f279006e5c0 2024-09-21T08:51:31.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7f3e73733640 1 -- start start 2024-09-21T08:51:31.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.201+0000 7fe4e8816640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 0x7fe4c803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f27949c3640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278400c3b0 tx=0x7f278400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e73733640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e6c06f0b0 0x7f3e6c133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e73733640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6c06be10 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e714cf640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3e6c06e5c0 0x7f3e6c06e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53222/0 (socket says 172.21.15.29:53222) 2024-09-21T08:51:31.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e714cf640 1 -- 172.21.15.29:0/4241506651 learned_addr learned my addr 172.21.15.29:0/4241506651 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:31.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7fe4e8816640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 0x7fe4c803a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4034000 tx=0x7fe4d402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3e6c09b5a0 con 0x7f3e6c06f0b0 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e70cce640 1 --2- 172.21.15.29:0/4241506651 >> v2:172.21.15.29:3300/0 conn(0x7f3e6c06f0b0 0x7f3e6c133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e70cce640 1 -- 172.21.15.29:0/4241506651 >> v1:172.21.15.29:6789/0 conn(0x7f3e6c06e5c0 legacy=0x7f3e6c06e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.202+0000 7f3e70cce640 1 -- 172.21.15.29:0/4241506651 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c06c400 con 0x7f3e6c06f0b0 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.203+0000 7f3e70cce640 1 --2- 172.21.15.29:0/4241506651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06f0b0 0x7f3e6c133d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009720 tx=0x7f3e5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc3c60c54f15be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784007410 con 0x7f279006e5c0 2024-09-21T08:51:31.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f3e63fff640 1 -- 172.21.15.29:0/4241506651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5c037070 con 0x7f3e6c06f0b0 2024-09-21T08:51:31.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2790094da0 con 0x7f279006e5c0 2024-09-21T08:51:31.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27900960e0 con 0x7f279006e5c0 2024-09-21T08:51:31.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27840075b0 con 0x7f279006e5c0 2024-09-21T08:51:31.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784007410 con 0x7f279006e5c0 2024-09-21T08:51:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f3e63fff640 1 -- 172.21.15.29:0/4241506651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c02ae20 con 0x7f3e6c06f0b0 2024-09-21T08:51:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7f3e63fff640 1 -- 172.21.15.29:0/4241506651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5c032590 con 0x7f3e6c06f0b0 2024-09-21T08:51:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.206+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4e409d3b0 con 0x7fe4e409a100 2024-09-21T08:51:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06f0b0 msgr2=0x7f3e6c133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 --2- 172.21.15.29:0/4241506651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06f0b0 0x7f3e6c133d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009720 tx=0x7f3e5c02a1a0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2770005080 con 0x7f279006e5c0 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2784011070 con 0x7f279006e5c0 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 shutdown_connections 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 --2- 172.21.15.29:0/4241506651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06f0b0 0x7f3e6c133d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 >> 172.21.15.29:0/4241506651 conn(0x7f3e6c09aa80 msgr2=0x7f3e6c09ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 shutdown_connections 2024-09-21T08:51:31.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.207+0000 7f3e73733640 1 -- 172.21.15.29:0/4241506651 wait complete. 2024-09-21T08:51:31.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.208+0000 7f278d7fa640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 0x7f277403aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.208+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f27840133c0 con 0x7f279006e5c0 2024-09-21T08:51:31.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.208+0000 7f278ffff640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 0x7f277403aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.208+0000 7f3e73733640 1 Processor -- start 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.208+0000 7f3e73733640 1 -- start start 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e73733640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e73733640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c134250 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e714cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e714cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43876/0 (socket says 172.21.15.29:43876) 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e714cf640 1 -- 172.21.15.29:0/616653202 learned_addr learned my addr 172.21.15.29:0/616653202 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:31.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f278ffff640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 0x7f277403aaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e714cf640 1 -- 172.21.15.29:0/616653202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c123650 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.209+0000 7f3e714cf640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800ca90 tx=0x7f3e6800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e68018070 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e68004c90 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6800aa50 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c097180 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27840047e0 con 0x7f279006e5c0 2024-09-21T08:51:31.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.213+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c124100 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.214+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c09ec50 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.215+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3e6801b070 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.215+0000 7f3e61ffb640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 0x7f3e5003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.215+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3e6804afc0 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.215+0000 7f3e70cce640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 0x7f3e5003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.216+0000 7f3e70cce640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 0x7f3e5003a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034000 tx=0x7f3e5c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:31.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.220+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3e6c123650 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.357+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0d301260b0 con 0x7f0d3009a100 2024-09-21T08:51:31.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.357+0000 7f0d26ffd640 1 -- 172.21.15.29:0/3784433996 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d3009d3b0 con 0x7f0d3009a100 2024-09-21T08:51:31.359 INFO:teuthology.orchestra.run.smithi029.stdout:42949672963 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 msgr2=0x7f0d1403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 0x7f0d1403a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0d20034000 tx=0x7f0d2002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 msgr2=0x7f0d301c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c4a0 tx=0x7f0d2c00c960 comp rx=0 tx=0).stop 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 shutdown_connections 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d140382a0 0x7f0d1403a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 --2- 172.21.15.29:0/3784433996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3009a100 0x7f0d301c3990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.359+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 >> 172.21.15.29:0/3784433996 conn(0x7f0d3006d4a0 msgr2=0x7f0d30096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.360+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 shutdown_connections 2024-09-21T08:51:31.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.360+0000 7f0d38277640 1 -- 172.21.15.29:0/3784433996 wait complete. 2024-09-21T08:51:31.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.2 2024-09-21T08:51:31.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.400+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3e6c06c020 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.400+0000 7f3e61ffb640 1 -- 172.21.15.29:0/616653202 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e6801c3b0 con 0x7f3e6c06e5c0 2024-09-21T08:51:31.402 INFO:teuthology.orchestra.run.smithi029.stdout:38654705667 2024-09-21T08:51:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 msgr2=0x7f3e5003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 0x7f3e5003a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034000 tx=0x7f3e5c02e000 comp rx=0 tx=0).stop 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 msgr2=0x7f3e6c1307d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800ca90 tx=0x7f3e6800cf50 comp rx=0 tx=0).stop 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 shutdown_connections 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e500382a0 0x7f3e5003a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 --2- 172.21.15.29:0/616653202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6c06e5c0 0x7f3e6c1307d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 >> 172.21.15.29:0/616653202 conn(0x7f3e6c09aa80 msgr2=0x7f3e6c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 shutdown_connections 2024-09-21T08:51:31.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.403+0000 7f3e73733640 1 -- 172.21.15.29:0/616653202 wait complete. 2024-09-21T08:51:31.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-09-21T08:51:31.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.414+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe4e4125ee0 con 0x7fe4e409a100 2024-09-21T08:51:31.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.414+0000 7fe4d9ffb640 1 -- 172.21.15.29:0/2732977352 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4e409d3b0 con 0x7fe4e409a100 2024-09-21T08:51:31.416 INFO:teuthology.orchestra.run.smithi029.stdout:42949672964 2024-09-21T08:51:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2770005370 con 0x7f279006e5c0 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 msgr2=0x7fe4c803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 0x7fe4c803a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4034000 tx=0x7fe4d402e000 comp rx=0 tx=0).stop 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 msgr2=0x7fe4e4094590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c450 tx=0x7fe4e000c910 comp rx=0 tx=0).stop 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 shutdown_connections 2024-09-21T08:51:31.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe4c80382a0 0x7fe4c803a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 --2- 172.21.15.29:0/2732977352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e409a100 0x7fe4e4094590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.416+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 >> 172.21.15.29:0/2732977352 conn(0x7fe4e406d4a0 msgr2=0x7fe4e408d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.417+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 shutdown_connections 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.417+0000 7fe4eb27b640 1 -- 172.21.15.29:0/2732977352 wait complete. 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.417+0000 7f278d7fa640 1 -- 172.21.15.29:0/4030895080 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27840047e0 con 0x7f279006e5c0 2024-09-21T08:51:31.419 INFO:teuthology.orchestra.run.smithi029.stdout:42949672965 2024-09-21T08:51:31.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 msgr2=0x7f277403aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 0x7f277403aaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c02e000 comp rx=0 tx=0).stop 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 msgr2=0x7f2790096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278400c3b0 tx=0x7f278400c870 comp rx=0 tx=0).stop 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 shutdown_connections 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2774038630 0x7f277403aaf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 --2- 172.21.15.29:0/4030895080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f279006e5c0 0x7f2790096f80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 >> 172.21.15.29:0/4030895080 conn(0x7f279009aa80 msgr2=0x7f2790098e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 shutdown_connections 2024-09-21T08:51:31.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:31.419+0000 7f2796c27640 1 -- 172.21.15.29:0/4030895080 wait complete. 2024-09-21T08:51:31.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-21T08:51:31.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2024-09-21T08:51:32.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T08:51:32.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T08:51:32.430 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T08:51:32.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T08:51:32.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.493+0000 7f29e4d78640 1 Processor -- start 2024-09-21T08:51:32.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.493+0000 7f29e4d78640 1 -- start start 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.493+0000 7f29e4d78640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f29e012c570 0x7f29e012c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.493+0000 7f29e4d78640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e0131890 con 0x7f29e0098a20 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.493+0000 7f29e4d78640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f29e0098550 con 0x7f29e012c570 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29de59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f29e012c570 0x7f29e012c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29ddd9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f29e0098a20 0x7f29e012ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53224/0 (socket says 172.21.15.29:53224) 2024-09-21T08:51:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29ddd9b640 1 -- 172.21.15.29:0/2073887943 learned_addr learned my addr 172.21.15.29:0/2073887943 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316762566 0 0) 0x7f29e0131890 con 0x7f29e0098a20 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c8003520 con 0x7f29e0098a20 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29de59c640 1 -- 172.21.15.29:0/2073887943 >> v1:172.21.15.29:6789/0 conn(0x7f29e0098a20 legacy=0x7f29e012ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3089414480 0 0) 0x7f29c8003520 con 0x7f29e0098a20 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.494+0000 7f29de59c640 1 -- 172.21.15.29:0/2073887943 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0132a70 con 0x7f29e012c570 2024-09-21T08:51:32.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.495+0000 7f29de59c640 1 --2- 172.21.15.29:0/2073887943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e012c570 0x7f29e012c950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009720 tx=0x7f29d002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af5a89620493351 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.496+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0037070 con 0x7f29e012c570 2024-09-21T08:51:32.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.496+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d002ab30 con 0x7f29e012c570 2024-09-21T08:51:32.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.496+0000 7f29dd59a640 1 -- 172.21.15.29:0/2073887943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d40015a0 con 0x7f29e012c570 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.496+0000 7f29e4d78640 1 -- 172.21.15.29:0/2073887943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e012c570 msgr2=0x7f29e012c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.496+0000 7f29e4d78640 1 --2- 172.21.15.29:0/2073887943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e012c570 0x7f29e012c950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009720 tx=0x7f29d002a0a0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.497+0000 7f29e4d78640 1 -- 172.21.15.29:0/2073887943 shutdown_connections 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.497+0000 7f29e4d78640 1 --2- 172.21.15.29:0/2073887943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e012c570 0x7f29e012c950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.497+0000 7f29e4d78640 1 -- 172.21.15.29:0/2073887943 >> 172.21.15.29:0/2073887943 conn(0x7f29e009f020 msgr2=0x7f29e009f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.497+0000 7f29e4d78640 1 -- 172.21.15.29:0/2073887943 shutdown_connections 2024-09-21T08:51:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.497+0000 7f29e4d78640 1 -- 172.21.15.29:0/2073887943 wait complete. 2024-09-21T08:51:32.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.498+0000 7f29e4d78640 1 Processor -- start 2024-09-21T08:51:32.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.498+0000 7f29e4d78640 1 -- start start 2024-09-21T08:51:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.498+0000 7f29e4d78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.498+0000 7f29e4d78640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f29e0131df0 con 0x7f29e0098a20 2024-09-21T08:51:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.499+0000 7f29de59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.499+0000 7f29de59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43888/0 (socket says 172.21.15.29:43888) 2024-09-21T08:51:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.499+0000 7f29de59c640 1 -- 172.21.15.29:0/166800323 learned_addr learned my addr 172.21.15.29:0/166800323 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.499+0000 7f29de59c640 1 -- 172.21.15.29:0/166800323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0129a10 con 0x7f29e0098a20 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.499+0000 7f29de59c640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29d0035040 tx=0x7f29d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.500+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0041070 con 0x7f29e0098a20 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.500+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d003c590 con 0x7f29e0098a20 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.500+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e0130700 con 0x7f29e0098a20 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.500+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0037040 con 0x7f29e0098a20 2024-09-21T08:51:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.500+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e012fa20 con 0x7f29e0098a20 2024-09-21T08:51:32.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.501+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f29d0044070 con 0x7f29e0098a20 2024-09-21T08:51:32.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.501+0000 7f29ceffd640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 0x7f29c003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.501+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e012ffb0 con 0x7f29e0098a20 2024-09-21T08:51:32.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.502+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f29d003cdb0 con 0x7f29e0098a20 2024-09-21T08:51:32.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.502+0000 7f29ddd9b640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 0x7f29c003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.502+0000 7f29ddd9b640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 0x7f29c003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005880 tx=0x7f29d4001080 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.511+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f29d003c890 con 0x7f29e0098a20 2024-09-21T08:51:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.534+0000 7fd46a2af640 1 Processor -- start 2024-09-21T08:51:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.534+0000 7fd46a2af640 1 -- start start 2024-09-21T08:51:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.534+0000 7fd46a2af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd46409bd50 0x7fd46409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.534+0000 7fd46a2af640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46409d3b0 con 0x7fd46409c670 2024-09-21T08:51:32.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.534+0000 7fd46a2af640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd464098230 con 0x7fd46409bd50 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd4637fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd46409c670 0x7fd4640990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53234/0 (socket says 172.21.15.29:53234) 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd4637fe640 1 -- 172.21.15.29:0/1984422505 learned_addr learned my addr 172.21.15.29:0/1984422505 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd463fff640 1 --2- 172.21.15.29:0/1984422505 >> v2:172.21.15.29:3300/0 conn(0x7fd46409bd50 0x7fd46409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd462ffd640 1 -- 172.21.15.29:0/1984422505 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465760848 0 0) 0x7fd458001110 con 0x7fd46409c670 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd462ffd640 1 -- 172.21.15.29:0/1984422505 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44c003520 con 0x7fd46409c670 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd463fff640 1 -- 172.21.15.29:0/1984422505 >> v1:172.21.15.29:6789/0 conn(0x7fd46409c670 legacy=0x7fd4640990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.535+0000 7fd463fff640 1 -- 172.21.15.29:0/1984422505 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4640983e0 con 0x7fd46409bd50 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.536+0000 7fd463fff640 1 --2- 172.21.15.29:0/1984422505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd46409c130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd454009720 tx=0x7fd45402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1d24b6de380b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd462ffd640 1 -- 172.21.15.29:0/1984422505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd46409bd50 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd462ffd640 1 -- 172.21.15.29:0/1984422505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45402ad90 con 0x7fd46409bd50 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd462ffd640 1 -- 172.21.15.29:0/1984422505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd454032590 con 0x7fd46409bd50 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd46a2af640 1 -- 172.21.15.29:0/1984422505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 msgr2=0x7fd46409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd46a2af640 1 --2- 172.21.15.29:0/1984422505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd46409c130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd454009720 tx=0x7fd45402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd46a2af640 1 -- 172.21.15.29:0/1984422505 shutdown_connections 2024-09-21T08:51:32.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd46a2af640 1 --2- 172.21.15.29:0/1984422505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd46409c130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.537+0000 7fd46a2af640 1 -- 172.21.15.29:0/1984422505 >> 172.21.15.29:0/1984422505 conn(0x7fd46406d4a0 msgr2=0x7fd46406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.538+0000 7fd46a2af640 1 -- 172.21.15.29:0/1984422505 shutdown_connections 2024-09-21T08:51:32.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.538+0000 7fd46a2af640 1 -- 172.21.15.29:0/1984422505 wait complete. 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.539+0000 7fd46a2af640 1 Processor -- start 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.539+0000 7fd46a2af640 1 -- start start 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.539+0000 7fd46a2af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.539+0000 7fd46a2af640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd464099b90 con 0x7fd46409bd50 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.539+0000 7fd463fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.540+0000 7fd463fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43910/0 (socket says 172.21.15.29:43910) 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.540+0000 7fd463fff640 1 -- 172.21.15.29:0/3710783030 learned_addr learned my addr 172.21.15.29:0/3710783030 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.540+0000 7fd463fff640 1 -- 172.21.15.29:0/3710783030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46409a760 con 0x7fd46409bd50 2024-09-21T08:51:32.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.540+0000 7fd463fff640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd4540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.540+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd454041070 con 0x7fd46409bd50 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.541+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4641ab4a0 con 0x7fd46409bd50 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.541+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45403c460 con 0x7fd46409bd50 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.541+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd464094980 con 0x7fd46409bd50 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.541+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd454041070 con 0x7fd46409bd50 2024-09-21T08:51:32.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.542+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd454044070 con 0x7fd46409bd50 2024-09-21T08:51:32.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.542+0000 7fd460ff9640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 0x7fd45003ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.542+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46409a130 con 0x7fd46409bd50 2024-09-21T08:51:32.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.543+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fd45403ca20 con 0x7fd46409bd50 2024-09-21T08:51:32.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.543+0000 7fd4637fe640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 0x7fd45003ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.543+0000 7fd4637fe640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 0x7fd45003ab20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd46409cac0 tx=0x7fd458001150 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.548+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd454044360 con 0x7fd46409bd50 2024-09-21T08:51:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.570+0000 7fd7a3423640 1 Processor -- start 2024-09-21T08:51:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.570+0000 7f23c81fd640 1 Processor -- start 2024-09-21T08:51:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.570+0000 7fd7a3423640 1 -- start start 2024-09-21T08:51:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.570+0000 7f23c81fd640 1 -- start start 2024-09-21T08:51:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c81fd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c006eda0 0x7f23c006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a3423640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd79c09a100 0x7fd79c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a3423640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79c09d3b0 con 0x7fd79c09bd50 2024-09-21T08:51:32.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c81fd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c006eba0 con 0x7f23c006f6c0 2024-09-21T08:51:32.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c81fd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f23c006d2f0 con 0x7f23c006eda0 2024-09-21T08:51:32.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a3423640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c09c840 con 0x7fd79c09a100 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c5f99640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c006eda0 0x7f23c006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c5f99640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23c006eda0 0x7f23c006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43926/0 (socket says 172.21.15.29:43926) 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c5f99640 1 -- 172.21.15.29:0/425115328 learned_addr learned my addr 172.21.15.29:0/425115328 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a09be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd79c09a100 0x7fd79c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a09be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd79c09a100 0x7fd79c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43936/0 (socket says 172.21.15.29:43936) 2024-09-21T08:51:32.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7fd7a09be640 1 -- 172.21.15.29:0/2750710065 learned_addr learned my addr 172.21.15.29:0/2750710065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.571+0000 7f23c5f99640 1 -- 172.21.15.29:0/425115328 >> v1:172.21.15.29:6789/0 conn(0x7f23c006f6c0 legacy=0x7f23c0121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.572+0000 7f23c5f99640 1 -- 172.21.15.29:0/425115328 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0070d50 con 0x7f23c006eda0 2024-09-21T08:51:32.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.572+0000 7fd7a09be640 1 -- 172.21.15.29:0/2750710065 >> v1:172.21.15.29:6789/0 conn(0x7fd79c09bd50 legacy=0x7fd79c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.572+0000 7fd7a09be640 1 -- 172.21.15.29:0/2750710065 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c098230 con 0x7fd79c09a100 2024-09-21T08:51:32.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.572+0000 7f23c5f99640 1 --2- 172.21.15.29:0/425115328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c006f180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0097f0 tx=0x7f23bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8620ab157cffc9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.572+0000 7f23c4f97640 1 -- 172.21.15.29:0/425115328 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23bc037070 con 0x7f23c006eda0 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c4f97640 1 -- 172.21.15.29:0/425115328 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc032440 con 0x7f23c006eda0 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c4f97640 1 -- 172.21.15.29:0/425115328 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23bc032740 con 0x7f23c006eda0 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7fd7a09be640 1 --2- 172.21.15.29:0/2750710065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c133da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097f0 tx=0x7fd78c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43af99846c7f5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7fd793fff640 1 -- 172.21.15.29:0/2750710065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78c037070 con 0x7fd79c09a100 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7fd793fff640 1 -- 172.21.15.29:0/2750710065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c032440 con 0x7fd79c09a100 2024-09-21T08:51:32.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7fd793fff640 1 -- 172.21.15.29:0/2750710065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78c032740 con 0x7fd79c09a100 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c81fd640 1 -- 172.21.15.29:0/425115328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 msgr2=0x7f23c006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c81fd640 1 --2- 172.21.15.29:0/425115328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c006f180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0097f0 tx=0x7f23bc02a270 comp rx=0 tx=0).stop 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c81fd640 1 -- 172.21.15.29:0/425115328 shutdown_connections 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c81fd640 1 --2- 172.21.15.29:0/425115328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c006f180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.573+0000 7f23c81fd640 1 -- 172.21.15.29:0/425115328 >> 172.21.15.29:0/425115328 conn(0x7f23c009a890 msgr2=0x7f23c009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7f23c81fd640 1 -- 172.21.15.29:0/425115328 shutdown_connections 2024-09-21T08:51:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 -- 172.21.15.29:0/2750710065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 msgr2=0x7fd79c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2750710065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c133da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097f0 tx=0x7fd78c02a1f0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7f23c81fd640 1 -- 172.21.15.29:0/425115328 wait complete. 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 -- 172.21.15.29:0/2750710065 shutdown_connections 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2750710065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c133da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 -- 172.21.15.29:0/2750710065 >> 172.21.15.29:0/2750710065 conn(0x7fd79c06d4a0 msgr2=0x7fd79c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 -- 172.21.15.29:0/2750710065 shutdown_connections 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.574+0000 7fd7a3423640 1 -- 172.21.15.29:0/2750710065 wait complete. 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c81fd640 1 Processor -- start 2024-09-21T08:51:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c81fd640 1 -- start start 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7fd7a3423640 1 Processor -- start 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7fd7a3423640 1 -- start start 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c81fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c81fd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f23c0122160 con 0x7f23c006eda0 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7fd7a3423640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7fd7a3423640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c134670 con 0x7fd79c09a100 2024-09-21T08:51:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c5f99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c5f99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43950/0 (socket says 172.21.15.29:43950) 2024-09-21T08:51:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.575+0000 7f23c5f99640 1 -- 172.21.15.29:0/1252067441 learned_addr learned my addr 172.21.15.29:0/1252067441 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7fd7a11bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7fd7a11bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43954/0 (socket says 172.21.15.29:43954) 2024-09-21T08:51:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7fd7a11bf640 1 -- 172.21.15.29:0/2949338099 learned_addr learned my addr 172.21.15.29:0/2949338099 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23c5f99640 1 -- 172.21.15.29:0/1252067441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c012cba0 con 0x7f23c006eda0 2024-09-21T08:51:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7fd7a11bf640 1 -- 172.21.15.29:0/2949338099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c125ee0 con 0x7fd79c09a100 2024-09-21T08:51:32.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23c5f99640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23bc035040 tx=0x7f23bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7fd7a11bf640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c450 tx=0x7fd79800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23bc041070 con 0x7f23c006eda0 2024-09-21T08:51:32.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd798017070 con 0x7fd79c09a100 2024-09-21T08:51:32.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd798005220 con 0x7fd79c09a100 2024-09-21T08:51:32.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc03c7a0 con 0x7f23c006eda0 2024-09-21T08:51:32.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23bc037040 con 0x7f23c006eda0 2024-09-21T08:51:32.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7980035f0 con 0x7fd79c09a100 2024-09-21T08:51:32.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.576+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c0125d80 con 0x7f23c006eda0 2024-09-21T08:51:32.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c012e620 con 0x7f23c006eda0 2024-09-21T08:51:32.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c095510 con 0x7fd79c09a100 2024-09-21T08:51:32.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.577+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c0961a0 con 0x7fd79c09a100 2024-09-21T08:51:32.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.578+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c0122670 con 0x7f23c006eda0 2024-09-21T08:51:32.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.578+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd79801a070 con 0x7fd79c09a100 2024-09-21T08:51:32.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.578+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79c096490 con 0x7fd79c09a100 2024-09-21T08:51:32.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7fd791ffb640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 0x7fd78003a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fd79804a4c0 con 0x7fd79c09a100 2024-09-21T08:51:32.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f23bc044070 con 0x7f23c006eda0 2024-09-21T08:51:32.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7fd7a09be640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 0x7fd78003a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7f23b67fc640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 0x7f23a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f23bc06bd20 con 0x7f23c006eda0 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.579+0000 7f23c5798640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 0x7f23a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.580+0000 7fd7a09be640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 0x7fd78003a7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd78c034000 tx=0x7fd78c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.580+0000 7f23c5798640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 0x7f23a403a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000f60 tx=0x7f23b0007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.583+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd79c096490 con 0x7fd79c09a100 2024-09-21T08:51:32.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.588+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f23bc03d3f0 con 0x7f23c006eda0 2024-09-21T08:51:32.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.697+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f29e01304f0 con 0x7f29e0098a20 2024-09-21T08:51:32.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.697+0000 7f29ceffd640 1 -- 172.21.15.29:0/166800323 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29d003c890 con 0x7f29e0098a20 2024-09-21T08:51:32.699 INFO:teuthology.orchestra.run.smithi029.stdout:42949672965 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 msgr2=0x7f29c003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 0x7f29c003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005880 tx=0x7f29d4001080 comp rx=0 tx=0).stop 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 msgr2=0x7f29e012d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29d0035040 tx=0x7f29d00046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 shutdown_connections 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f29c00382a0 0x7f29c003a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 --2- 172.21.15.29:0/166800323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e0098a20 0x7f29e012d660 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 >> 172.21.15.29:0/166800323 conn(0x7f29e009f020 msgr2=0x7f29e012a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 shutdown_connections 2024-09-21T08:51:32.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.699+0000 7f29e4d78640 1 -- 172.21.15.29:0/166800323 wait complete. 2024-09-21T08:51:32.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.2 2024-09-21T08:51:32.712 DEBUG:teuthology.parallel:result is None 2024-09-21T08:51:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.761+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd79c1260b0 con 0x7fd79c09a100 2024-09-21T08:51:32.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.761+0000 7fd791ffb640 1 -- 172.21.15.29:0/2949338099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd79c096490 con 0x7fd79c09a100 2024-09-21T08:51:32.762 INFO:teuthology.orchestra.run.smithi029.stdout:42949672966 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 msgr2=0x7fd78003a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 0x7fd78003a7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd78c034000 tx=0x7fd78c02e000 comp rx=0 tx=0).stop 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 msgr2=0x7fd79c1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c450 tx=0x7fd79800c910 comp rx=0 tx=0).stop 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 shutdown_connections 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7800382f0 0x7fd78003a7b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 --2- 172.21.15.29:0/2949338099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd79c09a100 0x7fd79c1c3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 >> 172.21.15.29:0/2949338099 conn(0x7fd79c06d4a0 msgr2=0x7fd79c096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 shutdown_connections 2024-09-21T08:51:32.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.763+0000 7fd7a3423640 1 -- 172.21.15.29:0/2949338099 wait complete. 2024-09-21T08:51:32.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.1 2024-09-21T08:51:32.775 DEBUG:teuthology.parallel:result is None 2024-09-21T08:51:32.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.789+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd4641ab240 con 0x7fd46409bd50 2024-09-21T08:51:32.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.790+0000 7fd460ff9640 1 -- 172.21.15.29:0/3710783030 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd454044360 con 0x7fd46409bd50 2024-09-21T08:51:32.791 INFO:teuthology.orchestra.run.smithi029.stdout:38654705669 2024-09-21T08:51:32.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 msgr2=0x7fd45003ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 0x7fd45003ab20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd46409cac0 tx=0x7fd458001150 comp rx=0 tx=0).stop 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 msgr2=0x7fd464094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd4540046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 shutdown_connections 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd450038660 0x7fd45003ab20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 --2- 172.21.15.29:0/3710783030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd46409bd50 0x7fd464094440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 >> 172.21.15.29:0/3710783030 conn(0x7fd46406d4a0 msgr2=0x7fd46409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 shutdown_connections 2024-09-21T08:51:32.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.792+0000 7fd46a2af640 1 -- 172.21.15.29:0/3710783030 wait complete. 2024-09-21T08:51:32.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-21T08:51:32.807 DEBUG:teuthology.parallel:result is None 2024-09-21T08:51:32.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.829+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f23c012e240 con 0x7f23c006eda0 2024-09-21T08:51:32.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.830+0000 7f23b67fc640 1 -- 172.21.15.29:0/1252067441 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23bc03ca80 con 0x7f23c006eda0 2024-09-21T08:51:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:42949672967 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.831+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 msgr2=0x7f23a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.831+0000 7f23c81fd640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 0x7f23a403a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000f60 tx=0x7f23b0007a30 comp rx=0 tx=0).stop 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.831+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 msgr2=0x7f23c0127be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.831+0000 7f23c81fd640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23bc035040 tx=0x7f23bc0046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 shutdown_connections 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a40382a0 0x7f23a403a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 --2- 172.21.15.29:0/1252067441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23c006eda0 0x7f23c0127be0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 >> 172.21.15.29:0/1252067441 conn(0x7f23c009a890 msgr2=0x7f23c0097bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 shutdown_connections 2024-09-21T08:51:32.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.832+0000 7f23c81fd640 1 -- 172.21.15.29:0/1252067441 wait complete. 2024-09-21T08:51:32.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672967 for osd.3 2024-09-21T08:51:32.843 DEBUG:teuthology.parallel:result is None 2024-09-21T08:51:32.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T08:51:32.844 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:51:32.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.986+0000 7fb9b9653640 1 Processor -- start 2024-09-21T08:51:32.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.986+0000 7fb9b9653640 1 -- start start 2024-09-21T08:51:32.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.986+0000 7fb9b9653640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9b406e080 0x7fb9b406e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.986+0000 7fb9b9653640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b406c740 con 0x7fb9b406e9a0 2024-09-21T08:51:32.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.986+0000 7fb9b9653640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b406fca0 con 0x7fb9b406e080 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9b406e080 0x7fb9b406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b27fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb9b406e9a0 0x7fb9b4132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53268/0 (socket says 172.21.15.29:53268) 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b27fc640 1 -- 172.21.15.29:0/1926833729 learned_addr learned my addr 172.21.15.29:0/1926833729 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b2ffd640 1 -- 172.21.15.29:0/1926833729 >> v1:172.21.15.29:6789/0 conn(0x7fb9b406e9a0 legacy=0x7fb9b4132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b1ffb640 1 -- 172.21.15.29:0/1926833729 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717620471 0 0) 0x7fb9b406c740 con 0x7fb9b406e9a0 2024-09-21T08:51:32.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.987+0000 7fb9b2ffd640 1 -- 172.21.15.29:0/1926833729 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b406bd80 con 0x7fb9b406e080 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b2ffd640 1 --2- 172.21.15.29:0/1926833729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b406e460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009720 tx=0x7fb9a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb275ca1de01ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b1ffb640 1 -- 172.21.15.29:0/1926833729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4037070 con 0x7fb9b406e080 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b1ffb640 1 -- 172.21.15.29:0/1926833729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a402ad90 con 0x7fb9b406e080 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b1ffb640 1 -- 172.21.15.29:0/1926833729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4032590 con 0x7fb9b406e080 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 -- 172.21.15.29:0/1926833729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 msgr2=0x7fb9b406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 --2- 172.21.15.29:0/1926833729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b406e460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009720 tx=0x7fb9a402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 -- 172.21.15.29:0/1926833729 shutdown_connections 2024-09-21T08:51:32.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 --2- 172.21.15.29:0/1926833729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b406e460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:32.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 -- 172.21.15.29:0/1926833729 >> 172.21.15.29:0/1926833729 conn(0x7fb9b409dd40 msgr2=0x7fb9b409e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:32.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 -- 172.21.15.29:0/1926833729 shutdown_connections 2024-09-21T08:51:32.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.988+0000 7fb9b9653640 1 -- 172.21.15.29:0/1926833729 wait complete. 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.989+0000 7fb9b9653640 1 Processor -- start 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.989+0000 7fb9b9653640 1 -- start start 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b9653640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b9653640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b406f130 con 0x7fb9b406e080 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43980/0 (socket says 172.21.15.29:43980) 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b2ffd640 1 -- 172.21.15.29:0/131531478 learned_addr learned my addr 172.21.15.29:0/131531478 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:32.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b2ffd640 1 -- 172.21.15.29:0/131531478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b4096e60 con 0x7fb9b406e080 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b2ffd640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4035040 tx=0x7fb9a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4037040 con 0x7fb9b406e080 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a4004160 con 0x7fb9b406e080 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b41a80d0 con 0x7fb9b406e080 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4004440 con 0x7fb9b406e080 2024-09-21T08:51:32.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.990+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b41a83e0 con 0x7fb9b406e080 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.991+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb9a4003610 con 0x7fb9b406e080 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.991+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b40731e0 con 0x7fb9b406e080 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.991+0000 7fb99b7fe640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 0x7fb9a003a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.992+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb9a406c420 con 0x7fb9b406e080 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.992+0000 7fb9b27fc640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 0x7fb9a003a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.992+0000 7fb9b27fc640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 0x7fb9a003a7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8000c00 tx=0x7fb9a8007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:32.996+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb9b40731e0 con 0x7fb9b406e080 2024-09-21T08:51:33.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.169+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9b40736a0 con 0x7fb9a00382f0 2024-09-21T08:51:33.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.170+0000 7fb99b7fe640 1 -- 172.21.15.29:0/131531478 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32191 (secure 0 0 0) 0x7fb9b40736a0 con 0x7fb9a00382f0 2024-09-21T08:51:33.172 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:33.172 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 msgr2=0x7fb9a003a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 0x7fb9a003a7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8000c00 tx=0x7fb9a8007910 comp rx=0 tx=0).stop 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 msgr2=0x7fb9b41bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4035040 tx=0x7fb9a40046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 shutdown_connections 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb9a00382f0 0x7fb9a003a7b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 --2- 172.21.15.29:0/131531478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b406e080 0x7fb9b41bff00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 >> 172.21.15.29:0/131531478 conn(0x7fb9b409dd40 msgr2=0x7fb9b4071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 shutdown_connections 2024-09-21T08:51:33.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.172+0000 7fb9b9653640 1 -- 172.21.15.29:0/131531478 wait complete. 2024-09-21T08:51:33.184 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T08:51:33.150708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118224,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369136,"statfs":{"total":386547056640,"available":386425995264,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.644291"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517728+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:51:28.517728+0000","last_peered":"2024-09-21T08:51:28.517728+0000","last_clean":"2024-09-21T08:51:28.517728+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:51:28.517728+0000","last_undegraded":"2024-09-21T08:51:28.517728+0000","last_fullsized":"2024-09-21T08:51:28.517728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.519786+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:51:28.519786+0000","last_peered":"2024-09-21T08:51:28.519786+0000","last_clean":"2024-09-21T08:51:28.519786+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:51:28.519786+0000","last_undegraded":"2024-09-21T08:51:28.519786+0000","last_fullsized":"2024-09-21T08:51:28.519786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517131+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:51:28.517131+0000","last_peered":"2024-09-21T08:51:28.517131+0000","last_clean":"2024-09-21T08:51:28.517131+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:51:28.517131+0000","last_undegraded":"2024-09-21T08:51:28.517131+0000","last_fullsized":"2024-09-21T08:51:28.517131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.519668+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:51:28.519668+0000","last_peered":"2024-09-21T08:51:28.519668+0000","last_clean":"2024-09-21T08:51:28.519668+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:51:28.519668+0000","last_undegraded":"2024-09-21T08:51:28.519668+0000","last_fullsized":"2024-09-21T08:51:28.519668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.518445+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:51:28.518445+0000","last_peered":"2024-09-21T08:51:28.518445+0000","last_clean":"2024-09-21T08:51:28.518445+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:51:28.518445+0000","last_undegraded":"2024-09-21T08:51:28.518445+0000","last_fullsized":"2024-09-21T08:51:28.518445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:29.224622+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:51:29.224622+0000","last_peered":"2024-09-21T08:51:29.224622+0000","last_clean":"2024-09-21T08:51:29.224622+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:51:29.224622+0000","last_undegraded":"2024-09-21T08:51:29.224622+0000","last_fullsized":"2024-09-21T08:51:29.224622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517190+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:51:28.517190+0000","last_peered":"2024-09-21T08:51:28.517190+0000","last_clean":"2024-09-21T08:51:28.517190+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:51:28.517190+0000","last_undegraded":"2024-09-21T08:51:28.517190+0000","last_fullsized":"2024-09-21T08:51:28.517190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517984+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:51:28.517984+0000","last_peered":"2024-09-21T08:51:28.517984+0000","last_clean":"2024-09-21T08:51:28.517984+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:51:28.517984+0000","last_undegraded":"2024-09-21T08:51:28.517984+0000","last_fullsized":"2024-09-21T08:51:28.517984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.514993+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:51:28.514993+0000","last_peered":"2024-09-21T08:51:28.514993+0000","last_clean":"2024-09-21T08:51:28.514993+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:51:28.514993+0000","last_undegraded":"2024-09-21T08:51:28.514993+0000","last_fullsized":"2024-09-21T08:51:28.514993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:51:33.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:51:33.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.284+0000 7f58324e6640 1 Processor -- start 2024-09-21T08:51:33.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.284+0000 7f58324e6640 1 -- start start 2024-09-21T08:51:33.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f58324e6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f582c096230 0x7f582c133e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f58324e6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582c09e100 con 0x7f582c095740 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f58324e6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f582c09a960 con 0x7f582c096230 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f582c096230 0x7f582c133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f582c095740 0x7f582c095b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53270/0 (socket says 172.21.15.29:53270) 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582bfff640 1 -- 172.21.15.29:0/4001564731 learned_addr learned my addr 172.21.15.29:0/4001564731 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582b7fe640 1 -- 172.21.15.29:0/4001564731 >> v1:172.21.15.29:6789/0 conn(0x7f582c095740 legacy=0x7f582c095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582affd640 1 -- 172.21.15.29:0/4001564731 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49994092 0 0) 0x7f582c09e100 con 0x7f582c095740 2024-09-21T08:51:33.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.285+0000 7f582b7fe640 1 -- 172.21.15.29:0/4001564731 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c097220 con 0x7f582c096230 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f582b7fe640 1 --2- 172.21.15.29:0/4001564731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c096230 0x7f582c133e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5820009720 tx=0x7f582002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6558dd2044d8fb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f582affd640 1 -- 172.21.15.29:0/4001564731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820037070 con 0x7f582c096230 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f582affd640 1 -- 172.21.15.29:0/4001564731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582002ae20 con 0x7f582c096230 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f582affd640 1 -- 172.21.15.29:0/4001564731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820032590 con 0x7f582c096230 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 -- 172.21.15.29:0/4001564731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c096230 msgr2=0x7f582c133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 --2- 172.21.15.29:0/4001564731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c096230 0x7f582c133e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5820009720 tx=0x7f582002a1a0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 -- 172.21.15.29:0/4001564731 shutdown_connections 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 --2- 172.21.15.29:0/4001564731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c096230 0x7f582c133e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 -- 172.21.15.29:0/4001564731 >> 172.21.15.29:0/4001564731 conn(0x7f582c09d860 msgr2=0x7f582c099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 -- 172.21.15.29:0/4001564731 shutdown_connections 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.286+0000 7f58324e6640 1 -- 172.21.15.29:0/4001564731 wait complete. 2024-09-21T08:51:33.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.287+0000 7f58324e6640 1 Processor -- start 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.287+0000 7f58324e6640 1 -- start start 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f58324e6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f58324e6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f582c096bd0 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f582bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f582bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44000/0 (socket says 172.21.15.29:44000) 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f582bfff640 1 -- 172.21.15.29:0/3927994941 learned_addr learned my addr 172.21.15.29:0/3927994941 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f582bfff640 1 -- 172.21.15.29:0/3927994941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c093520 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f582bfff640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c420 tx=0x7f581c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c018070 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c0074d0 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c004950 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.288+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582c06fe70 con 0x7f582c095740 2024-09-21T08:51:33.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.289+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582c06ded0 con 0x7f582c095740 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.289+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f581c01b070 con 0x7f582c095740 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.289+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582c093de0 con 0x7f582c095740 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.290+0000 7f5828ff9640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 0x7f581803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.290+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f581c04a5f0 con 0x7f582c095740 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.290+0000 7f582b7fe640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 0x7f581803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.290+0000 7f582b7fe640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 0x7f581803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5820034000 tx=0x7f582002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.294+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f581c011980 con 0x7f582c095740 2024-09-21T08:51:33.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.465+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f582c0975c0 con 0x7f58180382a0 2024-09-21T08:51:33.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.467+0000 7f5828ff9640 1 -- 172.21.15.29:0/3927994941 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32191 (secure 0 0 0) 0x7f5820032660 con 0x7f58180382a0 2024-09-21T08:51:33.468 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:33.468 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 msgr2=0x7f581803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 0x7f581803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5820034000 tx=0x7f582002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 msgr2=0x7f582c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c420 tx=0x7f581c00c8e0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 shutdown_connections 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f58180382a0 0x7f581803a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 --2- 172.21.15.29:0/3927994941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f582c095740 0x7f582c06d7b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.468+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 >> 172.21.15.29:0/3927994941 conn(0x7f582c09d860 msgr2=0x7f582c098270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.469+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 shutdown_connections 2024-09-21T08:51:33.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.469+0000 7f58324e6640 1 -- 172.21.15.29:0/3927994941 wait complete. 2024-09-21T08:51:33.480 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T08:51:33.150708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118224,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369136,"statfs":{"total":386547056640,"available":386425995264,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.644291"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517728+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:51:28.517728+0000","last_peered":"2024-09-21T08:51:28.517728+0000","last_clean":"2024-09-21T08:51:28.517728+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:51:28.517728+0000","last_undegraded":"2024-09-21T08:51:28.517728+0000","last_fullsized":"2024-09-21T08:51:28.517728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.519786+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:51:28.519786+0000","last_peered":"2024-09-21T08:51:28.519786+0000","last_clean":"2024-09-21T08:51:28.519786+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:51:28.519786+0000","last_undegraded":"2024-09-21T08:51:28.519786+0000","last_fullsized":"2024-09-21T08:51:28.519786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517131+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:51:28.517131+0000","last_peered":"2024-09-21T08:51:28.517131+0000","last_clean":"2024-09-21T08:51:28.517131+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:51:28.517131+0000","last_undegraded":"2024-09-21T08:51:28.517131+0000","last_fullsized":"2024-09-21T08:51:28.517131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.519668+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:51:28.519668+0000","last_peered":"2024-09-21T08:51:28.519668+0000","last_clean":"2024-09-21T08:51:28.519668+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:51:28.519668+0000","last_undegraded":"2024-09-21T08:51:28.519668+0000","last_fullsized":"2024-09-21T08:51:28.519668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.518445+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:51:28.518445+0000","last_peered":"2024-09-21T08:51:28.518445+0000","last_clean":"2024-09-21T08:51:28.518445+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:51:28.518445+0000","last_undegraded":"2024-09-21T08:51:28.518445+0000","last_fullsized":"2024-09-21T08:51:28.518445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:29.224622+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:51:29.224622+0000","last_peered":"2024-09-21T08:51:29.224622+0000","last_clean":"2024-09-21T08:51:29.224622+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:51:29.224622+0000","last_undegraded":"2024-09-21T08:51:29.224622+0000","last_fullsized":"2024-09-21T08:51:29.224622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517190+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:51:28.517190+0000","last_peered":"2024-09-21T08:51:28.517190+0000","last_clean":"2024-09-21T08:51:28.517190+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:51:28.517190+0000","last_undegraded":"2024-09-21T08:51:28.517190+0000","last_fullsized":"2024-09-21T08:51:28.517190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.517984+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:51:28.517984+0000","last_peered":"2024-09-21T08:51:28.517984+0000","last_clean":"2024-09-21T08:51:28.517984+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:51:28.517984+0000","last_undegraded":"2024-09-21T08:51:28.517984+0000","last_fullsized":"2024-09-21T08:51:28.517984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T08:51:28.514993+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:51:28.514993+0000","last_peered":"2024-09-21T08:51:28.514993+0000","last_clean":"2024-09-21T08:51:28.514993+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:51:28.514993+0000","last_undegraded":"2024-09-21T08:51:28.514993+0000","last_fullsized":"2024-09-21T08:51:28.514993+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:51:33.481 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T08:51:33.481 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T08:51:33.481 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T08:51:33.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T08:51:33.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.580+0000 7ff6cf647640 1 Processor -- start 2024-09-21T08:51:33.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.580+0000 7ff6cf647640 1 -- start start 2024-09-21T08:51:33.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cf647640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c812e8f0 0x7ff6c812ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cf647640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c8096ee0 con 0x7ff6c812f210 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cf647640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff6c809e090 con 0x7ff6c812e8f0 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cd3e3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c812e8f0 0x7ff6c812ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6ccbe2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff6c812f210 0x7ff6c812a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53286/0 (socket says 172.21.15.29:53286) 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6ccbe2640 1 -- 172.21.15.29:0/771652101 learned_addr learned my addr 172.21.15.29:0/771652101 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cd3e3640 1 -- 172.21.15.29:0/771652101 >> v1:172.21.15.29:6789/0 conn(0x7ff6c812f210 legacy=0x7ff6c812a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.581+0000 7ff6cd3e3640 1 -- 172.21.15.29:0/771652101 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c8074e50 con 0x7ff6c812e8f0 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.582+0000 7ff6cd3e3640 1 --2- 172.21.15.29:0/771652101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c812ecd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009720 tx=0x7ff6c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19feeceaf717694 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.582+0000 7ff6bffff640 1 -- 172.21.15.29:0/771652101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4037070 con 0x7ff6c812e8f0 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.582+0000 7ff6bffff640 1 -- 172.21.15.29:0/771652101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c402ad90 con 0x7ff6c812e8f0 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.582+0000 7ff6bffff640 1 -- 172.21.15.29:0/771652101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4032590 con 0x7ff6c812e8f0 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 -- 172.21.15.29:0/771652101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 msgr2=0x7ff6c812ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 --2- 172.21.15.29:0/771652101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c812ecd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009720 tx=0x7ff6c402a110 comp rx=0 tx=0).stop 2024-09-21T08:51:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 -- 172.21.15.29:0/771652101 shutdown_connections 2024-09-21T08:51:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 --2- 172.21.15.29:0/771652101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c812ecd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 -- 172.21.15.29:0/771652101 >> 172.21.15.29:0/771652101 conn(0x7ff6c809d860 msgr2=0x7ff6c8099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 -- 172.21.15.29:0/771652101 shutdown_connections 2024-09-21T08:51:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.583+0000 7ff6cf647640 1 -- 172.21.15.29:0/771652101 wait complete. 2024-09-21T08:51:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cf647640 1 Processor -- start 2024-09-21T08:51:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cf647640 1 -- start start 2024-09-21T08:51:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cf647640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cf647640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c8096ac0 con 0x7ff6c812e8f0 2024-09-21T08:51:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cd3e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cd3e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44022/0 (socket says 172.21.15.29:44022) 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cd3e3640 1 -- 172.21.15.29:0/138511602 learned_addr learned my addr 172.21.15.29:0/138511602 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.584+0000 7ff6cd3e3640 1 -- 172.21.15.29:0/138511602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c8070d70 con 0x7ff6c812e8f0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6cd3e3640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009840 tx=0x7ff6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4041070 con 0x7ff6c812e8f0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c403c460 con 0x7ff6c812e8f0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c8071540 con 0x7ff6c812e8f0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4037040 con 0x7ff6c812e8f0 2024-09-21T08:51:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.585+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c80733d0 con 0x7ff6c812e8f0 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.586+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6c4044070 con 0x7ff6c812e8f0 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.586+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c812e080 con 0x7ff6c812e8f0 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.586+0000 7ff6bdffb640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 0x7ff6ac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.586+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff6c406bae0 con 0x7ff6c812e8f0 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.586+0000 7ff6ccbe2640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 0x7ff6ac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.587+0000 7ff6ccbe2640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 0x7ff6ac03a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8007fd0 tx=0x7ff6b8007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.591+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff6c812e080 con 0x7ff6c812e8f0 2024-09-21T08:51:33.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.804+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6c80709b0 con 0x7ff6c812e8f0 2024-09-21T08:51:33.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.804+0000 7ff6bdffb640 1 -- 172.21.15.29:0/138511602 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff6c4044360 con 0x7ff6c812e8f0 2024-09-21T08:51:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:51:33.806 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 msgr2=0x7ff6ac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 0x7ff6ac03a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8007fd0 tx=0x7ff6b8007ac0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 msgr2=0x7ff6c806ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009840 tx=0x7ff6c40046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 shutdown_connections 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff6ac0382a0 0x7ff6ac03a760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 --2- 172.21.15.29:0/138511602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c812e8f0 0x7ff6c806ee60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 >> 172.21.15.29:0/138511602 conn(0x7ff6c809d860 msgr2=0x7ff6c8095de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 shutdown_connections 2024-09-21T08:51:33.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:51:33.806+0000 7ff6cf647640 1 -- 172.21.15.29:0/138511602 wait complete. 2024-09-21T08:51:33.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T08:51:33.819 INFO:teuthology.run_tasks:Running task rgw... 2024-09-21T08:51:33.832 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-21T08:51:33.833 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-21T08:51:33.833 INFO:tasks.rgw:Creating data pools 2024-09-21T08:51:33.833 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-21T08:51:33.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-21T08:51:33.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.942+0000 7fc6a9703640 1 Processor -- start 2024-09-21T08:51:33.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.942+0000 7fc6a9703640 1 -- start start 2024-09-21T08:51:33.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.942+0000 7fc6a9703640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6a410ed80 0x7fc6a410f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.942+0000 7fc6a9703640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a410fb50 con 0x7fc6a410f6a0 2024-09-21T08:51:33.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.942+0000 7fc6a9703640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a411c830 con 0x7fc6a410ed80 2024-09-21T08:51:33.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6a410ed80 0x7fc6a410f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6a410ed80 0x7fc6a410f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44570/0 (socket says 172.21.15.196:44570) 2024-09-21T08:51:33.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a2ffd640 1 -- 172.21.15.196:0/2791224726 learned_addr learned my addr 172.21.15.196:0/2791224726 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:33.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc69bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc6a410f6a0 0x7fc6a411a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46366/0 (socket says 172.21.15.196:46366) 2024-09-21T08:51:33.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a2ffd640 1 -- 172.21.15.196:0/2791224726 >> v1:172.21.15.29:6789/0 conn(0x7fc6a410f6a0 legacy=0x7fc6a411a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a2ffd640 1 -- 172.21.15.196:0/2791224726 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a411c9b0 con 0x7fc6a410ed80 2024-09-21T08:51:33.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.943+0000 7fc6a27fc640 1 -- 172.21.15.196:0/2791224726 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583133337 0 0) 0x7fc6a410fb50 con 0x7fc6a410f6a0 2024-09-21T08:51:33.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.944+0000 7fc6a2ffd640 1 --2- 172.21.15.196:0/2791224726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a410f160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097f0 tx=0x7fc69402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3051c7bdd0daabc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.944+0000 7fc6a27fc640 1 -- 172.21.15.196:0/2791224726 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc694037070 con 0x7fc6a410ed80 2024-09-21T08:51:33.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.944+0000 7fc6a27fc640 1 -- 172.21.15.196:0/2791224726 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc694032440 con 0x7fc6a410ed80 2024-09-21T08:51:33.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.944+0000 7fc6a27fc640 1 -- 172.21.15.196:0/2791224726 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc69402ae60 con 0x7fc6a410ed80 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 -- 172.21.15.196:0/2791224726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 msgr2=0x7fc6a410f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 --2- 172.21.15.196:0/2791224726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a410f160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097f0 tx=0x7fc69402a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 -- 172.21.15.196:0/2791224726 shutdown_connections 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 --2- 172.21.15.196:0/2791224726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a410f160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 -- 172.21.15.196:0/2791224726 >> 172.21.15.196:0/2791224726 conn(0x7fc6a406f300 msgr2=0x7fc6a4071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 -- 172.21.15.196:0/2791224726 shutdown_connections 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.945+0000 7fc6a9703640 1 -- 172.21.15.196:0/2791224726 wait complete. 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a9703640 1 Processor -- start 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a9703640 1 -- start start 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a9703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a9703640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a411bc70 con 0x7fc6a410ed80 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44576/0 (socket says 172.21.15.196:44576) 2024-09-21T08:51:33.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a2ffd640 1 -- 172.21.15.196:0/206834454 learned_addr learned my addr 172.21.15.196:0/206834454 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.946+0000 7fc6a2ffd640 1 -- 172.21.15.196:0/206834454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a41aa8f0 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc6a2ffd640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694035040 tx=0x7fc6940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc694041070 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69403c7a0 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a41aab80 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc694037040 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.947+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a41a4610 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc694044070 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a410f160 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc69b7fe640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 0x7fc68403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc69406be70 con 0x7fc6a410ed80 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc69bfff640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 0x7fc68403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:33.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.948+0000 7fc69bfff640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 0x7fc68403a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:33.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:33.953+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc69406ad00 con 0x7fc6a410ed80 2024-09-21T08:51:34.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:34.127+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fc6a41aad50 con 0x7fc6a410ed80 2024-09-21T08:51:35.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.097+0000 7fc69b7fe640 1 -- 172.21.15.196:0/206834454 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v20) ==== 151+0+0 (secure 0 0 0) 0x7fc69403a760 con 0x7fc6a410ed80 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 msgr2=0x7fc68403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 0x7fc68403a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc68c000c00 tx=0x7fc68c007930 comp rx=0 tx=0).stop 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 msgr2=0x7fc6a41aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694035040 tx=0x7fc6940046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 shutdown_connections 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc6840382a0 0x7fc68403a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 --2- 172.21.15.196:0/206834454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6a410ed80 0x7fc6a41aa320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 >> 172.21.15.196:0/206834454 conn(0x7fc6a406f300 msgr2=0x7fc6a4112940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:35.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 shutdown_connections 2024-09-21T08:51:35.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.100+0000 7fc6a9703640 1 -- 172.21.15.196:0/206834454 wait complete. 2024-09-21T08:51:35.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-21T08:51:35.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f3e77640 1 Processor -- start 2024-09-21T08:51:35.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f3e77640 1 -- start start 2024-09-21T08:51:35.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f3e77640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9ec118020 0x7ff9ec118400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:35.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f3e77640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec112940 con 0x7ff9ec111da0 2024-09-21T08:51:35.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f3e77640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec118ac0 con 0x7ff9ec118020 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f1c13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9ec118020 0x7ff9ec118400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f1c13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff9ec118020 0x7ff9ec118400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44588/0 (socket says 172.21.15.196:44588) 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f1c13640 1 -- 172.21.15.196:0/559071411 learned_addr learned my addr 172.21.15.196:0/559071411 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.219+0000 7ff9f1412640 1 --1- 172.21.15.196:0/559071411 >> v1:172.21.15.29:6789/0 conn(0x7ff9ec111da0 0x7ff9ec112230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46378/0 (socket says 172.21.15.196:46378) 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.220+0000 7ff9f1c13640 1 -- 172.21.15.196:0/559071411 >> v1:172.21.15.29:6789/0 conn(0x7ff9ec111da0 legacy=0x7ff9ec112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.220+0000 7ff9f1c13640 1 -- 172.21.15.196:0/559071411 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec112b10 con 0x7ff9ec118020 2024-09-21T08:51:35.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f1c13640 1 --2- 172.21.15.196:0/559071411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec118020 0x7ff9ec118400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80097f0 tx=0x7ff9e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f5fcb6cf88aab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f0c11640 1 -- 172.21.15.196:0/559071411 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e8037070 con 0x7ff9ec118020 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f0c11640 1 -- 172.21.15.196:0/559071411 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8032440 con 0x7ff9ec118020 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f0c11640 1 -- 172.21.15.196:0/559071411 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e802ae60 con 0x7ff9ec118020 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 -- 172.21.15.196:0/559071411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec118020 msgr2=0x7ff9ec118400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/559071411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec118020 0x7ff9ec118400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80097f0 tx=0x7ff9e802a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 -- 172.21.15.196:0/559071411 shutdown_connections 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/559071411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec118020 0x7ff9ec118400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 -- 172.21.15.196:0/559071411 >> 172.21.15.196:0/559071411 conn(0x7ff9ec06e680 msgr2=0x7ff9ec06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:35.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 -- 172.21.15.196:0/559071411 shutdown_connections 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.221+0000 7ff9f3e77640 1 -- 172.21.15.196:0/559071411 wait complete. 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.222+0000 7ff9f3e77640 1 Processor -- start 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.222+0000 7ff9f3e77640 1 -- start start 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.222+0000 7ff9f3e77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.222+0000 7ff9f3e77640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec11e1a0 con 0x7ff9ec111da0 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f1c13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f1c13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44596/0 (socket says 172.21.15.196:44596) 2024-09-21T08:51:35.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f1c13640 1 -- 172.21.15.196:0/2801622235 learned_addr learned my addr 172.21.15.196:0/2801622235 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:35.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f1c13640 1 -- 172.21.15.196:0/2801622235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec1a71e0 con 0x7ff9ec111da0 2024-09-21T08:51:35.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f1c13640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035040 tx=0x7ff9e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:35.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e8041070 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec1a74d0 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e803c7a0 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9e8037040 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.223+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec1ab4c0 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.224+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff9e8044070 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.224+0000 7ff9de7fc640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 0x7ff9d003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.224+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec1a7700 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.225+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3774+0+0 (secure 0 0 0) 0x7ff9e806c060 con 0x7ff9ec111da0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.225+0000 7ff9f1412640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 0x7ff9d003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:35.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.225+0000 7ff9f1412640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 0x7ff9d003a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00015f0 tx=0x7ff9e0007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:35.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.230+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff9e803a520 con 0x7ff9ec111da0 2024-09-21T08:51:35.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:35.395+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7ff9ec118020 con 0x7ff9ec111da0 2024-09-21T08:51:37.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.101+0000 7ff9de7fc640 1 -- 172.21.15.196:0/2801622235 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v22) ==== 227+0+0 (secure 0 0 0) 0x7ff9e803a780 con 0x7ff9ec111da0 2024-09-21T08:51:37.103 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'default.rgw.buckets.data' created 2024-09-21T08:51:37.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 msgr2=0x7ff9d003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 0x7ff9d003a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00015f0 tx=0x7ff9e0007a40 comp rx=0 tx=0).stop 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 msgr2=0x7ff9ec1a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035040 tx=0x7ff9e80046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 shutdown_connections 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff9d0038250 0x7ff9d003a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 --2- 172.21.15.196:0/2801622235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9ec111da0 0x7ff9ec1a6c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.105+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 >> 172.21.15.196:0/2801622235 conn(0x7ff9ec06e680 msgr2=0x7ff9ec119210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.106+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 shutdown_connections 2024-09-21T08:51:37.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.106+0000 7ff9f3e77640 1 -- 172.21.15.196:0/2801622235 wait complete. 2024-09-21T08:51:37.128 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-21T08:51:37.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.229+0000 7fd2b23a2640 1 Processor -- start 2024-09-21T08:51:37.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b23a2640 1 -- start start 2024-09-21T08:51:37.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b23a2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd2ac06deb0 0x7fd2ac11d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:37.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b23a2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac06f520 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b23a2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac11e760 con 0x7fd2ac06deb0 2024-09-21T08:51:37.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b0b9f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd2ac06deb0 0x7fd2ac11d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:37.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b13a0640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd2ac06d3c0 0x7fd2ac06d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46392/0 (socket says 172.21.15.196:46392) 2024-09-21T08:51:37.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b0b9f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd2ac06deb0 0x7fd2ac11d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44602/0 (socket says 172.21.15.196:44602) 2024-09-21T08:51:37.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.230+0000 7fd2b13a0640 1 -- 172.21.15.196:0/1680529535 learned_addr learned my addr 172.21.15.196:0/1680529535 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:37.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.231+0000 7fd2b0b9f640 1 -- 172.21.15.196:0/1680529535 >> v1:172.21.15.29:6789/0 conn(0x7fd2ac06d3c0 legacy=0x7fd2ac06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:37.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.231+0000 7fd2b0b9f640 1 -- 172.21.15.196:0/1680529535 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac11e8e0 con 0x7fd2ac06deb0 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.231+0000 7fd2b0b9f640 1 --2- 172.21.15.196:0/1680529535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06deb0 0x7fd2ac11d210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009720 tx=0x7fd2a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e44a777218c58cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd29ffff640 1 -- 172.21.15.196:0/1680529535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8037070 con 0x7fd2ac06deb0 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd29ffff640 1 -- 172.21.15.196:0/1680529535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a802ad90 con 0x7fd2ac06deb0 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd29ffff640 1 -- 172.21.15.196:0/1680529535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a8032590 con 0x7fd2ac06deb0 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 -- 172.21.15.196:0/1680529535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06deb0 msgr2=0x7fd2ac11d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/1680529535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06deb0 0x7fd2ac11d210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009720 tx=0x7fd2a802a110 comp rx=0 tx=0).stop 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 -- 172.21.15.196:0/1680529535 shutdown_connections 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/1680529535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06deb0 0x7fd2ac11d210 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 -- 172.21.15.196:0/1680529535 >> 172.21.15.196:0/1680529535 conn(0x7fd2ac071070 msgr2=0x7fd2ac073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:37.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 -- 172.21.15.196:0/1680529535 shutdown_connections 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.232+0000 7fd2b23a2640 1 -- 172.21.15.196:0/1680529535 wait complete. 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b23a2640 1 Processor -- start 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b23a2640 1 -- start start 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b23a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b23a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac11dc40 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b13a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b13a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44612/0 (socket says 172.21.15.196:44612) 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.233+0000 7fd2b13a0640 1 -- 172.21.15.196:0/4190806758 learned_addr learned my addr 172.21.15.196:0/4190806758 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd2b13a0640 1 -- 172.21.15.196:0/4190806758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac1a6f60 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd2b13a0640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c4a0 tx=0x7fd2a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0017070 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a0005c10 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a0007070 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac1a7250 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.234+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac1ab300 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.235+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd2a001a070 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.235+0000 7fd29dffb640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 0x7fd29003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.235+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac11e180 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.235+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4249+0+0 (secure 0 0 0) 0x7fd2a004a890 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.235+0000 7fd2b0b9f640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 0x7fd29003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:37.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.236+0000 7fd2b0b9f640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 0x7fd29003a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8034000 tx=0x7fd2a802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:37.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.241+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2a001b3b0 con 0x7fd2ac06d3c0 2024-09-21T08:51:37.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:37.407+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fd2ac1a7480 con 0x7fd2ac06d3c0 2024-09-21T08:51:38.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.107+0000 7fd29dffb640 1 -- 172.21.15.196:0/4190806758 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v23) ==== 185+0+0 (secure 0 0 0) 0x7fd2a0010c00 con 0x7fd2ac06d3c0 2024-09-21T08:51:38.109 INFO:teuthology.orchestra.run.smithi196.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.111+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 msgr2=0x7fd29003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.111+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 0x7fd29003a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8034000 tx=0x7fd2a802e000 comp rx=0 tx=0).stop 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.111+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 msgr2=0x7fd2ac1a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.111+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c4a0 tx=0x7fd2a000c960 comp rx=0 tx=0).stop 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.112+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 shutdown_connections 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.112+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd290038250 0x7fd29003a710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.112+0000 7fd2b23a2640 1 --2- 172.21.15.196:0/4190806758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2ac06d3c0 0x7fd2ac1a6a20 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c4a0 tx=0x7fd2a000c960 comp rx=0 tx=0).stop 2024-09-21T08:51:38.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.112+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 >> 172.21.15.196:0/4190806758 conn(0x7fd2ac071070 msgr2=0x7fd2ac11a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:38.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.118+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 shutdown_connections 2024-09-21T08:51:38.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.118+0000 7fd2b23a2640 1 -- 172.21.15.196:0/4190806758 wait complete. 2024-09-21T08:51:38.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-21T08:51:38.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff0a278d640 1 Processor -- start 2024-09-21T08:51:38.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff0a278d640 1 -- start start 2024-09-21T08:51:38.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff0a278d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff09c117a50 0x7ff09c119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:38.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff0a278d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c11a380 con 0x7ff09c114c40 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff0a278d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c11b560 con 0x7ff09c117a50 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.249+0000 7ff09b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff09c117a50 0x7ff09c119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.250+0000 7ff09b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff09c117a50 0x7ff09c119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44614/0 (socket says 172.21.15.196:44614) 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.250+0000 7ff09b7fe640 1 -- 172.21.15.196:0/4222071659 learned_addr learned my addr 172.21.15.196:0/4222071659 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.250+0000 7ff09b7fe640 1 -- 172.21.15.196:0/4222071659 >> v1:172.21.15.29:6789/0 conn(0x7ff09c114c40 legacy=0x7ff09c115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:38.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.250+0000 7ff09b7fe640 1 -- 172.21.15.196:0/4222071659 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c11b6e0 con 0x7ff09c117a50 2024-09-21T08:51:38.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff09b7fe640 1 --2- 172.21.15.196:0/4222071659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c117a50 0x7ff09c119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097f0 tx=0x7ff09002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a835b3a91a782395 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:38.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff09affd640 1 -- 172.21.15.196:0/4222071659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff090037070 con 0x7ff09c117a50 2024-09-21T08:51:38.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff09affd640 1 -- 172.21.15.196:0/4222071659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090032440 con 0x7ff09c117a50 2024-09-21T08:51:38.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff09affd640 1 -- 172.21.15.196:0/4222071659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff09002ae60 con 0x7ff09c117a50 2024-09-21T08:51:38.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 -- 172.21.15.196:0/4222071659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c117a50 msgr2=0x7ff09c119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 --2- 172.21.15.196:0/4222071659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c117a50 0x7ff09c119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097f0 tx=0x7ff09002a1e0 comp rx=0 tx=0).stop 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 -- 172.21.15.196:0/4222071659 shutdown_connections 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 --2- 172.21.15.196:0/4222071659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c117a50 0x7ff09c119e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 -- 172.21.15.196:0/4222071659 >> 172.21.15.196:0/4222071659 conn(0x7ff09c06f300 msgr2=0x7ff09c071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 -- 172.21.15.196:0/4222071659 shutdown_connections 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.251+0000 7ff0a278d640 1 -- 172.21.15.196:0/4222071659 wait complete. 2024-09-21T08:51:38.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.252+0000 7ff0a278d640 1 Processor -- start 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.252+0000 7ff0a278d640 1 -- start start 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.252+0000 7ff0a278d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.252+0000 7ff0a278d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c11aa70 con 0x7ff09c114c40 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff09bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff09bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44630/0 (socket says 172.21.15.196:44630) 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff09bfff640 1 -- 172.21.15.196:0/1697747359 learned_addr learned my addr 172.21.15.196:0/1697747359 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff09bfff640 1 -- 172.21.15.196:0/1697747359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c10fc90 con 0x7ff09c114c40 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff09bfff640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c380 tx=0x7ff08c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c005200 con 0x7ff09c114c40 2024-09-21T08:51:38.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c0053c0 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1a3970 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08c007190 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.253+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c1a3ec0 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.254+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c11afb0 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.254+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff08c007400 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.254+0000 7ff098ff9640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 0x7ff08803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.254+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4260+0+0 (secure 0 0 0) 0x7ff08c04ab30 con 0x7ff09c114c40 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.255+0000 7ff09b7fe640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 0x7ff08803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:38.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.255+0000 7ff09b7fe640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 0x7ff08803a710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff090034000 tx=0x7ff09002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:38.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.259+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff08c012c30 con 0x7ff09c114c40 2024-09-21T08:51:38.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:38.426+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff09c1a4200 con 0x7ff09c114c40 2024-09-21T08:51:39.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.112+0000 7ff098ff9640 1 -- 172.21.15.196:0/1697747359 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v24) ==== 169+0+0 (secure 0 0 0) 0x7ff08c0035f0 con 0x7ff09c114c40 2024-09-21T08:51:39.113 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'default.rgw.buckets.index' created 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.115+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 msgr2=0x7ff08803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.115+0000 7ff0a278d640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 0x7ff08803a710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff090034000 tx=0x7ff09002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.115+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 msgr2=0x7ff09c1a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.115+0000 7ff0a278d640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c380 tx=0x7ff08c00c840 comp rx=0 tx=0).stop 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 shutdown_connections 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff088038250 0x7ff08803a710 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff090034000 tx=0x7ff09002e000 comp rx=0 tx=0).stop 2024-09-21T08:51:39.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 --2- 172.21.15.196:0/1697747359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09c114c40 0x7ff09c1a3430 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c380 tx=0x7ff08c00c840 comp rx=0 tx=0).stop 2024-09-21T08:51:39.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 >> 172.21.15.196:0/1697747359 conn(0x7ff09c06f300 msgr2=0x7ff09c117e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:39.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 shutdown_connections 2024-09-21T08:51:39.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.116+0000 7ff0a278d640 1 -- 172.21.15.196:0/1697747359 wait complete. 2024-09-21T08:51:39.135 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-21T08:51:39.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea151fd640 1 Processor -- start 2024-09-21T08:51:39.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea151fd640 1 -- start start 2024-09-21T08:51:39.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea151fd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea1010ed80 0x7fea1010f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:39.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea151fd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1010fb50 con 0x7fea1010f6a0 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea151fd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fea1011c830 con 0x7fea1010ed80 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.236+0000 7fea0ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea1010ed80 0x7fea1010f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.237+0000 7fea0659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fea1010f6a0 0x7fea1011a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46408/0 (socket says 172.21.15.196:46408) 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.237+0000 7fea0659c640 1 -- 172.21.15.196:0/544157982 learned_addr learned my addr 172.21.15.196:0/544157982 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.237+0000 7fea0ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea1010ed80 0x7fea1010f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44644/0 (socket says 172.21.15.196:44644) 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.237+0000 7fea0ed9d640 1 -- 172.21.15.196:0/544157982 >> v1:172.21.15.29:6789/0 conn(0x7fea1010f6a0 legacy=0x7fea1011a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:39.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.237+0000 7fea0ed9d640 1 -- 172.21.15.196:0/544157982 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1011c9b0 con 0x7fea1010ed80 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea0ed9d640 1 --2- 172.21.15.196:0/544157982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea1010f160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea00009720 tx=0x7fea0002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7099654b0eac16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea0e59c640 1 -- 172.21.15.196:0/544157982 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00037070 con 0x7fea1010ed80 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea0e59c640 1 -- 172.21.15.196:0/544157982 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0002ad90 con 0x7fea1010ed80 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea0e59c640 1 -- 172.21.15.196:0/544157982 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00032590 con 0x7fea1010ed80 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 -- 172.21.15.196:0/544157982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 msgr2=0x7fea1010f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 --2- 172.21.15.196:0/544157982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea1010f160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea00009720 tx=0x7fea0002a110 comp rx=0 tx=0).stop 2024-09-21T08:51:39.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 -- 172.21.15.196:0/544157982 shutdown_connections 2024-09-21T08:51:39.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 --2- 172.21.15.196:0/544157982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea1010f160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:39.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 -- 172.21.15.196:0/544157982 >> 172.21.15.196:0/544157982 conn(0x7fea1006f300 msgr2=0x7fea10071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:39.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 -- 172.21.15.196:0/544157982 shutdown_connections 2024-09-21T08:51:39.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.238+0000 7fea151fd640 1 -- 172.21.15.196:0/544157982 wait complete. 2024-09-21T08:51:39.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.239+0000 7fea151fd640 1 Processor -- start 2024-09-21T08:51:39.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.239+0000 7fea151fd640 1 -- start start 2024-09-21T08:51:39.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea151fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:39.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea151fd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea1011bc70 con 0x7fea1010ed80 2024-09-21T08:51:39.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea0ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea0ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:44660/0 (socket says 172.21.15.196:44660) 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea0ed9d640 1 -- 172.21.15.196:0/402909154 learned_addr learned my addr 172.21.15.196:0/402909154 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea0ed9d640 1 -- 172.21.15.196:0/402909154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea101a4f60 con 0x7fea1010ed80 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea0ed9d640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea00009720 tx=0x7fea000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.240+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00041070 con 0x7fea1010ed80 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.241+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0003c590 con 0x7fea1010ed80 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.241+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00037040 con 0x7fea1010ed80 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.241+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea101a5250 con 0x7fea1010ed80 2024-09-21T08:51:39.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.241+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea101a92a0 con 0x7fea1010ed80 2024-09-21T08:51:39.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.241+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1010f160 con 0x7fea1010ed80 2024-09-21T08:51:39.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.242+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea00044070 con 0x7fea1010ed80 2024-09-21T08:51:39.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.242+0000 7fea07fff640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 0x7fe9f003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:39.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.242+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4624+0+0 (secure 0 0 0) 0x7fea0006c120 con 0x7fea1010ed80 2024-09-21T08:51:39.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.242+0000 7fea0659c640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 0x7fe9f003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:39.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.242+0000 7fea0659c640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 0x7fe9f003a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8000f60 tx=0x7fe9f8007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:39.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.247+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fea0003a520 con 0x7fea1010ed80 2024-09-21T08:51:39.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:39.415+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fea1010f6a0 con 0x7fea1010ed80 2024-09-21T08:51:40.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.115+0000 7fea07fff640 1 -- 172.21.15.196:0/402909154 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v25) ==== 187+0+0 (secure 0 0 0) 0x7fea0003a780 con 0x7fea1010ed80 2024-09-21T08:51:40.118 INFO:teuthology.orchestra.run.smithi196.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-21T08:51:40.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 msgr2=0x7fe9f003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:40.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 0x7fe9f003a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8000f60 tx=0x7fe9f8007a80 comp rx=0 tx=0).stop 2024-09-21T08:51:40.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 msgr2=0x7fea101a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:40.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea00009720 tx=0x7fea000046c0 comp rx=0 tx=0).stop 2024-09-21T08:51:40.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 shutdown_connections 2024-09-21T08:51:40.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe9f00382a0 0x7fe9f003a760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:40.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 --2- 172.21.15.196:0/402909154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea1010ed80 0x7fea101a4990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:40.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.118+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 >> 172.21.15.196:0/402909154 conn(0x7fea1006f300 msgr2=0x7fea101186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:40.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.119+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 shutdown_connections 2024-09-21T08:51:40.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:40.122+0000 7fea151fd640 1 -- 172.21.15.196:0/402909154 wait complete. 2024-09-21T08:51:40.151 DEBUG:tasks.rgw:Pools created 2024-09-21T08:51:40.151 INFO:tasks.rgw:Starting rgw... 2024-09-21T08:51:40.152 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-21T08:51:40.152 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-21T08:51:40.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo echo -n http://smithi196.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-21T08:51:40.180 INFO:teuthology.orchestra.run.smithi196.stdout:http://smithi196.front.sepia.ceph.com:80 2024-09-21T08:51:40.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-21T08:51:40.246 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-21T08:51:40.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-21T08:51:40.288 INFO:tasks.rgw.client.0:Started 2024-09-21T08:51:40.288 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:40.289 DEBUG:teuthology.orchestra.run.smithi196:> curl http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:40.319 INFO:teuthology.orchestra.run.smithi196.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T08:51:40.319 INFO:teuthology.orchestra.run.smithi196.stderr: Dload Upload Total Spent Left Speed 2024-09-21T08:51:40.319 INFO:teuthology.orchestra.run.smithi196.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T08:51:40.320 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T08:51:40.320 INFO:teuthology.orchestra.run.smithi196.stderr:curl: (7) Failed to connect to smithi196.front.sepia.ceph.com port 80: Connection refused 2024-09-21T08:51:41.321 DEBUG:teuthology.orchestra.run.smithi196:> curl http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:41.344 INFO:teuthology.orchestra.run.smithi196.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T08:51:41.344 INFO:teuthology.orchestra.run.smithi196.stderr: Dload Upload Total Spent Left Speed 2024-09-21T08:51:41.344 INFO:teuthology.orchestra.run.smithi196.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T08:51:41.345 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T08:51:41.346 INFO:teuthology.orchestra.run.smithi196.stderr:curl: (7) Failed to connect to smithi196.front.sepia.ceph.com port 80: Connection refused 2024-09-21T08:51:43.346 DEBUG:teuthology.orchestra.run.smithi196:> curl http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:43.370 INFO:teuthology.orchestra.run.smithi196.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T08:51:43.370 INFO:teuthology.orchestra.run.smithi196.stderr: Dload Upload Total Spent Left Speed 2024-09-21T08:51:43.370 INFO:teuthology.orchestra.run.smithi196.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T08:51:43.371 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T08:51:43.372 INFO:teuthology.orchestra.run.smithi196.stderr:curl: (7) Failed to connect to smithi196.front.sepia.ceph.com port 80: Connection refused 2024-09-21T08:51:47.373 DEBUG:teuthology.orchestra.run.smithi196:> curl http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:47.397 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T08:51:47.397 INFO:teuthology.orchestra.run.smithi196.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T08:51:47.397 INFO:teuthology.orchestra.run.smithi196.stderr: Dload Upload Total Spent Left Speed 2024-09-21T08:51:47.397 INFO:teuthology.orchestra.run.smithi196.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T08:51:47.397 INFO:teuthology.orchestra.run.smithi196.stderr:curl: (7) Failed to connect to smithi196.front.sepia.ceph.com port 80: Connection refused 2024-09-21T08:51:49.325 INFO:tasks.rgw.client.0.smithi196.stdout:2024-09-21T08:51:49.324+0000 7f93ad62f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-21T08:51:55.398 DEBUG:teuthology.orchestra.run.smithi196:> curl http://smithi196.front.sepia.ceph.com:80/ 2024-09-21T08:51:55.421 INFO:teuthology.orchestra.run.smithi196.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T08:51:55.421 INFO:teuthology.orchestra.run.smithi196.stderr: Dload Upload Total Spent Left Speed 2024-09-21T08:51:55.423 INFO:teuthology.orchestra.run.smithi196.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-21T08:51:55.424 INFO:teuthology.orchestra.run.smithi196.stdout:anonymous 2024-09-21T08:51:55.424 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-21T08:51:55.498 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-21T08:51:55.498 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-21T08:51:55.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-21T08:51:55.498 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-21T08:51:55.548 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:55.548 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:55.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.546+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.546+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.546+0000 7f4bc5124800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fe0449bee0 0x55fe0449e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.546+0000 7f4bc5124800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe04354b30 con 0x55fe04493a40 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.546+0000 7f4bc5124800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55fe04336360 con 0x55fe0449bee0 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0615640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fe0449bee0 0x55fe0449e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0615640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fe0449bee0 0x55fe0449e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33408/0 (socket says 172.21.15.196:33408) 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0615640 1 -- 172.21.15.196:0/1357954000 learned_addr learned my addr 172.21.15.196:0/1357954000 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0e16640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55fe04493a40 0x55fe04493e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46718/0 (socket says 172.21.15.196:46718) 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0615640 1 -- 172.21.15.196:0/1357954000 >> v1:172.21.15.29:6789/0 conn(0x55fe04493a40 legacy=0x55fe04493e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.547+0000 7f4bc0615640 1 -- 172.21.15.196:0/1357954000 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0435ce00 con 0x55fe0449bee0 2024-09-21T08:51:55.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.549+0000 7f4bc0615640 1 --2- 172.21.15.196:0/1357954000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0449e2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400a520 tx=0x7f4bb4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a453e7d6727197 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.549+0000 7f4bbfe14640 1 -- 172.21.15.196:0/1357954000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb4055070 con 0x55fe0449bee0 2024-09-21T08:51:55.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.549+0000 7f4bbfe14640 1 -- 172.21.15.196:0/1357954000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb40515b0 con 0x55fe0449bee0 2024-09-21T08:51:55.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.549+0000 7f4bbfe14640 1 -- 172.21.15.196:0/1357954000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb40518d0 con 0x55fe0449bee0 2024-09-21T08:51:55.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 -- 172.21.15.196:0/1357954000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 msgr2=0x55fe0449e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 --2- 172.21.15.196:0/1357954000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0449e2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400a520 tx=0x7f4bb4045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 -- 172.21.15.196:0/1357954000 shutdown_connections 2024-09-21T08:51:55.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 --2- 172.21.15.196:0/1357954000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0449e2d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 -- 172.21.15.196:0/1357954000 >> 172.21.15.196:0/1357954000 conn(0x55fe0448f5b0 msgr2=0x55fe044919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 -- 172.21.15.196:0/1357954000 shutdown_connections 2024-09-21T08:51:55.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.550+0000 7f4bc5124800 1 -- 172.21.15.196:0/1357954000 wait complete. 2024-09-21T08:51:55.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.565+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.565+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.565+0000 7f4bc5124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.565+0000 7f4bc5124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fe043e1320 con 0x55fe04493a40 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.566+0000 7f4bc0e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.566+0000 7f4bc0e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33418/0 (socket says 172.21.15.196:33418) 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.566+0000 7f4bc0e16640 1 -- 172.21.15.196:0/3188280071 learned_addr learned my addr 172.21.15.196:0/3188280071 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.566+0000 7f4bc0e16640 1 -- 172.21.15.196:0/3188280071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0432ebc0 con 0x55fe04493a40 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.566+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/3188280071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b230 tx=0x7f4bb000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4ce638340b3b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4aaee0d640 1 -- 172.21.15.196:0/3188280071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb000e5c0 con 0x55fe04493a40 2024-09-21T08:51:55.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4aaee0d640 1 -- 172.21.15.196:0/3188280071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0006070 con 0x55fe04493a40 2024-09-21T08:51:55.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4aaee0d640 1 -- 172.21.15.196:0/3188280071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb000e890 con 0x55fe04493a40 2024-09-21T08:51:55.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4bc5124800 1 -- 172.21.15.196:0/3188280071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 msgr2=0x55fe04586a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3188280071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b230 tx=0x7f4bb000b6f0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4bc5124800 1 -- 172.21.15.196:0/3188280071 shutdown_connections 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3188280071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe04493a40 0x55fe04586a50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.567+0000 7f4bc5124800 1 -- 172.21.15.196:0/3188280071 >> 172.21.15.196:0/3188280071 conn(0x55fe0448f5b0 msgr2=0x55fe04582410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 -- 172.21.15.196:0/3188280071 shutdown_connections 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 -- 172.21.15.196:0/3188280071 wait complete. 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc5124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fe0449ea20 con 0x55fe0449bee0 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc0e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc0e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33430/0 (socket says 172.21.15.196:33430) 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.568+0000 7f4bc0e16640 1 -- 172.21.15.196:0/442968459 learned_addr learned my addr 172.21.15.196:0/442968459 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4bc0e16640 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe04342fe0 con 0x55fe0449bee0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000fd0 tx=0x7f4bb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4aad60a640 1 -- 172.21.15.196:0/442968459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb001a7c0 con 0x55fe0449bee0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4aad60a640 1 -- 172.21.15.196:0/442968459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb001a960 con 0x55fe0449bee0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe0458ebd0 con 0x55fe0449bee0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4aad60a640 1 -- 172.21.15.196:0/442968459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb001ac80 con 0x55fe0449bee0 2024-09-21T08:51:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.569+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0458f0f0 con 0x55fe0449bee0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.570+0000 7f4aad60a640 1 -- 172.21.15.196:0/442968459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bb0017070 con 0x55fe0449bee0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.570+0000 7f4aad60a640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 0x7f4aa8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.570+0000 7f4aad60a640 1 -- 172.21.15.196:0/442968459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bb0015020 con 0x55fe0449bee0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.570+0000 7f4bc0615640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 0x7f4aa8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 0x55fe04595ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe04596020 con 0x55fe045936f0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc1617640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 0x55fe04595ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc0615640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 0x7f4aa8039050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4057000 tx=0x7f4bb4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc1617640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 0x55fe04595ae0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc1617640 1 -- 172.21.15.196:0/442968459 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb800a4a0 con 0x55fe045936f0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.571+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe04592cd0 con 0x55fe045936f0 2024-09-21T08:51:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.572+0000 7f4bc1617640 1 -- 172.21.15.196:0/442968459 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bb800a4a0 con 0x55fe045936f0 2024-09-21T08:51:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.572+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 0x55fe0459a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.572+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe0459ade0 con 0x55fe04598350 2024-09-21T08:51:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.572+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 0x55fe0459a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.572+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 0x55fe0459a740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.573+0000 7f4bc0e16640 1 -- 172.21.15.196:0/442968459 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe04598350 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.573+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045971f0 con 0x55fe045936f0 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.573+0000 7f4bc1617640 1 -- 172.21.15.196:0/442968459 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bb800a4a0 con 0x55fe045936f0 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.573+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe04597690 con 0x55fe045936f0 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.573+0000 7f4bc1617640 1 -- 172.21.15.196:0/442968459 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bb800a4a0 con 0x55fe045936f0 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc5124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc5124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fe04330580 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33434/0 (socket says 172.21.15.196:33434) 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.574+0000 7f4bc1617640 1 -- 172.21.15.196:0/3497991332 learned_addr learned my addr 172.21.15.196:0/3497991332 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4bc1617640 1 -- 172.21.15.196:0/3497991332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe045aa0d0 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4bc1617640 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fe0458f740 tx=0x7f4bb80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4aa67fc640 1 -- 172.21.15.196:0/3497991332 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8014450 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4aa67fc640 1 -- 172.21.15.196:0/3497991332 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb80145f0 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe045aa360 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4aa67fc640 1 -- 172.21.15.196:0/3497991332 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb80148d0 con 0x55fe045a9770 2024-09-21T08:51:55.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.575+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe045ad040 con 0x55fe045a9770 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4aa67fc640 1 -- 172.21.15.196:0/3497991332 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bb8011040 con 0x55fe045a9770 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4aa67fc640 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 0x7f4a98039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4aa67fc640 1 -- 172.21.15.196:0/3497991332 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bb801e070 con 0x55fe045a9770 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 0x7f4a98039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.576+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 0x7f4a98039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55fe04596470 tx=0x7f4bb004b4c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc5124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc5124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fe04587200 con 0x55fe045b63f0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33450/0 (socket says 172.21.15.196:33450) 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc1617640 1 -- 172.21.15.196:0/2495496672 learned_addr learned my addr 172.21.15.196:0/2495496672 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc1617640 1 -- 172.21.15.196:0/2495496672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe045b6dc0 con 0x55fe045b63f0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.577+0000 7f4bc1617640 1 --2- 172.21.15.196:0/2495496672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4bb804cbb0 tx=0x7f4bb8011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364db3f1758b534f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4a97fff640 1 -- 172.21.15.196:0/2495496672 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8013dc0 con 0x55fe045b63f0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4a97fff640 1 -- 172.21.15.196:0/2495496672 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8014a70 con 0x55fe045b63f0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4a97fff640 1 -- 172.21.15.196:0/2495496672 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8014d50 con 0x55fe045b63f0 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- 172.21.15.196:0/2495496672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 msgr2=0x55fe045b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 --2- 172.21.15.196:0/2495496672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4bb804cbb0 tx=0x7f4bb8011970 comp rx=0 tx=0).stop 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- 172.21.15.196:0/2495496672 shutdown_connections 2024-09-21T08:51:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 --2- 172.21.15.196:0/2495496672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045b67f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- 172.21.15.196:0/2495496672 >> 172.21.15.196:0/2495496672 conn(0x55fe045b2750 msgr2=0x55fe045b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- 172.21.15.196:0/2495496672 shutdown_connections 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- 172.21.15.196:0/2495496672 wait complete. 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 Processor -- start 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.578+0000 7f4bc5124800 1 -- start start 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc5124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc5124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fe045b7430 con 0x55fe045b63f0 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc1617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33454/0 (socket says 172.21.15.196:33454) 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 learned_addr learned my addr 172.21.15.196:0/654378303 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe045bdda0 con 0x55fe045b63f0 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4bc1617640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8011be0 tx=0x7f4bb804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.579+0000 7f4a967fc640 1 -- 172.21.15.196:0/654378303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8044030 con 0x55fe045b63f0 2024-09-21T08:51:55.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.580+0000 7f4a967fc640 1 -- 172.21.15.196:0/654378303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8022a80 con 0x55fe045b63f0 2024-09-21T08:51:55.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.580+0000 7f4a967fc640 1 -- 172.21.15.196:0/654378303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8016440 con 0x55fe045b63f0 2024-09-21T08:51:55.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.580+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe045be030 con 0x55fe045b63f0 2024-09-21T08:51:55.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.580+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe045c0ce0 con 0x55fe045b63f0 2024-09-21T08:51:55.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4a967fc640 1 -- 172.21.15.196:0/654378303 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bb802b350 con 0x55fe045b63f0 2024-09-21T08:51:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4a967fc640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a8c036b40 0x7f4a8c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4a967fc640 1 -- 172.21.15.196:0/654378303 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bb8045070 con 0x55fe045b63f0 2024-09-21T08:51:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a8c036b40 0x7f4a8c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045c9550 0x55fe045cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045cc160 con 0x55fe045c9550 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.581+0000 7f4bc0615640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045c9550 0x55fe045cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a8c036b40 0x7f4a8c039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000bc40 tx=0x7f4bb0031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc0615640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045c9550 0x55fe045cba10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 20 realm 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045cc590 con 0x55fe045c9550 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.582+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045cce60 con 0x55fe045c9550 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045cd200 con 0x55fe045c9550 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe045cdf60 0x55fe045d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d0890 con 0x55fe045cdf60 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.583+0000 7f4bc1617640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe045cdf60 0x55fe045d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc1617640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe045cdf60 0x55fe045d0350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc5124800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc5124800 20 searching for the correct realm 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fe045d28d0 0x55fe045d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.584+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fe045d28d0 0x55fe045d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fe045d28d0 0x55fe045d4d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0e16640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4bb003d050 0x7f4bb001c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0615640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4bb003d050 0x7f4bb001c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.585+0000 7f4bc0615640 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4bb003d050 0x7f4bb001c450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.586+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.586+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.586+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.586+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.586+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.587+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.588+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.589+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.590+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.591+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.592+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.593+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045d28d0 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045cdf60 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x55fe045c9550 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.594+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d5460 con 0x7f4bb003d050 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:55.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d12d0 con 0x55fe045c9550 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.595+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1bf0 con 0x55fe045c9550 2024-09-21T08:51:55.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 zone default found 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 4 Realm: () 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 zonegroup default 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d58e0 con 0x55fe045cdf60 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d0f10 con 0x55fe045d28d0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.596+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d7c90 con 0x55fe045d28d0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 20 started sync module instance, tier type = 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.597+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d6fa0 con 0x7f4bb003d050 2024-09-21T08:51:55.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.598+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.598+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94549483287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d6fa0 con 0x7f4bb003d050 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.598+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d87a0 con 0x55fe045c9550 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.599+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94549483287744] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.599+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.599+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94549483291280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d6fa0 con 0x55fe045c9550 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.599+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d9250 con 0x55fe045d28d0 2024-09-21T08:51:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.601+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.601+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94549483294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d9af0 con 0x55fe045d28d0 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.601+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045da570 con 0x7f4bb003d050 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.601+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94549483291280] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.603+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94549483294000] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.603+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.604+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94549483296320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d6af0 con 0x7f4bb003d050 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.604+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dae40 con 0x55fe045c9550 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.605+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94549483296320] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.605+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.605+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94549483298912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dadd0 con 0x55fe045c9550 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.605+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.606+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.606+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94549483303888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dc0d0 con 0x55fe045cdf60 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.606+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dcb70 con 0x55fe045cdf60 2024-09-21T08:51:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.606+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94549483298912] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.607+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94549483303888] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.607+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.607+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94549483308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dbc80 con 0x55fe045cdf60 2024-09-21T08:51:55.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.607+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dbc80 con 0x55fe045cdf60 2024-09-21T08:51:55.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94549483308608] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94549483301152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dd200 con 0x55fe045cdf60 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=0 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=1 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=2 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=3 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=4 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=5 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.609+0000 7f4bc5124800 20 add_watcher() i=6 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.610+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94549483301152] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.610+0000 7f4bc5124800 20 add_watcher() i=7 2024-09-21T08:51:55.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.610+0000 7f4bc5124800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.610+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe045e0410 con 0x55fe045c9550 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.611+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.611+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94549483310416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045dd620 con 0x55fe045c9550 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94549483310416] v34'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4a777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc5124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc5124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc5124800 5 note: GC not initialized 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4a767e4640 20 reqs_thread_entry: start 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc5124800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.612+0000 7f4bc5124800 20 Filter name: none 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4a6f7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:55.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe04612ea0 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe04612ea0 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.613+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe04612ea0 con 0x55fe045c9550 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x7f4bb003d050 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.614+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045d28d0 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x7f4bb003d050 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045d28d0 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(72 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.615+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045cdf60 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045d28d0 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.616+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045d28d0 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.617+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x7f4bb003d050 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(80 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045d28d0 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x7f4bb003d050 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.618+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(86 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.619+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045d28d0 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x7f4bb003d050 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045cdf60 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045c9550 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.620+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x55fe045d28d0 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.621+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.621+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fe045db880 con 0x7f4bb003d050 2024-09-21T08:51:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.621+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.622+0000 7f4a777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.622+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94549483310416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.623+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94549483310416] v34'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.623+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94549483287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x7f4bb003d050 2024-09-21T08:51:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.625+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94549483287744] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.626+0000 7f4bc5124800 20 remove_watcher() i=0 2024-09-21T08:51:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.626+0000 7f4bc5124800 2 removed watcher, disabling cache 2024-09-21T08:51:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.626+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94549483291280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045c9550 2024-09-21T08:51:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.627+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94549483291280] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.627+0000 7f4bc5124800 20 remove_watcher() i=1 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.627+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94549483294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d1750 con 0x55fe045d28d0 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.628+0000 7f4bc0e16640 1 -- 172.21.15.196:0/654378303 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94549483294000] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb002e070 con 0x55fe045d28d0 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.628+0000 7f4bc5124800 20 remove_watcher() i=2 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.628+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94549483296320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d8290 con 0x7f4bb003d050 2024-09-21T08:51:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.629+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94549483296320] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x7f4bb003d050 2024-09-21T08:51:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.629+0000 7f4bc5124800 20 remove_watcher() i=3 2024-09-21T08:51:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.629+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94549483298912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d9640 con 0x55fe045c9550 2024-09-21T08:51:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.630+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94549483298912] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb4057030 con 0x55fe045c9550 2024-09-21T08:51:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.630+0000 7f4bc5124800 20 remove_watcher() i=4 2024-09-21T08:51:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.630+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94549483303888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d8290 con 0x55fe045cdf60 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.631+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94549483303888] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.631+0000 7f4bc5124800 20 remove_watcher() i=5 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.631+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94549483308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045da060 con 0x55fe045cdf60 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.632+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94549483308608] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.632+0000 7f4bc5124800 20 remove_watcher() i=6 2024-09-21T08:51:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.632+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94549483301152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fe045d9640 con 0x55fe045cdf60 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc1617640 1 -- 172.21.15.196:0/654378303 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94549483301152] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bb802a070 con 0x55fe045cdf60 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 20 remove_watcher() i=7 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe045cdf60 msgr2=0x55fe045d0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe045cdf60 0x55fe045d0350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045c9550 msgr2=0x55fe045cba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045c9550 0x55fe045cba10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4bb003d050 msgr2=0x7f4bb001c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4bb003d050 0x7f4bb001c450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fe045d28d0 msgr2=0x55fe045d4d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.633+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fe045d28d0 0x55fe045d4d90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a8c036b40 msgr2=0x7f4a8c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a8c036b40 0x7f4a8c039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000bc40 tx=0x7f4bb0031000 comp rx=0 tx=0).stop 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 msgr2=0x55fe045bd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8011be0 tx=0x7f4bb804cb10 comp rx=0 tx=0).stop 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc0615640 1 -- 172.21.15.196:0/654378303 reap_dead start 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 shutdown_connections 2024-09-21T08:51:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/654378303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045b63f0 0x55fe045bd860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 >> 172.21.15.196:0/654378303 conn(0x55fe045b2750 msgr2=0x55fe045b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 shutdown_connections 2024-09-21T08:51:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/654378303 wait complete. 2024-09-21T08:51:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 msgr2=0x7f4a98039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 0x7f4a98039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55fe04596470 tx=0x7f4bb004b4c0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 msgr2=0x55fe045a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fe0458f740 tx=0x7f4bb80188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 shutdown_connections 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4a98036b90 0x7f4a98039050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/3497991332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe045a9770 0x55fe045a9b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.651 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 >> 172.21.15.196:0/3497991332 conn(0x55fe0459e700 msgr2=0x55fe045a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 shutdown_connections 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/3497991332 wait complete. 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 msgr2=0x55fe0459a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 0x55fe0459a740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 msgr2=0x55fe04595ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.652 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.634+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 0x55fe04595ae0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 msgr2=0x7f4aa8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 0x7f4aa8039050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4057000 tx=0x7f4bb4052000 comp rx=0 tx=0).stop 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 msgr2=0x55fe0458e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000fd0 tx=0x7f4bb0000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 shutdown_connections 2024-09-21T08:51:55.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fe04598350 0x55fe0459a740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fe045936f0 0x55fe04595ae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4aa8036b90 0x7f4aa8039050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 --2- 172.21.15.196:0/442968459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fe0449bee0 0x55fe0458e690 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 >> 172.21.15.196:0/442968459 conn(0x55fe0448f5b0 msgr2=0x55fe04580ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 shutdown_connections 2024-09-21T08:51:55.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.635+0000 7f4bc5124800 1 -- 172.21.15.196:0/442968459 wait complete. 2024-09-21T08:51:55.662 INFO:teuthology.orchestra.run.smithi196.stdout:[] 2024-09-21T08:51:55.662 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T08:51:55.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-21T08:51:55.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-21T08:51:55.663 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-21T08:51:55.707 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:55.707 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:55.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.705+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.705+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.705+0000 7f8381213800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d8698f900 0x556d86991cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.705+0000 7f8381213800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d8684bb30 con 0x556d8698b4c0 2024-09-21T08:51:55.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.705+0000 7f8381213800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556d8682d360 con 0x556d8698f900 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c19b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d8698f900 0x556d86991cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c99c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556d8698b4c0 0x556d8698b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46720/0 (socket says 172.21.15.196:46720) 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c19b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d8698f900 0x556d86991cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33464/0 (socket says 172.21.15.196:33464) 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c99c640 1 -- 172.21.15.196:0/52117184 learned_addr learned my addr 172.21.15.196:0/52117184 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c19b640 1 -- 172.21.15.196:0/52117184 >> v1:172.21.15.29:6789/0 conn(0x556d8698b4c0 legacy=0x556d8698b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.706+0000 7f837c19b640 1 -- 172.21.15.196:0/52117184 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86853e00 con 0x556d8698f900 2024-09-21T08:51:55.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f837c19b640 1 --2- 172.21.15.196:0/52117184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698f900 0x556d86991cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f837000a470 tx=0x7f8370045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa1bf8937d97a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f837b99a640 1 -- 172.21.15.196:0/52117184 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8370053570 con 0x556d8698f900 2024-09-21T08:51:55.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f837b99a640 1 -- 172.21.15.196:0/52117184 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370058070 con 0x556d8698f900 2024-09-21T08:51:55.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f837b99a640 1 -- 172.21.15.196:0/52117184 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8370053880 con 0x556d8698f900 2024-09-21T08:51:55.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 -- 172.21.15.196:0/52117184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698f900 msgr2=0x556d86991cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 --2- 172.21.15.196:0/52117184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698f900 0x556d86991cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f837000a470 tx=0x7f8370045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:55.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 -- 172.21.15.196:0/52117184 shutdown_connections 2024-09-21T08:51:55.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 --2- 172.21.15.196:0/52117184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698f900 0x556d86991cf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 -- 172.21.15.196:0/52117184 >> 172.21.15.196:0/52117184 conn(0x556d86986df0 msgr2=0x556d86989210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 -- 172.21.15.196:0/52117184 shutdown_connections 2024-09-21T08:51:55.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.708+0000 7f8381213800 1 -- 172.21.15.196:0/52117184 wait complete. 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.722+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.722+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.722+0000 7f8381213800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.722+0000 7f8381213800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d868d8330 con 0x556d8698b4c0 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f837c99c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f837c99c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33476/0 (socket says 172.21.15.196:33476) 2024-09-21T08:51:55.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f837c99c640 1 -- 172.21.15.196:0/208321351 learned_addr learned my addr 172.21.15.196:0/208321351 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f837c99c640 1 -- 172.21.15.196:0/208321351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86825bc0 con 0x556d8698b4c0 2024-09-21T08:51:55.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f837c99c640 1 --2- 172.21.15.196:0/208321351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f836c001e10 tx=0x7f836c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e063f5c083aa4373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f826ae0d640 1 -- 172.21.15.196:0/208321351 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836c012020 con 0x556d8698b4c0 2024-09-21T08:51:55.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f826ae0d640 1 -- 172.21.15.196:0/208321351 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836c00e5a0 con 0x556d8698b4c0 2024-09-21T08:51:55.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.723+0000 7f826ae0d640 1 -- 172.21.15.196:0/208321351 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836c00e8e0 con 0x556d8698b4c0 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- 172.21.15.196:0/208321351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 msgr2=0x556d868ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 --2- 172.21.15.196:0/208321351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f836c001e10 tx=0x7f836c00b780 comp rx=0 tx=0).stop 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- 172.21.15.196:0/208321351 shutdown_connections 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 --2- 172.21.15.196:0/208321351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d868ffd80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- 172.21.15.196:0/208321351 >> 172.21.15.196:0/208321351 conn(0x556d86986df0 msgr2=0x556d86a76110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- 172.21.15.196:0/208321351 shutdown_connections 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- 172.21.15.196:0/208321351 wait complete. 2024-09-21T08:51:55.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.724+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f8381213800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f8381213800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d86992530 con 0x556d8698b4c0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f837c99c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f837c99c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33492/0 (socket says 172.21.15.196:33492) 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f837c99c640 1 -- 172.21.15.196:0/1641607373 learned_addr learned my addr 172.21.15.196:0/1641607373 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f837c99c640 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86839fe0 con 0x556d8698b4c0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f837c99c640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b7c0 tx=0x7f836c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.725+0000 7f826960a640 1 -- 172.21.15.196:0/1641607373 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836c012030 con 0x556d8698b4c0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.726+0000 7f826960a640 1 -- 172.21.15.196:0/1641607373 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836c001470 con 0x556d8698b4c0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.726+0000 7f826960a640 1 -- 172.21.15.196:0/1641607373 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836c01a8d0 con 0x556d8698b4c0 2024-09-21T08:51:55.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.726+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d86a859b0 con 0x556d8698b4c0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.726+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d86a85ed0 con 0x556d8698b4c0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.726+0000 7f826960a640 1 -- 172.21.15.196:0/1641607373 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f836c015020 con 0x556d8698b4c0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f826960a640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 0x7f8264039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f826960a640 1 -- 172.21.15.196:0/1641607373 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f836c020030 con 0x556d8698b4c0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f837c19b640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 0x7f8264039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 0x556d86a8c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86a8cab0 con 0x556d8698f900 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f837d19d640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 0x556d86a8c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f837c19b640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 0x7f8264039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8370057000 tx=0x7f8370052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.727+0000 7f837d19d640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 0x556d86a8c4e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f837d19d640 1 -- 172.21.15.196:0/1641607373 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f837400a4a0 con 0x556d8698f900 2024-09-21T08:51:55.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86a89ab0 con 0x556d8698f900 2024-09-21T08:51:55.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f837d19d640 1 -- 172.21.15.196:0/1641607373 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f837400a4a0 con 0x556d8698f900 2024-09-21T08:51:55.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 0x556d86a911b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86a91850 con 0x556d86a8edc0 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f837c99c640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 0x556d86a911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.728+0000 7f837c99c640 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 0x556d86a911b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.729+0000 7f837c99c640 1 -- 172.21.15.196:0/1641607373 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86a8edc0 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.729+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86a8dc60 con 0x556d8698f900 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.729+0000 7f837d19d640 1 -- 172.21.15.196:0/1641607373 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f837400a4a0 con 0x556d8698f900 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.729+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86a8e100 con 0x556d8698f900 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.729+0000 7f837d19d640 1 -- 172.21.15.196:0/1641607373 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f837400a4a0 con 0x556d8698f900 2024-09-21T08:51:55.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f8381213800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f8381213800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d86827580 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33496/0 (socket says 172.21.15.196:33496) 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f837d19d640 1 -- 172.21.15.196:0/3038544590 learned_addr learned my addr 172.21.15.196:0/3038544590 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.730+0000 7f837d19d640 1 -- 172.21.15.196:0/3038544590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86aa0b40 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f837d19d640 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556d86a86520 tx=0x7f83740188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f82627fc640 1 -- 172.21.15.196:0/3038544590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8374014450 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f82627fc640 1 -- 172.21.15.196:0/3038544590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83740145f0 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f82627fc640 1 -- 172.21.15.196:0/3038544590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83740148d0 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d86aa0dd0 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.731+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d86aa3ab0 con 0x556d86aa01e0 2024-09-21T08:51:55.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f82627fc640 1 -- 172.21.15.196:0/3038544590 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8374011040 con 0x556d86aa01e0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f82627fc640 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 0x7f8254039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f82627fc640 1 -- 172.21.15.196:0/3038544590 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f837401e070 con 0x556d86aa01e0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f837c99c640 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 0x7f8254039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f837c99c640 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 0x7f8254039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556d86a8cee0 tx=0x7f836c04b080 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.732+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f8381213800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f8381213800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d86a80980 con 0x556d86aacdd0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33508/0 (socket says 172.21.15.196:33508) 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f837d19d640 1 -- 172.21.15.196:0/3429199181 learned_addr learned my addr 172.21.15.196:0/3429199181 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f837d19d640 1 -- 172.21.15.196:0/3429199181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86aad7a0 con 0x556d86aacdd0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f837d19d640 1 --2- 172.21.15.196:0/3429199181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f837404cbb0 tx=0x7f837403bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f2c10e88f9f398 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f8253fff640 1 -- 172.21.15.196:0/3429199181 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8374014a70 con 0x556d86aacdd0 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f8253fff640 1 -- 172.21.15.196:0/3429199181 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8374014c10 con 0x556d86aacdd0 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.733+0000 7f8253fff640 1 -- 172.21.15.196:0/3429199181 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f837402ba60 con 0x556d86aacdd0 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- 172.21.15.196:0/3429199181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 msgr2=0x556d86aad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 --2- 172.21.15.196:0/3429199181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f837404cbb0 tx=0x7f837403bf60 comp rx=0 tx=0).stop 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- 172.21.15.196:0/3429199181 shutdown_connections 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 --2- 172.21.15.196:0/3429199181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86aad1d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- 172.21.15.196:0/3429199181 >> 172.21.15.196:0/3429199181 conn(0x556d86aa91c0 msgr2=0x556d86aa72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- 172.21.15.196:0/3429199181 shutdown_connections 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- 172.21.15.196:0/3429199181 wait complete. 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 Processor -- start 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- start start 2024-09-21T08:51:55.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.734+0000 7f8381213800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d86aadde0 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f837d19d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33514/0 (socket says 172.21.15.196:33514) 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 learned_addr learned my addr 172.21.15.196:0/1639889605 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d86ab48a0 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f837d19d640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f83740403a0 tx=0x7f837404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f82527fc640 1 -- 172.21.15.196:0/1639889605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8374044030 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f82527fc640 1 -- 172.21.15.196:0/1639889605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837404e0d0 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d86ab4b30 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f82527fc640 1 -- 172.21.15.196:0/1639889605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8374014a70 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.735+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d86ab77e0 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.736+0000 7f82527fc640 1 -- 172.21.15.196:0/1639889605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f837404e3b0 con 0x556d86aacdd0 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.736+0000 7f82527fc640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8248036b40 0x7f8248039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.736+0000 7f82527fc640 1 -- 172.21.15.196:0/1639889605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8374045070 con 0x556d86aacdd0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.736+0000 7f837c99c640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8248036b40 0x7f8248039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f837c99c640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8248036b40 0x7f8248039000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f836c01a6a0 tx=0x7f836c036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d86abffb0 0x556d86ac2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac2bc0 con 0x556d86abffb0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f837c19b640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d86abffb0 0x556d86ac2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.737+0000 7f837c19b640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d86abffb0 0x556d86ac2470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 realm 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac2ff0 con 0x556d86abffb0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac38c0 con 0x556d86abffb0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac3c60 con 0x556d86abffb0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86ac49c0 0x556d86ac6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac73c0 con 0x556d86ac49c0 2024-09-21T08:51:55.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.738+0000 7f837d19d640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86ac49c0 0x556d86ac6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f837d19d640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86ac49c0 0x556d86ac6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f8381213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f8381213800 20 searching for the correct realm 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d86ac9350 0x556d86acb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.739+0000 7f837c99c640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d86ac9350 0x556d86acb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c99c640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d86ac9350 0x556d86acb810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c99c640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f836c03a040 0x7f836c03f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c19b640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f836c03a040 0x7f836c03f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c19b640 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f836c03a040 0x7f836c03f5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.740+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.741+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.742+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.743+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.744+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.745+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.746+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.747+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac9350 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86ac49c0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x556d86abffb0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d86acbee0 con 0x7f836c03a040 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.748+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac88a0 con 0x556d86abffb0 2024-09-21T08:51:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac8110 con 0x556d86abffb0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ac7850 con 0x556d86abffb0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 zone default found 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 4 Realm: () 2024-09-21T08:51:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 zonegroup default 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.749+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86acc810 con 0x556d86ac49c0 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86acea40 con 0x556d86ac9350 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86acede0 con 0x556d86ac9350 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 started sync module instance, tier type = 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.750+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acded0 con 0x7f836c03a040 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.751+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.751+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928899273728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acded0 con 0x7f836c03a040 2024-09-21T08:51:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.751+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acf830 con 0x556d86abffb0 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.754+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.754+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928899277632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acf7c0 con 0x556d86abffb0 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.754+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad07d0 con 0x556d86ac9350 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.757+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928899277632] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.757+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928899273728] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.757+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.757+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928899271200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acfc20 con 0x556d86ac9350 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.757+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad1070 con 0x7f836c03a040 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.760+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928899271200] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.760+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.760+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928899283904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad0fe0 con 0x7f836c03a040 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.760+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad1f30 con 0x556d86abffb0 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.763+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928899283904] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.763+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.763+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928899286032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad1f30 con 0x556d86abffb0 2024-09-21T08:51:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.763+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad2940 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.765+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928899286032] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.765+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.765+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928899287680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad1ea0 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.765+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad3680 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.768+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928899287680] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.771+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.771+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928899292384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad3680 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.771+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad40e0 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928899292384] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928899296144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad40a0 con 0x556d86ac49c0 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=0 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=1 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=2 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=3 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=4 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=5 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.772+0000 7f8381213800 20 add_watcher() i=6 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928899296144] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f8381213800 20 add_watcher() i=7 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f8381213800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad7560 con 0x556d86abffb0 2024-09-21T08:51:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.775+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928899293440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad4af0 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.778+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928899293440] v34'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.778+0000 7f8232fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.778+0000 7f8381213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.778+0000 7f8381213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.778+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86adffe0 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.779+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.779+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae06b0 con 0x556d86ac49c0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.780+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.781+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae06b0 con 0x556d86ac9350 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.783+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.783+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae0f60 con 0x556d86abffb0 2024-09-21T08:51:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.786+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.786+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86adbd10 con 0x7f836c03a040 2024-09-21T08:51:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.789+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.789+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86adbd10 con 0x556d86ac9350 2024-09-21T08:51:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.792+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.792+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae1a60 con 0x556d86abffb0 2024-09-21T08:51:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.794+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.794+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae1a60 con 0x556d86ac49c0 2024-09-21T08:51:55.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.795+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.795+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae1b60 con 0x7f836c03a040 2024-09-21T08:51:55.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.796+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.796+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae1c30 con 0x556d86ac9350 2024-09-21T08:51:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.797+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.797+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x7f836c03a040 2024-09-21T08:51:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.799+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.799+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac49c0 2024-09-21T08:51:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.800+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.800+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x7f836c03a040 2024-09-21T08:51:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.801+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.801+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac49c0 2024-09-21T08:51:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.803+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.803+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86abffb0 2024-09-21T08:51:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.804+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.804+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.805+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.805+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x7f836c03a040 2024-09-21T08:51:55.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.806+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.806+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.807+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.807+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86abffb0 2024-09-21T08:51:55.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.808+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.808+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86abffb0 2024-09-21T08:51:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.809+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.809+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.812+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.812+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x7f836c03a040 2024-09-21T08:51:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.813+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.813+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.814+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.814+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.817+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.818+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.819+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.819+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.821+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.821+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac49c0 2024-09-21T08:51:55.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.822+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.822+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.823+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.823+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac49c0 2024-09-21T08:51:55.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.824+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.824+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac9350 2024-09-21T08:51:55.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.825+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.826+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x556d86ac49c0 2024-09-21T08:51:55.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.827+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.827+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ae20e0 con 0x7f836c03a040 2024-09-21T08:51:55.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.828+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.828+0000 7f8231fe3640 20 reqs_thread_entry: start 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.828+0000 7f8381213800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.828+0000 7f8381213800 20 Filter name: none 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f81a37fe640 20 reqs_thread_entry: start 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d86b0d020 con 0x7f836c03a040 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-21T08:51:55.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.829+0000 7f8381213800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:51:55.834 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T08:51:55.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.830+0000 7f8232fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.830+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928899293440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86adeea0 con 0x556d86abffb0 2024-09-21T08:51:55.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.831+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93928899293440] v34'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.831+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928899273728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad3100 con 0x7f836c03a040 2024-09-21T08:51:55.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.833+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93928899273728] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.833+0000 7f8381213800 20 remove_watcher() i=0 2024-09-21T08:51:55.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.833+0000 7f8381213800 2 removed watcher, disabling cache 2024-09-21T08:51:55.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.833+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928899277632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad3100 con 0x556d86abffb0 2024-09-21T08:51:55.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.835+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93928899277632] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.835+0000 7f8381213800 20 remove_watcher() i=1 2024-09-21T08:51:55.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.835+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928899271200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acf340 con 0x556d86ac9350 2024-09-21T08:51:55.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.836+0000 7f837c99c640 1 -- 172.21.15.196:0/1639889605 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93928899271200] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836c02dcf0 con 0x556d86ac9350 2024-09-21T08:51:55.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.836+0000 7f8381213800 20 remove_watcher() i=2 2024-09-21T08:51:55.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.836+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928899283904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad3100 con 0x7f836c03a040 2024-09-21T08:51:55.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.837+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93928899283904] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x7f836c03a040 2024-09-21T08:51:55.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.837+0000 7f8381213800 20 remove_watcher() i=3 2024-09-21T08:51:55.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.837+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928899286032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acf340 con 0x556d86abffb0 2024-09-21T08:51:55.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.838+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93928899286032] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8370051070 con 0x556d86abffb0 2024-09-21T08:51:55.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.838+0000 7f8381213800 20 remove_watcher() i=4 2024-09-21T08:51:55.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.838+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928899287680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad0bc0 con 0x556d86ac49c0 2024-09-21T08:51:55.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.839+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93928899287680] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.839+0000 7f8381213800 20 remove_watcher() i=5 2024-09-21T08:51:55.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.839+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928899292384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86ad1410 con 0x556d86ac49c0 2024-09-21T08:51:55.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.840+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93928899292384] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.840+0000 7f8381213800 20 remove_watcher() i=6 2024-09-21T08:51:55.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.840+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928899296144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d86acf340 con 0x556d86ac49c0 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f837d19d640 1 -- 172.21.15.196:0/1639889605 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93928899296144] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8374056040 con 0x556d86ac49c0 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 20 remove_watcher() i=7 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86ac49c0 msgr2=0x556d86ac6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86ac49c0 0x556d86ac6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d86abffb0 msgr2=0x556d86ac2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d86abffb0 0x556d86ac2470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f836c03a040 msgr2=0x7f836c03f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f836c03a040 0x7f836c03f5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d86ac9350 msgr2=0x556d86acb810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d86ac9350 0x556d86acb810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8248036b40 msgr2=0x7f8248039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8248036b40 0x7f8248039000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f836c01a6a0 tx=0x7f836c036000 comp rx=0 tx=0).stop 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f837c19b640 1 -- 172.21.15.196:0/1639889605 reap_dead start 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 msgr2=0x556d86ab4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f83740403a0 tx=0x7f837404cb10 comp rx=0 tx=0).stop 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 shutdown_connections 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 --2- 172.21.15.196:0/1639889605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aacdd0 0x556d86ab4360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.841+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 >> 172.21.15.196:0/1639889605 conn(0x556d86aa91c0 msgr2=0x556d86aa7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 shutdown_connections 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1639889605 wait complete. 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 msgr2=0x7f8254039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 0x7f8254039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556d86a8cee0 tx=0x7f836c04b080 comp rx=0 tx=0).stop 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 msgr2=0x556d86aa0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556d86a86520 tx=0x7f83740188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 shutdown_connections 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8254036b90 0x7f8254039050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/3038544590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d86aa01e0 0x556d86aa0600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 >> 172.21.15.196:0/3038544590 conn(0x556d86a95170 msgr2=0x556d86a97cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 shutdown_connections 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/3038544590 wait complete. 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 msgr2=0x556d86a911b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 0x556d86a911b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 msgr2=0x556d86a8c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 0x556d86a8c4e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 msgr2=0x7f8264039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 0x7f8264039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8370057000 tx=0x7f8370052000 comp rx=0 tx=0).stop 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 msgr2=0x556d86a85470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b7c0 tx=0x7f836c000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 shutdown_connections 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d86a8edc0 0x556d86a911b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d8698f900 0x556d86a8c4e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8264036b40 0x7f8264039000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 --2- 172.21.15.196:0/1641607373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d8698b4c0 0x556d86a85470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.842+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 >> 172.21.15.196:0/1641607373 conn(0x556d86986df0 msgr2=0x556d86a74a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.843+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 shutdown_connections 2024-09-21T08:51:55.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.843+0000 7f8381213800 1 -- 172.21.15.196:0/1641607373 wait complete. 2024-09-21T08:51:55.853 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T08:51:55.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-21T08:51:55.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-21T08:51:55.854 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-21T08:51:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589e620800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55bcbfeb1d20 0x55bcbfeb4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589e620800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bcbfd6ab30 con 0x55bcbfe1edd0 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589e620800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55bcbfd4c360 con 0x55bcbfeb1d20 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589b91a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55bcbfeb1d20 0x55bcbfeb4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589b91a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55bcbfeb1d20 0x55bcbfeb4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33524/0 (socket says 172.21.15.196:33524) 2024-09-21T08:51:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589b91a640 1 -- 172.21.15.196:0/886744524 learned_addr learned my addr 172.21.15.196:0/886744524 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.896+0000 7f589c11b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55bcbfe1edd0 0x55bcbfeb0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46732/0 (socket says 172.21.15.196:46732) 2024-09-21T08:51:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.897+0000 7f589b91a640 1 -- 172.21.15.196:0/886744524 >> v1:172.21.15.29:6789/0 conn(0x55bcbfe1edd0 legacy=0x55bcbfeb0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.897+0000 7f589b91a640 1 -- 172.21.15.196:0/886744524 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbfd72e00 con 0x55bcbfeb1d20 2024-09-21T08:51:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.898+0000 7f589b91a640 1 --2- 172.21.15.196:0/886744524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfeb1d20 0x55bcbfeb4110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f588400a520 tx=0x7f5884045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9b83d66f6e40d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.898+0000 7f589b119640 1 -- 172.21.15.196:0/886744524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884055070 con 0x55bcbfeb1d20 2024-09-21T08:51:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589b119640 1 -- 172.21.15.196:0/886744524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58840515b0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589b119640 1 -- 172.21.15.196:0/886744524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58840518d0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 -- 172.21.15.196:0/886744524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfeb1d20 msgr2=0x55bcbfeb4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 --2- 172.21.15.196:0/886744524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfeb1d20 0x55bcbfeb4110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f588400a520 tx=0x7f5884045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 -- 172.21.15.196:0/886744524 shutdown_connections 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 --2- 172.21.15.196:0/886744524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfeb1d20 0x55bcbfeb4110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 -- 172.21.15.196:0/886744524 >> 172.21.15.196:0/886744524 conn(0x55bcbfea5df0 msgr2=0x55bcbfea8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 -- 172.21.15.196:0/886744524 shutdown_connections 2024-09-21T08:51:55.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.899+0000 7f589e620800 1 -- 172.21.15.196:0/886744524 wait complete. 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589e620800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589e620800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfdf7330 con 0x55bcbfe1edd0 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589c11b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589c11b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33530/0 (socket says 172.21.15.196:33530) 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589c11b640 1 -- 172.21.15.196:0/30444054 learned_addr learned my addr 172.21.15.196:0/30444054 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.913+0000 7f589c11b640 1 -- 172.21.15.196:0/30444054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbfd44bc0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f589c11b640 1 --2- 172.21.15.196:0/30444054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f588c001650 tx=0x7f588c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7852a1d71291c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f578a60c640 1 -- 172.21.15.196:0/30444054 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c013420 con 0x55bcbfe1edd0 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f578a60c640 1 -- 172.21.15.196:0/30444054 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c0135c0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f578a60c640 1 -- 172.21.15.196:0/30444054 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c0138c0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f589e620800 1 -- 172.21.15.196:0/30444054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 msgr2=0x55bcbff9ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f589e620800 1 --2- 172.21.15.196:0/30444054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f588c001650 tx=0x7f588c001b10 comp rx=0 tx=0).stop 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.914+0000 7f589e620800 1 -- 172.21.15.196:0/30444054 shutdown_connections 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 --2- 172.21.15.196:0/30444054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbff9ca50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 -- 172.21.15.196:0/30444054 >> 172.21.15.196:0/30444054 conn(0x55bcbfea5df0 msgr2=0x55bcbff98410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 -- 172.21.15.196:0/30444054 shutdown_connections 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 -- 172.21.15.196:0/30444054 wait complete. 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589e620800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfeb48f0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589c11b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589c11b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33536/0 (socket says 172.21.15.196:33536) 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.915+0000 7f589c11b640 1 -- 172.21.15.196:0/3073360681 learned_addr learned my addr 172.21.15.196:0/3073360681 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f589c11b640 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbfd58fe0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f589c11b640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55bcbff9d8b0 tx=0x7f588c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f5788e09640 1 -- 172.21.15.196:0/3073360681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c022020 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f5788e09640 1 -- 172.21.15.196:0/3073360681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c006830 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbffa4990 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f5788e09640 1 -- 172.21.15.196:0/3073360681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c004b30 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.916+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbffa4eb0 con 0x55bcbfe1edd0 2024-09-21T08:51:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f5788e09640 1 -- 172.21.15.196:0/3073360681 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f588c025020 con 0x55bcbfe1edd0 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f5788e09640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 0x7f5784039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f5788e09640 1 -- 172.21.15.196:0/3073360681 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f588c018030 con 0x55bcbfe1edd0 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f589b91a640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 0x7f5784039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 0x55bcbffab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffaba40 con 0x55bcbfeb1d20 2024-09-21T08:51:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.917+0000 7f589c91c640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 0x55bcbffab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589b91a640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 0x7f5784039050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5884057000 tx=0x7f5884052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589c91c640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 0x55bcbffab4c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589c91c640 1 -- 172.21.15.196:0/3073360681 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58940083e0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffa8a70 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589c91c640 1 -- 172.21.15.196:0/3073360681 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58940083e0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 0x55bcbffb0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffb0830 con 0x55bcbffadd50 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.918+0000 7f589c11b640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 0x55bcbffb0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.919+0000 7f589c11b640 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 0x55bcbffb0140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.919+0000 7f589c11b640 1 -- 172.21.15.196:0/3073360681 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f588c01b070 con 0x55bcbffadd50 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.919+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffacbf0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.919+0000 7f589c91c640 1 -- 172.21.15.196:0/3073360681 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58940083e0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.919+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffad070 con 0x55bcbfeb1d20 2024-09-21T08:51:55.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589c91c640 1 -- 172.21.15.196:0/3073360681 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58940083e0 con 0x55bcbfeb1d20 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589e620800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589e620800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfd46580 con 0x55bcbffbf1c0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33552/0 (socket says 172.21.15.196:33552) 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.920+0000 7f589c91c640 1 -- 172.21.15.196:0/2124401136 learned_addr learned my addr 172.21.15.196:0/2124401136 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f589c91c640 1 -- 172.21.15.196:0/2124401136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbffbfb20 con 0x55bcbffbf1c0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f589c91c640 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55bcbffa5850 tx=0x7f589400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f5781ffb640 1 -- 172.21.15.196:0/2124401136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894007d00 con 0x55bcbffbf1c0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f5781ffb640 1 -- 172.21.15.196:0/2124401136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589401e020 con 0x55bcbffbf1c0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbffbfdb0 con 0x55bcbffbf1c0 2024-09-21T08:51:55.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f5781ffb640 1 -- 172.21.15.196:0/2124401136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894019420 con 0x55bcbffbf1c0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.921+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbffc2a90 con 0x55bcbffbf1c0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f5781ffb640 1 -- 172.21.15.196:0/2124401136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5894016040 con 0x55bcbffbf1c0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f5781ffb640 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 0x7f5774039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f5781ffb640 1 -- 172.21.15.196:0/2124401136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f589401f030 con 0x55bcbffbf1c0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f589c11b640 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 0x7f5774039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f589c11b640 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 0x7f5774039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55bcbffabec0 tx=0x7f588c026e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.922+0000 7f589e620800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589e620800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55bcbff9d200 con 0x55bcbffcbea0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33566/0 (socket says 172.21.15.196:33566) 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589c91c640 1 -- 172.21.15.196:0/2986044736 learned_addr learned my addr 172.21.15.196:0/2986044736 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589c91c640 1 -- 172.21.15.196:0/2986044736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbffcc870 con 0x55bcbffcbea0 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f589c91c640 1 --2- 172.21.15.196:0/2986044736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f589404cb10 tx=0x7f5894014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8850ecae5083cbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f577b7fe640 1 -- 172.21.15.196:0/2986044736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589401d040 con 0x55bcbffcbea0 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f577b7fe640 1 -- 172.21.15.196:0/2986044736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894017b00 con 0x55bcbffcbea0 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.923+0000 7f577b7fe640 1 -- 172.21.15.196:0/2986044736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894017e00 con 0x55bcbffcbea0 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- 172.21.15.196:0/2986044736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 msgr2=0x55bcbffcc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 --2- 172.21.15.196:0/2986044736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f589404cb10 tx=0x7f5894014640 comp rx=0 tx=0).stop 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- 172.21.15.196:0/2986044736 shutdown_connections 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 --2- 172.21.15.196:0/2986044736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffcc2a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- 172.21.15.196:0/2986044736 >> 172.21.15.196:0/2986044736 conn(0x55bcbffc8200 msgr2=0x55bcbffc6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- 172.21.15.196:0/2986044736 shutdown_connections 2024-09-21T08:51:55.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- 172.21.15.196:0/2986044736 wait complete. 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 Processor -- start 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- start start 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffd3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589e620800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55bcbffccee0 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffd3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589c91c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffd3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33568/0 (socket says 172.21.15.196:33568) 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.924+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 learned_addr learned my addr 172.21.15.196:0/4139125594 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbffd3890 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f589c91c640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffd3350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f589404cb10 tx=0x7f589404caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f5779ffb640 1 -- 172.21.15.196:0/4139125594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894030070 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f5779ffb640 1 -- 172.21.15.196:0/4139125594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894046070 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f5779ffb640 1 -- 172.21.15.196:0/4139125594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589401d030 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcbffd3b20 con 0x55bcbffcbea0 2024-09-21T08:51:55.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.925+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbffd67d0 con 0x55bcbffcbea0 2024-09-21T08:51:55.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.926+0000 7f5779ffb640 1 -- 172.21.15.196:0/4139125594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5894033070 con 0x55bcbffcbea0 2024-09-21T08:51:55.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.926+0000 7f5779ffb640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f576c036b40 0x7f576c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.926+0000 7f5779ffb640 1 -- 172.21.15.196:0/4139125594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5894036c90 con 0x55bcbffcbea0 2024-09-21T08:51:55.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.926+0000 7f589c11b640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f576c036b40 0x7f576c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589c11b640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f576c036b40 0x7f576c039000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f588c002060 tx=0x7f588c028000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbffdedd0 0x55bcbffe1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe19e0 con 0x55bcbffdedd0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589b91a640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbffdedd0 0x55bcbffe1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589b91a640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbffdedd0 0x55bcbffe1290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 20 realm 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.927+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe1e10 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe26e0 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe2a80 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffe37e0 0x55bcbffe5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.928+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe61e0 con 0x55bcbffe37e0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589c91c640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffe37e0 0x55bcbffe5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589c91c640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffe37e0 0x55bcbffe5bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589e620800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589e620800 20 searching for the correct realm 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55bcbffe8150 0x55bcbffea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.929+0000 7f589c11b640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55bcbffe8150 0x55bcbffea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589c11b640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55bcbffe8150 0x55bcbffea610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589c11b640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f588c027020 0x7f588c0265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589b91a640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f588c027020 0x7f588c0265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.930+0000 7f589b91a640 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f588c027020 0x7f588c0265d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.931+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.932+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.933+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.934+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.935+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.936+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe8150 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.937+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffe37e0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x55bcbffdedd0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeace0 con 0x7f588c027020 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe76c0 con 0x55bcbffdedd0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.938+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe6670 con 0x55bcbffdedd0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:55.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffe7030 con 0x55bcbffdedd0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 zone default found 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 4 Realm: () 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 zonegroup default 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeb610 con 0x55bcbffe37e0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffed840 con 0x55bcbffe8150 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.939+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffedbe0 con 0x55bcbffe8150 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 20 started sync module instance, tier type = 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.940+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeccd0 con 0x7f588c027020 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.941+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.941+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94269163360768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeccd0 con 0x7f588c027020 2024-09-21T08:51:55.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.941+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffee630 con 0x55bcbffdedd0 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.942+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94269163360768] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.942+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.942+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94269163364672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeccd0 con 0x55bcbffdedd0 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.942+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffef0c0 con 0x55bcbffe8150 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.943+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94269163364672] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.943+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.943+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94269163358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffecc40 con 0x55bcbffe8150 2024-09-21T08:51:55.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.943+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeff80 con 0x7f588c027020 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.944+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94269163358240] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.945+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.945+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94269163371216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff03a0 con 0x7f588c027020 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.945+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff0c50 con 0x55bcbffdedd0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.946+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.946+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94269163373472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff07c0 con 0x55bcbffdedd0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.946+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff1bc0 con 0x55bcbffe37e0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.946+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94269163371216] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.947+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.947+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94269163378320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff07c0 con 0x55bcbffe37e0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.947+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff25d0 con 0x55bcbffe37e0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.947+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94269163373472] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.948+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94269163378320] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.948+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.948+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94269163372272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff2120 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.948+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff2ae0 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94269163372272] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94269163376752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff2ae0 con 0x55bcbffe37e0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=0 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=1 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=2 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=3 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=4 2024-09-21T08:51:55.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=5 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.949+0000 7f589e620800 20 add_watcher() i=6 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94269163376752] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589e620800 20 add_watcher() i=7 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589e620800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff5ee0 con 0x55bcbffdedd0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.950+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94269163382784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff3400 con 0x55bcbffdedd0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.951+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94269163382784] v34'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.951+0000 7f57527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.951+0000 7f589e620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.952+0000 7f589e620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.952+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff5d20 con 0x55bcbffdedd0 2024-09-21T08:51:55.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.953+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.953+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffeff0 con 0x55bcbffe37e0 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.954+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.954+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffeff0 con 0x55bcbffe8150 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.955+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.955+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffffa10 con 0x55bcbffdedd0 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.957+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.957+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffe6d0 con 0x7f588c027020 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.960+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.960+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffe6d0 con 0x55bcbffe8150 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.961+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.961+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00003a0 con 0x55bcbffdedd0 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.962+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.962+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.963+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.963+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x7f588c027020 2024-09-21T08:51:55.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.964+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.964+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.965+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.965+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x7f588c027020 2024-09-21T08:51:55.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.966+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.966+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.967+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.967+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x7f588c027020 2024-09-21T08:51:55.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.968+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.968+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.969+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.969+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffdedd0 2024-09-21T08:51:55.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.971+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.971+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.972+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.972+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x7f588c027020 2024-09-21T08:51:55.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.973+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.973+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x55bcbffe8150 2024-09-21T08:51:55.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.974+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.974+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x55bcbffdedd0 2024-09-21T08:51:55.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.975+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.975+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x55bcbffdedd0 2024-09-21T08:51:55.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.976+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.976+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x55bcbffe8150 2024-09-21T08:51:55.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.979+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.979+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000940 con 0x7f588c027020 2024-09-21T08:51:55.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.980+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.980+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000940 con 0x55bcbffe8150 2024-09-21T08:51:55.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.981+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.981+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc00008e0 con 0x55bcbffe8150 2024-09-21T08:51:55.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.984+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.984+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.985+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.985+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.986+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.986+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.988+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.988+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.989+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.989+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.990+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.990+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe8150 2024-09-21T08:51:55.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.991+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:55.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.991+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x55bcbffe37e0 2024-09-21T08:51:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.992+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.992+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcc0000850 con 0x7f588c027020 2024-09-21T08:51:55.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.993+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f57517e2640 20 reqs_thread_entry: start 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 20 Filter name: none 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f56c2ffd640 20 reqs_thread_entry: start 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 20 rados->read ofs=0 len=0 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bcc002b760 con 0x55bcbffe37e0 2024-09-21T08:51:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:55.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:55.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-21T08:51:55.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.994+0000 7f589e620800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T08:51:55.998 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T08:51:55.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.995+0000 7f57527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:55.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.995+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94269163382784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffd240 con 0x55bcbffdedd0 2024-09-21T08:51:55.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.996+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94269163382784] v34'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:55.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.996+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94269163360768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfffd240 con 0x7f588c027020 2024-09-21T08:51:56.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.997+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94269163360768] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:56.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.997+0000 7f589e620800 20 remove_watcher() i=0 2024-09-21T08:51:56.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.997+0000 7f589e620800 2 removed watcher, disabling cache 2024-09-21T08:51:56.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.997+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94269163364672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffed200 con 0x55bcbffdedd0 2024-09-21T08:51:56.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.998+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94269163364672] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:56.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.998+0000 7f589e620800 20 remove_watcher() i=1 2024-09-21T08:51:56.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.998+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94269163358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffed200 con 0x55bcbffe8150 2024-09-21T08:51:56.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.999+0000 7f589c11b640 1 -- 172.21.15.196:0/4139125594 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94269163358240] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c053040 con 0x55bcbffe8150 2024-09-21T08:51:56.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.999+0000 7f589e620800 20 remove_watcher() i=2 2024-09-21T08:51:56.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:55.999+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94269163371216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffec820 con 0x7f588c027020 2024-09-21T08:51:56.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.000+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94269163371216] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x7f588c027020 2024-09-21T08:51:56.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.000+0000 7f589e620800 20 remove_watcher() i=3 2024-09-21T08:51:56.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.000+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94269163373472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffefad0 con 0x55bcbffdedd0 2024-09-21T08:51:56.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.001+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94269163373472] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884057030 con 0x55bcbffdedd0 2024-09-21T08:51:56.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.001+0000 7f589e620800 20 remove_watcher() i=4 2024-09-21T08:51:56.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.001+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94269163378320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffec820 con 0x55bcbffe37e0 2024-09-21T08:51:56.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.002+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94269163378320] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:56.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.002+0000 7f589e620800 20 remove_watcher() i=5 2024-09-21T08:51:56.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.002+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94269163372272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbfff03a0 con 0x55bcbffe37e0 2024-09-21T08:51:56.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.004+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94269163372272] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:56.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.004+0000 7f589e620800 20 remove_watcher() i=6 2024-09-21T08:51:56.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.004+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94269163376752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bcbffeff80 con 0x55bcbffe37e0 2024-09-21T08:51:56.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589c91c640 1 -- 172.21.15.196:0/4139125594 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94269163376752] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5894032030 con 0x55bcbffe37e0 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 20 remove_watcher() i=7 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffe37e0 msgr2=0x55bcbffe5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffe37e0 0x55bcbffe5bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbffdedd0 msgr2=0x55bcbffe1290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbffdedd0 0x55bcbffe1290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f588c027020 msgr2=0x7f588c0265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f588c027020 0x7f588c0265d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55bcbffe8150 msgr2=0x55bcbffea610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55bcbffe8150 0x55bcbffea610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f576c036b40 msgr2=0x7f576c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f576c036b40 0x7f576c039000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f588c002060 tx=0x7f588c028000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 msgr2=0x55bcbffd3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/4139125594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffcbea0 0x55bcbffd3350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f589404cb10 tx=0x7f589404caa0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 reap_dead start 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589b91a640 1 -- 172.21.15.196:0/4139125594 reap_dead start 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 shutdown_connections 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 >> 172.21.15.196:0/4139125594 conn(0x55bcbffc8200 msgr2=0x55bcbffc62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 shutdown_connections 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/4139125594 wait complete. 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 msgr2=0x7f5774039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 0x7f5774039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55bcbffabec0 tx=0x7f588c026e50 comp rx=0 tx=0).stop 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 msgr2=0x55bcbffbf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55bcbffa5850 tx=0x7f589400aec0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 shutdown_connections 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5774036b90 0x7f5774039050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 --2- 172.21.15.196:0/2124401136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbffbf1c0 0x55bcbffbf5e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 >> 172.21.15.196:0/2124401136 conn(0x55bcbffb4150 msgr2=0x55bcbffb6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 shutdown_connections 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.005+0000 7f589e620800 1 -- 172.21.15.196:0/2124401136 wait complete. 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 msgr2=0x55bcbffb0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 0x55bcbffb0140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 msgr2=0x55bcbffab4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 0x55bcbffab4c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 msgr2=0x7f5784039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 0x7f5784039050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5884057000 tx=0x7f5884052000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 msgr2=0x55bcbffa4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55bcbff9d8b0 tx=0x7f588c001250 comp rx=0 tx=0).stop 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 shutdown_connections 2024-09-21T08:51:56.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55bcbffadd50 0x55bcbffb0140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55bcbfeb1d20 0x55bcbffab4c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5784036b90 0x7f5784039050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 --2- 172.21.15.196:0/3073360681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55bcbfe1edd0 0x55bcbffa4450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 >> 172.21.15.196:0/3073360681 conn(0x55bcbfea5df0 msgr2=0x55bcbff96d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 shutdown_connections 2024-09-21T08:51:56.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.006+0000 7f589e620800 1 -- 172.21.15.196:0/3073360681 wait complete. 2024-09-21T08:51:56.017 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T08:51:56.017 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T08:51:56.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T08:51:56.017 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T08:51:56.102 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.102 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f7127d0a800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6f518f900 0x55f6f5191cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f7127d0a800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6f504bb30 con 0x55f6f518b4c0 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f7127d0a800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f6f502d360 con 0x55f6f518f900 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f711cffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6f518f900 0x55f6f5191cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f711cffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6f518f900 0x55f6f5191cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33576/0 (socket says 172.21.15.196:33576) 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.100+0000 7f711cffd640 1 -- 172.21.15.196:0/1688662926 learned_addr learned my addr 172.21.15.196:0/1688662926 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.101+0000 7f711cffd640 1 -- 172.21.15.196:0/1688662926 >> v1:172.21.15.29:6789/0 conn(0x55f6f518b4c0 legacy=0x55f6f518b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.101+0000 7f711cffd640 1 -- 172.21.15.196:0/1688662926 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f5053e00 con 0x55f6f518f900 2024-09-21T08:51:56.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.102+0000 7f711cffd640 1 --2- 172.21.15.196:0/1688662926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518f900 0x55f6f5191cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f711000a6b0 tx=0x7f7110047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1cbc612ab4c68f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.102+0000 7f7124ffd640 1 -- 172.21.15.196:0/1688662926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711000a200 con 0x55f6f518f900 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7124ffd640 1 -- 172.21.15.196:0/1688662926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711000a3a0 con 0x55f6f518f900 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7124ffd640 1 -- 172.21.15.196:0/1688662926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7110008700 con 0x55f6f518f900 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 -- 172.21.15.196:0/1688662926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518f900 msgr2=0x55f6f5191cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1688662926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518f900 0x55f6f5191cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f711000a6b0 tx=0x7f7110047e30 comp rx=0 tx=0).stop 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 -- 172.21.15.196:0/1688662926 shutdown_connections 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1688662926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518f900 0x55f6f5191cf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 -- 172.21.15.196:0/1688662926 >> 172.21.15.196:0/1688662926 conn(0x55f6f5186df0 msgr2=0x55f6f5189210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 -- 172.21.15.196:0/1688662926 shutdown_connections 2024-09-21T08:51:56.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.103+0000 7f7127d0a800 1 -- 172.21.15.196:0/1688662926 wait complete. 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.116+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f7127d0a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f7127d0a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6f50d8330 con 0x55f6f518b4c0 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f71257fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f71257fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33584/0 (socket says 172.21.15.196:33584) 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f71257fe640 1 -- 172.21.15.196:0/3748230040 learned_addr learned my addr 172.21.15.196:0/3748230040 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f71257fe640 1 -- 172.21.15.196:0/3748230040 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f5025bc0 con 0x55f6f518b4c0 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f71257fe640 1 --2- 172.21.15.196:0/3748230040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7118001d50 tx=0x7f711800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5871e7845a671b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.117+0000 7f7012e05640 1 -- 172.21.15.196:0/3748230040 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711800f400 con 0x55f6f518b4c0 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7012e05640 1 -- 172.21.15.196:0/3748230040 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711800f5a0 con 0x55f6f518b4c0 2024-09-21T08:51:56.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7012e05640 1 -- 172.21.15.196:0/3748230040 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711800f7d0 con 0x55f6f518b4c0 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 -- 172.21.15.196:0/3748230040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 msgr2=0x55f6f52795e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 --2- 172.21.15.196:0/3748230040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7118001d50 tx=0x7f711800b5b0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 -- 172.21.15.196:0/3748230040 shutdown_connections 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 --2- 172.21.15.196:0/3748230040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f52795e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 -- 172.21.15.196:0/3748230040 >> 172.21.15.196:0/3748230040 conn(0x55f6f5186df0 msgr2=0x55f6f5274fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 -- 172.21.15.196:0/3748230040 shutdown_connections 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.118+0000 7f7127d0a800 1 -- 172.21.15.196:0/3748230040 wait complete. 2024-09-21T08:51:56.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f7127d0a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f7127d0a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6f51924d0 con 0x55f6f518b4c0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f71257fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f71257fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33586/0 (socket says 172.21.15.196:33586) 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f71257fe640 1 -- 172.21.15.196:0/2030697325 learned_addr learned my addr 172.21.15.196:0/2030697325 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f71257fe640 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f5039fe0 con 0x55f6f518b4c0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f71257fe640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55f6f527a440 tx=0x7f7118000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.119+0000 7f7011602640 1 -- 172.21.15.196:0/2030697325 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711801a7c0 con 0x55f6f518b4c0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.120+0000 7f7011602640 1 -- 172.21.15.196:0/2030697325 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711801a960 con 0x55f6f518b4c0 2024-09-21T08:51:56.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.120+0000 7f7011602640 1 -- 172.21.15.196:0/2030697325 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711801ac60 con 0x55f6f518b4c0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.120+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6f5281530 con 0x55f6f518b4c0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.120+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f5281a50 con 0x55f6f518b4c0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7011602640 1 -- 172.21.15.196:0/2030697325 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7118017070 con 0x55f6f518b4c0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7011602640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 0x7f700c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7011602640 1 -- 172.21.15.196:0/2030697325 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7118015020 con 0x55f6f518b4c0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f711cffd640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 0x7f700c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 0x55f6f5288060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52885a0 con 0x55f6f518f900 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7125fff640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 0x55f6f5288060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f711cffd640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 0x7f700c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7110058000 tx=0x7f7110053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.121+0000 7f7125fff640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 0x55f6f5288060 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f7125fff640 1 -- 172.21.15.196:0/2030697325 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712000a4a0 con 0x55f6f518f900 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f5285630 con 0x55f6f518f900 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f7125fff640 1 -- 172.21.15.196:0/2030697325 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f712000a4a0 con 0x55f6f518f900 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 0x55f6f528ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f528d3b0 con 0x55f6f528a8d0 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.122+0000 7f71257fe640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 0x55f6f528ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f71257fe640 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 0x55f6f528ccc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f71257fe640 1 -- 172.21.15.196:0/2030697325 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f711802e070 con 0x55f6f528a8d0 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f5289740 con 0x55f6f518f900 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f7125fff640 1 -- 172.21.15.196:0/2030697325 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f712000a4a0 con 0x55f6f518f900 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f5289be0 con 0x55f6f518f900 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.123+0000 7f7125fff640 1 -- 172.21.15.196:0/2030697325 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f712000a4a0 con 0x55f6f518f900 2024-09-21T08:51:56.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7127d0a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7127d0a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5027580 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33600/0 (socket says 172.21.15.196:33600) 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.124+0000 7f7125fff640 1 -- 172.21.15.196:0/484383327 learned_addr learned my addr 172.21.15.196:0/484383327 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f7125fff640 1 -- 172.21.15.196:0/484383327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f529c620 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f7125fff640 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f6f5288980 tx=0x7f7120018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f700a7fc640 1 -- 172.21.15.196:0/484383327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120014450 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f700a7fc640 1 -- 172.21.15.196:0/484383327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7120014610 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6f529c8b0 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f700a7fc640 1 -- 172.21.15.196:0/484383327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120014930 con 0x55f6f529bcc0 2024-09-21T08:51:56.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.125+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f529f590 con 0x55f6f529bcc0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f700a7fc640 1 -- 172.21.15.196:0/484383327 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7120011040 con 0x55f6f529bcc0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f700a7fc640 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 0x7f6ffc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f700a7fc640 1 -- 172.21.15.196:0/484383327 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f712001e070 con 0x55f6f529bcc0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f71257fe640 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 0x7f6ffc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.126+0000 7f71257fe640 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 0x7f6ffc039050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f711801beb0 tx=0x7f711804b2d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7127d0a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7127d0a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5279d90 con 0x55f6f52acd30 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33610/0 (socket says 172.21.15.196:33610) 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7125fff640 1 -- 172.21.15.196:0/3333063400 learned_addr learned my addr 172.21.15.196:0/3333063400 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7125fff640 1 -- 172.21.15.196:0/3333063400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f52ad700 con 0x55f6f52acd30 2024-09-21T08:51:56.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f7125fff640 1 --2- 172.21.15.196:0/3333063400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f712004cb90 tx=0x7f7120011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1500d6fd81fa42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f6ffbfff640 1 -- 172.21.15.196:0/3333063400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120044070 con 0x55f6f52acd30 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f6ffbfff640 1 -- 172.21.15.196:0/3333063400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71200167c0 con 0x55f6f52acd30 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.127+0000 7f6ffbfff640 1 -- 172.21.15.196:0/3333063400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120013ca0 con 0x55f6f52acd30 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- 172.21.15.196:0/3333063400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 msgr2=0x55f6f52ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 --2- 172.21.15.196:0/3333063400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f712004cb90 tx=0x7f7120011700 comp rx=0 tx=0).stop 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- 172.21.15.196:0/3333063400 shutdown_connections 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 --2- 172.21.15.196:0/3333063400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52ad130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- 172.21.15.196:0/3333063400 >> 172.21.15.196:0/3333063400 conn(0x55f6f52a4c80 msgr2=0x55f6f52a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- 172.21.15.196:0/3333063400 shutdown_connections 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- 172.21.15.196:0/3333063400 wait complete. 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 Processor -- start 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- start start 2024-09-21T08:51:56.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.128+0000 7f7127d0a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6f52add70 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7125fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33614/0 (socket says 172.21.15.196:33614) 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 learned_addr learned my addr 172.21.15.196:0/1593996081 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f52b4720 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7125fff640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f712002f040 tx=0x7f712004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f6ffa7fc640 1 -- 172.21.15.196:0/1593996081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7120022c60 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f6ffa7fc640 1 -- 172.21.15.196:0/1593996081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7120022e20 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6f52b49b0 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f6ffa7fc640 1 -- 172.21.15.196:0/1593996081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712004e0d0 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.129+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f52b7660 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.130+0000 7f6ffa7fc640 1 -- 172.21.15.196:0/1593996081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f712003e020 con 0x55f6f52acd30 2024-09-21T08:51:56.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.130+0000 7f6ffa7fc640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ff0036be0 0x7f6ff00390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.130+0000 7f6ffa7fc640 1 -- 172.21.15.196:0/1593996081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f712003c020 con 0x55f6f52acd30 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.130+0000 7f71257fe640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ff0036be0 0x7f6ff00390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.131+0000 7f71257fe640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ff0036be0 0x7f6ff00390a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f711804b660 tx=0x7f7118035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.131+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.131+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f52bfdb0 0x55f6f52c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.131+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c29c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.131+0000 7f711cffd640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f52bfdb0 0x55f6f52c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f711cffd640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f52bfdb0 0x55f6f52c2270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 realm 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c2df0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c36c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.132+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c3a60 con 0x55f6f52bfdb0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f7127d0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f52c47c0 0x55f6f52c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.133+0000 7f7125fff640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f52c47c0 0x55f6f52c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7125fff640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f52c47c0 0x55f6f52c6bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7127d0a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7127d0a800 20 searching for the correct realm 2024-09-21T08:51:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f6f52c9150 0x55f6f52cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cbce0 con 0x55f6f52c9150 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f71257fe640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f6f52c9150 0x55f6f52cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.134+0000 7f71257fe640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f6f52c9150 0x55f6f52cb610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f71257fe640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f711801b3d0 0x7f711800e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cbce0 con 0x7f711801b3d0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f711cffd640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f711801b3d0 0x7f711800e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f711cffd640 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f711801b3d0 0x7f711800e590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cbce0 con 0x55f6f52c47c0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.135+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.136+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x7f711801b3d0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.137+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x7f711801b3d0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.138+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.139+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.140+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.140+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.140+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.140+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x7f711801b3d0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.141+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.142+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x7f711801b3d0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c9150 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.143+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c71c0 con 0x7f711801b3d0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c7560 con 0x55f6f52bfdb0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c7950 con 0x55f6f52bfdb0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.144+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c7d70 con 0x55f6f52bfdb0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 zone default found 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 4 Realm: () 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:56.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 zonegroup default 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52c7d70 con 0x55f6f52c47c0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52ce040 con 0x55f6f52c9150 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.145+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52ce3e0 con 0x55f6f52c9150 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.146+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.146+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.146+0000 7f7127d0a800 20 started sync module instance, tier type = 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.146+0000 7f7127d0a800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.146+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cd4d0 con 0x7f711801b3d0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.147+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.147+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94519163673088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cd4d0 con 0x7f711801b3d0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.147+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cee30 con 0x55f6f52bfdb0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.148+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94519163673088] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.148+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.148+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94519163670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cedf0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.148+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cf8d0 con 0x55f6f52c9150 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.149+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94519163670560] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.149+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.149+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94519163676992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52ced60 con 0x55f6f52c9150 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.149+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d0790 con 0x7f711801b3d0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.150+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.150+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94519163684032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d0f30 con 0x7f711801b3d0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.150+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94519163676992] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.150+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cfcc0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.151+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94519163688224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cfcc0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d2450 con 0x55f6f52c47c0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94519163684032] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94519163685248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d2410 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.152+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d2e60 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.153+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94519163688224] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.153+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94519163685248] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.154+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.154+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94519163690848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d2e60 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.154+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d23c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94519163691904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d3770 con 0x55f6f52c47c0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=0 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=1 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=2 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=3 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=4 2024-09-21T08:51:56.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=5 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94519163690848] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.155+0000 7f7127d0a800 20 add_watcher() i=6 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94519163691904] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f7127d0a800 20 add_watcher() i=7 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f7127d0a800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d29b0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.156+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94519163695744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d29b0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.157+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94519163695744] v34'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.157+0000 7f6fdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.157+0000 7f7127d0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.157+0000 7f7127d0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.157+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52df2b0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.158+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.158+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52df980 con 0x55f6f52c47c0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.159+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.159+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52df980 con 0x55f6f52c9150 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.160+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.160+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e01f0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.161+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.161+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52daf10 con 0x7f711801b3d0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.162+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.163+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52daf10 con 0x55f6f52c9150 2024-09-21T08:51:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.164+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.164+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52daf10 con 0x55f6f52bfdb0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.167+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.167+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52daf10 con 0x55f6f52c47c0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.168+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.168+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52dafa0 con 0x7f711801b3d0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.169+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.169+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52dafa0 con 0x55f6f52c9150 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.170+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.170+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52dafa0 con 0x7f711801b3d0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.171+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.171+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x55f6f52c47c0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.172+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.172+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x7f711801b3d0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.173+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.173+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x55f6f52c47c0 2024-09-21T08:51:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.174+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.174+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x55f6f52bfdb0 2024-09-21T08:51:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.175+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.175+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x55f6f52c9150 2024-09-21T08:51:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.176+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.176+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0f90 con 0x7f711801b3d0 2024-09-21T08:51:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.177+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.177+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e0fd0 con 0x55f6f52c9150 2024-09-21T08:51:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.180+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.180+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1080 con 0x55f6f52bfdb0 2024-09-21T08:51:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.181+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.181+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1080 con 0x55f6f52bfdb0 2024-09-21T08:51:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.183+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.183+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1080 con 0x55f6f52c9150 2024-09-21T08:51:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.186+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.186+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x7f711801b3d0 2024-09-21T08:51:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.187+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.187+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.188+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.188+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.189+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.189+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.189+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.189+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.190+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.190+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1080 con 0x55f6f52c47c0 2024-09-21T08:51:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.192+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.192+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.193+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.193+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c47c0 2024-09-21T08:51:56.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.194+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.194+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c9150 2024-09-21T08:51:56.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.195+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.195+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x55f6f52c47c0 2024-09-21T08:51:56.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.196+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.196+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52e1040 con 0x7f711801b3d0 2024-09-21T08:51:56.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.197+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f6fd9fe3640 20 reqs_thread_entry: start 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 20 Filter name: none 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f6f4b7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:51:56.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6f530c100 con 0x55f6f52c47c0 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.198+0000 7f7127d0a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:51:56.202 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T08:51:56.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.199+0000 7f6fdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.199+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94519163695744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52da080 con 0x55f6f52bfdb0 2024-09-21T08:51:56.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.200+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94519163695744] v34'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.200+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94519163673088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d3280 con 0x7f711801b3d0 2024-09-21T08:51:56.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.201+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94519163673088] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.201+0000 7f7127d0a800 20 remove_watcher() i=0 2024-09-21T08:51:56.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.201+0000 7f7127d0a800 2 removed watcher, disabling cache 2024-09-21T08:51:56.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.201+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94519163670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cda00 con 0x55f6f52bfdb0 2024-09-21T08:51:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.202+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94519163670560] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.202+0000 7f7127d0a800 20 remove_watcher() i=1 2024-09-21T08:51:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.202+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94519163676992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cd020 con 0x55f6f52c9150 2024-09-21T08:51:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.203+0000 7f71257fe640 1 -- 172.21.15.196:0/1593996081 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94519163676992] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711802e070 con 0x55f6f52c9150 2024-09-21T08:51:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.203+0000 7f7127d0a800 20 remove_watcher() i=2 2024-09-21T08:51:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.203+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94519163684032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cd020 con 0x7f711801b3d0 2024-09-21T08:51:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.204+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94519163684032] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x7f711801b3d0 2024-09-21T08:51:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.204+0000 7f7127d0a800 20 remove_watcher() i=3 2024-09-21T08:51:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.204+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94519163688224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d04c0 con 0x55f6f52bfdb0 2024-09-21T08:51:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.205+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94519163688224] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711004f760 con 0x55f6f52bfdb0 2024-09-21T08:51:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.205+0000 7f7127d0a800 20 remove_watcher() i=4 2024-09-21T08:51:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.205+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94519163685248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52cd020 con 0x55f6f52c47c0 2024-09-21T08:51:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.207+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94519163685248] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.207+0000 7f7127d0a800 20 remove_watcher() i=5 2024-09-21T08:51:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.207+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94519163690848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d1520 con 0x55f6f52c47c0 2024-09-21T08:51:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.208+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94519163690848] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.208+0000 7f7127d0a800 20 remove_watcher() i=6 2024-09-21T08:51:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.208+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94519163691904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6f52d04c0 con 0x55f6f52c47c0 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7125fff640 1 -- 172.21.15.196:0/1593996081 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94519163691904] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712002a070 con 0x55f6f52c47c0 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 20 remove_watcher() i=7 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f52c47c0 msgr2=0x55f6f52c6bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f52c47c0 0x55f6f52c6bb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f52bfdb0 msgr2=0x55f6f52c2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f52bfdb0 0x55f6f52c2270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f711801b3d0 msgr2=0x7f711800e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f711801b3d0 0x7f711800e590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f6f52c9150 msgr2=0x55f6f52cb610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f6f52c9150 0x55f6f52cb610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ff0036be0 msgr2=0x7f6ff00390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ff0036be0 0x7f6ff00390a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f711804b660 tx=0x7f7118035000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 msgr2=0x55f6f52b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f711cffd640 1 -- 172.21.15.196:0/1593996081 reap_dead start 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f712002f040 tx=0x7f712004cb20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 shutdown_connections 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/1593996081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f52acd30 0x55f6f52b41e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 >> 172.21.15.196:0/1593996081 conn(0x55f6f52a4c80 msgr2=0x55f6f52a2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 shutdown_connections 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/1593996081 wait complete. 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 msgr2=0x7f6ffc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 0x7f6ffc039050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f711801beb0 tx=0x7f711804b2d0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 msgr2=0x55f6f529c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f6f5288980 tx=0x7f7120018830 comp rx=0 tx=0).stop 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 shutdown_connections 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6ffc036b90 0x7f6ffc039050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 --2- 172.21.15.196:0/484383327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f529bcc0 0x55f6f529c0e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 >> 172.21.15.196:0/484383327 conn(0x55f6f5290c50 msgr2=0x55f6f52937d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 shutdown_connections 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.209+0000 7f7127d0a800 1 -- 172.21.15.196:0/484383327 wait complete. 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 msgr2=0x55f6f528ccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 0x55f6f528ccc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 msgr2=0x55f6f5288060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 0x55f6f5288060 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 msgr2=0x7f700c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 0x7f700c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7110058000 tx=0x7f7110053000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 msgr2=0x55f6f5280ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55f6f527a440 tx=0x7f7118000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 shutdown_connections 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f6f528a8d0 0x55f6f528ccc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f6f518f900 0x55f6f5288060 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f700c036b40 0x7f700c039000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 --2- 172.21.15.196:0/2030697325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6f518b4c0 0x55f6f5280ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 >> 172.21.15.196:0/2030697325 conn(0x55f6f5186df0 msgr2=0x55f6f52738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 shutdown_connections 2024-09-21T08:51:56.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.210+0000 7f7127d0a800 1 -- 172.21.15.196:0/2030697325 wait complete. 2024-09-21T08:51:56.221 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T08:51:56.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T08:51:56.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T08:51:56.221 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T08:51:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.263+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.263+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.263+0000 7f4d18124800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2b9fb2a60 0x55a2b9fb4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d18124800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2b9e6db30 con 0x55a2b9fae760 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d18124800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a2b9e4f360 con 0x55a2b9fb2a60 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d0b615640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2b9fb2a60 0x55a2b9fb4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d0b615640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2b9fb2a60 0x55a2b9fb4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33620/0 (socket says 172.21.15.196:33620) 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d0b615640 1 -- 172.21.15.196:0/3213366162 learned_addr learned my addr 172.21.15.196:0/3213366162 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d13e16640 1 --1- 172.21.15.196:0/3213366162 >> v1:172.21.15.29:6789/0 conn(0x55a2b9fae760 0x55a2b9faeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46760/0 (socket says 172.21.15.196:46760) 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d0b615640 1 -- 172.21.15.196:0/3213366162 >> v1:172.21.15.29:6789/0 conn(0x55a2b9fae760 legacy=0x55a2b9faeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.264+0000 7f4d0b615640 1 -- 172.21.15.196:0/3213366162 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b9e75e00 con 0x55a2b9fb2a60 2024-09-21T08:51:56.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.266+0000 7f4d0b615640 1 --2- 172.21.15.196:0/3213366162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fb2a60 0x55a2b9fb4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f456bc0305a8a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.266+0000 7f4d13615640 1 -- 172.21.15.196:0/3213366162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc055070 con 0x55a2b9fb2a60 2024-09-21T08:51:56.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.266+0000 7f4d13615640 1 -- 172.21.15.196:0/3213366162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0515b0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.266+0000 7f4d13615640 1 -- 172.21.15.196:0/3213366162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc0518d0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 -- 172.21.15.196:0/3213366162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fb2a60 msgr2=0x55a2b9fb4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 --2- 172.21.15.196:0/3213366162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fb2a60 0x55a2b9fb4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 -- 172.21.15.196:0/3213366162 shutdown_connections 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 --2- 172.21.15.196:0/3213366162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fb2a60 0x55a2b9fb4e50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 -- 172.21.15.196:0/3213366162 >> 172.21.15.196:0/3213366162 conn(0x55a2b9fa9ff0 msgr2=0x55a2b9fac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 -- 172.21.15.196:0/3213366162 shutdown_connections 2024-09-21T08:51:56.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.267+0000 7f4d18124800 1 -- 172.21.15.196:0/3213366162 wait complete. 2024-09-21T08:51:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d18124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d18124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2b9efa330 con 0x55a2b9fae760 2024-09-21T08:51:56.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d13e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d13e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33622/0 (socket says 172.21.15.196:33622) 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d13e16640 1 -- 172.21.15.196:0/133241502 learned_addr learned my addr 172.21.15.196:0/133241502 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.281+0000 7f4d13e16640 1 -- 172.21.15.196:0/133241502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b9e47bc0 con 0x55a2b9fae760 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.282+0000 7f4d13e16640 1 --2- 172.21.15.196:0/133241502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400b230 tx=0x7f4d0400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf07a443c1476adc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.282+0000 7f4c01e0b640 1 -- 172.21.15.196:0/133241502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0400e5c0 con 0x55a2b9fae760 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.282+0000 7f4c01e0b640 1 -- 172.21.15.196:0/133241502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d04006070 con 0x55a2b9fae760 2024-09-21T08:51:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.282+0000 7f4c01e0b640 1 -- 172.21.15.196:0/133241502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0400e890 con 0x55a2b9fae760 2024-09-21T08:51:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- 172.21.15.196:0/133241502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 msgr2=0x55a2b9f246c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 --2- 172.21.15.196:0/133241502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400b230 tx=0x7f4d0400b6f0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- 172.21.15.196:0/133241502 shutdown_connections 2024-09-21T08:51:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 --2- 172.21.15.196:0/133241502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2b9f246c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- 172.21.15.196:0/133241502 >> 172.21.15.196:0/133241502 conn(0x55a2b9fa9ff0 msgr2=0x55a2ba099220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- 172.21.15.196:0/133241502 shutdown_connections 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- 172.21.15.196:0/133241502 wait complete. 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d18124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2b9fb5690 con 0x55a2b9fae760 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d13e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d13e16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33638/0 (socket says 172.21.15.196:33638) 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.283+0000 7f4d13e16640 1 -- 172.21.15.196:0/628900998 learned_addr learned my addr 172.21.15.196:0/628900998 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4d13e16640 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b9e5bfe0 con 0x55a2b9fae760 2024-09-21T08:51:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4d13e16640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000fd0 tx=0x7f4d04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4bfbfff640 1 -- 172.21.15.196:0/628900998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0400f8d0 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4bfbfff640 1 -- 172.21.15.196:0/628900998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0400fa90 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ba0a7a70 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4bfbfff640 1 -- 172.21.15.196:0/628900998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0400fdb0 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.284+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ba0a7f90 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4bfbfff640 1 -- 172.21.15.196:0/628900998 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d04017070 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4bfbfff640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 0x7f4bfc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4bfbfff640 1 -- 172.21.15.196:0/628900998 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d04015020 con 0x55a2b9fae760 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4d0b615640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 0x7f4bfc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 0x55a2ba0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0aeb20 con 0x55a2b9fb2a60 2024-09-21T08:51:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.285+0000 7f4d14617640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 0x55a2ba0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d0b615640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 0x7f4bfc039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc057000 tx=0x7f4cfc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d14617640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 0x55a2ba0ae5a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d14617640 1 -- 172.21.15.196:0/628900998 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d0c00a4a0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0abb70 con 0x55a2b9fb2a60 2024-09-21T08:51:56.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d14617640 1 -- 172.21.15.196:0/628900998 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d0c00a4a0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 0x55a2ba0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0b38e0 con 0x55a2ba0b0e50 2024-09-21T08:51:56.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.286+0000 7f4d13e16640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 0x55a2ba0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.287+0000 7f4d13e16640 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 0x55a2ba0b3240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.287+0000 7f4d13e16640 1 -- 172.21.15.196:0/628900998 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0b0e50 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.287+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0afcf0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.287+0000 7f4d14617640 1 -- 172.21.15.196:0/628900998 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d0c00a4a0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.287+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0b0190 con 0x55a2b9fb2a60 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d14617640 1 -- 172.21.15.196:0/628900998 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d0c00a4a0 con 0x55a2b9fb2a60 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d18124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d18124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2b9e49580 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33650/0 (socket says 172.21.15.196:33650) 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.288+0000 7f4d14617640 1 -- 172.21.15.196:0/1828528294 learned_addr learned my addr 172.21.15.196:0/1828528294 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4d14617640 1 -- 172.21.15.196:0/1828528294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ba0c2b60 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4d14617640 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55a2ba0a85e0 tx=0x7f4d0c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4bf97fa640 1 -- 172.21.15.196:0/1828528294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c014450 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4bf97fa640 1 -- 172.21.15.196:0/1828528294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0145f0 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ba0c2df0 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4bf97fa640 1 -- 172.21.15.196:0/1828528294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c0148d0 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.289+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ba0c5ad0 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4bf97fa640 1 -- 172.21.15.196:0/1828528294 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d0c011040 con 0x55a2ba0c2200 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4bf97fa640 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 0x7f4bec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4bf97fa640 1 -- 172.21.15.196:0/1828528294 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d0c01e070 con 0x55a2ba0c2200 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 0x7f4bec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 0x7f4bec039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55a2ba0aef70 tx=0x7f4d0404b690 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d18124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.290+0000 7f4d18124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2b9f22d90 con 0x55a2ba0ceed0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33662/0 (socket says 172.21.15.196:33662) 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d14617640 1 -- 172.21.15.196:0/3095312479 learned_addr learned my addr 172.21.15.196:0/3095312479 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d14617640 1 -- 172.21.15.196:0/3095312479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ba0cf8a0 con 0x55a2ba0ceed0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d14617640 1 --2- 172.21.15.196:0/3095312479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04cb90 tx=0x7f4d0c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26c84d5db5b5031 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4bf2ffd640 1 -- 172.21.15.196:0/3095312479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c044070 con 0x55a2ba0ceed0 2024-09-21T08:51:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4bf2ffd640 1 -- 172.21.15.196:0/3095312479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c02ba60 con 0x55a2ba0ceed0 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4bf2ffd640 1 -- 172.21.15.196:0/3095312479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c02bd60 con 0x55a2ba0ceed0 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d18124800 1 -- 172.21.15.196:0/3095312479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 msgr2=0x55a2ba0cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.291+0000 7f4d18124800 1 --2- 172.21.15.196:0/3095312479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04cb90 tx=0x7f4d0c011700 comp rx=0 tx=0).stop 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- 172.21.15.196:0/3095312479 shutdown_connections 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 --2- 172.21.15.196:0/3095312479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0cf2d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- 172.21.15.196:0/3095312479 >> 172.21.15.196:0/3095312479 conn(0x55a2ba0cb230 msgr2=0x55a2ba0c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- 172.21.15.196:0/3095312479 shutdown_connections 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- 172.21.15.196:0/3095312479 wait complete. 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 Processor -- start 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- start start 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d18124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ba0cfe20 con 0x55a2ba0ceed0 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d14617640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33668/0 (socket says 172.21.15.196:33668) 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 learned_addr learned my addr 172.21.15.196:0/1931483011 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.292+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ba0d6860 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4d14617640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04ba60 tx=0x7f4d0c04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4bf17fa640 1 -- 172.21.15.196:0/1931483011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c03a020 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4bf17fa640 1 -- 172.21.15.196:0/1931483011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c02b350 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ba0d6af0 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4bf17fa640 1 -- 172.21.15.196:0/1931483011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0c02b670 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.293+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ba0d97a0 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4bf17fa640 1 -- 172.21.15.196:0/1931483011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d0c03d020 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4bf17fa640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bdc036b40 0x7f4bdc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4bf17fa640 1 -- 172.21.15.196:0/1931483011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d0c033040 con 0x55a2ba0ceed0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bdc036b40 0x7f4bdc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bdc036b40 0x7f4bdc039000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d0404d010 tx=0x7f4d04035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.294+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ba0e1f40 0x55a2ba0e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e4b50 con 0x55a2ba0e1f40 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d0b615640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ba0e1f40 0x55a2ba0e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d0b615640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ba0e1f40 0x55a2ba0e4400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 20 realm 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e4f80 con 0x55a2ba0e1f40 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:56.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.295+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e5850 con 0x55a2ba0e1f40 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e5bf0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0e6950 0x55a2ba0e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e9350 con 0x55a2ba0e6950 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.296+0000 7f4d14617640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0e6950 0x55a2ba0e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d14617640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0e6950 0x55a2ba0e8d40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d18124800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d18124800 20 searching for the correct realm 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ba0eb2e0 0x55a2ba0ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ba0eb2e0 0x55a2ba0ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.297+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ba0eb2e0 0x55a2ba0ed7a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d13e16640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4d0400f070 0x7f4d0401c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d0b615640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4d0400f070 0x7f4d0401c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d0b615640 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4d0400f070 0x7f4d0401c620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.298+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.299+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.300+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.301+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.302+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.303+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.304+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e6950 2024-09-21T08:51:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.305+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x55a2ba0e1f40 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ede70 con 0x7f4d0400f070 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ea830 con 0x55a2ba0e1f40 2024-09-21T08:51:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0e97b0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.306+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ea130 con 0x55a2ba0e1f40 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 zone default found 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 4 Realm: () 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 zonegroup default 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ee7a0 con 0x55a2ba0e6950 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f09d0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.307+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f0d70 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.308+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.308+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.308+0000 7f4d18124800 20 started sync module instance, tier type = 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.308+0000 7f4d18124800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.308+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0efe10 con 0x7f4d0400f070 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.309+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.309+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157394608912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0efe10 con 0x7f4d0400f070 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.309+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f1730 con 0x55a2ba0e1f40 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.311+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.311+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157394612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f1bd0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.311+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f26c0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.311+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157394608912] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.312+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157394612864] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.312+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.312+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157394613920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0ef960 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.312+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f2f90 con 0x7f4d0400f070 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.314+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157394613920] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.314+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.314+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157394619104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f2f00 con 0x7f4d0400f070 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.314+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3e50 con 0x55a2ba0e1f40 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.317+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.317+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157394622880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3dc0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.317+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f4db0 con 0x55a2ba0e6950 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.317+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157394619104] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.318+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157394622880] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.320+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.320+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157394625088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f4890 con 0x55a2ba0e6950 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.320+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f5650 con 0x55a2ba0e6950 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.321+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.321+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157394629024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f5ab0 con 0x55a2ba0e6950 2024-09-21T08:51:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.321+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f65b0 con 0x55a2ba0e6950 2024-09-21T08:51:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.321+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157394625088] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.321+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157394629024] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157394632864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f55c0 con 0x55a2ba0e6950 2024-09-21T08:51:56.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=0 2024-09-21T08:51:56.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=1 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=2 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=3 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=4 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=5 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.322+0000 7f4d18124800 20 add_watcher() i=6 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157394632864] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d18124800 20 add_watcher() i=7 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d18124800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f95a0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.323+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157394621312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f6a20 con 0x55a2ba0e1f40 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.324+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157394621312] v34'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.324+0000 7f4bc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.324+0000 7f4d18124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.324+0000 7f4d18124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.324+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba101ef0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.326+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.326+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1025c0 con 0x55a2ba0e6950 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.327+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.327+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1025c0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.328+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.328+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba102f10 con 0x55a2ba0e1f40 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.329+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.329+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba103370 con 0x7f4d0400f070 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.330+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.330+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1038e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.331+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.331+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba103d10 con 0x55a2ba0e1f40 2024-09-21T08:51:56.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.332+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.332+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba103d10 con 0x55a2ba0e6950 2024-09-21T08:51:56.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.333+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.333+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba102ca0 con 0x7f4d0400f070 2024-09-21T08:51:56.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.334+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.334+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.335+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.335+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x7f4d0400f070 2024-09-21T08:51:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.336+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.336+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e6950 2024-09-21T08:51:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.337+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.337+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x7f4d0400f070 2024-09-21T08:51:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.338+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.338+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e6950 2024-09-21T08:51:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.339+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.339+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.340+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.340+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.341+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.341+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x7f4d0400f070 2024-09-21T08:51:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.342+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.342+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.343+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.343+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.344+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.344+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.345+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.346+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.346+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.347+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x7f4d0400f070 2024-09-21T08:51:56.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.347+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.347+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.348+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.348+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.349+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.349+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.350+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.350+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.351+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.351+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e6950 2024-09-21T08:51:56.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.353+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.353+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.353+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.353+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e6950 2024-09-21T08:51:56.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.354+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.354+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.356+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.356+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x55a2ba0e6950 2024-09-21T08:51:56.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.356+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.357+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba1042e0 con 0x7f4d0400f070 2024-09-21T08:51:56.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4bc8fe1640 20 reqs_thread_entry: start 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 20 Filter name: none 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4b427fc640 20 reqs_thread_entry: start 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba12f300 con 0x55a2ba0e1f40 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.358+0000 7f4d18124800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, user does not exist 2024-09-21T08:51:56.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.359+0000 7f4bc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.359+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157394621312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0fd850 con 0x55a2ba0e1f40 2024-09-21T08:51:56.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.360+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94157394621312] v34'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.360+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157394608912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3380 con 0x7f4d0400f070 2024-09-21T08:51:56.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.361+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94157394608912] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.361+0000 7f4d18124800 20 remove_watcher() i=0 2024-09-21T08:51:56.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.361+0000 7f4d18124800 2 removed watcher, disabling cache 2024-09-21T08:51:56.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.361+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157394612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3380 con 0x55a2ba0e1f40 2024-09-21T08:51:56.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.362+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94157394612864] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.362+0000 7f4d18124800 20 remove_watcher() i=1 2024-09-21T08:51:56.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.362+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157394613920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f1280 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.363+0000 7f4d13e16640 1 -- 172.21.15.196:0/1931483011 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94157394613920] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0402e070 con 0x55a2ba0eb2e0 2024-09-21T08:51:56.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.363+0000 7f4d18124800 20 remove_watcher() i=2 2024-09-21T08:51:56.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.363+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157394619104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3380 con 0x7f4d0400f070 2024-09-21T08:51:56.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.364+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94157394619104] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x7f4d0400f070 2024-09-21T08:51:56.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.364+0000 7f4d18124800 20 remove_watcher() i=3 2024-09-21T08:51:56.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.364+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157394622880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f2ae0 con 0x55a2ba0e1f40 2024-09-21T08:51:56.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.365+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94157394622880] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cfc057030 con 0x55a2ba0e1f40 2024-09-21T08:51:56.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.365+0000 7f4d18124800 20 remove_watcher() i=4 2024-09-21T08:51:56.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.365+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157394625088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f3380 con 0x55a2ba0e6950 2024-09-21T08:51:56.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.366+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94157394625088] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.366+0000 7f4d18124800 20 remove_watcher() i=5 2024-09-21T08:51:56.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.366+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157394629024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f39a0 con 0x55a2ba0e6950 2024-09-21T08:51:56.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.367+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94157394629024] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.367+0000 7f4d18124800 20 remove_watcher() i=6 2024-09-21T08:51:56.370 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.367+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157394632864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ba0f2ae0 con 0x55a2ba0e6950 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d14617640 1 -- 172.21.15.196:0/1931483011 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94157394632864] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0c02a070 con 0x55a2ba0e6950 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 20 remove_watcher() i=7 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0e6950 msgr2=0x55a2ba0e8d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0e6950 0x55a2ba0e8d40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ba0e1f40 msgr2=0x55a2ba0e4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ba0e1f40 0x55a2ba0e4400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4d0400f070 msgr2=0x7f4d0401c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4d0400f070 0x7f4d0401c620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ba0eb2e0 msgr2=0x55a2ba0ed7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.368+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ba0eb2e0 0x55a2ba0ed7a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bdc036b40 msgr2=0x7f4bdc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bdc036b40 0x7f4bdc039000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d0404d010 tx=0x7f4d04035000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 msgr2=0x55a2ba0d6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d0b615640 1 -- 172.21.15.196:0/1931483011 reap_dead start 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c04ba60 tx=0x7f4d0c04cb20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 shutdown_connections 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1931483011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0ceed0 0x55a2ba0d6320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 >> 172.21.15.196:0/1931483011 conn(0x55a2ba0cb230 msgr2=0x55a2ba0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 shutdown_connections 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1931483011 wait complete. 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 msgr2=0x7f4bec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 0x7f4bec039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55a2ba0aef70 tx=0x7f4d0404b690 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 msgr2=0x55a2ba0c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55a2ba0a85e0 tx=0x7f4d0c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 shutdown_connections 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bec036b40 0x7f4bec039000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/1828528294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ba0c2200 0x55a2ba0c2620 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 >> 172.21.15.196:0/1828528294 conn(0x55a2ba0b7190 msgr2=0x55a2ba0b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 shutdown_connections 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/1828528294 wait complete. 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 msgr2=0x55a2ba0b3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 0x55a2ba0b3240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 msgr2=0x55a2ba0ae5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.369+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 0x55a2ba0ae5a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 msgr2=0x7f4bfc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 0x7f4bfc039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc057000 tx=0x7f4cfc052000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 msgr2=0x55a2ba0a7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000fd0 tx=0x7f4d04000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 shutdown_connections 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ba0b0e50 0x55a2ba0b3240 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2b9fb2a60 0x55a2ba0ae5a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4bfc036b40 0x7f4bfc039000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 --2- 172.21.15.196:0/628900998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2b9fae760 0x55a2ba0a7530 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 >> 172.21.15.196:0/628900998 conn(0x55a2b9fa9ff0 msgr2=0x55a2ba098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 shutdown_connections 2024-09-21T08:51:56.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.370+0000 7f4d18124800 1 -- 172.21.15.196:0/628900998 wait complete. 2024-09-21T08:51:56.380 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-21T08:51:56.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T08:51:56.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T08:51:56.381 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-21T08:51:56.467 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.467 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1ed42800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558a8a54efa0 0x558a8a5de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1ed42800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a8a49ab30 con 0x558a8a5de710 2024-09-21T08:51:56.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1ed42800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558a8a47c360 con 0x558a8a54efa0 2024-09-21T08:51:56.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac1aa97640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558a8a54efa0 0x558a8a5de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac12296640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x558a8a5de710 0x558a8a5e0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46772/0 (socket says 172.21.15.196:46772) 2024-09-21T08:51:56.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.466+0000 7fac12296640 1 -- 172.21.15.196:0/4049388261 learned_addr learned my addr 172.21.15.196:0/4049388261 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:56.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.467+0000 7fac1aa97640 1 -- 172.21.15.196:0/4049388261 >> v1:172.21.15.29:6789/0 conn(0x558a8a5de710 legacy=0x558a8a5e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.467+0000 7fac1aa97640 1 -- 172.21.15.196:0/4049388261 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a4a2e00 con 0x558a8a54efa0 2024-09-21T08:51:56.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.468+0000 7fac1aa97640 1 --2- 172.21.15.196:0/4049388261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a5de1d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a470 tx=0x7fac0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d20d40e980d55f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1a296640 1 -- 172.21.15.196:0/4049388261 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c053570 con 0x558a8a54efa0 2024-09-21T08:51:56.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1a296640 1 -- 172.21.15.196:0/4049388261 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c058070 con 0x558a8a54efa0 2024-09-21T08:51:56.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1a296640 1 -- 172.21.15.196:0/4049388261 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c053880 con 0x558a8a54efa0 2024-09-21T08:51:56.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 -- 172.21.15.196:0/4049388261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 msgr2=0x558a8a5de1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 --2- 172.21.15.196:0/4049388261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a5de1d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a470 tx=0x7fac0c045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 -- 172.21.15.196:0/4049388261 shutdown_connections 2024-09-21T08:51:56.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 --2- 172.21.15.196:0/4049388261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a5de1d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 -- 172.21.15.196:0/4049388261 >> 172.21.15.196:0/4049388261 conn(0x558a8a5d5e40 msgr2=0x558a8a5d8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 -- 172.21.15.196:0/4049388261 shutdown_connections 2024-09-21T08:51:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.469+0000 7fac1ed42800 1 -- 172.21.15.196:0/4049388261 wait complete. 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1ed42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1ed42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a8a527350 con 0x558a8a54efa0 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33690/0 (socket says 172.21.15.196:33690) 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.483+0000 7fac1aa97640 1 -- 172.21.15.196:0/3341495617 learned_addr learned my addr 172.21.15.196:0/3341495617 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.484+0000 7fac1aa97640 1 -- 172.21.15.196:0/3341495617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a474bc0 con 0x558a8a54efa0 2024-09-21T08:51:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.484+0000 7fac1aa97640 1 --2- 172.21.15.196:0/3341495617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fac0c025c20 tx=0x7fac0c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7618d66ad920231 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.484+0000 7fab08e09640 1 -- 172.21.15.196:0/3341495617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c05c580 con 0x558a8a54efa0 2024-09-21T08:51:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.484+0000 7fab08e09640 1 -- 172.21.15.196:0/3341495617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c063030 con 0x558a8a54efa0 2024-09-21T08:51:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.484+0000 7fab08e09640 1 -- 172.21.15.196:0/3341495617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c05c850 con 0x558a8a54efa0 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- 172.21.15.196:0/3341495617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 msgr2=0x558a8a6ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3341495617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fac0c025c20 tx=0x7fac0c051000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- 172.21.15.196:0/3341495617 shutdown_connections 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3341495617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6ca990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- 172.21.15.196:0/3341495617 >> 172.21.15.196:0/3341495617 conn(0x558a8a5d5e40 msgr2=0x558a8a6c6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- 172.21.15.196:0/3341495617 shutdown_connections 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- 172.21.15.196:0/3341495617 wait complete. 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.485+0000 7fac1ed42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a8a5e2680 con 0x558a8a54efa0 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33694/0 (socket says 172.21.15.196:33694) 2024-09-21T08:51:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1aa97640 1 -- 172.21.15.196:0/2688077810 learned_addr learned my addr 172.21.15.196:0/2688077810 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1aa97640 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a488fe0 con 0x558a8a54efa0 2024-09-21T08:51:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1aa97640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a330 tx=0x7fac0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fab07606640 1 -- 172.21.15.196:0/2688077810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c06c030 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fab07606640 1 -- 172.21.15.196:0/2688077810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c05c580 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a8a6d2760 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fab07606640 1 -- 172.21.15.196:0/2688077810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c05c880 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.486+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8a6d2ce0 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1ed42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1ed42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a8a476580 con 0x558a8a6df070 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fab07606640 1 -- 172.21.15.196:0/2688077810 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac0c053440 con 0x558a8a54efa0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1b298640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1b298640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33708/0 (socket says 172.21.15.196:33708) 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fac1b298640 1 -- 172.21.15.196:0/1429207777 learned_addr learned my addr 172.21.15.196:0/1429207777 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fab07606640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 0x7fab000391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.487+0000 7fab07606640 1 -- 172.21.15.196:0/2688077810 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fac0c070020 con 0x558a8a54efa0 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1aa97640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 0x7fab000391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1b298640 1 -- 172.21.15.196:0/1429207777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a6df9b0 con 0x558a8a6df070 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1b298640 1 --2- 172.21.15.196:0/1429207777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a430 tx=0x7fac1400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea854db2054a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1aa97640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 0x7fab000391a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac0c067b00 tx=0x7fac0c080040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fab05602640 1 -- 172.21.15.196:0/1429207777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac14015070 con 0x558a8a6df070 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fab05602640 1 -- 172.21.15.196:0/1429207777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac14001670 con 0x558a8a6df070 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fab05602640 1 -- 172.21.15.196:0/1429207777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac14001990 con 0x558a8a6df070 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 -- 172.21.15.196:0/1429207777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 msgr2=0x558a8a6df470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 --2- 172.21.15.196:0/1429207777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a430 tx=0x7fac1400a8f0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 -- 172.21.15.196:0/1429207777 shutdown_connections 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 --2- 172.21.15.196:0/1429207777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6df470 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 -- 172.21.15.196:0/1429207777 >> 172.21.15.196:0/1429207777 conn(0x558a8a5de710 msgr2=0x558a8a6da7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 -- 172.21.15.196:0/1429207777 shutdown_connections 2024-09-21T08:51:56.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.488+0000 7fac1ed42800 1 -- 172.21.15.196:0/1429207777 wait complete. 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1ed42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1ed42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a8a6dfbe0 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1b298640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1b298640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33718/0 (socket says 172.21.15.196:33718) 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1b298640 1 -- 172.21.15.196:0/2818618583 learned_addr learned my addr 172.21.15.196:0/2818618583 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.489+0000 7fac1b298640 1 -- 172.21.15.196:0/2818618583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a6e6a70 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7fac1b298640 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac14013040 tx=0x7fac14003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7faaff7fe640 1 -- 172.21.15.196:0/2818618583 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac14020020 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a8a6e6d00 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8a6e99b0 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7faaff7fe640 1 -- 172.21.15.196:0/2818618583 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac140108e0 con 0x558a8a6df070 2024-09-21T08:51:56.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.490+0000 7faaff7fe640 1 -- 172.21.15.196:0/2818618583 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac14015040 con 0x558a8a6df070 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7faaff7fe640 1 -- 172.21.15.196:0/2818618583 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac14023020 con 0x558a8a6df070 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7faaff7fe640 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 0x7faaf4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7faaff7fe640 1 -- 172.21.15.196:0/2818618583 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fac1404c070 con 0x558a8a6df070 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7fac12296640 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 0x7faaf4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7fac1ed42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7fac1ed42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.491+0000 7fac12296640 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 0x7faaf4039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558a8a6db390 tx=0x7fac04001270 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1ed42800 1 Processor -- start 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1ed42800 1 -- start start 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1ed42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1ed42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a8a6cb0e0 con 0x558a8a7005a0 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1aa97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33734/0 (socket says 172.21.15.196:33734) 2024-09-21T08:51:56.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1aa97640 1 -- 172.21.15.196:0/3267128146 learned_addr learned my addr 172.21.15.196:0/3267128146 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.492+0000 7fac1aa97640 1 -- 172.21.15.196:0/3267128146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8a700f90 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7fac1aa97640 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac0c05d010 tx=0x7fac0c067990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7faadf7e6640 1 -- 172.21.15.196:0/3267128146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c079070 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7faadf7e6640 1 -- 172.21.15.196:0/3267128146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c095070 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a8a703b60 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7faadf7e6640 1 -- 172.21.15.196:0/3267128146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac0c009410 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.493+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8a703f40 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7faadf7e6640 1 -- 172.21.15.196:0/3267128146 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac0c085070 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7faadf7e6640 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 0x7faa5c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7faadf7e6640 1 -- 172.21.15.196:0/3267128146 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fac0c08e070 con 0x558a8a7005a0 2024-09-21T08:51:56.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac12296640 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 0x7faa5c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7faadd7e2640 20 reqs_thread_entry: start 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac12296640 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 0x7faa5c039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac04004170 tx=0x7fac0400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 0x558a8a710400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a8a710ad0 con 0x558a8a70df70 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac1b298640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 0x558a8a710400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.494+0000 7fac1b298640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 0x558a8a710400 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.495+0000 7fac1b298640 1 -- 172.21.15.196:0/2688077810 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac1400e070 con 0x558a8a70df70 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.495+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 0x558a8a714c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.495+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:2 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a8a7152e0 con 0x558a8a7128a0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.495+0000 7fac1aa97640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 0x558a8a714c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.495+0000 7fac1aa97640 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 0x558a8a714c90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.496+0000 7fac1aa97640 1 -- 172.21.15.196:0/2688077810 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(2 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac0c07b070 con 0x558a8a7128a0 2024-09-21T08:51:56.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.496+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a8a71a140 con 0x558a8a7128a0 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.497+0000 7fac1aa97640 1 -- 172.21.15.196:0/2688077810 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [stat,call,call,writefull 0~993] v34'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fac0c07b070 con 0x558a8a7128a0 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 msgr2=0x7faaf4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 0x7faaf4039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558a8a6db390 tx=0x7fac04001270 comp rx=0 tx=0).stop 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 msgr2=0x558a8a6e6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac14013040 tx=0x7fac14003370 comp rx=0 tx=0).stop 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 shutdown_connections 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faaf4036b40 0x7faaf4039000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2818618583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a6df070 0x558a8a6e6530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 >> 172.21.15.196:0/2818618583 conn(0x558a8a5de710 msgr2=0x558a8a6da3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 shutdown_connections 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2818618583 wait complete. 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 msgr2=0x7faa5c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 0x7faa5c039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac04004170 tx=0x7fac0400f000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 msgr2=0x558a8a7009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac0c05d010 tx=0x7fac0c067990 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 shutdown_connections 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa5c036b40 0x7faa5c039000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/3267128146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a7005a0 0x558a8a7009c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 >> 172.21.15.196:0/3267128146 conn(0x558a8a6f54b0 msgr2=0x558a8a6f7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 shutdown_connections 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/3267128146 wait complete. 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 msgr2=0x558a8a714c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 0x558a8a714c90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 msgr2=0x558a8a710400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.498+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 0x558a8a710400 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 msgr2=0x7fab000391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 0x7fab000391a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac0c067b00 tx=0x7fac0c080040 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 msgr2=0x558a8a6d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a330 tx=0x7fac0c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 shutdown_connections 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558a8a7128a0 0x558a8a714c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558a8a70df70 0x558a8a710400 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fab00036ce0 0x7fab000391a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 --2- 172.21.15.196:0/2688077810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a8a54efa0 0x558a8a6d2220 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 >> 172.21.15.196:0/2688077810 conn(0x558a8a5d5e40 msgr2=0x558a8a6c4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 shutdown_connections 2024-09-21T08:51:56.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.499+0000 7fac1ed42800 1 -- 172.21.15.196:0/2688077810 wait complete. 2024-09-21T08:51:56.509 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T08:51:56.509 DEBUG:tasks.util.rgw: json result: {'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T08:51:56.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-21T08:51:56.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-21T08:51:56.511 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-21T08:51:56.553 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.553 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.551+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.551+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.551+0000 7f862d20f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2861208d0 0x55a286122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.551+0000 7f862d20f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a285fdbb30 con 0x55a28608fe00 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.551+0000 7f862d20f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a285fbd360 con 0x55a2861208d0 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f8623fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2861208d0 0x55a286122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f86288e7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55a28608fe00 0x55a28611f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46788/0 (socket says 172.21.15.196:46788) 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f8623fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2861208d0 0x55a286122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33736/0 (socket says 172.21.15.196:33736) 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f86288e7640 1 -- 172.21.15.196:0/4029050249 learned_addr learned my addr 172.21.15.196:0/4029050249 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f8623fff640 1 -- 172.21.15.196:0/4029050249 >> v1:172.21.15.29:6789/0 conn(0x55a28608fe00 legacy=0x55a28611f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.552+0000 7f8623fff640 1 -- 172.21.15.196:0/4029050249 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a285fe3e00 con 0x55a2861208d0 2024-09-21T08:51:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f8623fff640 1 --2- 172.21.15.196:0/4029050249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2861208d0 0x55a286122cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f861400a470 tx=0x7f8614045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d66edfaabb2267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f86237fe640 1 -- 172.21.15.196:0/4029050249 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8614053570 con 0x55a2861208d0 2024-09-21T08:51:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f86237fe640 1 -- 172.21.15.196:0/4029050249 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8614058070 con 0x55a2861208d0 2024-09-21T08:51:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f86237fe640 1 -- 172.21.15.196:0/4029050249 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8614053880 con 0x55a2861208d0 2024-09-21T08:51:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 -- 172.21.15.196:0/4029050249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2861208d0 msgr2=0x55a286122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 --2- 172.21.15.196:0/4029050249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2861208d0 0x55a286122cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f861400a470 tx=0x7f8614045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 -- 172.21.15.196:0/4029050249 shutdown_connections 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 --2- 172.21.15.196:0/4029050249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2861208d0 0x55a286122cc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 -- 172.21.15.196:0/4029050249 >> 172.21.15.196:0/4029050249 conn(0x55a286116de0 msgr2=0x55a286119200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 -- 172.21.15.196:0/4029050249 shutdown_connections 2024-09-21T08:51:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.554+0000 7f862d20f800 1 -- 172.21.15.196:0/4029050249 wait complete. 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f862d20f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f862d20f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a286068320 con 0x55a28608fe00 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f86288e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f86288e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33750/0 (socket says 172.21.15.196:33750) 2024-09-21T08:51:56.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.568+0000 7f86288e7640 1 -- 172.21.15.196:0/2724744184 learned_addr learned my addr 172.21.15.196:0/2724744184 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.569+0000 7f86288e7640 1 -- 172.21.15.196:0/2724744184 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a285fb5bc0 con 0x55a28608fe00 2024-09-21T08:51:56.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.569+0000 7f86288e7640 1 --2- 172.21.15.196:0/2724744184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f861c001d80 tx=0x7f861c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791efd06de717d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.569+0000 7f8516e05640 1 -- 172.21.15.196:0/2724744184 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f861c013030 con 0x55a28608fe00 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.569+0000 7f8516e05640 1 -- 172.21.15.196:0/2724744184 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c00e470 con 0x55a28608fe00 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.569+0000 7f8516e05640 1 -- 172.21.15.196:0/2724744184 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f861c00e810 con 0x55a28608fe00 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- 172.21.15.196:0/2724744184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 msgr2=0x55a28611cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 --2- 172.21.15.196:0/2724744184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f861c001d80 tx=0x7f861c001e70 comp rx=0 tx=0).stop 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- 172.21.15.196:0/2724744184 shutdown_connections 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 --2- 172.21.15.196:0/2724744184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a28611cae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- 172.21.15.196:0/2724744184 >> 172.21.15.196:0/2724744184 conn(0x55a286116de0 msgr2=0x55a2862071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- 172.21.15.196:0/2724744184 shutdown_connections 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- 172.21.15.196:0/2724744184 wait complete. 2024-09-21T08:51:56.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f862d20f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2861235f0 con 0x55a28608fe00 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f86288e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f86288e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33758/0 (socket says 172.21.15.196:33758) 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.570+0000 7f86288e7640 1 -- 172.21.15.196:0/1157820665 learned_addr learned my addr 172.21.15.196:0/1157820665 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f86288e7640 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a285fc9fe0 con 0x55a28608fe00 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f86288e7640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f861c004000 tx=0x7f861c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f8515602640 1 -- 172.21.15.196:0/1157820665 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f861c027070 con 0x55a28608fe00 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f8515602640 1 -- 172.21.15.196:0/1157820665 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c019900 con 0x55a28608fe00 2024-09-21T08:51:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2862159a0 con 0x55a28608fe00 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f8515602640 1 -- 172.21.15.196:0/1157820665 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f861c019c60 con 0x55a28608fe00 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.571+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a286215ec0 con 0x55a28608fe00 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f8515602640 1 -- 172.21.15.196:0/1157820665 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f861c02a070 con 0x55a28608fe00 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f8515602640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 0x7f8510039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f8515602640 1 -- 172.21.15.196:0/1157820665 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f861c01f070 con 0x55a28608fe00 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f8623fff640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 0x7f8510039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 0x55a28621c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28621caa0 con 0x55a2861208d0 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.572+0000 7f86290e8640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 0x55a28621c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f8623fff640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 0x7f8510039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8614057000 tx=0x7f8614052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f86290e8640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 0x55a28621c4d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f86290e8640 1 -- 172.21.15.196:0/1157820665 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f862400a4a0 con 0x55a2861208d0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286219a80 con 0x55a2861208d0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f86290e8640 1 -- 172.21.15.196:0/1157820665 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f862400a4a0 con 0x55a2861208d0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 0x55a2862211a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286221840 con 0x55a28621edb0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.573+0000 7f86288e7640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 0x55a2862211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.574+0000 7f86288e7640 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 0x55a2862211a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.574+0000 7f86288e7640 1 -- 172.21.15.196:0/1157820665 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f861c029030 con 0x55a28621edb0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.574+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28621dc50 con 0x55a2861208d0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.574+0000 7f86290e8640 1 -- 172.21.15.196:0/1157820665 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f862400a4a0 con 0x55a2861208d0 2024-09-21T08:51:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.574+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28621e0f0 con 0x55a2861208d0 2024-09-21T08:51:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f86290e8640 1 -- 172.21.15.196:0/1157820665 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f862400a4a0 con 0x55a2861208d0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f862d20f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f862d20f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a285fb7580 con 0x55a2862301d0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33768/0 (socket says 172.21.15.196:33768) 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.575+0000 7f86290e8640 1 -- 172.21.15.196:0/2239649622 learned_addr learned my addr 172.21.15.196:0/2239649622 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f86290e8640 1 -- 172.21.15.196:0/2239649622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a286230b30 con 0x55a2862301d0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f86290e8640 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a286216510 tx=0x7f86240188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f850e7fc640 1 -- 172.21.15.196:0/2239649622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624014450 con 0x55a2862301d0 2024-09-21T08:51:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f850e7fc640 1 -- 172.21.15.196:0/2239649622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86240145f0 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a286230dc0 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f850e7fc640 1 -- 172.21.15.196:0/2239649622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86240148d0 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.576+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a286233aa0 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f850e7fc640 1 -- 172.21.15.196:0/2239649622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8624011040 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f850e7fc640 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 0x7f8500039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f850e7fc640 1 -- 172.21.15.196:0/2239649622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f862401e070 con 0x55a2862301d0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f86288e7640 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 0x7f8500039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f86288e7640 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 0x7f8500039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a28621cef0 tx=0x7f861c02ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f862d20f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f862d20f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a28611b1b0 con 0x55a28623ce80 2024-09-21T08:51:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.577+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33778/0 (socket says 172.21.15.196:33778) 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f86290e8640 1 -- 172.21.15.196:0/3557993582 learned_addr learned my addr 172.21.15.196:0/3557993582 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f86290e8640 1 -- 172.21.15.196:0/3557993582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28623d850 con 0x55a28623ce80 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f86290e8640 1 --2- 172.21.15.196:0/3557993582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f862404cb80 tx=0x7f862403bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788ec7ba697bef51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f84fffff640 1 -- 172.21.15.196:0/3557993582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86240168f0 con 0x55a28623ce80 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f84fffff640 1 -- 172.21.15.196:0/3557993582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624013c80 con 0x55a28623ce80 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f84fffff640 1 -- 172.21.15.196:0/3557993582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624014a70 con 0x55a28623ce80 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 -- 172.21.15.196:0/3557993582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 msgr2=0x55a28623d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 --2- 172.21.15.196:0/3557993582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f862404cb80 tx=0x7f862403bf60 comp rx=0 tx=0).stop 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 -- 172.21.15.196:0/3557993582 shutdown_connections 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 --2- 172.21.15.196:0/3557993582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a28623d280 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 -- 172.21.15.196:0/3557993582 >> 172.21.15.196:0/3557993582 conn(0x55a286239220 msgr2=0x55a286237320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 -- 172.21.15.196:0/3557993582 shutdown_connections 2024-09-21T08:51:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.578+0000 7f862d20f800 1 -- 172.21.15.196:0/3557993582 wait complete. 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f862d20f800 1 Processor -- start 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f862d20f800 1 -- start start 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f862d20f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a286244280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f862d20f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a28623de70 con 0x55a28623ce80 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a286244280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f86290e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a286244280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33784/0 (socket says 172.21.15.196:33784) 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 learned_addr learned my addr 172.21.15.196:0/3924969849 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2862447c0 con 0x55a28623ce80 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.579+0000 7f86290e8640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a286244280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f862403e040 tx=0x7f862404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f84fe7fc640 1 -- 172.21.15.196:0/3924969849 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624044030 con 0x55a28623ce80 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f84fe7fc640 1 -- 172.21.15.196:0/3924969849 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624013e30 con 0x55a28623ce80 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a286244a50 con 0x55a28623ce80 2024-09-21T08:51:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f84fe7fc640 1 -- 172.21.15.196:0/3924969849 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8624022a80 con 0x55a28623ce80 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a286247700 con 0x55a28623ce80 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.580+0000 7f84fe7fc640 1 -- 172.21.15.196:0/3924969849 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8624022c20 con 0x55a28623ce80 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f84fe7fc640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f84f4036b40 0x7f84f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f84fe7fc640 1 -- 172.21.15.196:0/3924969849 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8624045070 con 0x55a28623ce80 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f86288e7640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f84f4036b40 0x7f84f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f86288e7640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f84f4036b40 0x7f84f4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f861c016fd0 tx=0x7f861c036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a28624ff40 0x55a286252400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286252b50 con 0x55a28624ff40 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.581+0000 7f8623fff640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a28624ff40 0x55a286252400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f8623fff640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a28624ff40 0x55a286252400 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 realm 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286252f80 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286253850 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.582+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286253bf0 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f862d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a286254950 0x55a286256d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286257280 con 0x55a286254950 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f86290e8640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a286254950 0x55a286256d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.583+0000 7f86290e8640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a286254950 0x55a286256d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f862d20f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f862d20f800 20 searching for the correct realm 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a286259300 0x55a28625b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86288e7640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a286259300 0x55a28625b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86288e7640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a286259300 0x55a28625b7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86288e7640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f861c02c060 0x7f861c041750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.584+0000 7f8623fff640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f861c02c060 0x7f861c041750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f8623fff640 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f861c02c060 0x7f861c041750 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.585+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.586+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.587+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.588+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.589+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.590+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.591+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286259300 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a286254950 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x55a28624ff40 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a28625be90 con 0x7f861c02c060 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.592+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286257d00 con 0x55a28624ff40 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286258180 con 0x55a28624ff40 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286258620 con 0x55a28624ff40 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 zone default found 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 4 Realm: () 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 zonegroup default 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28625c310 con 0x55a286254950 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.593+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286257940 con 0x55a286259300 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28625e660 con 0x55a286259300 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 20 started sync module instance, tier type = 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.594+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625d9d0 con 0x7f861c02c060 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.595+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.595+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94156523691776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625d9d0 con 0x7f861c02c060 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.595+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625f210 con 0x55a28624ff40 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.596+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94156523691776] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.596+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.596+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94156523695328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625d9d0 con 0x55a28624ff40 2024-09-21T08:51:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.596+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625fca0 con 0x55a286259300 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.597+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94156523695328] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.597+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.597+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94156523689248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28625d940 con 0x55a286259300 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.597+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286260b60 con 0x7f861c02c060 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.598+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94156523689248] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.598+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.598+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94156523701936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286260f80 con 0x7f861c02c060 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.598+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286261940 con 0x55a28624ff40 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.601+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.601+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94156523705488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286261d60 con 0x55a28624ff40 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.601+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2862627c0 con 0x55a286254950 2024-09-21T08:51:56.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.601+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94156523701936] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.602+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94156523705488] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.604+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.604+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94156523702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286261d60 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.604+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286263060 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.605+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.605+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94156523711328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286262fc0 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.605+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286263fc0 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.605+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94156523702992] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94156523711328] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94156523706544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a286263ad0 con 0x55a286254950 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=0 2024-09-21T08:51:56.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=1 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=2 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=3 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=4 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=5 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.606+0000 7f862d20f800 20 add_watcher() i=6 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94156523706544] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f862d20f800 20 add_watcher() i=7 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f862d20f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a286266fb0 con 0x55a28624ff40 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.607+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94156523715280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2862643a0 con 0x55a28624ff40 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.608+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94156523715280] v34'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.608+0000 7f84defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 5 note: GC not initialized 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f84ddfe3640 20 reqs_thread_entry: start 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 20 Filter name: none 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f844f7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629a6a0 con 0x55a28624ff40 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.609+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629a6a0 con 0x7f861c02c060 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629a660 con 0x55a28624ff40 2024-09-21T08:51:56.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629a660 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629ab40 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.610+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629ab40 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629ab40 con 0x55a28624ff40 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629ab40 con 0x55a28624ff40 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.611+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x7f861c02c060 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.612+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.613+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.614+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x7f861c02c060 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.615+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.616+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.617+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.617+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.617+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.617+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.617+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.618+0000 7f84defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.618+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94156523715280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.619+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94156523715280] v34'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.619+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94156523691776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x7f861c02c060 2024-09-21T08:51:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.622+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94156523691776] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.622+0000 7f862d20f800 20 remove_watcher() i=0 2024-09-21T08:51:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.622+0000 7f862d20f800 2 removed watcher, disabling cache 2024-09-21T08:51:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.622+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94156523695328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.623+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94156523695328] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.623+0000 7f862d20f800 20 remove_watcher() i=1 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.623+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94156523689248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286259300 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.624+0000 7f86288e7640 1 -- 172.21.15.196:0/3924969849 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94156523689248] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f861c029030 con 0x55a286259300 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.625+0000 7f862d20f800 20 remove_watcher() i=2 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.625+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94156523701936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x7f861c02c060 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.625+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94156523701936] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x7f861c02c060 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.625+0000 7f862d20f800 20 remove_watcher() i=3 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.626+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94156523705488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a28624ff40 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.627+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94156523705488] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8614051070 con 0x55a28624ff40 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.627+0000 7f862d20f800 20 remove_watcher() i=4 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.627+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94156523702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.628+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94156523702992] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.628+0000 7f862d20f800 20 remove_watcher() i=5 2024-09-21T08:51:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.628+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94156523711328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.629+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94156523711328] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.629+0000 7f862d20f800 20 remove_watcher() i=6 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.629+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94156523706544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a28629aa20 con 0x55a286254950 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f86290e8640 1 -- 172.21.15.196:0/3924969849 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94156523706544] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f862402a070 con 0x55a286254950 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 20 remove_watcher() i=7 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a286254950 msgr2=0x55a286256d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a286254950 0x55a286256d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a28624ff40 msgr2=0x55a286252400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a28624ff40 0x55a286252400 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f861c02c060 msgr2=0x7f861c041750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f861c02c060 0x7f861c041750 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a286259300 msgr2=0x55a28625b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a286259300 0x55a28625b7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f84f4036b40 msgr2=0x7f84f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f84f4036b40 0x7f84f4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f861c016fd0 tx=0x7f861c036000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 msgr2=0x55a286244280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 --2- 172.21.15.196:0/3924969849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28623ce80 0x55a286244280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f862403e040 tx=0x7f862404cb10 comp rx=0 tx=0).stop 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 reap_dead start 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f8623fff640 1 -- 172.21.15.196:0/3924969849 reap_dead start 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 shutdown_connections 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 >> 172.21.15.196:0/3924969849 conn(0x55a286239220 msgr2=0x55a2862372f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 shutdown_connections 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.630+0000 7f862d20f800 1 -- 172.21.15.196:0/3924969849 wait complete. 2024-09-21T08:51:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 msgr2=0x7f8500039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 0x7f8500039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a28621cef0 tx=0x7f861c02ae80 comp rx=0 tx=0).stop 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 msgr2=0x55a2862305f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a286216510 tx=0x7f86240188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 shutdown_connections 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8500036b40 0x7f8500039000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/2239649622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2862301d0 0x55a2862305f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 >> 172.21.15.196:0/2239649622 conn(0x55a286225160 msgr2=0x55a286227ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 shutdown_connections 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/2239649622 wait complete. 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 msgr2=0x55a2862211a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 0x55a2862211a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 msgr2=0x55a28621c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 0x55a28621c4d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 msgr2=0x7f8510039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 0x7f8510039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8614057000 tx=0x7f8614052000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 msgr2=0x55a286215460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f861c004000 tx=0x7f861c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 shutdown_connections 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a28621edb0 0x55a2862211a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2861208d0 0x55a28621c4d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8510036b40 0x7f8510039000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 --2- 172.21.15.196:0/1157820665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a28608fe00 0x55a286215460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 >> 172.21.15.196:0/1157820665 conn(0x55a286116de0 msgr2=0x55a286206dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 shutdown_connections 2024-09-21T08:51:56.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.631+0000 7f862d20f800 1 -- 172.21.15.196:0/1157820665 wait complete. 2024-09-21T08:51:56.644 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[],"summary":[]} 2024-09-21T08:51:56.645 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-21T08:51:56.645 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:56.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:56.645 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:56.728 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.728 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.726+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.726+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.726+0000 7f37dec10800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d15b9e4c0 0x556d15b9e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.726+0000 7f37dec10800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d15a5eb30 con 0x556d15b9ee00 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37dec10800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556d15a40360 con 0x556d15b9e4c0 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37da384640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d15b9e4c0 0x556d15b9e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37d1b83640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556d15b9ee00 0x556d15ba3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46792/0 (socket says 172.21.15.196:46792) 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37da384640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556d15b9e4c0 0x556d15b9e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33794/0 (socket says 172.21.15.196:33794) 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37d1b83640 1 -- 172.21.15.196:0/3831331026 learned_addr learned my addr 172.21.15.196:0/3831331026 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37da384640 1 -- 172.21.15.196:0/3831331026 >> v1:172.21.15.29:6789/0 conn(0x556d15b9ee00 legacy=0x556d15ba3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.727+0000 7f37da384640 1 -- 172.21.15.196:0/3831331026 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15a66e00 con 0x556d15b9e4c0 2024-09-21T08:51:56.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37da384640 1 --2- 172.21.15.196:0/3831331026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b9e8c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00a470 tx=0x7f37cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca73e47fd3789ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37d9b83640 1 -- 172.21.15.196:0/3831331026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc053570 con 0x556d15b9e4c0 2024-09-21T08:51:56.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37d9b83640 1 -- 172.21.15.196:0/3831331026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc058070 con 0x556d15b9e4c0 2024-09-21T08:51:56.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37d9b83640 1 -- 172.21.15.196:0/3831331026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc053880 con 0x556d15b9e4c0 2024-09-21T08:51:56.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37dec10800 1 -- 172.21.15.196:0/3831331026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 msgr2=0x556d15b9e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37dec10800 1 --2- 172.21.15.196:0/3831331026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b9e8c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00a470 tx=0x7f37cc045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.733 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37dec10800 1 -- 172.21.15.196:0/3831331026 shutdown_connections 2024-09-21T08:51:56.733 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37dec10800 1 --2- 172.21.15.196:0/3831331026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b9e8c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.733 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.729+0000 7f37dec10800 1 -- 172.21.15.196:0/3831331026 >> 172.21.15.196:0/3831331026 conn(0x556d15b99df0 msgr2=0x556d15b9c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.733 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.730+0000 7f37dec10800 1 -- 172.21.15.196:0/3831331026 shutdown_connections 2024-09-21T08:51:56.733 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.730+0000 7f37dec10800 1 -- 172.21.15.196:0/3831331026 wait complete. 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.743+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.743+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.743+0000 7f37dec10800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.743+0000 7f37dec10800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d15aeb330 con 0x556d15b9e4c0 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f37da384640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f37da384640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33804/0 (socket says 172.21.15.196:33804) 2024-09-21T08:51:56.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f37da384640 1 -- 172.21.15.196:0/2249102525 learned_addr learned my addr 172.21.15.196:0/2249102525 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f37da384640 1 -- 172.21.15.196:0/2249102525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15a38bc0 con 0x556d15b9e4c0 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f37da384640 1 --2- 172.21.15.196:0/2249102525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37cc025c20 tx=0x7f37cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892fcccd1da07285 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f36c8608640 1 -- 172.21.15.196:0/2249102525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc05c580 con 0x556d15b9e4c0 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f36c8608640 1 -- 172.21.15.196:0/2249102525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc063030 con 0x556d15b9e4c0 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.744+0000 7f36c8608640 1 -- 172.21.15.196:0/2249102525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc05c850 con 0x556d15b9e4c0 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- 172.21.15.196:0/2249102525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 msgr2=0x556d15b12d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 --2- 172.21.15.196:0/2249102525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37cc025c20 tx=0x7f37cc051000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- 172.21.15.196:0/2249102525 shutdown_connections 2024-09-21T08:51:56.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 --2- 172.21.15.196:0/2249102525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15b12d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- 172.21.15.196:0/2249102525 >> 172.21.15.196:0/2249102525 conn(0x556d15b99df0 msgr2=0x556d15c89130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- 172.21.15.196:0/2249102525 shutdown_connections 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- 172.21.15.196:0/2249102525 wait complete. 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.745+0000 7f37dec10800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d15ba54e0 con 0x556d15b9e4c0 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37da384640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37da384640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33814/0 (socket says 172.21.15.196:33814) 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37da384640 1 -- 172.21.15.196:0/1017506249 learned_addr learned my addr 172.21.15.196:0/1017506249 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37da384640 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15a4cfe0 con 0x556d15b9e4c0 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37da384640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00a330 tx=0x7f37cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f36c6e05640 1 -- 172.21.15.196:0/1017506249 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc06c030 con 0x556d15b9e4c0 2024-09-21T08:51:56.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f36c6e05640 1 -- 172.21.15.196:0/1017506249 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc05c580 con 0x556d15b9e4c0 2024-09-21T08:51:56.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d15c966b0 con 0x556d15b9e4c0 2024-09-21T08:51:56.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f36c6e05640 1 -- 172.21.15.196:0/1017506249 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc05c860 con 0x556d15b9e4c0 2024-09-21T08:51:56.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.746+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d15c96c30 con 0x556d15b9e4c0 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f36c6e05640 1 -- 172.21.15.196:0/1017506249 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37cc053440 con 0x556d15b9e4c0 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f36c6e05640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 0x7f36c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f36c6e05640 1 -- 172.21.15.196:0/1017506249 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37cc070020 con 0x556d15b9e4c0 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f37d1b83640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 0x7f36c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 0x556d15c9d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.747+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15c9d760 con 0x556d15b9ee00 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dab85640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 0x556d15c9d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37d1b83640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 0x7f36c0039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37c4000f60 tx=0x7f37c40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dab85640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 0x556d15c9d1e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dab85640 1 -- 172.21.15.196:0/1017506249 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d400a4a0 con 0x556d15b9ee00 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15c9a790 con 0x556d15b9ee00 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dab85640 1 -- 172.21.15.196:0/1017506249 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37d400a4a0 con 0x556d15b9ee00 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 0x556d15ca1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.748+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15ca25c0 con 0x556d15c9fae0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.749+0000 7f37da384640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 0x556d15ca1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.749+0000 7f37da384640 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 0x556d15ca1ed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.749+0000 7f37da384640 1 -- 172.21.15.196:0/1017506249 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37cc07b070 con 0x556d15c9fae0 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15c9e980 con 0x556d15b9ee00 2024-09-21T08:51:56.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dab85640 1 -- 172.21.15.196:0/1017506249 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37d400a4a0 con 0x556d15b9ee00 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15c9ee20 con 0x556d15b9ee00 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dab85640 1 -- 172.21.15.196:0/1017506249 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37d400a4a0 con 0x556d15b9ee00 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.750+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dec10800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dec10800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d15a3a580 con 0x556d15cb0f10 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33828/0 (socket says 172.21.15.196:33828) 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dab85640 1 -- 172.21.15.196:0/3816131870 learned_addr learned my addr 172.21.15.196:0/3816131870 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dab85640 1 -- 172.21.15.196:0/3816131870 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15cb1870 con 0x556d15cb0f10 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dab85640 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x556d15c9db60 tx=0x7f37d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f36bffff640 1 -- 172.21.15.196:0/3816131870 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4014450 con 0x556d15cb0f10 2024-09-21T08:51:56.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f36bffff640 1 -- 172.21.15.196:0/3816131870 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4014610 con 0x556d15cb0f10 2024-09-21T08:51:56.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f36bffff640 1 -- 172.21.15.196:0/3816131870 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4014930 con 0x556d15cb0f10 2024-09-21T08:51:56.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d15cb1b00 con 0x556d15cb0f10 2024-09-21T08:51:56.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.751+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d15cb47e0 con 0x556d15cb0f10 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.752+0000 7f36bffff640 1 -- 172.21.15.196:0/3816131870 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d4011040 con 0x556d15cb0f10 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.752+0000 7f36bffff640 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.752+0000 7f36bffff640 1 -- 172.21.15.196:0/3816131870 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37d401e070 con 0x556d15cb0f10 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.752+0000 7f37da384640 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37da384640 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 0x7f36b4039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x556d15c9dc50 tx=0x7f37cc008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dec10800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dec10800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d15c916f0 con 0x556d15c8e820 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33844/0 (socket says 172.21.15.196:33844) 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dab85640 1 -- 172.21.15.196:0/2320140263 learned_addr learned my addr 172.21.15.196:0/2320140263 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dab85640 1 -- 172.21.15.196:0/2320140263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15c8f1f0 con 0x556d15c8e820 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.753+0000 7f37dab85640 1 --2- 172.21.15.196:0/2320140263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37d404ccc0 tx=0x7f37d404ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a822bb206284b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f36bdffb640 1 -- 172.21.15.196:0/2320140263 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4013dc0 con 0x556d15c8e820 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f36bdffb640 1 -- 172.21.15.196:0/2320140263 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4014ad0 con 0x556d15c8e820 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f36bdffb640 1 -- 172.21.15.196:0/2320140263 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4014dd0 con 0x556d15c8e820 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- 172.21.15.196:0/2320140263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 msgr2=0x556d15c8ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 --2- 172.21.15.196:0/2320140263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37d404ccc0 tx=0x7f37d404ce00 comp rx=0 tx=0).stop 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- 172.21.15.196:0/2320140263 shutdown_connections 2024-09-21T08:51:56.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 --2- 172.21.15.196:0/2320140263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15c8ec20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- 172.21.15.196:0/2320140263 >> 172.21.15.196:0/2320140263 conn(0x556d15cb9f40 msgr2=0x556d15cb8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- 172.21.15.196:0/2320140263 shutdown_connections 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- 172.21.15.196:0/2320140263 wait complete. 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 Processor -- start 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.754+0000 7f37dec10800 1 -- start start 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dec10800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dec10800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d15c8d500 con 0x556d15c8e820 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dab85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33854/0 (socket says 172.21.15.196:33854) 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 learned_addr learned my addr 172.21.15.196:0/3591767076 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d15cc7700 con 0x556d15c8e820 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dab85640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37d404bb40 tx=0x7f37d404cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f36abfff640 1 -- 172.21.15.196:0/3591767076 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4022dc0 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f36abfff640 1 -- 172.21.15.196:0/3591767076 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d402b350 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d15cc7990 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f36abfff640 1 -- 172.21.15.196:0/3591767076 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d402b650 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.755+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d15cca640 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.756+0000 7f36abfff640 1 -- 172.21.15.196:0/3591767076 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d4044020 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.756+0000 7f36abfff640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.756+0000 7f36abfff640 1 -- 172.21.15.196:0/3591767076 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37d4034070 con 0x556d15c8e820 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.756+0000 7f37da384640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15cd2e80 0x556d15cd5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cd5a90 con 0x556d15cd2e80 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37d1b83640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15cd2e80 0x556d15cd5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37da384640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009750 tx=0x7f37cc086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37d1b83640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15cd2e80 0x556d15cd5340 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c4009050 con 0x556d15cd2e80 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 20 realm 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cd22d0 con 0x556d15cd2e80 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c4009050 con 0x556d15cd2e80 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.757+0000 7f37dec10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cd6570 con 0x556d15cd2e80 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c4009050 con 0x556d15cd2e80 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cd6e40 con 0x556d15cd2e80 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37c4009050 con 0x556d15cd2e80 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15cd76f0 0x556d15cd9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cda220 con 0x556d15cd76f0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.758+0000 7f37dab85640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15cd76f0 0x556d15cd9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dab85640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15cd76f0 0x556d15cd9ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dec10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dec10800 20 searching for the correct realm 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d15cdc2d0 0x556d15cde790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37da384640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d15cdc2d0 0x556d15cde790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.759+0000 7f37da384640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d15cdc2d0 0x556d15cde790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37da384640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37cc05c070 0x7f37cc0902c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37d1b83640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37cc05c070 0x7f37cc0902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37d1b83640 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37cc05c070 0x7f37cc0902c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4009050 con 0x7f37cc05c070 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.760+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4009050 con 0x556d15cd2e80 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.761+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x7f37cc05c070 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.762+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37c4029040 con 0x7f37cc05c070 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.763+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.764+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.765+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x7f37cc05c070 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.766+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x7f37cc05c070 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cdc2d0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.767+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x556d15cd2e80 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdee60 con 0x7f37cc05c070 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c4029040 con 0x7f37cc05c070 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdacd0 con 0x556d15cd2e80 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.768+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdb150 con 0x556d15cd2e80 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37c4029040 con 0x556d15cd2e80 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdb5f0 con 0x556d15cd2e80 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 zone default found 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 4 Realm: () 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 zonegroup default 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15cdf2e0 con 0x556d15cd76f0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce1510 con 0x556d15cdc2d0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.769+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce18b0 con 0x556d15cdc2d0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.770+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.770+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.770+0000 7f37dec10800 20 started sync module instance, tier type = 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.770+0000 7f37dec10800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:56.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.770+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce0950 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.771+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.771+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93927005621840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce0950 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.771+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce2270 con 0x556d15cd2e80 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.772+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93927005621840] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.772+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.772+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93927005626272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce0950 con 0x556d15cd2e80 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.772+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce2ce0 con 0x556d15cdc2d0 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.773+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93927005626272] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.773+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.773+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93927005619360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce08c0 con 0x556d15cdc2d0 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.773+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce3bd0 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.774+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.774+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93927005632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce4370 con 0x7f37cc05c070 2024-09-21T08:51:56.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.774+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce4e90 con 0x556d15cd2e80 2024-09-21T08:51:56.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.775+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93927005619360] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.776+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.776+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93927005636960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce4e50 con 0x556d15cd2e80 2024-09-21T08:51:56.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.776+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce58a0 con 0x556d15cd76f0 2024-09-21T08:51:56.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.776+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93927005632768] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.779+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93927005636960] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.779+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.779+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93927005630720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce53f0 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.779+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce6140 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.782+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.782+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93927005641872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce53f0 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.782+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce6cc0 con 0x556d15cd76f0 2024-09-21T08:51:56.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.782+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93927005630720] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93927005641872] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93927005644720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce60b0 con 0x556d15cd76f0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=1 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=2 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=3 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=4 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=5 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.783+0000 7f37dec10800 20 add_watcher() i=6 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93927005644720] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37dec10800 20 add_watcher() i=7 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37dec10800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:56.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce9cb0 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.784+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93927005633984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15ce71a0 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.785+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93927005633984] v34'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.785+0000 7f3690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.785+0000 7f37dec10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.785+0000 7f37dec10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 5 note: GC not initialized 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f360b7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 20 Filter name: none 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f36097fa640 20 reqs_thread_entry: start 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cb10 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.786+0000 7f37dec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.793 INFO:teuthology.orchestra.run.smithi196.stderr:could not fetch user info: no user info saved 2024-09-21T08:51:56.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.787+0000 7f3690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.787+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93927005633984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x556d15cd2e80 2024-09-21T08:51:56.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.788+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93927005633984] v34'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.788+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93927005621840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1a900 con 0x7f37cc05c070 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.791+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93927005621840] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.791+0000 7f37dec10800 20 remove_watcher() i=0 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.791+0000 7f37dec10800 2 removed watcher, disabling cache 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.791+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93927005626272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1a900 con 0x556d15cd2e80 2024-09-21T08:51:56.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.792+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93927005626272] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.792+0000 7f37dec10800 20 remove_watcher() i=1 2024-09-21T08:51:56.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.792+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93927005619360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1a900 con 0x556d15cdc2d0 2024-09-21T08:51:56.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.793+0000 7f37da384640 1 -- 172.21.15.196:0/3591767076 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93927005619360] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc099070 con 0x556d15cdc2d0 2024-09-21T08:51:56.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.793+0000 7f37dec10800 20 remove_watcher() i=2 2024-09-21T08:51:56.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.793+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93927005632768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x7f37cc05c070 2024-09-21T08:51:56.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.794+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93927005632768] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x7f37cc05c070 2024-09-21T08:51:56.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.794+0000 7f37dec10800 20 remove_watcher() i=3 2024-09-21T08:51:56.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.794+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93927005636960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x556d15cd2e80 2024-09-21T08:51:56.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.796+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93927005636960] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c40391c0 con 0x556d15cd2e80 2024-09-21T08:51:56.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.796+0000 7f37dec10800 20 remove_watcher() i=4 2024-09-21T08:51:56.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.796+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93927005630720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x556d15cd76f0 2024-09-21T08:51:56.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.797+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93927005630720] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.797+0000 7f37dec10800 20 remove_watcher() i=5 2024-09-21T08:51:56.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.797+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93927005641872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x556d15cd76f0 2024-09-21T08:51:56.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.799+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93927005641872] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.799+0000 7f37dec10800 20 remove_watcher() i=6 2024-09-21T08:51:56.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.799+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93927005644720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556d15d1cad0 con 0x556d15cd76f0 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dab85640 1 -- 172.21.15.196:0/3591767076 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93927005644720] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d402a070 con 0x556d15cd76f0 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 20 remove_watcher() i=7 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15cd76f0 msgr2=0x556d15cd9ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15cd76f0 0x556d15cd9ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15cd2e80 msgr2=0x556d15cd5340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15cd2e80 0x556d15cd5340 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37cc05c070 msgr2=0x7f37cc0902c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37cc05c070 0x7f37cc0902c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d15cdc2d0 msgr2=0x556d15cde790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556d15cdc2d0 0x556d15cde790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 msgr2=0x7f36a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009750 tx=0x7f37cc086000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37d1b83640 1 -- 172.21.15.196:0/3591767076 reap_dead start 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 msgr2=0x556d15cc71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37d404bb40 tx=0x7f37d404cc50 comp rx=0 tx=0).stop 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 shutdown_connections 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3591767076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15c8e820 0x556d15cc71c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 >> 172.21.15.196:0/3591767076 conn(0x556d15cb9f40 msgr2=0x556d15cb8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 shutdown_connections 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3591767076 wait complete. 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 msgr2=0x7f36b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 0x7f36b4039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x556d15c9dc50 tx=0x7f37cc008310 comp rx=0 tx=0).stop 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 msgr2=0x556d15cb1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x556d15c9db60 tx=0x7f37d4018830 comp rx=0 tx=0).stop 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 shutdown_connections 2024-09-21T08:51:56.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 --2- 172.21.15.196:0/3816131870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15cb0f10 0x556d15cb1330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.800+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 >> 172.21.15.196:0/3816131870 conn(0x556d15ca5ea0 msgr2=0x556d15ca8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 shutdown_connections 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/3816131870 wait complete. 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 msgr2=0x556d15ca1ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 0x556d15ca1ed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 msgr2=0x556d15c9d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 0x556d15c9d1e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 msgr2=0x7f36c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 0x7f36c0039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37c4000f60 tx=0x7f37c40012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 msgr2=0x556d15c96170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00a330 tx=0x7f37cc002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 shutdown_connections 2024-09-21T08:51:56.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556d15c9fae0 0x556d15ca1ed0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556d15b9ee00 0x556d15c9d1e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c0036b40 0x7f36c0039000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 --2- 172.21.15.196:0/1017506249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d15b9e4c0 0x556d15c96170 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 >> 172.21.15.196:0/1017506249 conn(0x556d15b99df0 msgr2=0x556d15c879c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 shutdown_connections 2024-09-21T08:51:56.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.801+0000 7f37dec10800 1 -- 172.21.15.196:0/1017506249 wait complete. 2024-09-21T08:51:56.811 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T08:51:56.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-21T08:51:56.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-21T08:51:56.812 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-21T08:51:56.866 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:56.867 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:56.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.864+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8ea539800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561497431ed0 0x5614974342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8ea539800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614972eab30 con 0x561497429a30 2024-09-21T08:51:56.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8ea539800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5614972cc360 con 0x561497431ed0 2024-09-21T08:51:56.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e59d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561497431ed0 0x5614974342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e61d8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x561497429a30 0x561497429e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46798/0 (socket says 172.21.15.196:46798) 2024-09-21T08:51:56.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e61d8640 1 -- 172.21.15.196:0/3392664007 learned_addr learned my addr 172.21.15.196:0/3392664007 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:56.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e51d6640 1 -- 172.21.15.196:0/3392664007 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244374210 0 0) 0x5614972eab30 con 0x561497429a30 2024-09-21T08:51:56.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e51d6640 1 -- 172.21.15.196:0/3392664007 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d4001e10 con 0x561497429a30 2024-09-21T08:51:56.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e59d7640 1 -- 172.21.15.196:0/3392664007 >> v1:172.21.15.29:6789/0 conn(0x561497429a30 legacy=0x561497429e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.865+0000 7fd8e59d7640 1 -- 172.21.15.196:0/3392664007 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614972f2e00 con 0x561497431ed0 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.867+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/3392664007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497431ed0 0x5614974342c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000a470 tx=0x7fd8d0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17bd9ebce53d787 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8e51d6640 1 -- 172.21.15.196:0/3392664007 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d0059070 con 0x561497431ed0 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8e51d6640 1 -- 172.21.15.196:0/3392664007 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d0054570 con 0x561497431ed0 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8e51d6640 1 -- 172.21.15.196:0/3392664007 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d0054850 con 0x561497431ed0 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 -- 172.21.15.196:0/3392664007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497431ed0 msgr2=0x5614974342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 --2- 172.21.15.196:0/3392664007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497431ed0 0x5614974342c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000a470 tx=0x7fd8d0045920 comp rx=0 tx=0).stop 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 -- 172.21.15.196:0/3392664007 shutdown_connections 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 --2- 172.21.15.196:0/3392664007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497431ed0 0x5614974342c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 -- 172.21.15.196:0/3392664007 >> 172.21.15.196:0/3392664007 conn(0x561497425580 msgr2=0x5614974279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 -- 172.21.15.196:0/3392664007 shutdown_connections 2024-09-21T08:51:56.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.868+0000 7fd8ea539800 1 -- 172.21.15.196:0/3392664007 wait complete. 2024-09-21T08:51:56.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8ea539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8ea539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561497377450 con 0x561497429a30 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8e61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8e61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33880/0 (socket says 172.21.15.196:33880) 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8e61d8640 1 -- 172.21.15.196:0/39404215 learned_addr learned my addr 172.21.15.196:0/39404215 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.882+0000 7fd8e61d8640 1 -- 172.21.15.196:0/39404215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614972c4bc0 con 0x561497429a30 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/39404215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001db0 tx=0x7fd8d800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd46dc589942ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd7d4608640 1 -- 172.21.15.196:0/39404215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8012020 con 0x561497429a30 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd7d4608640 1 -- 172.21.15.196:0/39404215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d800e5a0 con 0x561497429a30 2024-09-21T08:51:56.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd7d4608640 1 -- 172.21.15.196:0/39404215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d800e940 con 0x561497429a30 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd8ea539800 1 -- 172.21.15.196:0/39404215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 msgr2=0x56149751c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.883+0000 7fd8ea539800 1 --2- 172.21.15.196:0/39404215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001db0 tx=0x7fd8d800b6c0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- 172.21.15.196:0/39404215 shutdown_connections 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 --2- 172.21.15.196:0/39404215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x56149751c970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- 172.21.15.196:0/39404215 >> 172.21.15.196:0/39404215 conn(0x561497425580 msgr2=0x561497518330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- 172.21.15.196:0/39404215 shutdown_connections 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- 172.21.15.196:0/39404215 wait complete. 2024-09-21T08:51:56.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8ea539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561497434a10 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8e61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8e61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33892/0 (socket says 172.21.15.196:33892) 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8e61d8640 1 -- 172.21.15.196:0/2227553497 learned_addr learned my addr 172.21.15.196:0/2227553497 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.884+0000 7fd8e61d8640 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614972d8fe0 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56149751d7d0 tx=0x7fd8d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd7d2e05640 1 -- 172.21.15.196:0/2227553497 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8012030 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd7d2e05640 1 -- 172.21.15.196:0/2227553497 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8001430 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd7d2e05640 1 -- 172.21.15.196:0/2227553497 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d801a8a0 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614975248d0 con 0x561497429a30 2024-09-21T08:51:56.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.885+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561497524df0 con 0x561497429a30 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd7d2e05640 1 -- 172.21.15.196:0/2227553497 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8d8015020 con 0x561497429a30 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd7d2e05640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 0x7fd7cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd7d2e05640 1 -- 172.21.15.196:0/2227553497 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd8d8020030 con 0x561497429a30 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 0x7fd7cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 0x56149752b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149752b980 con 0x561497431ed0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 0x56149752b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 0x7fd7cc039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x56149738f1f0 tx=0x7fd8d0050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.886+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 0x56149752b400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2227553497 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e000a4a0 con 0x561497431ed0 2024-09-21T08:51:56.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497528980 con 0x561497431ed0 2024-09-21T08:51:56.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2227553497 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e000a4a0 con 0x561497431ed0 2024-09-21T08:51:56.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 0x561497530050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975306f0 con 0x56149752dc60 2024-09-21T08:51:56.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.887+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 0x561497530050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 0x561497530050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8e61d8640 1 -- 172.21.15.196:0/2227553497 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8d8018430 con 0x56149752dc60 2024-09-21T08:51:56.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149752cb00 con 0x561497431ed0 2024-09-21T08:51:56.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2227553497 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e000a4a0 con 0x561497431ed0 2024-09-21T08:51:56.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149752cfa0 con 0x561497431ed0 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.888+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2227553497 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8e000a4a0 con 0x561497431ed0 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8ea539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8ea539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5614972c6580 con 0x56149753f080 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33900/0 (socket says 172.21.15.196:33900) 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2547355992 learned_addr learned my addr 172.21.15.196:0/2547355992 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.889+0000 7fd8e69d9640 1 -- 172.21.15.196:0/2547355992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149753f9e0 con 0x56149753f080 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x561497525440 tx=0x7fd8e00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd7cbfff640 1 -- 172.21.15.196:0/2547355992 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0014450 con 0x56149753f080 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd7cbfff640 1 -- 172.21.15.196:0/2547355992 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e00145f0 con 0x56149753f080 2024-09-21T08:51:56.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56149753fc70 con 0x56149753f080 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd7cbfff640 1 -- 172.21.15.196:0/2547355992 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e00148d0 con 0x56149753f080 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.890+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561497542950 con 0x56149753f080 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd7cbfff640 1 -- 172.21.15.196:0/2547355992 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8e0011040 con 0x56149753f080 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd7cbfff640 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 0x7fd7c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd7cbfff640 1 -- 172.21.15.196:0/2547355992 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd8e001e070 con 0x56149753f080 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 0x7fd7c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 0x7fd7c0039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56149752bdd0 tx=0x7fd8d804b0a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8ea539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.891+0000 7fd8ea539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56149751d120 con 0x56149754bd00 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33906/0 (socket says 172.21.15.196:33906) 2024-09-21T08:51:56.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd8e69d9640 1 -- 172.21.15.196:0/28657362 learned_addr learned my addr 172.21.15.196:0/28657362 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd8e69d9640 1 -- 172.21.15.196:0/28657362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149754c6d0 con 0x56149754bd00 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/28657362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd8e004cb40 tx=0x7fd8e003bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a184b9cf9d50c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd7c9ffb640 1 -- 172.21.15.196:0/28657362 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e00168f0 con 0x56149754bd00 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd7c9ffb640 1 -- 172.21.15.196:0/28657362 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0013cb0 con 0x56149754bd00 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.892+0000 7fd7c9ffb640 1 -- 172.21.15.196:0/28657362 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0014a70 con 0x56149754bd00 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- 172.21.15.196:0/28657362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 msgr2=0x56149754c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 --2- 172.21.15.196:0/28657362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd8e004cb40 tx=0x7fd8e003bf20 comp rx=0 tx=0).stop 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- 172.21.15.196:0/28657362 shutdown_connections 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 --2- 172.21.15.196:0/28657362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x56149754c100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- 172.21.15.196:0/28657362 >> 172.21.15.196:0/28657362 conn(0x561497548060 msgr2=0x561497546160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- 172.21.15.196:0/28657362 shutdown_connections 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- 172.21.15.196:0/28657362 wait complete. 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 Processor -- start 2024-09-21T08:51:56.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- start start 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8ea539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56149754cd40 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8e69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33918/0 (socket says 172.21.15.196:33918) 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 learned_addr learned my addr 172.21.15.196:0/1436226745 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.893+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614975536c0 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd8e004ba60 tx=0x7fd8e004cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd7b7fff640 1 -- 172.21.15.196:0/1436226745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0013e60 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd7b7fff640 1 -- 172.21.15.196:0/1436226745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0022a50 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561497553950 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd7b7fff640 1 -- 172.21.15.196:0/1436226745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0022d50 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561497556600 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.894+0000 7fd7b7fff640 1 -- 172.21.15.196:0/1436226745 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8e00133b0 con 0x56149754bd00 2024-09-21T08:51:56.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd7b7fff640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7b0036b90 0x7fd7b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd7b7fff640 1 -- 172.21.15.196:0/1436226745 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd8e000e040 con 0x56149754bd00 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7b0036b90 0x7fd7b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7b0036b90 0x7fd7b0039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8018740 tx=0x7fd8d8033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56149755ee50 0x561497561310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.895+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497561a60 con 0x56149755ee50 2024-09-21T08:51:56.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56149755ee50 0x561497561310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56149755ee50 0x561497561310 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 20 realm 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497561e90 con 0x56149755ee50 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.896+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497562760 con 0x56149755ee50 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497562b00 con 0x56149755ee50 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561497563860 0x561497565c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497566260 con 0x561497563860 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561497563860 0x561497565c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.897+0000 7fd8e69d9640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561497563860 0x561497565c50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8ea539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8ea539800 20 searching for the correct realm 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5614975681f0 0x56149756a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5614975681f0 0x56149756a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5614975681f0 0x56149756a6b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e61d8640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd8d8017050 0x7fd8d8024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.898+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd8d8017050 0x7fd8d8024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e59d7640 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd8d8017050 0x7fd8d8024420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.899+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.900+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.901+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.902+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.903+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.904+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.905+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x5614975681f0 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x561497563860 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x56149755ee50 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56149756ad80 con 0x7fd8d8017050 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:56.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.906+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497567740 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975666c0 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497567000 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 zone default found 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 4 Realm: () 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 zonegroup default 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149756b200 con 0x561497563860 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.907+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149756d4b0 con 0x5614975681f0 2024-09-21T08:51:56.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56149756d850 con 0x5614975681f0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 20 started sync module instance, tier type = 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.908+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756c940 con 0x7fd8d8017050 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.909+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.909+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646438383168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756c940 con 0x7fd8d8017050 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.909+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756e270 con 0x56149755ee50 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.910+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.910+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646438387040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756e230 con 0x56149755ee50 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.910+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756f250 con 0x5614975681f0 2024-09-21T08:51:56.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.911+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646438383168] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.912+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.912+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646438391136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756f640 con 0x5614975681f0 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.912+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497570040 con 0x7fd8d8017050 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.912+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646438387040] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.913+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646438391136] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.913+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.913+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646438380688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756e5f0 con 0x7fd8d8017050 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.913+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497570910 con 0x56149755ee50 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.914+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.914+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646438396944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497570ce0 con 0x56149755ee50 2024-09-21T08:51:56.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.914+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497571800 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.914+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646438380688] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.915+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646438396944] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.915+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.915+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646438394704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497570ce0 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.915+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975720a0 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.916+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.916+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646438403056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497572500 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.916+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497573010 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.916+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646438394704] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646438403056] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646438406848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561497572010 con 0x561497563860 2024-09-21T08:51:56.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=0 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=1 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=2 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=3 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=4 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=5 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.917+0000 7fd8ea539800 20 add_watcher() i=6 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646438406848] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8ea539800 20 add_watcher() i=7 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8ea539800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561497576000 con 0x56149755ee50 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.918+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646438398000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975734b0 con 0x56149755ee50 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.919+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646438398000] v34'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.919+0000 7fd79cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 5 note: GC not initialized 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd7177fe640 20 reqs_thread_entry: start 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 Filter name: none 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd7157fa640 20 reqs_thread_entry: start 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975a9460 con 0x56149755ee50 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:56.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.920+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7aa0 con 0x56149755ee50 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7e90 con 0x561497563860 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T08:51:56.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.921+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a8400 con 0x56149755ee50 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8ea539800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8ea539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94646438629040 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975acf60 con 0x56149755ee50 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify (1) cookie 94646438396944 notify 146028888064 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5614975a87a0 con 0x56149755ee50 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd7c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94646438396944 notifier 4300 bl.length()=567 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd7c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 notify.4 [notify cookie 94646438629040 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.922+0000 7fd7c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:56.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.923+0000 7fd7c9ffb640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd7ac003ea0 con 0x56149755ee50 2024-09-21T08:51:56.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.923+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.923+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== watch-notify(notify_complete (2) cookie 94646438629040 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5614975a7ff0 con 0x56149755ee50 2024-09-21T08:51:56.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.923+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a8eb0 con 0x56149755ee50 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.924+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.924+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.924+0000 7fd8ea539800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.924+0000 7fd8ea539800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.924+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94646438629040 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975acf00 con 0x7fd8d8017050 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== watch-notify(notify (1) cookie 94646438380688 notify 146028888064 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5614975a7ff0 con 0x7fd8d8017050 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd7c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94646438380688 notifier 4300 bl.length()=169 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd7c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd7c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd7c9ffb640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd7ac003ea0 con 0x7fd8d8017050 2024-09-21T08:51:56.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(69 notify.3 [notify cookie 94646438629040 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify_complete (2) cookie 94646438629040 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd8d0075040 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.925+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975aaee0 con 0x561497563860 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8ea539800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8ea539800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8ea539800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94646438636080 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614975aae50 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== watch-notify(notify (1) cookie 94646438380688 notify 146028888065 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fd8d0075040 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd7c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94646438380688 notifier 4300 bl.length()=177 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(72 notify.3 [notify cookie 94646438636080 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd7c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-21T08:51:56.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd7c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-21T08:51:56.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.926+0000 7fd7c97fa640 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd71c003400 con 0x7fd8d8017050 2024-09-21T08:51:56.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.927+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== watch-notify(notify_complete (2) cookie 94646438636080 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd8d0068040 con 0x7fd8d8017050 2024-09-21T08:51:56.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.927+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.943 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.928+0000 7fd79cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.928+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646438398000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7120 con 0x56149755ee50 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.929+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94646438398000] v34'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.929+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646438383168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7120 con 0x7fd8d8017050 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.930+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94646438383168] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.930+0000 7fd8ea539800 20 remove_watcher() i=0 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.930+0000 7fd8ea539800 2 removed watcher, disabling cache 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.930+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646438387040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7120 con 0x56149755ee50 2024-09-21T08:51:56.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.931+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94646438387040] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.931+0000 7fd8ea539800 20 remove_watcher() i=1 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.931+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646438391136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614975a7120 con 0x5614975681f0 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.932+0000 7fd8e61d8640 1 -- 172.21.15.196:0/1436226745 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94646438391136] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8018430 con 0x5614975681f0 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.932+0000 7fd8ea539800 20 remove_watcher() i=2 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.932+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646438380688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756ed60 con 0x7fd8d8017050 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.933+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94646438380688] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x7fd8d8017050 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.933+0000 7fd8ea539800 20 remove_watcher() i=3 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.933+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646438396944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756c490 con 0x56149755ee50 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.934+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94646438396944] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d005c040 con 0x56149755ee50 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.934+0000 7fd8ea539800 20 remove_watcher() i=4 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.934+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646438394704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756ed60 con 0x561497563860 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.935+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94646438394704] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.935+0000 7fd8ea539800 20 remove_watcher() i=5 2024-09-21T08:51:56.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.935+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646438403056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756c490 con 0x561497563860 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.936+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94646438403056] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.936+0000 7fd8ea539800 20 remove_watcher() i=6 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.936+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646438406848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56149756ed60 con 0x561497563860 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8e69d9640 1 -- 172.21.15.196:0/1436226745 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94646438406848] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002a070 con 0x561497563860 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 20 remove_watcher() i=7 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561497563860 msgr2=0x561497565c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561497563860 0x561497565c50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56149755ee50 msgr2=0x561497561310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56149755ee50 0x561497561310 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd8d8017050 msgr2=0x7fd8d8024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd8d8017050 0x7fd8d8024420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5614975681f0 msgr2=0x56149756a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5614975681f0 0x56149756a6b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7b0036b90 msgr2=0x7fd7b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7b0036b90 0x7fd7b0039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8018740 tx=0x7fd8d8033000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 msgr2=0x561497553180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8e59d7640 1 -- 172.21.15.196:0/1436226745 reap_dead start 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd8e004ba60 tx=0x7fd8e004cad0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 shutdown_connections 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 --2- 172.21.15.196:0/1436226745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149754bd00 0x561497553180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 >> 172.21.15.196:0/1436226745 conn(0x561497548060 msgr2=0x561497546130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 shutdown_connections 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.937+0000 7fd8ea539800 1 -- 172.21.15.196:0/1436226745 wait complete. 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 msgr2=0x7fd7c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 0x7fd7c0039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56149752bdd0 tx=0x7fd8d804b0a0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 msgr2=0x56149753f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x561497525440 tx=0x7fd8e00188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 shutdown_connections 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7c0036b90 0x7fd7c0039050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2547355992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56149753f080 0x56149753f4a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 >> 172.21.15.196:0/2547355992 conn(0x561497534010 msgr2=0x561497536b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 shutdown_connections 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2547355992 wait complete. 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 msgr2=0x561497530050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 0x561497530050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 msgr2=0x56149752b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 0x56149752b400 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 msgr2=0x7fd7cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 0x7fd7cc039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x56149738f1f0 tx=0x7fd8d0050000 comp rx=0 tx=0).stop 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 msgr2=0x561497524390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:56.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56149751d7d0 tx=0x7fd8d8000bc0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 shutdown_connections 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56149752dc60 0x561497530050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561497431ed0 0x56149752b400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd7cc036b40 0x7fd7cc039000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 --2- 172.21.15.196:0/2227553497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561497429a30 0x561497524390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 >> 172.21.15.196:0/2227553497 conn(0x561497425580 msgr2=0x561497516c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 shutdown_connections 2024-09-21T08:51:56.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:56.938+0000 7fd8ea539800 1 -- 172.21.15.196:0/2227553497 wait complete. 2024-09-21T08:51:56.954 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:56.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-21T08:51:56.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-21T08:51:56.954 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-21T08:51:57.002 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.003 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbd0c0f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556cdf68b4e0 0x556cdf68b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbd0c0f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556cdf54bb30 con 0x556cdf68be20 2024-09-21T08:51:57.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbd0c0f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556cdf52d360 con 0x556cdf68b4e0 2024-09-21T08:51:57.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbcc2e7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556cdf68b4e0 0x556cdf68b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbc3fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556cdf68be20 0x556cdf6909a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46806/0 (socket says 172.21.15.196:46806) 2024-09-21T08:51:57.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbcc2e7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556cdf68b4e0 0x556cdf68b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33930/0 (socket says 172.21.15.196:33930) 2024-09-21T08:51:57.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.001+0000 7ffbc3fff640 1 -- 172.21.15.196:0/31627973 learned_addr learned my addr 172.21.15.196:0/31627973 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.002+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/31627973 >> v1:172.21.15.29:6789/0 conn(0x556cdf68be20 legacy=0x556cdf6909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.002+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/31627973 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf553e00 con 0x556cdf68b4e0 2024-09-21T08:51:57.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.003+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/31627973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf68b8e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00a600 tx=0x7ffbbc047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350e098284ed40f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbcbae6640 1 -- 172.21.15.196:0/31627973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc056070 con 0x556cdf68b4e0 2024-09-21T08:51:57.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbcbae6640 1 -- 172.21.15.196:0/31627973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc00a200 con 0x556cdf68b4e0 2024-09-21T08:51:57.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbcbae6640 1 -- 172.21.15.196:0/31627973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc008590 con 0x556cdf68b4e0 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/31627973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 msgr2=0x556cdf68b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/31627973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf68b8e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00a600 tx=0x7ffbbc047cb0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/31627973 shutdown_connections 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/31627973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf68b8e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/31627973 >> 172.21.15.196:0/31627973 conn(0x556cdf686e10 msgr2=0x556cdf689230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/31627973 shutdown_connections 2024-09-21T08:51:57.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.004+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/31627973 wait complete. 2024-09-21T08:51:57.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbd0c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbd0c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556cdf5d8350 con 0x556cdf68b4e0 2024-09-21T08:51:57.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbcc2e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbcc2e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33942/0 (socket says 172.21.15.196:33942) 2024-09-21T08:51:57.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.018+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/4141621748 learned_addr learned my addr 172.21.15.196:0/4141621748 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.019+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/4141621748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf525bc0 con 0x556cdf68b4e0 2024-09-21T08:51:57.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.019+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/4141621748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc027ae0 tx=0x7ffbbc053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc45325714d8fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.019+0000 7ffaba60c640 1 -- 172.21.15.196:0/4141621748 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc008780 con 0x556cdf68b4e0 2024-09-21T08:51:57.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.019+0000 7ffaba60c640 1 -- 172.21.15.196:0/4141621748 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc008920 con 0x556cdf68b4e0 2024-09-21T08:51:57.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.019+0000 7ffaba60c640 1 -- 172.21.15.196:0/4141621748 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc008c00 con 0x556cdf68b4e0 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/4141621748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 msgr2=0x556cdf779690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/4141621748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc027ae0 tx=0x7ffbbc053000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/4141621748 shutdown_connections 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/4141621748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf779690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/4141621748 >> 172.21.15.196:0/4141621748 conn(0x556cdf686e10 msgr2=0x556cdf775050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/4141621748 shutdown_connections 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/4141621748 wait complete. 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.020+0000 7ffbd0c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556cdf692500 con 0x556cdf68b4e0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbcc2e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbcc2e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33954/0 (socket says 172.21.15.196:33954) 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/564045458 learned_addr learned my addr 172.21.15.196:0/564045458 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf539fe0 con 0x556cdf68b4e0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc047cf0 tx=0x7ffbbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffab8e09640 1 -- 172.21.15.196:0/564045458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc0515a0 con 0x556cdf68b4e0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffab8e09640 1 -- 172.21.15.196:0/564045458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc051740 con 0x556cdf68b4e0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cdf7858f0 con 0x556cdf68b4e0 2024-09-21T08:51:57.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffab8e09640 1 -- 172.21.15.196:0/564045458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc051a40 con 0x556cdf68b4e0 2024-09-21T08:51:57.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.021+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cdf785e70 con 0x556cdf68b4e0 2024-09-21T08:51:57.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffab8e09640 1 -- 172.21.15.196:0/564045458 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbbc059070 con 0x556cdf68b4e0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffab8e09640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 0x7ffab4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffab8e09640 1 -- 172.21.15.196:0/564045458 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbbc062070 con 0x556cdf68b4e0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 0x7ffab4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 0x556cdf78c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.022+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf78c9a0 con 0x556cdf68be20 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbccae8640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 0x556cdf78c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 0x7ffab4039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001d90 tx=0x7ffbb40012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbccae8640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 0x556cdf78c420 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbccae8640 1 -- 172.21.15.196:0/564045458 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbc400a4a0 con 0x556cdf68be20 2024-09-21T08:51:57.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf78d280 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbccae8640 1 -- 172.21.15.196:0/564045458 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbc400a4a0 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 0x556cdf791060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.023+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7917f0 con 0x556cdf78ebd0 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.024+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 0x556cdf791060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.024+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 0x556cdf791060 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.024+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/564045458 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf78ebd0 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.024+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf78dad0 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbccae8640 1 -- 172.21.15.196:0/564045458 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbc400a4a0 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf78de70 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbccae8640 1 -- 172.21.15.196:0/564045458 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbc400a4a0 con 0x556cdf68be20 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbd0c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.025+0000 7ffbd0c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556cdf527580 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33964/0 (socket says 172.21.15.196:33964) 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbccae8640 1 -- 172.21.15.196:0/577951763 learned_addr learned my addr 172.21.15.196:0/577951763 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbccae8640 1 -- 172.21.15.196:0/577951763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf7a0960 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbccae8640 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556cdf78cda0 tx=0x7ffbc4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffab1ffb640 1 -- 172.21.15.196:0/577951763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4014450 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffab1ffb640 1 -- 172.21.15.196:0/577951763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc4014610 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cdf7a0bf0 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffab1ffb640 1 -- 172.21.15.196:0/577951763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4014930 con 0x556cdf7a0000 2024-09-21T08:51:57.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.026+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cdf7a38d0 con 0x556cdf7a0000 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffab1ffb640 1 -- 172.21.15.196:0/577951763 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc4011040 con 0x556cdf7a0000 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffab1ffb640 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 0x7ffaa4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffab1ffb640 1 -- 172.21.15.196:0/577951763 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbc401e070 con 0x556cdf7a0000 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 0x7ffaa4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.027+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 0x7ffaa4039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x556cdf789b20 tx=0x7ffbbc050d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbd0c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbd0c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556cdf779d80 con 0x556cdf7acbd0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33970/0 (socket says 172.21.15.196:33970) 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbccae8640 1 -- 172.21.15.196:0/1386410211 learned_addr learned my addr 172.21.15.196:0/1386410211 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbccae8640 1 -- 172.21.15.196:0/1386410211 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf7ad5a0 con 0x556cdf7acbd0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffbccae8640 1 --2- 172.21.15.196:0/1386410211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbc404cb90 tx=0x7ffbc4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670b240dfcad47fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffaab7fe640 1 -- 172.21.15.196:0/1386410211 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4044070 con 0x556cdf7acbd0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffaab7fe640 1 -- 172.21.15.196:0/1386410211 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc40167c0 con 0x556cdf7acbd0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.028+0000 7ffaab7fe640 1 -- 172.21.15.196:0/1386410211 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4013ca0 con 0x556cdf7acbd0 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/1386410211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 msgr2=0x556cdf7acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/1386410211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbc404cb90 tx=0x7ffbc4011700 comp rx=0 tx=0).stop 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/1386410211 shutdown_connections 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/1386410211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7acfd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/1386410211 >> 172.21.15.196:0/1386410211 conn(0x556cdf7a8fc0 msgr2=0x556cdf7a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/1386410211 shutdown_connections 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/1386410211 wait complete. 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 Processor -- start 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- start start 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.029+0000 7ffbd0c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556cdf7adc10 con 0x556cdf7acbd0 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbccae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33980/0 (socket says 172.21.15.196:33980) 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 learned_addr learned my addr 172.21.15.196:0/3004570987 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cdf7b45d0 con 0x556cdf7acbd0 2024-09-21T08:51:57.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbccae8640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffbc404bab0 tx=0x7ffbc404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffaa9ffb640 1 -- 172.21.15.196:0/3004570987 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc4022c60 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffaa9ffb640 1 -- 172.21.15.196:0/3004570987 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc4022e00 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cdf7b4860 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffaa9ffb640 1 -- 172.21.15.196:0/3004570987 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc404e0d0 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.030+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cdf7b7510 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.031+0000 7ffaa9ffb640 1 -- 172.21.15.196:0/3004570987 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc403e020 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.031+0000 7ffaa9ffb640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffa9c036b40 0x7ffa9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.031+0000 7ffaa9ffb640 1 -- 172.21.15.196:0/3004570987 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbc403c020 con 0x556cdf7acbd0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.031+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffa9c036b40 0x7ffa9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffa9c036b40 0x7ffa9c039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc008890 tx=0x7ffbbc083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf7bfdb0 0x556cdf7c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c29c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf7bfdb0 0x556cdf7c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.032+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf7bfdb0 0x556cdf7c2270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbb4009050 con 0x556cdf7bfdb0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 realm 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7bf200 con 0x556cdf7bfdb0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbb4009050 con 0x556cdf7bfdb0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c34b0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbb4009050 con 0x556cdf7bfdb0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c3d80 con 0x556cdf7bfdb0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbb4009050 con 0x556cdf7bfdb0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf7c47a0 0x556cdf7c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.033+0000 7ffbccae8640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf7c47a0 0x556cdf7c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbccae8640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf7c47a0 0x556cdf7c6b90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbd0c0f800 20 searching for the correct realm 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556cdf7c9250 0x556cdf7cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cbde0 con 0x556cdf7c9250 2024-09-21T08:51:57.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556cdf7c9250 0x556cdf7cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.034+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556cdf7c9250 0x556cdf7cb710 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbcc2e7640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbbc05b070 0x7ffbbc006540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cbde0 con 0x7ffbbc05b070 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbbc05b070 0x7ffbbc006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbc3fff640 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbbc05b070 0x7ffbbc006540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4009050 con 0x7ffbbc05b070 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.035+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cbde0 con 0x556cdf7c47a0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4009050 con 0x556cdf7bfdb0 2024-09-21T08:51:57.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.036+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x7ffbbc05b070 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x7ffbbc05b070 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.037+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x7ffbbc05b070 2024-09-21T08:51:57.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffbb4029040 con 0x7ffbbc05b070 2024-09-21T08:51:57.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.038+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.039+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x7ffbbc05b070 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x7ffbbc05b070 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.040+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x7ffbbc05b070 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x7ffbbc05b070 2024-09-21T08:51:57.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c9250 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.041+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7c47a0 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x556cdf7bfdb0 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7280 con 0x7ffbbc05b070 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb4029040 con 0x7ffbbc05b070 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7b40 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.042+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c7f30 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbb4029040 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c8350 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 zone default found 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 4 Realm: () 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 zonegroup default 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7c8780 con 0x556cdf7c47a0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.043+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7ce170 con 0x556cdf7c9250 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7ce510 con 0x556cdf7c9250 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 20 started sync module instance, tier type = 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.044+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cd600 con 0x7ffbbc05b070 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.045+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.045+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93926094330624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cd600 con 0x7ffbbc05b070 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.045+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7ceed0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.046+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.046+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93926094334496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cf330 con 0x556cdf7bfdb0 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.046+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cfe50 con 0x556cdf7c9250 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.046+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93926094330624] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.047+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93926094334496] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.047+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.047+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93926094338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cee40 con 0x556cdf7c9250 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.047+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d0730 con 0x7ffbbc05b070 2024-09-21T08:51:57.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.048+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93926094338336] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.048+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.048+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93926094328144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d0b20 con 0x7ffbbc05b070 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.048+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d14e0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.050+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.050+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93926094344240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d1450 con 0x556cdf7bfdb0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.051+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d2450 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.051+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93926094328144] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.051+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93926094344240] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.052+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.052+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93926094346496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d2450 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.052+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d2cf0 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.053+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.053+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93926094350400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d3110 con 0x556cdf7c47a0 2024-09-21T08:51:57.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.053+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d3960 con 0x556cdf7c47a0 2024-09-21T08:51:57.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.053+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93926094346496] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93926094350400] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93926094351456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d3530 con 0x556cdf7c47a0 2024-09-21T08:51:57.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=0 2024-09-21T08:51:57.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=1 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=2 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=3 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=4 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=5 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.054+0000 7ffbd0c0f800 20 add_watcher() i=6 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93926094351456] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbd0c0f800 20 add_watcher() i=7 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbd0c0f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d67a0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.055+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93926094352880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d3ac0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.057+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93926094352880] v34'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffa827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 5 note: GC not initialized 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffa817e2640 20 reqs_thread_entry: start 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 20 Filter name: none 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ff9f2ffd640 20 reqs_thread_entry: start 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.058+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf809cf0 con 0x556cdf7c47a0 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-21T08:51:57.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf808330 con 0x556cdf7bfdb0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=7 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.059+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cdf808720 con 0x556cdf7bfdb0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:57.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.060+0000 7ffbd0c0f800 20 get_user_info_from_index found 0 xattrs 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.061+0000 7ffa827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.061+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93926094352880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf807a60 con 0x556cdf7bfdb0 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.061+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93926094352880] v34'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.061+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93926094330624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf807a60 con 0x7ffbbc05b070 2024-09-21T08:51:57.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.065+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93926094330624] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.065+0000 7ffbd0c0f800 20 remove_watcher() i=0 2024-09-21T08:51:57.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.065+0000 7ffbd0c0f800 2 removed watcher, disabling cache 2024-09-21T08:51:57.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.065+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93926094334496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf807a60 con 0x556cdf7bfdb0 2024-09-21T08:51:57.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.066+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93926094334496] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.066+0000 7ffbd0c0f800 20 remove_watcher() i=1 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.066+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93926094338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf807a60 con 0x556cdf7c9250 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.067+0000 7ffbcc2e7640 1 -- 172.21.15.196:0/3004570987 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93926094338336] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbbc058030 con 0x556cdf7c9250 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.067+0000 7ffbd0c0f800 20 remove_watcher() i=2 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.067+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93926094328144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cdb00 con 0x7ffbbc05b070 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.068+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93926094328144] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x7ffbbc05b070 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.068+0000 7ffbd0c0f800 20 remove_watcher() i=3 2024-09-21T08:51:57.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.068+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93926094344240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cea20 con 0x556cdf7bfdb0 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.069+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93926094344240] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb40391c0 con 0x556cdf7bfdb0 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.069+0000 7ffbd0c0f800 20 remove_watcher() i=4 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.069+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93926094346496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cdb00 con 0x556cdf7c47a0 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.070+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93926094346496] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.071+0000 7ffbd0c0f800 20 remove_watcher() i=5 2024-09-21T08:51:57.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.071+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93926094350400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7d1030 con 0x556cdf7c47a0 2024-09-21T08:51:57.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.071+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93926094350400] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.071+0000 7ffbd0c0f800 20 remove_watcher() i=6 2024-09-21T08:51:57.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.071+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93926094351456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cdf7cea20 con 0x556cdf7c47a0 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.072+0000 7ffbccae8640 1 -- 172.21.15.196:0/3004570987 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93926094351456] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc402a070 con 0x556cdf7c47a0 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.072+0000 7ffbd0c0f800 20 remove_watcher() i=7 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf7c47a0 msgr2=0x556cdf7c6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf7c47a0 0x556cdf7c6b90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf7bfdb0 msgr2=0x556cdf7c2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf7bfdb0 0x556cdf7c2270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbbc05b070 msgr2=0x7ffbbc006540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbbc05b070 0x7ffbbc006540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556cdf7c9250 msgr2=0x556cdf7cb710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556cdf7c9250 0x556cdf7cb710 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffa9c036b40 msgr2=0x7ffa9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffa9c036b40 0x7ffa9c039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc008890 tx=0x7ffbbc083000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 msgr2=0x556cdf7b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbc3fff640 1 -- 172.21.15.196:0/3004570987 reap_dead start 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffbc404bab0 tx=0x7ffbc404cb20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 shutdown_connections 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/3004570987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7acbd0 0x556cdf7b4090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 >> 172.21.15.196:0/3004570987 conn(0x556cdf7a8fc0 msgr2=0x556cdf7a7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 shutdown_connections 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/3004570987 wait complete. 2024-09-21T08:51:57.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 msgr2=0x7ffaa4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 0x7ffaa4039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x556cdf789b20 tx=0x7ffbbc050d10 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 msgr2=0x556cdf7a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556cdf78cda0 tx=0x7ffbc4018830 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 shutdown_connections 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffaa4036b90 0x7ffaa4039050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/577951763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf7a0000 0x556cdf7a0420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 >> 172.21.15.196:0/577951763 conn(0x556cdf794f40 msgr2=0x556cdf797b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 shutdown_connections 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.073+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/577951763 wait complete. 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 msgr2=0x556cdf791060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 0x556cdf791060 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 msgr2=0x556cdf78c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 0x556cdf78c420 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 msgr2=0x7ffab4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 0x7ffab4039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001d90 tx=0x7ffbb40012f0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 msgr2=0x556cdf7853b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc047cf0 tx=0x7ffbbc002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 shutdown_connections 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556cdf78ebd0 0x556cdf791060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556cdf68be20 0x556cdf78c420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffab4036b90 0x7ffab4039050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 --2- 172.21.15.196:0/564045458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556cdf68b4e0 0x556cdf7853b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 >> 172.21.15.196:0/564045458 conn(0x556cdf686e10 msgr2=0x556cdf773900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 shutdown_connections 2024-09-21T08:51:57.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.074+0000 7ffbd0c0f800 1 -- 172.21.15.196:0/564045458 wait complete. 2024-09-21T08:51:57.084 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-21T08:51:57.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.085 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:57.129 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.129 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.127+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.127+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.127+0000 7f496b5af800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f55c4d7e90 0x55f55c567140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.127+0000 7f496b5af800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f55c423b30 con 0x55f55c567680 2024-09-21T08:51:57.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.127+0000 7f496b5af800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f55c405360 con 0x55f55c4d7e90 2024-09-21T08:51:57.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.128+0000 7f49690a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f55c4d7e90 0x55f55c567140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.128+0000 7f49688a2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f55c567680 0x55f55c569a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46816/0 (socket says 172.21.15.196:46816) 2024-09-21T08:51:57.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.128+0000 7f49688a2640 1 -- 172.21.15.196:0/3417909743 learned_addr learned my addr 172.21.15.196:0/3417909743 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.128+0000 7f49690a3640 1 -- 172.21.15.196:0/3417909743 >> v1:172.21.15.29:6789/0 conn(0x55f55c567680 legacy=0x55f55c569a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.128+0000 7f49690a3640 1 -- 172.21.15.196:0/3417909743 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c42be00 con 0x55f55c4d7e90 2024-09-21T08:51:57.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f49690a3640 1 --2- 172.21.15.196:0/3417909743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c567140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f495c00a470 tx=0x7f495c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bc3df54a1eecb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f495bfff640 1 -- 172.21.15.196:0/3417909743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c053570 con 0x55f55c4d7e90 2024-09-21T08:51:57.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f495bfff640 1 -- 172.21.15.196:0/3417909743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c058070 con 0x55f55c4d7e90 2024-09-21T08:51:57.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f495bfff640 1 -- 172.21.15.196:0/3417909743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c053880 con 0x55f55c4d7e90 2024-09-21T08:51:57.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 -- 172.21.15.196:0/3417909743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 msgr2=0x55f55c567140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 --2- 172.21.15.196:0/3417909743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c567140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f495c00a470 tx=0x7f495c045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 -- 172.21.15.196:0/3417909743 shutdown_connections 2024-09-21T08:51:57.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 --2- 172.21.15.196:0/3417909743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c567140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 -- 172.21.15.196:0/3417909743 >> 172.21.15.196:0/3417909743 conn(0x55f55c55edf0 msgr2=0x55f55c561210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 -- 172.21.15.196:0/3417909743 shutdown_connections 2024-09-21T08:51:57.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.130+0000 7f496b5af800 1 -- 172.21.15.196:0/3417909743 wait complete. 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f496b5af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f496b5af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f55c4b0330 con 0x55f55c4d7e90 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f49690a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.144+0000 7f49690a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:33996/0 (socket says 172.21.15.196:33996) 2024-09-21T08:51:57.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f49690a3640 1 -- 172.21.15.196:0/700599897 learned_addr learned my addr 172.21.15.196:0/700599897 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f49690a3640 1 -- 172.21.15.196:0/700599897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c3fdbc0 con 0x55f55c4d7e90 2024-09-21T08:51:57.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f49690a3640 1 --2- 172.21.15.196:0/700599897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f495c025c20 tx=0x7f495c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2d0a55dd64c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f4857606640 1 -- 172.21.15.196:0/700599897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c05c580 con 0x55f55c4d7e90 2024-09-21T08:51:57.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f4857606640 1 -- 172.21.15.196:0/700599897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c063030 con 0x55f55c4d7e90 2024-09-21T08:51:57.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.145+0000 7f4857606640 1 -- 172.21.15.196:0/700599897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c05c850 con 0x55f55c4d7e90 2024-09-21T08:51:57.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 -- 172.21.15.196:0/700599897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 msgr2=0x55f55c653880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 --2- 172.21.15.196:0/700599897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f495c025c20 tx=0x7f495c051000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 -- 172.21.15.196:0/700599897 shutdown_connections 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 --2- 172.21.15.196:0/700599897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c653880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 -- 172.21.15.196:0/700599897 >> 172.21.15.196:0/700599897 conn(0x55f55c55edf0 msgr2=0x55f55c64f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 -- 172.21.15.196:0/700599897 shutdown_connections 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 -- 172.21.15.196:0/700599897 wait complete. 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.146+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f496b5af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f496b5af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f55c56b5f0 con 0x55f55c4d7e90 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f49690a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f49690a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34012/0 (socket says 172.21.15.196:34012) 2024-09-21T08:51:57.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f49690a3640 1 -- 172.21.15.196:0/1316954741 learned_addr learned my addr 172.21.15.196:0/1316954741 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f49690a3640 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c411fe0 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.147+0000 7f49690a3640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f55c6546e0 tx=0x7f495c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f4855e03640 1 -- 172.21.15.196:0/1316954741 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c054af0 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f4855e03640 1 -- 172.21.15.196:0/1316954741 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c054c90 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f55c563160 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f4855e03640 1 -- 172.21.15.196:0/1316954741 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f495c068420 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55c563680 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.148+0000 7f4855e03640 1 -- 172.21.15.196:0/1316954741 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f495c0685c0 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f4855e03640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 0x7f4850039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f4855e03640 1 -- 172.21.15.196:0/1316954741 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f495c070030 con 0x55f55c4d7e90 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f49688a2640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 0x7f4850039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 0x55f55c6645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c664b10 con 0x55f55c567680 2024-09-21T08:51:57.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f49698a4640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 0x55f55c6645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f49688a2640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 0x7f4850039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4960000f60 tx=0x7f49600012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.149+0000 7f49698a4640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 0x55f55c6645d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f49698a4640 1 -- 172.21.15.196:0/1316954741 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f496400a4a0 con 0x55f55c567680 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c665360 con 0x55f55c567680 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f49698a4640 1 -- 172.21.15.196:0/1316954741 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f496400a4a0 con 0x55f55c567680 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 0x55f55c6691c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c669950 con 0x55f55c666d90 2024-09-21T08:51:57.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.150+0000 7f49690a3640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 0x55f55c6691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f49690a3640 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 0x55f55c6691c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f49690a3640 1 -- 172.21.15.196:0/1316954741 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f495c051070 con 0x55f55c666d90 2024-09-21T08:51:57.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c665bb0 con 0x55f55c567680 2024-09-21T08:51:57.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f49698a4640 1 -- 172.21.15.196:0/1316954741 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f496400a4a0 con 0x55f55c567680 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c665f50 con 0x55f55c567680 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.151+0000 7f49698a4640 1 -- 172.21.15.196:0/1316954741 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f496400a4a0 con 0x55f55c567680 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f496b5af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f496b5af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f55c564fb0 con 0x55f55c6782f0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34014/0 (socket says 172.21.15.196:34014) 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.152+0000 7f49698a4640 1 -- 172.21.15.196:0/3985621435 learned_addr learned my addr 172.21.15.196:0/3985621435 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f49698a4640 1 -- 172.21.15.196:0/3985621435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c678c50 con 0x55f55c6782f0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f49698a4640 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55f55c5640b0 tx=0x7f4964018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f484effd640 1 -- 172.21.15.196:0/3985621435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964014450 con 0x55f55c6782f0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f484effd640 1 -- 172.21.15.196:0/3985621435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4964014610 con 0x55f55c6782f0 2024-09-21T08:51:57.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f484effd640 1 -- 172.21.15.196:0/3985621435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964014930 con 0x55f55c6782f0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f55c678ee0 con 0x55f55c6782f0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.153+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55c67bbc0 con 0x55f55c6782f0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f484effd640 1 -- 172.21.15.196:0/3985621435 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4964011040 con 0x55f55c6782f0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f484effd640 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 0x7f4840039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f484effd640 1 -- 172.21.15.196:0/3985621435 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f496401e070 con 0x55f55c6782f0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f49690a3640 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 0x7f4840039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f49690a3640 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 0x7f4840039050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55f55c563bf0 tx=0x7f495c0094f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f496b5af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.154+0000 7f496b5af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f55c3ff580 con 0x55f55c684f00 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34016/0 (socket says 172.21.15.196:34016) 2024-09-21T08:51:57.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f49698a4640 1 -- 172.21.15.196:0/443510894 learned_addr learned my addr 172.21.15.196:0/443510894 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f49698a4640 1 -- 172.21.15.196:0/443510894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c685840 con 0x55f55c684f00 2024-09-21T08:51:57.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f49698a4640 1 --2- 172.21.15.196:0/443510894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4964018430 tx=0x7f49640404b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb2f13bc72ef3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f484cff9640 1 -- 172.21.15.196:0/443510894 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964013dc0 con 0x55f55c684f00 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f484cff9640 1 -- 172.21.15.196:0/443510894 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4964046ad0 con 0x55f55c684f00 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.155+0000 7f484cff9640 1 -- 172.21.15.196:0/443510894 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964046db0 con 0x55f55c684f00 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- 172.21.15.196:0/443510894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 msgr2=0x55f55c685300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 --2- 172.21.15.196:0/443510894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4964018430 tx=0x7f49640404b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- 172.21.15.196:0/443510894 shutdown_connections 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 --2- 172.21.15.196:0/443510894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c685300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- 172.21.15.196:0/443510894 >> 172.21.15.196:0/443510894 conn(0x55f55c6812b0 msgr2=0x55f55c67f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- 172.21.15.196:0/443510894 shutdown_connections 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- 172.21.15.196:0/443510894 wait complete. 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 Processor -- start 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- start start 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c68c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f496b5af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f55c685d60 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c68c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f49698a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c68c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34026/0 (socket says 172.21.15.196:34026) 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.156+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 learned_addr learned my addr 172.21.15.196:0/289927573 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55c68c810 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f49698a4640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c68c2d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49640119b0 tx=0x7f496404cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f483effd640 1 -- 172.21.15.196:0/289927573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496403b070 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f483effd640 1 -- 172.21.15.196:0/289927573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496402ba60 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f55c68caa0 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f483effd640 1 -- 172.21.15.196:0/289927573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964016440 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.157+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55c68f750 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f483effd640 1 -- 172.21.15.196:0/289927573 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4964022a80 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f483effd640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4834036b40 0x7f4834039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f483effd640 1 -- 172.21.15.196:0/289927573 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4964033070 con 0x55f55c684f00 2024-09-21T08:51:57.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f49690a3640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4834036b40 0x7f4834039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c697eb0 0x55f55c69a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69aa70 con 0x55f55c697eb0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.158+0000 7f49688a2640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c697eb0 0x55f55c69a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f49690a3640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4834036b40 0x7f4834039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f495c009580 tx=0x7f495c088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f49688a2640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c697eb0 0x55f55c69a370 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4960009050 con 0x55f55c697eb0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 realm 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c697350 con 0x55f55c697eb0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4960009050 con 0x55f55c697eb0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69b550 con 0x55f55c697eb0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4960009050 con 0x55f55c697eb0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.159+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69be20 con 0x55f55c697eb0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4960009050 con 0x55f55c697eb0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f496b5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c69c6d0 0x55f55c69eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69f240 con 0x55f55c69c6d0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f49698a4640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c69c6d0 0x55f55c69eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.160+0000 7f49698a4640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c69c6d0 0x55f55c69eae0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f496b5af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f496b5af800 20 searching for the correct realm 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f55c6a1340 0x55f55c6a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c6a1340 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49690a3640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f55c6a1340 0x55f55c6a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49690a3640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f55c6a1340 0x55f55c6a3800 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49690a3640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f495c08c040 0x7f495c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x7f495c08c040 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.161+0000 7f49688a2640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f495c08c040 0x7f495c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f495c08c040 0x7f495c07d3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960009050 con 0x7f495c08c040 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c69c6d0 2024-09-21T08:51:57.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c697eb0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960009050 con 0x55f55c697eb0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c697eb0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.162+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c69c6d0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c69c6d0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x7f495c08c040 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a3ed0 con 0x55f55c6a1340 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.163+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x7f495c08c040 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.164+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.165+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.166+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x7f495c08c040 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.167+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x7f495c08c040 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c6a1340 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.168+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x55f55c697eb0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f495c0aa040 con 0x7f495c08c040 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69fd40 con 0x55f55c697eb0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a01c0 con 0x55f55c697eb0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.169+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a0660 con 0x55f55c697eb0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 zone default found 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 4 Realm: () 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 zonegroup default 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a4350 con 0x55f55c69c6d0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c69f980 con 0x55f55c6a1340 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a6700 con 0x55f55c6a1340 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 started sync module instance, tier type = 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.170+0000 7f496b5af800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.171+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a5a10 con 0x7f495c08c040 2024-09-21T08:51:57.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.172+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.172+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512305823504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a5a10 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.172+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a7280 con 0x55f55c697eb0 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.174+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.174+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512305827152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a7240 con 0x55f55c697eb0 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.174+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a8260 con 0x55f55c6a1340 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.174+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512305823504] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.175+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512305827152] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.175+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.175+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512305829488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a5560 con 0x55f55c6a1340 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.175+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a8b00 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.177+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512305829488] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.177+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.177+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512305833552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a8f20 con 0x7f495c08c040 2024-09-21T08:51:57.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.177+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a98e0 con 0x55f55c697eb0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.178+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.178+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512305837104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a9d00 con 0x55f55c697eb0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.178+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6aa7e0 con 0x55f55c69c6d0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.178+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512305833552] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.179+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512305837104] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.179+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.179+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512305840880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a9850 con 0x55f55c69c6d0 2024-09-21T08:51:57.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.179+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ab080 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.180+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.180+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512305843152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ab4a0 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.180+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6abcf0 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.180+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512305840880] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512305843152] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512305844208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ab8c0 con 0x55f55c69c6d0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=0 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=1 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=2 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=3 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=4 2024-09-21T08:51:57.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=5 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.181+0000 7f496b5af800 20 add_watcher() i=6 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.182+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512305844208] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.182+0000 7f496b5af800 20 add_watcher() i=7 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.182+0000 7f496b5af800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.182+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6aea80 con 0x55f55c697eb0 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.183+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.183+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512305857648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ab8c0 con 0x55f55c697eb0 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512305857648] v34'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f496b5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f496b5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f496b5af800 5 note: GC not initialized 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f481f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f481e7e4640 20 reqs_thread_entry: start 2024-09-21T08:51:57.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f496b5af800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.185+0000 7f496b5af800 20 Filter name: none 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.186+0000 7f478ffff640 20 reqs_thread_entry: start 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.186+0000 7f496b5af800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.186+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6e1a40 con 0x55f55c697eb0 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.186+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.186+0000 7f496b5af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.193 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.187+0000 7f481f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.187+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512305857648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ad9d0 con 0x55f55c697eb0 2024-09-21T08:51:57.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.188+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94512305857648] v34'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.188+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512305823504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ae470 con 0x7f495c08c040 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.190+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94512305823504] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.190+0000 7f496b5af800 20 remove_watcher() i=0 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.190+0000 7f496b5af800 2 removed watcher, disabling cache 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.190+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512305827152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ae470 con 0x55f55c697eb0 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.192+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94512305827152] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.192+0000 7f496b5af800 20 remove_watcher() i=1 2024-09-21T08:51:57.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.192+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512305829488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6ae470 con 0x55f55c6a1340 2024-09-21T08:51:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.193+0000 7f49690a3640 1 -- 172.21.15.196:0/289927573 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94512305829488] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f495c051070 con 0x55f55c6a1340 2024-09-21T08:51:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.193+0000 7f496b5af800 20 remove_watcher() i=2 2024-09-21T08:51:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.193+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512305833552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a7670 con 0x7f495c08c040 2024-09-21T08:51:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.194+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94512305833552] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x7f495c08c040 2024-09-21T08:51:57.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.194+0000 7f496b5af800 20 remove_watcher() i=3 2024-09-21T08:51:57.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.194+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512305837104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a8650 con 0x55f55c697eb0 2024-09-21T08:51:57.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.196+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94512305837104] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4960029040 con 0x55f55c697eb0 2024-09-21T08:51:57.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.196+0000 7f496b5af800 20 remove_watcher() i=4 2024-09-21T08:51:57.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.196+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512305840880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a7670 con 0x55f55c69c6d0 2024-09-21T08:51:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.197+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94512305840880] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.197+0000 7f496b5af800 20 remove_watcher() i=5 2024-09-21T08:51:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.197+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512305843152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a9430 con 0x55f55c69c6d0 2024-09-21T08:51:57.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.198+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94512305843152] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.198+0000 7f496b5af800 20 remove_watcher() i=6 2024-09-21T08:51:57.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.198+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512305844208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f55c6a8650 con 0x55f55c69c6d0 2024-09-21T08:51:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f49698a4640 1 -- 172.21.15.196:0/289927573 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94512305844208] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964055070 con 0x55f55c69c6d0 2024-09-21T08:51:57.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 20 remove_watcher() i=7 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c69c6d0 msgr2=0x55f55c69eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c69c6d0 0x55f55c69eae0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c697eb0 msgr2=0x55f55c69a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c697eb0 0x55f55c69a370 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f495c08c040 msgr2=0x7f495c07d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f495c08c040 0x7f495c07d3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f55c6a1340 msgr2=0x55f55c6a3800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f55c6a1340 0x55f55c6a3800 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4834036b40 msgr2=0x7f4834039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4834036b40 0x7f4834039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f495c009580 tx=0x7f495c088000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 msgr2=0x55f55c68c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 --2- 172.21.15.196:0/289927573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c684f00 0x55f55c68c2d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49640119b0 tx=0x7f496404cc70 comp rx=0 tx=0).stop 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 reap_dead start 2024-09-21T08:51:57.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f49688a2640 1 -- 172.21.15.196:0/289927573 reap_dead start 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 shutdown_connections 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 >> 172.21.15.196:0/289927573 conn(0x55f55c6812b0 msgr2=0x55f55c67f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 shutdown_connections 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.199+0000 7f496b5af800 1 -- 172.21.15.196:0/289927573 wait complete. 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 msgr2=0x7f4840039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 0x7f4840039050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55f55c563bf0 tx=0x7f495c0094f0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 msgr2=0x55f55c678710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55f55c5640b0 tx=0x7f4964018830 comp rx=0 tx=0).stop 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 shutdown_connections 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4840036b90 0x7f4840039050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/3985621435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c6782f0 0x55f55c678710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 >> 172.21.15.196:0/3985621435 conn(0x55f55c66d280 msgr2=0x55f55c66fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 shutdown_connections 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/3985621435 wait complete. 2024-09-21T08:51:57.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 msgr2=0x55f55c6691c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 0x55f55c6691c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 msgr2=0x55f55c6645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 0x55f55c6645d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 msgr2=0x7f4850039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 0x7f4850039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4960000f60 tx=0x7f49600012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 msgr2=0x55f55c564a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f55c6546e0 tx=0x7f495c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 shutdown_connections 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f55c666d90 0x55f55c6691c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f55c567680 0x55f55c6645d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4850036b90 0x7f4850039050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 --2- 172.21.15.196:0/1316954741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f55c4d7e90 0x55f55c564a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 >> 172.21.15.196:0/1316954741 conn(0x55f55c55edf0 msgr2=0x55f55c64daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 shutdown_connections 2024-09-21T08:51:57.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.200+0000 7f496b5af800 1 -- 172.21.15.196:0/1316954741 wait complete. 2024-09-21T08:51:57.211 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-21T08:51:57.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-21T08:51:57.212 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-21T08:51:57.256 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.256 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.254+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.254+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.254+0000 7fb3df50c800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557d43ff05f0 0x557d44081690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.254+0000 7fb3df50c800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d43f3bb30 con 0x557d44081bd0 2024-09-21T08:51:57.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.254+0000 7fb3df50c800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557d43f1d360 con 0x557d43ff05f0 2024-09-21T08:51:57.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.255+0000 7fb3dd000640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557d43ff05f0 0x557d44081690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.255+0000 7fb3dc7ff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557d44081bd0 0x557d44083fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46824/0 (socket says 172.21.15.196:46824) 2024-09-21T08:51:57.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.255+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/2187436752 learned_addr learned my addr 172.21.15.196:0/2187436752 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.255+0000 7fb3dd000640 1 -- 172.21.15.196:0/2187436752 >> v1:172.21.15.29:6789/0 conn(0x557d44081bd0 legacy=0x557d44083fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.255+0000 7fb3dd000640 1 -- 172.21.15.196:0/2187436752 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d43f43e00 con 0x557d43ff05f0 2024-09-21T08:51:57.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3dd000640 1 --2- 172.21.15.196:0/2187436752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44081690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc005fd0 tx=0x7fb3cc045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c54bfd2aeb1933 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3dbffe640 1 -- 172.21.15.196:0/2187436752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc058530 con 0x557d43ff05f0 2024-09-21T08:51:57.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3dbffe640 1 -- 172.21.15.196:0/2187436752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0586d0 con 0x557d43ff05f0 2024-09-21T08:51:57.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3dbffe640 1 -- 172.21.15.196:0/2187436752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc0589d0 con 0x557d43ff05f0 2024-09-21T08:51:57.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3df50c800 1 -- 172.21.15.196:0/2187436752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 msgr2=0x557d44081690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2187436752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44081690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc005fd0 tx=0x7fb3cc045c30 comp rx=0 tx=0).stop 2024-09-21T08:51:57.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3df50c800 1 -- 172.21.15.196:0/2187436752 shutdown_connections 2024-09-21T08:51:57.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2187436752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44081690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.257+0000 7fb3df50c800 1 -- 172.21.15.196:0/2187436752 >> 172.21.15.196:0/2187436752 conn(0x557d44076de0 msgr2=0x557d44079200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.258+0000 7fb3df50c800 1 -- 172.21.15.196:0/2187436752 shutdown_connections 2024-09-21T08:51:57.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.258+0000 7fb3df50c800 1 -- 172.21.15.196:0/2187436752 wait complete. 2024-09-21T08:51:57.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.271+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.271+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.271+0000 7fb3df50c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.271+0000 7fb3df50c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557d43fc8330 con 0x557d43ff05f0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34040/0 (socket says 172.21.15.196:34040) 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb3dd000640 1 -- 172.21.15.196:0/569096810 learned_addr learned my addr 172.21.15.196:0/569096810 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb3dd000640 1 -- 172.21.15.196:0/569096810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d43f15bc0 con 0x557d43ff05f0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb3dd000640 1 --2- 172.21.15.196:0/569096810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a3f0 tx=0x7fb3cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654ae6909ba4476a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb2cae0d640 1 -- 172.21.15.196:0/569096810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc0589b0 con 0x557d43ff05f0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb2cae0d640 1 -- 172.21.15.196:0/569096810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc068070 con 0x557d43ff05f0 2024-09-21T08:51:57.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.272+0000 7fb2cae0d640 1 -- 172.21.15.196:0/569096810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc058c80 con 0x557d43ff05f0 2024-09-21T08:51:57.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- 172.21.15.196:0/569096810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 msgr2=0x557d4416dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 --2- 172.21.15.196:0/569096810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a3f0 tx=0x7fb3cc051000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- 172.21.15.196:0/569096810 shutdown_connections 2024-09-21T08:51:57.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 --2- 172.21.15.196:0/569096810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d4416dac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- 172.21.15.196:0/569096810 >> 172.21.15.196:0/569096810 conn(0x557d44076de0 msgr2=0x557d44169480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- 172.21.15.196:0/569096810 shutdown_connections 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- 172.21.15.196:0/569096810 wait complete. 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.273+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3df50c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3df50c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557d44085980 con 0x557d43ff05f0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34054/0 (socket says 172.21.15.196:34054) 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3dd000640 1 -- 172.21.15.196:0/1984623612 learned_addr learned my addr 172.21.15.196:0/1984623612 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3dd000640 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d43f29fe0 con 0x557d43ff05f0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb3dd000640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc065040 tx=0x7fb3cc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.274+0000 7fb2c960a640 1 -- 172.21.15.196:0/1984623612 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc063650 con 0x557d43ff05f0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb2c960a640 1 -- 172.21.15.196:0/1984623612 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0637f0 con 0x557d43ff05f0 2024-09-21T08:51:57.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb2c960a640 1 -- 172.21.15.196:0/1984623612 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3cc063af0 con 0x557d43ff05f0 2024-09-21T08:51:57.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d44175940 con 0x557d43ff05f0 2024-09-21T08:51:57.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d44175e60 con 0x557d43ff05f0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb2c960a640 1 -- 172.21.15.196:0/1984623612 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb3cc074020 con 0x557d43ff05f0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb2c960a640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 0x7fb2c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.275+0000 7fb2c960a640 1 -- 172.21.15.196:0/1984623612 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb3cc090960 con 0x557d43ff05f0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 0x7fb2c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 0x557d4417c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4417c9b0 con 0x557d44081bd0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3dd801640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 0x557d4417c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 0x7fb2c4039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0000f60 tx=0x7fb3d00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3dd801640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 0x557d4417c470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3dd801640 1 -- 172.21.15.196:0/1984623612 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3d40083e0 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.276+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d44179a20 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3dd801640 1 -- 172.21.15.196:0/1984623612 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3d40083e0 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 0x557d44181070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d44181760 con 0x557d4417ec80 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3dd000640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 0x557d44181070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3dd000640 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 0x557d44181070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3dd000640 1 -- 172.21.15.196:0/1984623612 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d4417ec80 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.277+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4417db20 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3dd801640 1 -- 172.21.15.196:0/1984623612 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3d40083e0 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4417df80 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3dd801640 1 -- 172.21.15.196:0/1984623612 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb3d40083e0 con 0x557d44081bd0 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3df50c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.278+0000 7fb3df50c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557d43f17580 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34058/0 (socket says 172.21.15.196:34058) 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3dd801640 1 -- 172.21.15.196:0/2153209572 learned_addr learned my addr 172.21.15.196:0/2153209572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3dd801640 1 -- 172.21.15.196:0/2153209572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d44190a60 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3dd801640 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x557d441764b0 tx=0x7fb3d400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb2c27fc640 1 -- 172.21.15.196:0/2153209572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4007d00 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb2c27fc640 1 -- 172.21.15.196:0/2153209572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d401e020 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d44190cf0 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb2c27fc640 1 -- 172.21.15.196:0/2153209572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4019420 con 0x557d44190100 2024-09-21T08:51:57.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.279+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d441939d0 con 0x557d44190100 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.280+0000 7fb2c27fc640 1 -- 172.21.15.196:0/2153209572 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb3d4016040 con 0x557d44190100 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.280+0000 7fb2c27fc640 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 0x7fb2b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.280+0000 7fb2c27fc640 1 -- 172.21.15.196:0/2153209572 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb3d401f030 con 0x557d44190100 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.280+0000 7fb3dd000640 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 0x7fb2b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd000640 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 0x7fb2b4039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x557d4417cdf0 tx=0x7fb3cc06bef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3df50c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3df50c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557d4416e1b0 con 0x557d4419cd00 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34068/0 (socket says 172.21.15.196:34068) 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd801640 1 -- 172.21.15.196:0/199353171 learned_addr learned my addr 172.21.15.196:0/199353171 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd801640 1 -- 172.21.15.196:0/199353171 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4419d6d0 con 0x557d4419cd00 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb3dd801640 1 --2- 172.21.15.196:0/199353171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4022470 tx=0x7fb3d4017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd68552ba3fdb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb2b3fff640 1 -- 172.21.15.196:0/199353171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d401d030 con 0x557d4419cd00 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.281+0000 7fb2b3fff640 1 -- 172.21.15.196:0/199353171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d4015d00 con 0x557d4419cd00 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb2b3fff640 1 -- 172.21.15.196:0/199353171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40197a0 con 0x557d4419cd00 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- 172.21.15.196:0/199353171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 msgr2=0x557d4419d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 --2- 172.21.15.196:0/199353171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4022470 tx=0x7fb3d4017fa0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- 172.21.15.196:0/199353171 shutdown_connections 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 --2- 172.21.15.196:0/199353171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d4419d100 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- 172.21.15.196:0/199353171 >> 172.21.15.196:0/199353171 conn(0x557d44199060 msgr2=0x557d44197160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- 172.21.15.196:0/199353171 shutdown_connections 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- 172.21.15.196:0/199353171 wait complete. 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 Processor -- start 2024-09-21T08:51:57.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- start start 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d441a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.282+0000 7fb3df50c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557d4419dd40 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d441a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3dd801640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d441a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34074/0 (socket says 172.21.15.196:34074) 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 learned_addr learned my addr 172.21.15.196:0/4265809515 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d441a46f0 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3dd801640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d441a41b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4017fe0 tx=0x7fb3d404ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb2b27fc640 1 -- 172.21.15.196:0/4265809515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4019b20 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb2b27fc640 1 -- 172.21.15.196:0/4265809515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40153e0 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb2b27fc640 1 -- 172.21.15.196:0/4265809515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4019cc0 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d441a4980 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.283+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d441a7630 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.284+0000 7fb2b27fc640 1 -- 172.21.15.196:0/4265809515 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb3d402b350 con 0x557d4419cd00 2024-09-21T08:51:57.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.284+0000 7fb2b27fc640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2a8036a70 0x7fb2a8038f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.284+0000 7fb2b27fc640 1 -- 172.21.15.196:0/4265809515 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb3d4043c30 con 0x557d4419cd00 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.284+0000 7fb3dd000640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2a8036a70 0x7fb2a8038f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3dd000640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2a8036a70 0x7fb2a8038f30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc06bf60 tx=0x7fb3cc093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d441afb50 0x557d441b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b2760 con 0x557d441afb50 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d441afb50 0x557d441b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.285+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d441afb50 0x557d441b2010 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3d0009050 con 0x557d441afb50 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 realm 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441aefa0 con 0x557d441afb50 2024-09-21T08:51:57.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3d0009050 con 0x557d441afb50 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b3250 con 0x557d441afb50 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3d0009050 con 0x557d441afb50 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b3b20 con 0x557d441afb50 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3d0009050 con 0x557d441afb50 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d441b4460 0x557d441b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.286+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b6fe0 con 0x557d441b4460 2024-09-21T08:51:57.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3dd801640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d441b4460 0x557d441b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3dd801640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d441b4460 0x557d441b6850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3df50c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3df50c800 20 searching for the correct realm 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557d441b8fb0 0x557d441bb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.287+0000 7fb3dd000640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557d441b8fb0 0x557d441bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dd000640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557d441b8fb0 0x557d441bb470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dd000640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb3cc090560 0x7fb3cc087690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb3cc090560 0x7fb3cc087690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.288+0000 7fb3dc7ff640 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb3cc090560 0x7fb3cc087690 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0009050 con 0x7fb3cc090560 2024-09-21T08:51:57.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0009050 con 0x557d441afb50 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.289+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x7fb3cc090560 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.290+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.291+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb3d0029040 con 0x7fb3cc090560 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.292+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.293+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x7fb3cc090560 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.294+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.295+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x7fb3cc090560 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b8fb0 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x557d441afb50 2024-09-21T08:51:57.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.296+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbb40 con 0x7fb3cc090560 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d0029040 con 0x7fb3cc090560 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b79a0 con 0x557d441afb50 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b8240 con 0x557d441afb50 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3d0029040 con 0x557d441afb50 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441b75e0 con 0x557d441afb50 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 zone default found 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 4 Realm: () 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 zonegroup default 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.297+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441bbfc0 con 0x557d441b4460 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441be290 con 0x557d441b8fb0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441be630 con 0x557d441b8fb0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 started sync module instance, tier type = 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.298+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bd720 con 0x7fb3cc090560 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.299+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.299+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996501949520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bd720 con 0x7fb3cc090560 2024-09-21T08:51:57.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.299+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bf080 con 0x557d441afb50 2024-09-21T08:51:57.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.300+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996501949520] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.300+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.300+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996501953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bd720 con 0x557d441afb50 2024-09-21T08:51:57.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.300+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bfad0 con 0x557d441b8fb0 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.303+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996501953424] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.303+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.303+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996501946992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441bd690 con 0x557d441b8fb0 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.303+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c0990 con 0x7fb3cc090560 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.305+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996501946992] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.305+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.305+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996501959904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c0db0 con 0x7fb3cc090560 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.305+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c1770 con 0x557d441afb50 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.308+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.308+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996501963456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c1b90 con 0x557d441afb50 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.308+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c25f0 con 0x557d441b4460 2024-09-21T08:51:57.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.308+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996501959904] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.309+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996501963456] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.309+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.309+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996501960960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c16e0 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.309+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c2ec0 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.310+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996501960960] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.310+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.310+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996501967104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c16e0 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.310+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c3560 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996501967104] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996501970992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c3520 con 0x557d441b4460 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=0 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=1 2024-09-21T08:51:57.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=2 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=3 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=4 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=5 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.311+0000 7fb3df50c800 20 add_watcher() i=6 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996501970992] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3df50c800 20 add_watcher() i=7 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3df50c800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441c6980 con 0x557d441afb50 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.312+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996501969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c3e40 con 0x557d441afb50 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996501969344] v34'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3df50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3df50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3df50c800 5 note: GC not initialized 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb2927e4640 20 reqs_thread_entry: start 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3df50c800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.315+0000 7fb3df50c800 20 Filter name: none 2024-09-21T08:51:57.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb28b7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441f9dc0 con 0x557d441afb50 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441fc850 con 0x7fb3cc090560 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.316+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d44200040 con 0x557d441afb50 2024-09-21T08:51:57.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3df50c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3df50c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3df50c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93996502219264 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d441feb20 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 93996501963456 notify 146028888065 ret 0) ==== 609+0+0 (crc 0 0 0) 0x557d43f3bb30 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 93996501963456 notifier 4321 bl.length()=567 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(65 notify.4 [notify cookie 93996502219264 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb2b3fff640 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb2a0003ea0 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.318+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 93996502219264 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3d002fbb0 con 0x557d441afb50 2024-09-21T08:51:57.322 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.319+0000 7fb2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.319+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996501969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441f7b10 con 0x557d441afb50 2024-09-21T08:51:57.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.320+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93996501969344] v34'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.320+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996501949520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441f7b10 con 0x7fb3cc090560 2024-09-21T08:51:57.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.323+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93996501949520] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.323+0000 7fb3df50c800 20 remove_watcher() i=0 2024-09-21T08:51:57.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.323+0000 7fb3df50c800 2 removed watcher, disabling cache 2024-09-21T08:51:57.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.323+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996501953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441f7b10 con 0x557d441afb50 2024-09-21T08:51:57.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.324+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93996501953424] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.324+0000 7fb3df50c800 20 remove_watcher() i=1 2024-09-21T08:51:57.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.324+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996501946992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441f7b10 con 0x557d441b8fb0 2024-09-21T08:51:57.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.325+0000 7fb3dd000640 1 -- 172.21.15.196:0/4265809515 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93996501946992] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc06c450 con 0x557d441b8fb0 2024-09-21T08:51:57.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.325+0000 7fb3df50c800 20 remove_watcher() i=2 2024-09-21T08:51:57.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.325+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996501959904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441feb20 con 0x7fb3cc090560 2024-09-21T08:51:57.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.326+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93996501959904] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x7fb3cc090560 2024-09-21T08:51:57.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.326+0000 7fb3df50c800 20 remove_watcher() i=3 2024-09-21T08:51:57.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.326+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996501963456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441feb20 con 0x557d441afb50 2024-09-21T08:51:57.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.328+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93996501963456] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d00391c0 con 0x557d441afb50 2024-09-21T08:51:57.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.328+0000 7fb3df50c800 20 remove_watcher() i=4 2024-09-21T08:51:57.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.328+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996501960960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441feb20 con 0x557d441b4460 2024-09-21T08:51:57.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.329+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93996501960960] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.329+0000 7fb3df50c800 20 remove_watcher() i=5 2024-09-21T08:51:57.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.329+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996501967104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441beb90 con 0x557d441b4460 2024-09-21T08:51:57.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.330+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93996501967104] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.330+0000 7fb3df50c800 20 remove_watcher() i=6 2024-09-21T08:51:57.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.330+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996501970992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d441c0990 con 0x557d441b4460 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3dd801640 1 -- 172.21.15.196:0/4265809515 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93996501970992] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4056040 con 0x557d441b4460 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 20 remove_watcher() i=7 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d441b4460 msgr2=0x557d441b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d441b4460 0x557d441b6850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d441afb50 msgr2=0x557d441b2010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d441afb50 0x557d441b2010 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb3cc090560 msgr2=0x7fb3cc087690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb3cc090560 0x7fb3cc087690 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557d441b8fb0 msgr2=0x557d441bb470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557d441b8fb0 0x557d441bb470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2a8036a70 msgr2=0x7fb2a8038f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2a8036a70 0x7fb2a8038f30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc06bf60 tx=0x7fb3cc093000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 msgr2=0x557d441a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3df50c800 1 --2- 172.21.15.196:0/4265809515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d4419cd00 0x557d441a41b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4017fe0 tx=0x7fb3d404ce20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.331+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 reap_dead start 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3dc7ff640 1 -- 172.21.15.196:0/4265809515 reap_dead start 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 shutdown_connections 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 >> 172.21.15.196:0/4265809515 conn(0x557d44199060 msgr2=0x557d44197130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 shutdown_connections 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/4265809515 wait complete. 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 msgr2=0x7fb2b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 0x7fb2b4039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x557d4417cdf0 tx=0x7fb3cc06bef0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 msgr2=0x557d44190520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x557d441764b0 tx=0x7fb3d400aec0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 shutdown_connections 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2b4036b90 0x7fb2b4039050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/2153209572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d44190100 0x557d44190520 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 >> 172.21.15.196:0/2153209572 conn(0x557d44185090 msgr2=0x557d44187c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 shutdown_connections 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/2153209572 wait complete. 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 msgr2=0x557d44181070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 0x557d44181070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 msgr2=0x557d4417c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 0x557d4417c470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 msgr2=0x7fb2c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 0x7fb2c4039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0000f60 tx=0x7fb3d00012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 msgr2=0x557d44175400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.332+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc065040 tx=0x7fb3cc003330 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 shutdown_connections 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557d4417ec80 0x557d44181070 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557d44081bd0 0x557d4417c470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb2c4036b90 0x7fb2c4039050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 --2- 172.21.15.196:0/1984623612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557d43ff05f0 0x557d44175400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 >> 172.21.15.196:0/1984623612 conn(0x557d44076de0 msgr2=0x557d44167cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 shutdown_connections 2024-09-21T08:51:57.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.333+0000 7fb3df50c800 1 -- 172.21.15.196:0/1984623612 wait complete. 2024-09-21T08:51:57.344 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.344 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:57.388 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.388 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.386+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.386+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.386+0000 7f036090a800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5619637375f0 0x5619637c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.386+0000 7f036090a800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561963682b30 con 0x5619637c8bd0 2024-09-21T08:51:57.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.386+0000 7f036090a800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561963664360 con 0x5619637375f0 2024-09-21T08:51:57.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.387+0000 7f035e3fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5619637375f0 0x5619637c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.387+0000 7f0357fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5619637c8bd0 0x5619637cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46830/0 (socket says 172.21.15.196:46830) 2024-09-21T08:51:57.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.387+0000 7f0357fff640 1 -- 172.21.15.196:0/3075124253 learned_addr learned my addr 172.21.15.196:0/3075124253 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.387+0000 7f035e3fe640 1 -- 172.21.15.196:0/3075124253 >> v1:172.21.15.29:6789/0 conn(0x5619637c8bd0 legacy=0x5619637cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.387+0000 7f035e3fe640 1 -- 172.21.15.196:0/3075124253 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196368ae00 con 0x5619637375f0 2024-09-21T08:51:57.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.389+0000 7f035e3fe640 1 --2- 172.21.15.196:0/3075124253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619637c8690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f035000a470 tx=0x7f0350045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c950e35a9687c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.389+0000 7f035dbfd640 1 -- 172.21.15.196:0/3075124253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350053570 con 0x5619637375f0 2024-09-21T08:51:57.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.389+0000 7f035dbfd640 1 -- 172.21.15.196:0/3075124253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0350058070 con 0x5619637375f0 2024-09-21T08:51:57.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.389+0000 7f035dbfd640 1 -- 172.21.15.196:0/3075124253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350053880 con 0x5619637375f0 2024-09-21T08:51:57.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 -- 172.21.15.196:0/3075124253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 msgr2=0x5619637c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 --2- 172.21.15.196:0/3075124253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619637c8690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f035000a470 tx=0x7f0350045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 -- 172.21.15.196:0/3075124253 shutdown_connections 2024-09-21T08:51:57.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 --2- 172.21.15.196:0/3075124253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619637c8690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 -- 172.21.15.196:0/3075124253 >> 172.21.15.196:0/3075124253 conn(0x5619637bdde0 msgr2=0x5619637c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 -- 172.21.15.196:0/3075124253 shutdown_connections 2024-09-21T08:51:57.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.390+0000 7f036090a800 1 -- 172.21.15.196:0/3075124253 wait complete. 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.403+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.403+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.403+0000 7f036090a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.403+0000 7f036090a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56196370f330 con 0x5619637375f0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f035e3fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f035e3fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34084/0 (socket says 172.21.15.196:34084) 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f035e3fe640 1 -- 172.21.15.196:0/1430583456 learned_addr learned my addr 172.21.15.196:0/1430583456 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f035e3fe640 1 -- 172.21.15.196:0/1430583456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196365cbc0 con 0x5619637375f0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f035e3fe640 1 --2- 172.21.15.196:0/1430583456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0350025c20 tx=0x7f0350051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b83c048ff7ba009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f024c608640 1 -- 172.21.15.196:0/1430583456 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035005c580 con 0x5619637375f0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f024c608640 1 -- 172.21.15.196:0/1430583456 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0350063030 con 0x5619637375f0 2024-09-21T08:51:57.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.404+0000 7f024c608640 1 -- 172.21.15.196:0/1430583456 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035005c850 con 0x5619637375f0 2024-09-21T08:51:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- 172.21.15.196:0/1430583456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 msgr2=0x5619638b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 --2- 172.21.15.196:0/1430583456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0350025c20 tx=0x7f0350051000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- 172.21.15.196:0/1430583456 shutdown_connections 2024-09-21T08:51:57.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 --2- 172.21.15.196:0/1430583456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638b4a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- 172.21.15.196:0/1430583456 >> 172.21.15.196:0/1430583456 conn(0x5619637bdde0 msgr2=0x5619638b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- 172.21.15.196:0/1430583456 shutdown_connections 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- 172.21.15.196:0/1430583456 wait complete. 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.405+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f036090a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f036090a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5619637cc980 con 0x5619637375f0 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f035e3fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f035e3fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34098/0 (socket says 172.21.15.196:34098) 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f035e3fe640 1 -- 172.21.15.196:0/1902897284 learned_addr learned my addr 172.21.15.196:0/1902897284 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f035e3fe640 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561963670fe0 con 0x5619637375f0 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f035e3fe640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5619638b58d0 tx=0x7f0350002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f024ae05640 1 -- 172.21.15.196:0/1902897284 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350054ad0 con 0x5619637375f0 2024-09-21T08:51:57.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f024ae05640 1 -- 172.21.15.196:0/1902897284 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0350054c70 con 0x5619637375f0 2024-09-21T08:51:57.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619638bc920 con 0x5619637375f0 2024-09-21T08:51:57.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.406+0000 7f024ae05640 1 -- 172.21.15.196:0/1902897284 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350068420 con 0x5619637375f0 2024-09-21T08:51:57.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.407+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619638bce40 con 0x5619637375f0 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.407+0000 7f024ae05640 1 -- 172.21.15.196:0/1902897284 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f03500685c0 con 0x5619637375f0 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.407+0000 7f024ae05640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 0x7f0244039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.407+0000 7f024ae05640 1 -- 172.21.15.196:0/1902897284 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0350070030 con 0x5619637375f0 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f0357fff640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 0x7f0244039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 0x5619638c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638c39d0 con 0x5619637c8bd0 2024-09-21T08:51:57.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f035ebff640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 0x5619638c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f0357fff640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 0x7f0244039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0348000f60 tx=0x7f03480012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f035ebff640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 0x5619638c3450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f035ebff640 1 -- 172.21.15.196:0/1902897284 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f035800a4a0 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.408+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638c0a00 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.409+0000 7f035ebff640 1 -- 172.21.15.196:0/1902897284 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f035800a4a0 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.409+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 0x5619638c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.409+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638c8810 con 0x5619638c5d30 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.409+0000 7f035e3fe640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 0x5619638c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.409+0000 7f035e3fe640 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 0x5619638c8120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f035e3fe640 1 -- 172.21.15.196:0/1902897284 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0350051070 con 0x5619638c5d30 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638c4bd0 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f035ebff640 1 -- 172.21.15.196:0/1902897284 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f035800a4a0 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638c5030 con 0x5619637c8bd0 2024-09-21T08:51:57.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f035ebff640 1 -- 172.21.15.196:0/1902897284 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f035800a4a0 con 0x5619637c8bd0 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.410+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f036090a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f036090a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56196365e580 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34106/0 (socket says 172.21.15.196:34106) 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f035ebff640 1 -- 172.21.15.196:0/2891434989 learned_addr learned my addr 172.21.15.196:0/2891434989 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f035ebff640 1 -- 172.21.15.196:0/2891434989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619638d7ab0 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f035ebff640 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5619638c3db0 tx=0x7f0358018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f0243fff640 1 -- 172.21.15.196:0/2891434989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358014450 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f0243fff640 1 -- 172.21.15.196:0/2891434989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358014610 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619638d7d40 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f0243fff640 1 -- 172.21.15.196:0/2891434989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358014930 con 0x5619638d7150 2024-09-21T08:51:57.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.411+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619638daa20 con 0x5619638d7150 2024-09-21T08:51:57.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.412+0000 7f0243fff640 1 -- 172.21.15.196:0/2891434989 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0358011040 con 0x5619638d7150 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.412+0000 7f0243fff640 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 0x7f02380390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.412+0000 7f0243fff640 1 -- 172.21.15.196:0/2891434989 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f035801e070 con 0x5619638d7150 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.412+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 0x7f02380390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 0x7f02380390c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5619638c3ea0 tx=0x7f0350045e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f036090a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f036090a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5619638b51c0 con 0x5619638e3dd0 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34120/0 (socket says 172.21.15.196:34120) 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035ebff640 1 -- 172.21.15.196:0/386762025 learned_addr learned my addr 172.21.15.196:0/386762025 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035ebff640 1 -- 172.21.15.196:0/386762025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619638e47a0 con 0x5619638e3dd0 2024-09-21T08:51:57.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.413+0000 7f035ebff640 1 --2- 172.21.15.196:0/386762025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0358018430 tx=0x7f03580404b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee5e15f30c87c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f0241ffb640 1 -- 172.21.15.196:0/386762025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358046ad0 con 0x5619638e3dd0 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f0241ffb640 1 -- 172.21.15.196:0/386762025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358046c70 con 0x5619638e3dd0 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f0241ffb640 1 -- 172.21.15.196:0/386762025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358014ad0 con 0x5619638e3dd0 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 -- 172.21.15.196:0/386762025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 msgr2=0x5619638e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 --2- 172.21.15.196:0/386762025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0358018430 tx=0x7f03580404b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 -- 172.21.15.196:0/386762025 shutdown_connections 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 --2- 172.21.15.196:0/386762025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638e41d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 -- 172.21.15.196:0/386762025 >> 172.21.15.196:0/386762025 conn(0x5619638e0130 msgr2=0x5619638de230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 -- 172.21.15.196:0/386762025 shutdown_connections 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 -- 172.21.15.196:0/386762025 wait complete. 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.414+0000 7f036090a800 1 Processor -- start 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f036090a800 1 -- start start 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f036090a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f036090a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5619638e4e50 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f035ebff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34128/0 (socket says 172.21.15.196:34128) 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 learned_addr learned my addr 172.21.15.196:0/2103023360 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619638eb7d0 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f035ebff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03580119b0 tx=0x7f035804cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f022ffff640 1 -- 172.21.15.196:0/2103023360 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358046e20 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f022ffff640 1 -- 172.21.15.196:0/2103023360 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358022a80 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f022ffff640 1 -- 172.21.15.196:0/2103023360 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0358022d60 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.415+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619638eba60 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.416+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619638ee710 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.416+0000 7f022ffff640 1 -- 172.21.15.196:0/2103023360 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f035804e9f0 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.416+0000 7f022ffff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b90 0x7f0228039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.416+0000 7f022ffff640 1 -- 172.21.15.196:0/2103023360 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f035800e040 con 0x5619638e3dd0 2024-09-21T08:51:57.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.416+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b90 0x7f0228039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619638f6ef0 0x5619638f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638f9b00 con 0x5619638f6ef0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b90 0x7f0228039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f035008f3c0 tx=0x7f0350088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f0357fff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619638f6ef0 0x5619638f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f0357fff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619638f6ef0 0x5619638f93b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0348009050 con 0x5619638f6ef0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.417+0000 7f036090a800 20 realm 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638f6340 con 0x5619638f6ef0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0348009050 con 0x5619638f6ef0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638fa5e0 con 0x5619638f6ef0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0348009050 con 0x5619638f6ef0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638faeb0 con 0x5619638f6ef0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0348009050 con 0x5619638f6ef0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638fb760 0x5619638fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638fe290 con 0x5619638fb760 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.418+0000 7f035ebff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638fb760 0x5619638fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f035ebff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638fb760 0x5619638fdb50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f036090a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f036090a800 20 searching for the correct realm 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561963900340 0x561963902800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561963900340 0x561963902800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.419+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561963900340 0x561963902800 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f035e3fe640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f035008c040 0x7f035007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f0357fff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f035008c040 0x7f035007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f0357fff640 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f035008c040 0x7f035007d3f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348009050 con 0x7f035008c040 2024-09-21T08:51:57.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.420+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348009050 con 0x5619638f6ef0 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.421+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x7f035008c040 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.422+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0348029040 con 0x7f035008c040 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.423+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.424+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x7f035008c040 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.425+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x7f035008c040 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.426+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x561963900340 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638fb760 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x5619638f6ef0 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561963902ed0 con 0x7f035008c040 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0348029040 con 0x7f035008c040 2024-09-21T08:51:57.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.427+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638fed40 con 0x5619638f6ef0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638ff1c0 con 0x5619638f6ef0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0348029040 con 0x5619638f6ef0 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619638ff660 con 0x5619638f6ef0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 zone default found 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 4 Realm: () 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 zonegroup default 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.428+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561963903350 con 0x5619638fb760 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561963905580 con 0x561963900340 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561963905920 con 0x561963900340 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 started sync module instance, tier type = 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.429+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619639049c0 con 0x7f035008c040 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.430+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.430+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667044572944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619639049c0 con 0x7f035008c040 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.430+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619639062e0 con 0x5619638f6ef0 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.433+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.433+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667044576816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963906740 con 0x5619638f6ef0 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.433+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907250 con 0x561963900340 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.433+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667044572944] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.434+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667044576816] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.434+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.434+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667044580608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963906250 con 0x561963900340 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.434+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907af0 con 0x7f035008c040 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.436+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667044580608] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.436+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.436+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667044582976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907a60 con 0x7f035008c040 2024-09-21T08:51:57.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.436+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619639089b0 con 0x5619638f6ef0 2024-09-21T08:51:57.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.439+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667044582976] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.439+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.439+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667044585040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619639089b0 con 0x5619638f6ef0 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.439+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963909370 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.440+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667044585040] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.440+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.440+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667044586752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963908920 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.440+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56196390a070 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.441+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.441+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667044592576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963909fe0 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.441+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56196390b000 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.441+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667044586752] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667044592576] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667044594832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56196390aae0 con 0x5619638fb760 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=0 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=1 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=2 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=3 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=4 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=5 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.442+0000 7f036090a800 20 add_watcher() i=6 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.443+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667044594832] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.443+0000 7f036090a800 20 add_watcher() i=7 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.443+0000 7f036090a800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.443+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56196390e030 con 0x5619638f6ef0 2024-09-21T08:51:57.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.444+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.444+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667044591376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56196390b4b0 con 0x5619638f6ef0 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667044591376] v34'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f0214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f036090a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f036090a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f036090a800 5 note: GC not initialized 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.446+0000 7f018f7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.447+0000 7f036090a800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.447+0000 7f036090a800 20 Filter name: none 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.447+0000 7f018d7fa640 20 reqs_thread_entry: start 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.447+0000 7f036090a800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.447+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561963940e50 con 0x5619638f6ef0 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.448+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.448+0000 7f036090a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.453 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.449+0000 7f0214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.449+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667044591376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56196393f7d0 con 0x5619638f6ef0 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.450+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94667044591376] v34'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.450+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667044572944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963909710 con 0x7f035008c040 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.451+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94667044572944] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.451+0000 7f036090a800 20 remove_watcher() i=0 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.451+0000 7f036090a800 2 removed watcher, disabling cache 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.451+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667044576816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963904f10 con 0x5619638f6ef0 2024-09-21T08:51:57.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.452+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94667044576816] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.452+0000 7f036090a800 20 remove_watcher() i=1 2024-09-21T08:51:57.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.452+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667044580608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963905e30 con 0x561963900340 2024-09-21T08:51:57.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.453+0000 7f035e3fe640 1 -- 172.21.15.196:0/2103023360 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94667044580608] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350051070 con 0x561963900340 2024-09-21T08:51:57.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.453+0000 7f036090a800 20 remove_watcher() i=2 2024-09-21T08:51:57.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.453+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667044582976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963906d00 con 0x7f035008c040 2024-09-21T08:51:57.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.454+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94667044582976] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x7f035008c040 2024-09-21T08:51:57.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.454+0000 7f036090a800 20 remove_watcher() i=3 2024-09-21T08:51:57.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.454+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667044585040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907640 con 0x5619638f6ef0 2024-09-21T08:51:57.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.455+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94667044585040] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480391c0 con 0x5619638f6ef0 2024-09-21T08:51:57.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.455+0000 7f036090a800 20 remove_watcher() i=4 2024-09-21T08:51:57.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.455+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667044586752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907640 con 0x5619638fb760 2024-09-21T08:51:57.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.456+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94667044586752] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.456+0000 7f036090a800 20 remove_watcher() i=5 2024-09-21T08:51:57.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.456+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667044592576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963908500 con 0x5619638fb760 2024-09-21T08:51:57.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.457+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94667044592576] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.457+0000 7f036090a800 20 remove_watcher() i=6 2024-09-21T08:51:57.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.457+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667044594832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561963907640 con 0x5619638fb760 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f035ebff640 1 -- 172.21.15.196:0/2103023360 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94667044594832] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f035802a070 con 0x5619638fb760 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 20 remove_watcher() i=7 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638fb760 msgr2=0x5619638fdb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638fb760 0x5619638fdb50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619638f6ef0 msgr2=0x5619638f93b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619638f6ef0 0x5619638f93b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f035008c040 msgr2=0x7f035007d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f035008c040 0x7f035007d3f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561963900340 msgr2=0x561963902800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561963900340 0x561963902800 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b90 msgr2=0x7f0228039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b90 0x7f0228039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f035008f3c0 tx=0x7f0350088000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 msgr2=0x5619638eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f0357fff640 1 -- 172.21.15.196:0/2103023360 reap_dead start 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03580119b0 tx=0x7f035804cc70 comp rx=0 tx=0).stop 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 shutdown_connections 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 --2- 172.21.15.196:0/2103023360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638e3dd0 0x5619638eb290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.458+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 >> 172.21.15.196:0/2103023360 conn(0x5619638e0130 msgr2=0x5619638de200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 shutdown_connections 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2103023360 wait complete. 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 msgr2=0x7f02380390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 0x7f02380390c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5619638c3ea0 tx=0x7f0350045e60 comp rx=0 tx=0).stop 2024-09-21T08:51:57.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 msgr2=0x5619638d7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5619638c3db0 tx=0x7f0358018830 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 shutdown_connections 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036c00 0x7f02380390c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/2891434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619638d7150 0x5619638d7570 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 >> 172.21.15.196:0/2891434989 conn(0x5619638cc0e0 msgr2=0x5619638cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 shutdown_connections 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/2891434989 wait complete. 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 msgr2=0x5619638c8120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 0x5619638c8120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 msgr2=0x5619638c3450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 0x5619638c3450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 msgr2=0x7f0244039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 0x7f0244039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0348000f60 tx=0x7f03480012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 msgr2=0x5619638bc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5619638b58d0 tx=0x7f0350002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 shutdown_connections 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5619638c5d30 0x5619638c8120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5619637c8bd0 0x5619638c3450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0244036b90 0x7f0244039050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 --2- 172.21.15.196:0/1902897284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619637375f0 0x5619638bc3e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 >> 172.21.15.196:0/1902897284 conn(0x5619637bdde0 msgr2=0x5619638aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 shutdown_connections 2024-09-21T08:51:57.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.459+0000 7f036090a800 1 -- 172.21.15.196:0/1902897284 wait complete. 2024-09-21T08:51:57.470 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-21T08:51:57.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-21T08:51:57.471 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-21T08:51:57.514 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.515 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b9539800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55842f53b990 0x55842f53dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b9539800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55842f3f7b30 con 0x55842f537550 2024-09-21T08:51:57.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b9539800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55842f3d9360 con 0x55842f53b990 2024-09-21T08:51:57.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b49d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55842f53b990 0x55842f53dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b51d1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55842f537550 0x55842f537950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46832/0 (socket says 172.21.15.196:46832) 2024-09-21T08:51:57.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b51d1640 1 -- 172.21.15.196:0/2461489135 learned_addr learned my addr 172.21.15.196:0/2461489135 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.513+0000 7f05b49d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55842f53b990 0x55842f53dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34144/0 (socket says 172.21.15.196:34144) 2024-09-21T08:51:57.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.514+0000 7f05b49d0640 1 -- 172.21.15.196:0/2461489135 >> v1:172.21.15.29:6789/0 conn(0x55842f537550 legacy=0x55842f537950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.514+0000 7f05b49d0640 1 -- 172.21.15.196:0/2461489135 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f3ffe00 con 0x55842f53b990 2024-09-21T08:51:57.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.514+0000 7f05affff640 1 -- 172.21.15.196:0/2461489135 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993331941 0 0) 0x55842f3f7b30 con 0x55842f537550 2024-09-21T08:51:57.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.515+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2461489135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f53b990 0x55842f53dd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ffffe119f2721c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.515+0000 7f05affff640 1 -- 172.21.15.196:0/2461489135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0053570 con 0x55842f53b990 2024-09-21T08:51:57.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.515+0000 7f05affff640 1 -- 172.21.15.196:0/2461489135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0058070 con 0x55842f53b990 2024-09-21T08:51:57.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05affff640 1 -- 172.21.15.196:0/2461489135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0053880 con 0x55842f53b990 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 -- 172.21.15.196:0/2461489135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f53b990 msgr2=0x55842f53dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 --2- 172.21.15.196:0/2461489135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f53b990 0x55842f53dd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a470 tx=0x7f05a0045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 -- 172.21.15.196:0/2461489135 shutdown_connections 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 --2- 172.21.15.196:0/2461489135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f53b990 0x55842f53dd80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 -- 172.21.15.196:0/2461489135 >> 172.21.15.196:0/2461489135 conn(0x55842f532de0 msgr2=0x55842f535200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 -- 172.21.15.196:0/2461489135 shutdown_connections 2024-09-21T08:51:57.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.516+0000 7f05b9539800 1 -- 172.21.15.196:0/2461489135 wait complete. 2024-09-21T08:51:57.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.529+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b9539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b9539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55842f484330 con 0x55842f537550 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b51d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b51d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34156/0 (socket says 172.21.15.196:34156) 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b51d1640 1 -- 172.21.15.196:0/757576676 learned_addr learned my addr 172.21.15.196:0/757576676 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b51d1640 1 -- 172.21.15.196:0/757576676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f3d1bc0 con 0x55842f537550 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.530+0000 7f05b51d1640 1 --2- 172.21.15.196:0/757576676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05b0001660 tx=0x7f05b0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ccccaec3f2cbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f04a3606640 1 -- 172.21.15.196:0/757576676 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0003450 con 0x55842f537550 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f04a3606640 1 -- 172.21.15.196:0/757576676 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0003610 con 0x55842f537550 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f04a3606640 1 -- 172.21.15.196:0/757576676 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b00039b0 con 0x55842f537550 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 -- 172.21.15.196:0/757576676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 msgr2=0x55842f4ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 --2- 172.21.15.196:0/757576676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05b0001660 tx=0x7f05b0001b20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 -- 172.21.15.196:0/757576676 shutdown_connections 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 --2- 172.21.15.196:0/757576676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f4ac5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 -- 172.21.15.196:0/757576676 >> 172.21.15.196:0/757576676 conn(0x55842f532de0 msgr2=0x55842f621f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 -- 172.21.15.196:0/757576676 shutdown_connections 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.531+0000 7f05b9539800 1 -- 172.21.15.196:0/757576676 wait complete. 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b9539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b9539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55842f53e5c0 con 0x55842f537550 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b51d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b51d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34164/0 (socket says 172.21.15.196:34164) 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b51d1640 1 -- 172.21.15.196:0/2339911781 learned_addr learned my addr 172.21.15.196:0/2339911781 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b51d1640 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f3e5fe0 con 0x55842f537550 2024-09-21T08:51:57.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.532+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55842f4abca0 tx=0x7f05b0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f04a1e03640 1 -- 172.21.15.196:0/2339911781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0025070 con 0x55842f537550 2024-09-21T08:51:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f04a1e03640 1 -- 172.21.15.196:0/2339911781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0019040 con 0x55842f537550 2024-09-21T08:51:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55842f62f5e0 con 0x55842f537550 2024-09-21T08:51:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f04a1e03640 1 -- 172.21.15.196:0/2339911781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0013970 con 0x55842f537550 2024-09-21T08:51:57.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55842f62fb60 con 0x55842f537550 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.533+0000 7f04a1e03640 1 -- 172.21.15.196:0/2339911781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05b0010070 con 0x55842f537550 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f04a1e03640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 0x7f049c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f04a1e03640 1 -- 172.21.15.196:0/2339911781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f05b004c130 con 0x55842f537550 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 0x7f049c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 0x55842f636110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f636730 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 0x55842f636110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 0x7f049c039000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05a0057000 tx=0x7f05a0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 0x55842f636110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b59d2640 1 -- 172.21.15.196:0/2339911781 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a80083e0 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.534+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f6336c0 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.535+0000 7f05b59d2640 1 -- 172.21.15.196:0/2339911781 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05a80083e0 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.535+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 0x55842f63ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.535+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f63b520 con 0x55842f638a40 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.535+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 0x55842f63ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.535+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 0x55842f63ae30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.536+0000 7f05b51d1640 1 -- 172.21.15.196:0/2339911781 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05b000f030 con 0x55842f638a40 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.536+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f6378b0 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.536+0000 7f05b59d2640 1 -- 172.21.15.196:0/2339911781 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05a80083e0 con 0x55842f53b990 2024-09-21T08:51:57.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.536+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f637d10 con 0x55842f53b990 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.536+0000 7f05b59d2640 1 -- 172.21.15.196:0/2339911781 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05a80083e0 con 0x55842f53b990 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b9539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b9539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55842f3d3580 con 0x55842f649e80 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34180/0 (socket says 172.21.15.196:34180) 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b59d2640 1 -- 172.21.15.196:0/1935359033 learned_addr learned my addr 172.21.15.196:0/1935359033 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b59d2640 1 -- 172.21.15.196:0/1935359033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f64a7e0 con 0x55842f649e80 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.537+0000 7f05b59d2640 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55842f6304a0 tx=0x7f05a800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f049affd640 1 -- 172.21.15.196:0/1935359033 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8007d00 con 0x55842f649e80 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f049affd640 1 -- 172.21.15.196:0/1935359033 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a801e020 con 0x55842f649e80 2024-09-21T08:51:57.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55842f64aa70 con 0x55842f649e80 2024-09-21T08:51:57.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f049affd640 1 -- 172.21.15.196:0/1935359033 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8019420 con 0x55842f649e80 2024-09-21T08:51:57.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55842f64d750 con 0x55842f649e80 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.538+0000 7f049affd640 1 -- 172.21.15.196:0/1935359033 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05a8016040 con 0x55842f649e80 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f049affd640 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 0x7f048c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f049affd640 1 -- 172.21.15.196:0/1935359033 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f05a801f030 con 0x55842f649e80 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b51d1640 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 0x7f048c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b51d1640 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 0x7f048c039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05b0012fd0 tx=0x7f05b0028d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b9539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b9539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55842f62a4d0 con 0x55842f6275a0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34188/0 (socket says 172.21.15.196:34188) 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.539+0000 7f05b59d2640 1 -- 172.21.15.196:0/2393496015 learned_addr learned my addr 172.21.15.196:0/2393496015 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b59d2640 1 -- 172.21.15.196:0/2393496015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f627f70 con 0x55842f6275a0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2393496015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05a804cb70 tx=0x7f05a8015800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062fc4103d323 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f0498ff9640 1 -- 172.21.15.196:0/2393496015 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a801d040 con 0x55842f6275a0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f0498ff9640 1 -- 172.21.15.196:0/2393496015 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8017e00 con 0x55842f6275a0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f0498ff9640 1 -- 172.21.15.196:0/2393496015 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a80184e0 con 0x55842f6275a0 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 -- 172.21.15.196:0/2393496015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 msgr2=0x55842f6279a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 --2- 172.21.15.196:0/2393496015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05a804cb70 tx=0x7f05a8015800 comp rx=0 tx=0).stop 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 -- 172.21.15.196:0/2393496015 shutdown_connections 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 --2- 172.21.15.196:0/2393496015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f6279a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 -- 172.21.15.196:0/2393496015 >> 172.21.15.196:0/2393496015 conn(0x55842f652ec0 msgr2=0x55842f651010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 -- 172.21.15.196:0/2393496015 shutdown_connections 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.540+0000 7f05b9539800 1 -- 172.21.15.196:0/2393496015 wait complete. 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b9539800 1 Processor -- start 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b9539800 1 -- start start 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b9539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f660170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b9539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55842f6262e0 con 0x55842f6275a0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f660170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b59d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f660170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34204/0 (socket says 172.21.15.196:34204) 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 learned_addr learned my addr 172.21.15.196:0/2478860210 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842f6606b0 con 0x55842f6275a0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.541+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f660170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05a8014880 tx=0x7f05a8008870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f048affd640 1 -- 172.21.15.196:0/2478860210 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8030070 con 0x55842f6275a0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f048affd640 1 -- 172.21.15.196:0/2478860210 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8015ac0 con 0x55842f6275a0 2024-09-21T08:51:57.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55842f660940 con 0x55842f6275a0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f048affd640 1 -- 172.21.15.196:0/2478860210 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a801d040 con 0x55842f6275a0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55842f6635f0 con 0x55842f6275a0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.542+0000 7f048affd640 1 -- 172.21.15.196:0/2478860210 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05a8019650 con 0x55842f6275a0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f048affd640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0480036b40 0x7f0480039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f048affd640 1 -- 172.21.15.196:0/2478860210 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f05a8042c90 con 0x55842f6275a0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0480036b40 0x7f0480039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0480036b40 0x7f0480039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f05b0003fd0 tx=0x7f05b004b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f66bc60 0x55842f66e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f66e870 con 0x55842f66bc60 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.543+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f66bc60 0x55842f66e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f66bc60 0x55842f66e120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 realm 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f66eca0 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f66f570 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.544+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f66f910 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f670670 0x55842f672a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f673070 con 0x55842f670670 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f670670 0x55842f672a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.545+0000 7f05b59d2640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f670670 0x55842f672a60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b9539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b9539800 20 searching for the correct realm 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55842f675000 0x55842f6774c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55842f675000 0x55842f6774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55842f675000 0x55842f6774c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b51d1640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f05b003e980 0x7f05b001d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.546+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f05b003e980 0x7f05b001d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b49d0640 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f05b003e980 0x7f05b001d380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.547+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.548+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.549+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.550+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.551+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.552+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f675000 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.553+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f670670 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x55842f66bc60 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55842f677b90 con 0x7f05b003e980 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.554+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f674550 con 0x55842f66bc60 2024-09-21T08:51:57.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f673dc0 con 0x55842f66bc60 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f673500 con 0x55842f66bc60 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 zone default found 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 4 Realm: () 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 zonegroup default 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f678050 con 0x55842f670670 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.555+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f67a320 con 0x55842f675000 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f67a6c0 con 0x55842f675000 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 20 started sync module instance, tier type = 2024-09-21T08:51:57.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.556+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6797b0 con 0x7f05b003e980 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.557+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.557+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94026219363552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6797b0 con 0x7f05b003e980 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.557+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67b110 con 0x55842f66bc60 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.558+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.558+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94026219367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67b0c0 con 0x55842f66bc60 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.558+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67c0e0 con 0x55842f675000 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.558+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94026219363552] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.559+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94026219367456] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.559+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.559+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94026219369728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f679300 con 0x55842f675000 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.559+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67c980 con 0x7f05b003e980 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.560+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94026219369728] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.560+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.560+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94026219373776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67c8f0 con 0x7f05b003e980 2024-09-21T08:51:57.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.561+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67d840 con 0x55842f66bc60 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.562+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94026219373776] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.562+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.562+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94026219375904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67d840 con 0x55842f66bc60 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.562+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67e250 con 0x55842f670670 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.563+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.563+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94026219380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67e1c0 con 0x55842f670670 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.563+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67f220 con 0x55842f670670 2024-09-21T08:51:57.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.563+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94026219375904] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.564+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94026219380128] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.564+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.564+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94026219382336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67d390 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.564+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67f800 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94026219382336] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94026219384080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67f800 con 0x55842f670670 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=0 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=1 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=2 2024-09-21T08:51:57.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=3 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=4 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=5 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.565+0000 7f05b9539800 20 add_watcher() i=6 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94026219384080] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b9539800 20 add_watcher() i=7 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b9539800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f682ac0 con 0x55842f66bc60 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.566+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94026219386048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f67fd90 con 0x55842f66bc60 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.567+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94026219386048] v34'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.567+0000 7f046b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.567+0000 7f05b9539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.567+0000 7f05b9539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.567+0000 7f05b9539800 5 note: GC not initialized 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f046a7e4640 20 reqs_thread_entry: start 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 20 Filter name: none 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f03dbfff640 20 reqs_thread_entry: start 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b5eb0 con 0x55842f66bc60 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.568+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b8940 con 0x7f05b003e980 2024-09-21T08:51:57.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.569+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.569+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6bc130 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b9539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b9539800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b9539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94026219633424 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b7930 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94026219375904 notify 146028888066 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55842f3ffe00 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f0498ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94026219375904 notifier 4335 bl.length()=567 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(65 notify.4 [notify cookie 94026219633424 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f0498ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f0498ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f0498ff9640 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0478003ea0 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.570+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94026219633424 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05a0082b70 con 0x55842f66bc60 2024-09-21T08:51:57.581 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.571+0000 7f046b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.571+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94026219386048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f66bc60 2024-09-21T08:51:57.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.572+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94026219386048] v34'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.572+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94026219363552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x7f05b003e980 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.573+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94026219363552] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.573+0000 7f05b9539800 20 remove_watcher() i=0 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.573+0000 7f05b9539800 2 removed watcher, disabling cache 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.573+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94026219367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f66bc60 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.575+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94026219367456] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.575+0000 7f05b9539800 20 remove_watcher() i=1 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.575+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94026219369728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f675000 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.576+0000 7f05b51d1640 1 -- 172.21.15.196:0/2478860210 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94026219369728] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b000f030 con 0x55842f675000 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.576+0000 7f05b9539800 20 remove_watcher() i=2 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.576+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94026219373776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x7f05b003e980 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.577+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94026219373776] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x7f05b003e980 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.577+0000 7f05b9539800 20 remove_watcher() i=3 2024-09-21T08:51:57.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.577+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94026219375904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f66bc60 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.578+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94026219375904] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a0051070 con 0x55842f66bc60 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.578+0000 7f05b9539800 20 remove_watcher() i=4 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.578+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94026219380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.579+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94026219380128] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.579+0000 7f05b9539800 20 remove_watcher() i=5 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.579+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94026219382336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.580+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94026219382336] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.580+0000 7f05b9539800 20 remove_watcher() i=6 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.580+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94026219384080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55842f6b3c00 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b59d2640 1 -- 172.21.15.196:0/2478860210 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94026219384080] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a8032070 con 0x55842f670670 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 20 remove_watcher() i=7 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f670670 msgr2=0x55842f672a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f670670 0x55842f672a60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f66bc60 msgr2=0x55842f66e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f66bc60 0x55842f66e120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f05b003e980 msgr2=0x7f05b001d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f05b003e980 0x7f05b001d380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55842f675000 msgr2=0x55842f6774c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55842f675000 0x55842f6774c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0480036b40 msgr2=0x7f0480039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0480036b40 0x7f0480039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f05b0003fd0 tx=0x7f05b004b000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 msgr2=0x55842f660170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/2478860210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f6275a0 0x55842f660170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05a8014880 tx=0x7f05a8008870 comp rx=0 tx=0).stop 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b49d0640 1 -- 172.21.15.196:0/2478860210 reap_dead start 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 shutdown_connections 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 >> 172.21.15.196:0/2478860210 conn(0x55842f652ec0 msgr2=0x55842f650f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 shutdown_connections 2024-09-21T08:51:57.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/2478860210 wait complete. 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 msgr2=0x7f048c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 0x7f048c039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05b0012fd0 tx=0x7f05b0028d40 comp rx=0 tx=0).stop 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 msgr2=0x55842f64a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55842f6304a0 tx=0x7f05a800aec0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 shutdown_connections 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f048c036b40 0x7f048c039000 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 --2- 172.21.15.196:0/1935359033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f649e80 0x55842f64a2a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.581+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 >> 172.21.15.196:0/1935359033 conn(0x55842f63ee10 msgr2=0x55842f641990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 shutdown_connections 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/1935359033 wait complete. 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 msgr2=0x55842f63ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 0x55842f63ae30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 msgr2=0x55842f636110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 0x55842f636110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 msgr2=0x7f049c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 0x7f049c039000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05a0057000 tx=0x7f05a0052000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 msgr2=0x55842f62f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55842f4abca0 tx=0x7f05b0001250 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 shutdown_connections 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55842f638a40 0x55842f63ae30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55842f53b990 0x55842f636110 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f049c036b40 0x7f049c039000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 --2- 172.21.15.196:0/2339911781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55842f537550 0x55842f62f0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 >> 172.21.15.196:0/2339911781 conn(0x55842f532de0 msgr2=0x55842f6207e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 shutdown_connections 2024-09-21T08:51:57.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.582+0000 7f05b9539800 1 -- 172.21.15.196:0/2339911781 wait complete. 2024-09-21T08:51:57.593 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.593 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:57.637 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.637 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.635+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.635+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.635+0000 7f216a92e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d29b507900 0x55d29b509cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.635+0000 7f216a92e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d29b3c3b30 con 0x55d29b5034c0 2024-09-21T08:51:57.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.635+0000 7f216a92e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55d29b3a5360 con 0x55d29b507900 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f215de5b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d29b507900 0x55d29b509cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f215de5b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d29b507900 0x55d29b509cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34208/0 (socket says 172.21.15.196:34208) 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f215de5b640 1 -- 172.21.15.196:0/4223463816 learned_addr learned my addr 172.21.15.196:0/4223463816 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f216665c640 1 --1- 172.21.15.196:0/4223463816 >> v1:172.21.15.29:6789/0 conn(0x55d29b5034c0 0x55d29b5038c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46848/0 (socket says 172.21.15.196:46848) 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f215de5b640 1 -- 172.21.15.196:0/4223463816 >> v1:172.21.15.29:6789/0 conn(0x55d29b5034c0 legacy=0x55d29b5038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.636+0000 7f215de5b640 1 -- 172.21.15.196:0/4223463816 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b3cbe00 con 0x55d29b507900 2024-09-21T08:51:57.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.638+0000 7f215de5b640 1 --2- 172.21.15.196:0/4223463816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b507900 0x55d29b509cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f215000a520 tx=0x7f2150045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c1065d880f5c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.638+0000 7f2165e5b640 1 -- 172.21.15.196:0/4223463816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150055070 con 0x55d29b507900 2024-09-21T08:51:57.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.638+0000 7f2165e5b640 1 -- 172.21.15.196:0/4223463816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21500515b0 con 0x55d29b507900 2024-09-21T08:51:57.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.638+0000 7f2165e5b640 1 -- 172.21.15.196:0/4223463816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21500518d0 con 0x55d29b507900 2024-09-21T08:51:57.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 -- 172.21.15.196:0/4223463816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b507900 msgr2=0x55d29b509cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 --2- 172.21.15.196:0/4223463816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b507900 0x55d29b509cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f215000a520 tx=0x7f2150045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 -- 172.21.15.196:0/4223463816 shutdown_connections 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 --2- 172.21.15.196:0/4223463816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b507900 0x55d29b509cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 -- 172.21.15.196:0/4223463816 >> 172.21.15.196:0/4223463816 conn(0x55d29b4fedf0 msgr2=0x55d29b501210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 -- 172.21.15.196:0/4223463816 shutdown_connections 2024-09-21T08:51:57.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.639+0000 7f216a92e800 1 -- 172.21.15.196:0/4223463816 wait complete. 2024-09-21T08:51:57.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.652+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.652+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.652+0000 7f216a92e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.652+0000 7f216a92e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d29b450330 con 0x55d29b5034c0 2024-09-21T08:51:57.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f216665c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f216665c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34216/0 (socket says 172.21.15.196:34216) 2024-09-21T08:51:57.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f216665c640 1 -- 172.21.15.196:0/908175037 learned_addr learned my addr 172.21.15.196:0/908175037 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f216665c640 1 -- 172.21.15.196:0/908175037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b39dbc0 con 0x55d29b5034c0 2024-09-21T08:51:57.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f216665c640 1 --2- 172.21.15.196:0/908175037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2158001e40 tx=0x7f2158001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1d93a72f1bc15c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f2054608640 1 -- 172.21.15.196:0/908175037 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215800e5c0 con 0x55d29b5034c0 2024-09-21T08:51:57.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f2054608640 1 -- 172.21.15.196:0/908175037 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158006070 con 0x55d29b5034c0 2024-09-21T08:51:57.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.653+0000 7f2054608640 1 -- 172.21.15.196:0/908175037 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215800e910 con 0x55d29b5034c0 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- 172.21.15.196:0/908175037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 msgr2=0x55d29b5f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 --2- 172.21.15.196:0/908175037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2158001e40 tx=0x7f2158001e70 comp rx=0 tx=0).stop 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- 172.21.15.196:0/908175037 shutdown_connections 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 --2- 172.21.15.196:0/908175037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b5f2750 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- 172.21.15.196:0/908175037 >> 172.21.15.196:0/908175037 conn(0x55d29b4fedf0 msgr2=0x55d29b5ee110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- 172.21.15.196:0/908175037 shutdown_connections 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- 172.21.15.196:0/908175037 wait complete. 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.654+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216a92e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216a92e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d29b50a530 con 0x55d29b5034c0 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216665c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216665c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34222/0 (socket says 172.21.15.196:34222) 2024-09-21T08:51:57.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216665c640 1 -- 172.21.15.196:0/1902279684 learned_addr learned my addr 172.21.15.196:0/1902279684 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216665c640 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b3b1fe0 con 0x55d29b5034c0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216665c640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f2052e05640 1 -- 172.21.15.196:0/1902279684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215800f8d0 con 0x55d29b5034c0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f2052e05640 1 -- 172.21.15.196:0/1902279684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215800fa70 con 0x55d29b5034c0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f2052e05640 1 -- 172.21.15.196:0/1902279684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215800fd90 con 0x55d29b5034c0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.655+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d29b5fdea0 con 0x55d29b5034c0 2024-09-21T08:51:57.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.656+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29b5fe3c0 con 0x55d29b5034c0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.656+0000 7f2052e05640 1 -- 172.21.15.196:0/1902279684 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2158017070 con 0x55d29b5034c0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.656+0000 7f2052e05640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 0x7f204c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.656+0000 7f2052e05640 1 -- 172.21.15.196:0/1902279684 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2158015020 con 0x55d29b5034c0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f215de5b640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 0x7f204c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 0x55d29b602260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b602880 con 0x55d29b507900 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f2166e5d640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 0x55d29b602260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f215de5b640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 0x7f204c038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2150057000 tx=0x7f2150052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f2166e5d640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 0x55d29b602260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f2166e5d640 1 -- 172.21.15.196:0/1902279684 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f216000a4a0 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.657+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b5ff790 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f2166e5d640 1 -- 172.21.15.196:0/1902279684 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f216000a4a0 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 0x55d29b606fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b607640 con 0x55d29b604bb0 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216665c640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 0x55d29b606fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216665c640 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 0x55d29b606fa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216665c640 1 -- 172.21.15.196:0/1902279684 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f215802e070 con 0x55d29b604bb0 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.658+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b603a50 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f2166e5d640 1 -- 172.21.15.196:0/1902279684 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f216000a4a0 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b603ef0 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f2166e5d640 1 -- 172.21.15.196:0/1902279684 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f216000a4a0 con 0x55d29b507900 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f216a92e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.659+0000 7f216a92e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d29b39f580 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34226/0 (socket says 172.21.15.196:34226) 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f2166e5d640 1 -- 172.21.15.196:0/16684486 learned_addr learned my addr 172.21.15.196:0/16684486 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f2166e5d640 1 -- 172.21.15.196:0/16684486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b616910 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f2166e5d640 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d29b602c80 tx=0x7f2160018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f204bfff640 1 -- 172.21.15.196:0/16684486 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160014450 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f204bfff640 1 -- 172.21.15.196:0/16684486 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21600145f0 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d29b616ba0 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f204bfff640 1 -- 172.21.15.196:0/16684486 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160014910 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.660+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29b619880 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.661+0000 7f204bfff640 1 -- 172.21.15.196:0/16684486 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2160011040 con 0x55d29b615fb0 2024-09-21T08:51:57.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.661+0000 7f204bfff640 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 0x7f2040039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.661+0000 7f204bfff640 1 -- 172.21.15.196:0/16684486 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f216001e070 con 0x55d29b615fb0 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.661+0000 7f216665c640 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 0x7f2040039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f216665c640 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 0x7f2040039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55d29b602cf0 tx=0x7f215804b760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f216a92e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f216a92e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d29b5f2f00 con 0x55d29b622c60 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34238/0 (socket says 172.21.15.196:34238) 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2166e5d640 1 -- 172.21.15.196:0/3525442113 learned_addr learned my addr 172.21.15.196:0/3525442113 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2166e5d640 1 -- 172.21.15.196:0/3525442113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b623630 con 0x55d29b622c60 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2166e5d640 1 --2- 172.21.15.196:0/3525442113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f216004cd40 tx=0x7f216002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14172f4dac0251 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2049ffb640 1 -- 172.21.15.196:0/3525442113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160028040 con 0x55d29b622c60 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.662+0000 7f2049ffb640 1 -- 172.21.15.196:0/3525442113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160011c40 con 0x55d29b622c60 2024-09-21T08:51:57.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f2049ffb640 1 -- 172.21.15.196:0/3525442113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160046b30 con 0x55d29b622c60 2024-09-21T08:51:57.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- 172.21.15.196:0/3525442113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 msgr2=0x55d29b623060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 --2- 172.21.15.196:0/3525442113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f216004cd40 tx=0x7f216002b720 comp rx=0 tx=0).stop 2024-09-21T08:51:57.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- 172.21.15.196:0/3525442113 shutdown_connections 2024-09-21T08:51:57.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 --2- 172.21.15.196:0/3525442113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b623060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- 172.21.15.196:0/3525442113 >> 172.21.15.196:0/3525442113 conn(0x55d29b61efc0 msgr2=0x55d29b61d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- 172.21.15.196:0/3525442113 shutdown_connections 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- 172.21.15.196:0/3525442113 wait complete. 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 Processor -- start 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- start start 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.663+0000 7f216a92e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d29b623ce0 con 0x55d29b622c60 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2166e5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34254/0 (socket says 172.21.15.196:34254) 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 learned_addr learned my addr 172.21.15.196:0/824776493 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29b5f9ec0 con 0x55d29b622c60 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2166e5d640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2160011590 tx=0x7f216004ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2037fff640 1 -- 172.21.15.196:0/824776493 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160028040 con 0x55d29b622c60 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2037fff640 1 -- 172.21.15.196:0/824776493 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160031030 con 0x55d29b622c60 2024-09-21T08:51:57.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d29b5fa150 con 0x55d29b622c60 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f2037fff640 1 -- 172.21.15.196:0/824776493 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2160022ba0 con 0x55d29b622c60 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.664+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29b5fa650 con 0x55d29b622c60 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.665+0000 7f2037fff640 1 -- 172.21.15.196:0/824776493 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f216004e1d0 con 0x55d29b622c60 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.665+0000 7f2037fff640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2030036b40 0x7f2030039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.665+0000 7f2037fff640 1 -- 172.21.15.196:0/824776493 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f216000e040 con 0x55d29b622c60 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.665+0000 7f216665c640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2030036b40 0x7f2030039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.665+0000 7f216665c640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2030036b40 0x7f2030039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55d29b607a40 tx=0x7f215804d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b637f40 0x55d29b63a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63ab50 con 0x55d29b637f40 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f215de5b640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b637f40 0x55d29b63a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f215de5b640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b637f40 0x55d29b63a400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 20 realm 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63af20 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.666+0000 7f216a92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63b7c0 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63bb60 con 0x55d29b637f40 2024-09-21T08:51:57.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b63c610 0x55d29b63ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63f180 con 0x55d29b63c610 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f2166e5d640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b63c610 0x55d29b63ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.667+0000 7f2166e5d640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b63c610 0x55d29b63ea20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216a92e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216a92e800 20 searching for the correct realm 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55d29b641230 0x55d29b6436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b641230 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216665c640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55d29b641230 0x55d29b6436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216665c640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55d29b641230 0x55d29b6436f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216665c640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f215800f070 0x7f215801d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x7f215800f070 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.668+0000 7f215de5b640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f215800f070 0x7f215801d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f215de5b640 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f215800f070 0x7f215801d5f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b63c610 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b637f40 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.669+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.670+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b637f40 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.670+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.670+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b63c610 2024-09-21T08:51:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.670+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.670+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d29b643dc0 con 0x55d29b63c610 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x7f215800f070 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.671+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x7f215800f070 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.672+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.673+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.674+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x7f215800f070 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.675+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x7f215800f070 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b641230 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b63c610 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.676+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x55d29b637f40 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f216005d040 con 0x7f215800f070 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b63fc30 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b640080 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.677+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b640520 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 zone default found 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 4 Realm: () 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 zonegroup default 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b644240 con 0x55d29b63c610 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b646470 con 0x55d29b641230 2024-09-21T08:51:57.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b646810 con 0x55d29b641230 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.678+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.679+0000 7f216a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.679+0000 7f216a92e800 20 started sync module instance, tier type = 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.679+0000 7f216a92e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.679+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6458b0 con 0x7f215800f070 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.680+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.680+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94363038538960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6458b0 con 0x7f215800f070 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.680+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6470e0 con 0x55d29b637f40 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.681+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.681+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94363038542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6470a0 con 0x55d29b637f40 2024-09-21T08:51:57.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.681+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6480c0 con 0x55d29b641230 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.681+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94363038538960] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.682+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.682+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94363038546896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6484b0 con 0x55d29b641230 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.682+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b648eb0 con 0x7f215800f070 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.682+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94363038542768] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.683+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94363038546896] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.683+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.683+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94363038536704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b647480 con 0x7f215800f070 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.683+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b649750 con 0x55d29b637f40 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.684+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94363038536704] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.684+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.684+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94363038550464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b649700 con 0x55d29b637f40 2024-09-21T08:51:57.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.684+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64a160 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.685+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.685+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94363038550464] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.685+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94363038555312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64a0d0 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.685+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64ac20 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.686+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.686+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94363038558064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64b080 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.686+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64bb90 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.686+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94363038555312] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94363038558064] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94363038561856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b649250 con 0x55d29b63c610 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=0 2024-09-21T08:51:57.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=1 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=2 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=3 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=4 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=5 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.687+0000 7f216a92e800 20 add_watcher() i=6 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94363038561856] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f216a92e800 20 add_watcher() i=7 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f216a92e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64eb80 con 0x55d29b637f40 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.688+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94363038559120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64c030 con 0x55d29b637f40 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94363038559120] v34'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f216a92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f216a92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f216a92e800 5 note: GC not initialized 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.689+0000 7f1f977fe640 20 reqs_thread_entry: start 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f216a92e800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f216a92e800 20 Filter name: none 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f1f957fa640 20 reqs_thread_entry: start 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f216a92e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d29b681a90 con 0x55d29b637f40 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.690+0000 7f216a92e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.701 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.691+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.691+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94363038559120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6803d0 con 0x55d29b637f40 2024-09-21T08:51:57.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.692+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94363038559120] v34'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.692+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94363038538960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64ab90 con 0x7f215800f070 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.693+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94363038538960] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.693+0000 7f216a92e800 20 remove_watcher() i=0 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.693+0000 7f216a92e800 2 removed watcher, disabling cache 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.693+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94363038542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64ab90 con 0x55d29b637f40 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.694+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94363038542768] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.694+0000 7f216a92e800 20 remove_watcher() i=1 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.694+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94363038546896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b64ab90 con 0x55d29b641230 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.696+0000 7f216665c640 1 -- 172.21.15.196:0/824776493 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94363038546896] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215802e070 con 0x55d29b641230 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.696+0000 7f216a92e800 20 remove_watcher() i=2 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.696+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94363038536704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b647bd0 con 0x7f215800f070 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.696+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94363038536704] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x7f215800f070 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.697+0000 7f216a92e800 20 remove_watcher() i=3 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.697+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94363038550464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b645400 con 0x55d29b637f40 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.697+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94363038550464] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2150057030 con 0x55d29b637f40 2024-09-21T08:51:57.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.697+0000 7f216a92e800 20 remove_watcher() i=4 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.697+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94363038555312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b647bd0 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.698+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94363038555312] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.698+0000 7f216a92e800 20 remove_watcher() i=5 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.698+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94363038558064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b6489c0 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.699+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94363038558064] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.699+0000 7f216a92e800 20 remove_watcher() i=6 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.699+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94363038561856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d29b649cb0 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f2166e5d640 1 -- 172.21.15.196:0/824776493 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94363038561856] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f216003dd70 con 0x55d29b63c610 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 20 remove_watcher() i=7 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b63c610 msgr2=0x55d29b63ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b63c610 0x55d29b63ea20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b637f40 msgr2=0x55d29b63a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b637f40 0x55d29b63a400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f215800f070 msgr2=0x7f215801d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f215800f070 0x7f215801d5f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55d29b641230 msgr2=0x55d29b6436f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55d29b641230 0x55d29b6436f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2030036b40 msgr2=0x7f2030039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2030036b40 0x7f2030039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55d29b607a40 tx=0x7f215804d000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 msgr2=0x55d29b5fb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2160011590 tx=0x7f216004ccd0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f215de5b640 1 -- 172.21.15.196:0/824776493 reap_dead start 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 shutdown_connections 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/824776493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b622c60 0x55d29b5fb7d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 >> 172.21.15.196:0/824776493 conn(0x55d29b61efc0 msgr2=0x55d29b61d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 shutdown_connections 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/824776493 wait complete. 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 msgr2=0x7f2040039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 0x7f2040039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55d29b602cf0 tx=0x7f215804b760 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 msgr2=0x55d29b6163d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55d29b602c80 tx=0x7f2160018830 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 shutdown_connections 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2040036b40 0x7f2040039000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 --2- 172.21.15.196:0/16684486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b615fb0 0x55d29b6163d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.701+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 >> 172.21.15.196:0/16684486 conn(0x55d29b60af40 msgr2=0x55d29b60dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 shutdown_connections 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/16684486 wait complete. 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 msgr2=0x55d29b606fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 0x55d29b606fa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 msgr2=0x55d29b602260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 0x55d29b602260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 msgr2=0x7f204c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 0x7f204c038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2150057000 tx=0x7f2150052000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 msgr2=0x55d29b477dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f60 tx=0x7f2158000bc0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 shutdown_connections 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55d29b604bb0 0x55d29b606fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55d29b507900 0x55d29b602260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f204c036af0 0x7f204c038fb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 --2- 172.21.15.196:0/1902279684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d29b5034c0 0x55d29b477dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 >> 172.21.15.196:0/1902279684 conn(0x55d29b4fedf0 msgr2=0x55d29b5eca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 shutdown_connections 2024-09-21T08:51:57.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.702+0000 7f216a92e800 1 -- 172.21.15.196:0/1902279684 wait complete. 2024-09-21T08:51:57.713 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-21T08:51:57.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-21T08:51:57.713 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-21T08:51:57.761 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.761 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.759+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.759+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f0354139800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559616cb7920 0x559616cb9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f0354139800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559616b73b30 con 0x559616cb34e0 2024-09-21T08:51:57.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f0354139800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x559616b55360 con 0x559616cb7920 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034f5f4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559616cb7920 0x559616cb9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034f5f4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559616cb7920 0x559616cb9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34266/0 (socket says 172.21.15.196:34266) 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034fdf5640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x559616cb34e0 0x559616cb38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46850/0 (socket says 172.21.15.196:46850) 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034f5f4640 1 -- 172.21.15.196:0/3993171270 learned_addr learned my addr 172.21.15.196:0/3993171270 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034f5f4640 1 -- 172.21.15.196:0/3993171270 >> v1:172.21.15.29:6789/0 conn(0x559616cb34e0 legacy=0x559616cb38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.760+0000 7f034f5f4640 1 -- 172.21.15.196:0/3993171270 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616b7be00 con 0x559616cb7920 2024-09-21T08:51:57.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.762+0000 7f034f5f4640 1 --2- 172.21.15.196:0/3993171270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb7920 0x559616cb9d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f034400a520 tx=0x7f0344045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9f8eb5c0282cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.762+0000 7f034edf3640 1 -- 172.21.15.196:0/3993171270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0344055070 con 0x559616cb7920 2024-09-21T08:51:57.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.762+0000 7f034edf3640 1 -- 172.21.15.196:0/3993171270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03440515b0 con 0x559616cb7920 2024-09-21T08:51:57.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.762+0000 7f034edf3640 1 -- 172.21.15.196:0/3993171270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440518d0 con 0x559616cb7920 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 -- 172.21.15.196:0/3993171270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb7920 msgr2=0x559616cb9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 --2- 172.21.15.196:0/3993171270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb7920 0x559616cb9d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f034400a520 tx=0x7f0344045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 -- 172.21.15.196:0/3993171270 shutdown_connections 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 --2- 172.21.15.196:0/3993171270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb7920 0x559616cb9d10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 -- 172.21.15.196:0/3993171270 >> 172.21.15.196:0/3993171270 conn(0x559616caee10 msgr2=0x559616cb1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 -- 172.21.15.196:0/3993171270 shutdown_connections 2024-09-21T08:51:57.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.763+0000 7f0354139800 1 -- 172.21.15.196:0/3993171270 wait complete. 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.777+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.777+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.777+0000 7f0354139800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.777+0000 7f0354139800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559616c00350 con 0x559616cb34e0 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f034fdf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f034fdf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34278/0 (socket says 172.21.15.196:34278) 2024-09-21T08:51:57.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f034fdf5640 1 -- 172.21.15.196:0/3729409177 learned_addr learned my addr 172.21.15.196:0/3729409177 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f034fdf5640 1 -- 172.21.15.196:0/3729409177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616b4dbc0 con 0x559616cb34e0 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f034fdf5640 1 --2- 172.21.15.196:0/3729409177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0340001650 tx=0x7f0340001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4ccc1dcea7e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f023de0b640 1 -- 172.21.15.196:0/3729409177 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340013420 con 0x559616cb34e0 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f023de0b640 1 -- 172.21.15.196:0/3729409177 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03400135c0 con 0x559616cb34e0 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.778+0000 7f023de0b640 1 -- 172.21.15.196:0/3729409177 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03400138c0 con 0x559616cb34e0 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- 172.21.15.196:0/3729409177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 msgr2=0x559616c27da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 --2- 172.21.15.196:0/3729409177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0340001650 tx=0x7f0340001b10 comp rx=0 tx=0).stop 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- 172.21.15.196:0/3729409177 shutdown_connections 2024-09-21T08:51:57.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 --2- 172.21.15.196:0/3729409177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616c27da0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- 172.21.15.196:0/3729409177 >> 172.21.15.196:0/3729409177 conn(0x559616caee10 msgr2=0x559616d9e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- 172.21.15.196:0/3729409177 shutdown_connections 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- 172.21.15.196:0/3729409177 wait complete. 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.779+0000 7f0354139800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0354139800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559616cba550 con 0x559616cb34e0 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f034fdf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f034fdf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34290/0 (socket says 172.21.15.196:34290) 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f034fdf5640 1 -- 172.21.15.196:0/1587755200 learned_addr learned my addr 172.21.15.196:0/1587755200 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f034fdf5640 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616b61fe0 con 0x559616cb34e0 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f034fdf5640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0340000f80 tx=0x7f0340001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0237fff640 1 -- 172.21.15.196:0/1587755200 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340022020 con 0x559616cb34e0 2024-09-21T08:51:57.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0237fff640 1 -- 172.21.15.196:0/1587755200 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340006830 con 0x559616cb34e0 2024-09-21T08:51:57.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0237fff640 1 -- 172.21.15.196:0/1587755200 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340004bb0 con 0x559616cb34e0 2024-09-21T08:51:57.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559616dab870 con 0x559616cb34e0 2024-09-21T08:51:57.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.780+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559616dabd90 con 0x559616cb34e0 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.781+0000 7f0237fff640 1 -- 172.21.15.196:0/1587755200 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0340025020 con 0x559616cb34e0 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.781+0000 7f0237fff640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 0x7f0238039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.781+0000 7f0237fff640 1 -- 172.21.15.196:0/1587755200 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0340018030 con 0x559616cb34e0 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.781+0000 7f034f5f4640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 0x7f0238039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 0x559616db23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616db2920 con 0x559616cb7920 2024-09-21T08:51:57.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f03505f6640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 0x559616db23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f034f5f4640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 0x7f0238039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0344057000 tx=0x7f0344052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f03505f6640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 0x559616db23a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f03505f6640 1 -- 172.21.15.196:0/1587755200 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.782+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616daf950 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f03505f6640 1 -- 172.21.15.196:0/1587755200 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03480083e0 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 0x559616db7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616db7730 con 0x559616db4c50 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f034fdf5640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 0x559616db7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f034fdf5640 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 0x559616db7040 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f034fdf5640 1 -- 172.21.15.196:0/1587755200 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f034001b070 con 0x559616db4c50 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.783+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616db3af0 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.784+0000 7f03505f6640 1 -- 172.21.15.196:0/1587755200 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03480083e0 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.784+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616db3f70 con 0x559616cb7920 2024-09-21T08:51:57.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.784+0000 7f03505f6640 1 -- 172.21.15.196:0/1587755200 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f03480083e0 con 0x559616cb7920 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.784+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.784+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f0354139800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f0354139800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559616b4f580 con 0x559616da3fe0 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34298/0 (socket says 172.21.15.196:34298) 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f03505f6640 1 -- 172.21.15.196:0/2423992771 learned_addr learned my addr 172.21.15.196:0/2423992771 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f03505f6640 1 -- 172.21.15.196:0/2423992771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616da4400 con 0x559616da3fe0 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f03505f6640 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x559616dac730 tx=0x7f034800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.785+0000 7f02357fa640 1 -- 172.21.15.196:0/2423992771 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0348007d00 con 0x559616da3fe0 2024-09-21T08:51:57.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f02357fa640 1 -- 172.21.15.196:0/2423992771 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034801e020 con 0x559616da3fe0 2024-09-21T08:51:57.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559616da2bd0 con 0x559616da3fe0 2024-09-21T08:51:57.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f02357fa640 1 -- 172.21.15.196:0/2423992771 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0348019420 con 0x559616da3fe0 2024-09-21T08:51:57.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559616da30d0 con 0x559616da3fe0 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f02357fa640 1 -- 172.21.15.196:0/2423992771 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0348016040 con 0x559616da3fe0 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f02357fa640 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 0x7f0228039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.786+0000 7f02357fa640 1 -- 172.21.15.196:0/2423992771 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f034801f030 con 0x559616da3fe0 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f034fdf5640 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 0x7f0228039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f034fdf5640 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 0x7f0228039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x559616db2dc0 tx=0x7f034001d7a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f0354139800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f0354139800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559616da6800 con 0x559616dd4fb0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34310/0 (socket says 172.21.15.196:34310) 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f03505f6640 1 -- 172.21.15.196:0/2997471772 learned_addr learned my addr 172.21.15.196:0/2997471772 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.787+0000 7f03505f6640 1 -- 172.21.15.196:0/2997471772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616dd5980 con 0x559616dd4fb0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f03505f6640 1 --2- 172.21.15.196:0/2997471772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f034804cbe0 tx=0x7f03480157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d12ca6ec50b75b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f022effd640 1 -- 172.21.15.196:0/2997471772 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034801d040 con 0x559616dd4fb0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f022effd640 1 -- 172.21.15.196:0/2997471772 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034804a070 con 0x559616dd4fb0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f022effd640 1 -- 172.21.15.196:0/2997471772 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03480400c0 con 0x559616dd4fb0 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 -- 172.21.15.196:0/2997471772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 msgr2=0x559616dd53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 --2- 172.21.15.196:0/2997471772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f034804cbe0 tx=0x7f03480157e0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 -- 172.21.15.196:0/2997471772 shutdown_connections 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 --2- 172.21.15.196:0/2997471772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616dd53b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 -- 172.21.15.196:0/2997471772 >> 172.21.15.196:0/2997471772 conn(0x559616dd1310 msgr2=0x559616dcf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 -- 172.21.15.196:0/2997471772 shutdown_connections 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 -- 172.21.15.196:0/2997471772 wait complete. 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.788+0000 7f0354139800 1 Processor -- start 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f0354139800 1 -- start start 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f0354139800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f0354139800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559616dd5ff0 con 0x559616dd4fb0 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f03505f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34312/0 (socket says 172.21.15.196:34312) 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 learned_addr learned my addr 172.21.15.196:0/4279497134 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559616ddc960 con 0x559616dd4fb0 2024-09-21T08:51:57.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f03505f6640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0348007fd0 tx=0x7f034804cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f022d7fa640 1 -- 172.21.15.196:0/4279497134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034801d070 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f022d7fa640 1 -- 172.21.15.196:0/4279497134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0348032070 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559616ddcbf0 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.789+0000 7f022d7fa640 1 -- 172.21.15.196:0/4279497134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0348015e20 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.790+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559616ddf8a0 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.790+0000 7f022d7fa640 1 -- 172.21.15.196:0/4279497134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f034804e980 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.790+0000 7f022d7fa640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0218036b40 0x7f0218039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.790+0000 7f022d7fa640 1 -- 172.21.15.196:0/4279497134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0348038cb0 con 0x559616dd4fb0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.790+0000 7f034fdf5640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0218036b40 0x7f0218039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.791+0000 7f034fdf5640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0218036b40 0x7f0218039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559616db7b30 tx=0x7f0340035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.791+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.791+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616de7ed0 0x559616dea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.791+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616deaae0 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.791+0000 7f034f5f4640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616de7ed0 0x559616dea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f034f5f4640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616de7ed0 0x559616dea390 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 realm 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616deaf10 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616deb7e0 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.792+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616debb80 con 0x559616de7ed0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616dec8e0 0x559616deecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f03505f6640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616dec8e0 0x559616deecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f03505f6640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616dec8e0 0x559616deecd0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 20 searching for the correct realm 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559616df12d0 0x559616df3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.793+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616df3e60 con 0x559616df12d0 2024-09-21T08:51:57.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034fdf5640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559616df12d0 0x559616df3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034fdf5640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559616df12d0 0x559616df3790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034fdf5640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0340027020 0x7f034001e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616df3e60 con 0x7f0340027020 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.794+0000 7f034f5f4640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0340027020 0x7f034001e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f034f5f4640 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0340027020 0x7f034001e3f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616df3e60 con 0x559616dec8e0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.795+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.796+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x7f0340027020 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.797+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x7f0340027020 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.798+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.799+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x7f0340027020 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.800+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.801+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x7f0340027020 2024-09-21T08:51:57.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616df12d0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616dec8e0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x559616de7ed0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.802+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559616def320 con 0x7f0340027020 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616defbe0 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616deffd0 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616df03f0 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 zone default found 2024-09-21T08:51:57.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 4 Realm: () 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 zonegroup default 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.803+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616df42e0 con 0x559616dec8e0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616df6060 con 0x559616df12d0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616df64c0 con 0x559616df12d0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 started sync module instance, tier type = 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.804+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df5500 con 0x7f0340027020 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.805+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.805+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94103117191712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df5500 con 0x7f0340027020 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.805+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df6fd0 con 0x559616de7ed0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.806+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94103117191712] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.806+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.806+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94103117195968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df5500 con 0x559616de7ed0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.806+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df7a40 con 0x559616df12d0 2024-09-21T08:51:57.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.807+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.807+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94103117198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df82e0 con 0x559616df12d0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.807+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df8d80 con 0x7f0340027020 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.808+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94103117195968] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.808+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.808+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94103117203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df9170 con 0x7f0340027020 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.808+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df9b30 con 0x559616de7ed0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.808+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94103117198640] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.809+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.809+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94103117200944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df9b30 con 0x559616de7ed0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.809+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfa540 con 0x559616dec8e0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.809+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94103117203536] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.810+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94103117200944] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.810+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.810+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94103117207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfa540 con 0x559616dec8e0 2024-09-21T08:51:57.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.810+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616df9ae0 con 0x559616dec8e0 2024-09-21T08:51:57.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.811+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.811+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94103117208224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfae90 con 0x559616dec8e0 2024-09-21T08:51:57.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.811+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfb9b0 con 0x559616dec8e0 2024-09-21T08:51:57.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94103117207168] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94103117214848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfb970 con 0x559616dec8e0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=1 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=2 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=3 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=4 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=5 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94103117208224] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.812+0000 7f0354139800 20 add_watcher() i=6 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.813+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94103117214848] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.813+0000 7f0354139800 20 add_watcher() i=7 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.813+0000 7f0354139800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.813+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616dfa960 con 0x559616de7ed0 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.814+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.814+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94103117209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616dfa960 con 0x559616de7ed0 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94103117209744] v34'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 5 note: GC not initialized 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0204fe1640 20 reqs_thread_entry: start 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 20 Filter name: none 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f017e7fc640 20 reqs_thread_entry: start 2024-09-21T08:51:57.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.815+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616e31d60 con 0x559616de7ed0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616e327d0 con 0x559616dec8e0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.816+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e38250 con 0x559616de7ed0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v34'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f0354139800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f0354139800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f0354139800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94103117462544 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616e33870 con 0x559616de7ed0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94103117200944 notify 146028888067 ret 0) ==== 720+0+0 (crc 0 0 0) 0x559616b7be00 con 0x559616de7ed0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f022effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94103117200944 notifier 4349 bl.length()=678 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f022effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f022effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f022effd640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0214003ea0 con 0x559616de7ed0 2024-09-21T08:51:57.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(65 notify.4 [notify cookie 94103117462544 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94103117462544 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f034405b8d0 con 0x559616de7ed0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.818+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e37c10 con 0x559616dec8e0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.819+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.819+0000 7f0354139800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.819+0000 7f0354139800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.819+0000 7f0354139800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.819+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94103117462544 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559616e333c0 con 0x559616df12d0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 94103117198640 notify 146028888064 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f0340052040 con 0x559616df12d0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f022e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94103117198640 notifier 4349 bl.length()=177 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f022e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f022e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 notify.2 [notify cookie 94103117462544 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f022e7fc640 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0184003400 con 0x559616df12d0 2024-09-21T08:51:57.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.820+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== watch-notify(notify_complete (2) cookie 94103117462544 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559616dabd90 con 0x559616df12d0 2024-09-21T08:51:57.833 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T08:51:57.818632Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.821+0000 7f0205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.821+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94103117209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e33ca0 con 0x559616de7ed0 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.822+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94103117209744] v34'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.822+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94103117191712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x7f0340027020 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.823+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94103117191712] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.823+0000 7f0354139800 20 remove_watcher() i=0 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.823+0000 7f0354139800 2 removed watcher, disabling cache 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.823+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94103117195968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616de7ed0 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.824+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94103117195968] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.824+0000 7f0354139800 20 remove_watcher() i=1 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.824+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94103117198640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616df12d0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.825+0000 7f034fdf5640 1 -- 172.21.15.196:0/4279497134 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94103117198640] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034001b070 con 0x559616df12d0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.825+0000 7f0354139800 20 remove_watcher() i=2 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.825+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94103117203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x7f0340027020 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.826+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94103117203536] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x7f0340027020 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.826+0000 7f0354139800 20 remove_watcher() i=3 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.826+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94103117200944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616de7ed0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.829+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94103117200944] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0344057030 con 0x559616de7ed0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.829+0000 7f0354139800 20 remove_watcher() i=4 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.829+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94103117207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616dec8e0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.830+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94103117207168] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.830+0000 7f0354139800 20 remove_watcher() i=5 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.830+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94103117208224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616dec8e0 2024-09-21T08:51:57.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.831+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94103117208224] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.831+0000 7f0354139800 20 remove_watcher() i=6 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.831+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94103117214848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559616e2fa20 con 0x559616dec8e0 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.831+0000 7f03505f6640 1 -- 172.21.15.196:0/4279497134 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94103117214848] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03480083e0 con 0x559616dec8e0 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.831+0000 7f0354139800 20 remove_watcher() i=7 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616dec8e0 msgr2=0x559616deecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616dec8e0 0x559616deecd0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616de7ed0 msgr2=0x559616dea390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616de7ed0 0x559616dea390 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0340027020 msgr2=0x7f034001e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0340027020 0x7f034001e3f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559616df12d0 msgr2=0x559616df3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559616df12d0 0x559616df3790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0218036b40 msgr2=0x7f0218039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0218036b40 0x7f0218039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559616db7b30 tx=0x7f0340035000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 msgr2=0x559616ddc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f034f5f4640 1 -- 172.21.15.196:0/4279497134 reap_dead start 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0348007fd0 tx=0x7f034804cb40 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 shutdown_connections 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/4279497134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616dd4fb0 0x559616ddc420 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 >> 172.21.15.196:0/4279497134 conn(0x559616dd1310 msgr2=0x559616dcf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 shutdown_connections 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/4279497134 wait complete. 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 msgr2=0x7f0228039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 0x7f0228039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x559616db2dc0 tx=0x7f034001d7a0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 msgr2=0x559616da2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x559616dac730 tx=0x7f034800aec0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 shutdown_connections 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0228036b40 0x7f0228039000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 --2- 172.21.15.196:0/2423992771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616da3fe0 0x559616da2630 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 >> 172.21.15.196:0/2423992771 conn(0x559616dbb050 msgr2=0x559616dbdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 shutdown_connections 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.832+0000 7f0354139800 1 -- 172.21.15.196:0/2423992771 wait complete. 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 msgr2=0x559616db7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 0x559616db7040 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 msgr2=0x559616db23a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 0x559616db23a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 msgr2=0x7f0238039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 0x7f0238039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0344057000 tx=0x7f0344052000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 msgr2=0x559616dab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0340000f80 tx=0x7f0340001250 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 shutdown_connections 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559616db4c50 0x559616db7040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559616cb7920 0x559616db23a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0238036b40 0x7f0238039000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 --2- 172.21.15.196:0/1587755200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559616cb34e0 0x559616dab330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 >> 172.21.15.196:0/1587755200 conn(0x559616caee10 msgr2=0x559616d9cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 shutdown_connections 2024-09-21T08:51:57.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.833+0000 7f0354139800 1 -- 172.21.15.196:0/1587755200 wait complete. 2024-09-21T08:51:57.844 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T08:51:57.818632Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:57.844 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:57.888 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:57.888 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:57.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f8ab06800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5634171e4760 0x5634171e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f8ab06800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634170a3b30 con 0x5634171e50a0 2024-09-21T08:51:57.889 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f8ab06800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x563417085360 con 0x5634171e4760 2024-09-21T08:51:57.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f885fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5634171e4760 0x5634171e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f7fdf9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5634171e50a0 0x5634171e9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46856/0 (socket says 172.21.15.196:46856) 2024-09-21T08:51:57.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/4059780817 learned_addr learned my addr 172.21.15.196:0/4059780817 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:57.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.887+0000 7f6f885fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5634171e4760 0x5634171e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34326/0 (socket says 172.21.15.196:34326) 2024-09-21T08:51:57.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.888+0000 7f6f885fa640 1 -- 172.21.15.196:0/4059780817 >> v1:172.21.15.29:6789/0 conn(0x5634171e50a0 legacy=0x5634171e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.888+0000 7f6f885fa640 1 -- 172.21.15.196:0/4059780817 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634170abe00 con 0x5634171e4760 2024-09-21T08:51:57.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.889+0000 7f6f885fa640 1 --2- 172.21.15.196:0/4059780817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634171e4b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800a470 tx=0x7f6f78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8013092bc33437fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f87df9640 1 -- 172.21.15.196:0/4059780817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78053570 con 0x5634171e4760 2024-09-21T08:51:57.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f87df9640 1 -- 172.21.15.196:0/4059780817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78058070 con 0x5634171e4760 2024-09-21T08:51:57.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f87df9640 1 -- 172.21.15.196:0/4059780817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78053880 con 0x5634171e4760 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 -- 172.21.15.196:0/4059780817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 msgr2=0x5634171e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/4059780817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634171e4b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800a470 tx=0x7f6f78045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 -- 172.21.15.196:0/4059780817 shutdown_connections 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/4059780817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634171e4b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 -- 172.21.15.196:0/4059780817 >> 172.21.15.196:0/4059780817 conn(0x5634171dfff0 msgr2=0x5634171e2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 -- 172.21.15.196:0/4059780817 shutdown_connections 2024-09-21T08:51:57.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.890+0000 7f6f8ab06800 1 -- 172.21.15.196:0/4059780817 wait complete. 2024-09-21T08:51:57.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f8ab06800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f8ab06800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563417130330 con 0x5634171e4760 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f885fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f885fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34328/0 (socket says 172.21.15.196:34328) 2024-09-21T08:51:57.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f885fa640 1 -- 172.21.15.196:0/484596129 learned_addr learned my addr 172.21.15.196:0/484596129 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.904+0000 7f6f885fa640 1 -- 172.21.15.196:0/484596129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341707dbc0 con 0x5634171e4760 2024-09-21T08:51:57.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.905+0000 7f6f885fa640 1 --2- 172.21.15.196:0/484596129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f78025c20 tx=0x7f6f78051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd6387fead9a975 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.905+0000 7f6e7660c640 1 -- 172.21.15.196:0/484596129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78053ba0 con 0x5634171e4760 2024-09-21T08:51:57.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.905+0000 7f6e7660c640 1 -- 172.21.15.196:0/484596129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78063030 con 0x5634171e4760 2024-09-21T08:51:57.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.905+0000 7f6e7660c640 1 -- 172.21.15.196:0/484596129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78053440 con 0x5634171e4760 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- 172.21.15.196:0/484596129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 msgr2=0x5634172d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/484596129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6f78025c20 tx=0x7f6f78051000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- 172.21.15.196:0/484596129 shutdown_connections 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/484596129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172d38a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- 172.21.15.196:0/484596129 >> 172.21.15.196:0/484596129 conn(0x5634171dfff0 msgr2=0x5634172cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- 172.21.15.196:0/484596129 shutdown_connections 2024-09-21T08:51:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- 172.21.15.196:0/484596129 wait complete. 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.906+0000 7f6f8ab06800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634171eb640 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f885fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f885fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34334/0 (socket says 172.21.15.196:34334) 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f885fa640 1 -- 172.21.15.196:0/3112175961 learned_addr learned my addr 172.21.15.196:0/3112175961 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f885fa640 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563417091fe0 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5634172d4700 tx=0x7f6f78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6e74e09640 1 -- 172.21.15.196:0/3112175961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78078070 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6e74e09640 1 -- 172.21.15.196:0/3112175961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78053570 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6e74e09640 1 -- 172.21.15.196:0/3112175961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f78053850 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.907+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634172db770 con 0x5634171e4760 2024-09-21T08:51:57.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.908+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634172dbcf0 con 0x5634171e4760 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.908+0000 7f6e74e09640 1 -- 172.21.15.196:0/3112175961 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6f7807b070 con 0x5634171e4760 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.908+0000 7f6e74e09640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 0x7f6e70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.908+0000 7f6e74e09640 1 -- 172.21.15.196:0/3112175961 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6f78070070 con 0x5634171e4760 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 0x7f6e70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 0x5634172e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634172e2870 con 0x5634171e50a0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 0x5634172e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 0x7f6e70039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000f60 tx=0x7f6f700012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 0x5634172e22a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3112175961 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f8000a4a0 con 0x5634171e50a0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.909+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634172df850 con 0x5634171e50a0 2024-09-21T08:51:57.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.910+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3112175961 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f8000a4a0 con 0x5634171e50a0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.910+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 0x5634172e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.910+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634172e76b0 con 0x5634172e4bd0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.910+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 0x5634172e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.910+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 0x5634172e6fc0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f885fa640 1 -- 172.21.15.196:0/3112175961 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f7807a030 con 0x5634172e4bd0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634172e3980 con 0x5634171e50a0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3112175961 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f8000a4a0 con 0x5634171e50a0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634172e3e20 con 0x5634171e50a0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3112175961 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f8000a4a0 con 0x5634171e50a0 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.911+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f8ab06800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f8ab06800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56341707f580 con 0x5634172f5f10 2024-09-21T08:51:57.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34350/0 (socket says 172.21.15.196:34350) 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3017133644 learned_addr learned my addr 172.21.15.196:0/3017133644 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3017133644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634172f6870 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5634172e2c50 tx=0x7f6f80018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.912+0000 7f6e6dffb640 1 -- 172.21.15.196:0/3017133644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80014450 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6e6dffb640 1 -- 172.21.15.196:0/3017133644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f80014610 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634172f6b00 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6e6dffb640 1 -- 172.21.15.196:0/3017133644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80014930 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634172f97e0 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6e6dffb640 1 -- 172.21.15.196:0/3017133644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6f80011040 con 0x5634172f5f10 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6e6dffb640 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 0x7f6e60039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.913+0000 7f6e6dffb640 1 -- 172.21.15.196:0/3017133644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6f8001e070 con 0x5634172f5f10 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 0x7f6e60039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 0x7f6e60039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f78068fd0 tx=0x7f6f7808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f8ab06800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f8ab06800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634172d3ff0 con 0x563417302b70 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34354/0 (socket says 172.21.15.196:34354) 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3061630271 learned_addr learned my addr 172.21.15.196:0/3061630271 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.914+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3061630271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563417303540 con 0x563417302b70 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3061630271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f8004ccc0 tx=0x7f6f80011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dd85f12d94aafc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6e677fe640 1 -- 172.21.15.196:0/3061630271 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80016940 con 0x563417302b70 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6e677fe640 1 -- 172.21.15.196:0/3061630271 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f80014ad0 con 0x563417302b70 2024-09-21T08:51:57.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6e677fe640 1 -- 172.21.15.196:0/3061630271 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80014db0 con 0x563417302b70 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3061630271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 msgr2=0x563417302f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3061630271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f8004ccc0 tx=0x7f6f80011940 comp rx=0 tx=0).stop 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3061630271 shutdown_connections 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3061630271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x563417302f70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3061630271 >> 172.21.15.196:0/3061630271 conn(0x5634172feed0 msgr2=0x5634172fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3061630271 shutdown_connections 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3061630271 wait complete. 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.915+0000 7f6f8ab06800 1 Processor -- start 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f8ab06800 1 -- start start 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f8ab06800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x56341730a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f8ab06800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563417303b10 con 0x563417302b70 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x56341730a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f88dfb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x56341730a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34370/0 (socket says 172.21.15.196:34370) 2024-09-21T08:51:57.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 learned_addr learned my addr 172.21.15.196:0/3876140723 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341730a5a0 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x56341730a060 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f8004ccc0 tx=0x7f6f8004cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6e65ffb640 1 -- 172.21.15.196:0/3876140723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f80016940 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6e65ffb640 1 -- 172.21.15.196:0/3876140723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8002b350 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56341730a830 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.916+0000 7f6e65ffb640 1 -- 172.21.15.196:0/3876140723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f8002b630 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.917+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341730d4e0 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.917+0000 7f6e65ffb640 1 -- 172.21.15.196:0/3876140723 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6f80044020 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6e65ffb640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e58036b40 0x7f6e58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6e65ffb640 1 -- 172.21.15.196:0/3876140723 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6f80034070 con 0x563417302b70 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e58036b40 0x7f6e58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563417315c90 0x563417318150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634173188a0 con 0x563417315c90 2024-09-21T08:51:57.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563417315c90 0x563417318150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e58036b40 0x7f6e58039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7807c730 tx=0x7f6f78093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.918+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563417315c90 0x563417318150 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f70009050 con 0x563417315c90 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 realm 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634173150e0 con 0x563417315c90 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f70009050 con 0x563417315c90 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:57.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563417319380 con 0x563417315c90 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f70009050 con 0x563417315c90 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563417319c50 con 0x563417315c90 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f70009050 con 0x563417315c90 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56341731a500 0x56341731c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341731d050 con 0x56341731a500 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.919+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56341731a500 0x56341731c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f88dfb640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56341731a500 0x56341731c8f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f8ab06800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f8ab06800 20 searching for the correct realm 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56341731f100 0x5634173215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.920+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56341731f100 0x5634173215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56341731f100 0x5634173215c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f885fa640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6f7807d060 0x7f6f7805e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6f7807d060 0x7f6f7805e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f7fdf9640 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6f7807d060 0x7f6f7805e8a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70009050 con 0x7f6f7807d060 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.921+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70009050 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.922+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x7f6f7807d060 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.923+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f70029040 con 0x7f6f7807d060 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.924+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.925+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x7f6f7807d060 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.926+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x7f6f7807d060 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.927+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731f100 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x56341731a500 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x563417315c90 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563417321c90 con 0x7f6f7807d060 2024-09-21T08:51:57.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f70029040 con 0x7f6f7807d060 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.928+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341731db00 con 0x563417315c90 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341731df80 con 0x563417315c90 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f70029040 con 0x563417315c90 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:57.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341731e420 con 0x563417315c90 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 zone default found 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 4 Realm: () 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 zonegroup default 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563417322110 con 0x56341731a500 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.929+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563417324340 con 0x56341731f100 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634173246e0 con 0x56341731f100 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 20 started sync module instance, tier type = 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.930+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417323780 con 0x7f6f7807d060 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.931+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.931+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94781727456112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417323780 con 0x7f6f7807d060 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.931+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173250a0 con 0x563417315c90 2024-09-21T08:51:57.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.932+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94781727456112] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.932+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.932+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94781727454384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173250a0 con 0x563417315c90 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.932+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417325a60 con 0x56341731f100 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.933+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.933+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94781727462832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417326300 con 0x56341731f100 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.934+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417326da0 con 0x7f6f7807d060 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.935+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94781727462832] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.935+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94781727454384] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.937+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.937+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94781727460336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417325e50 con 0x7f6f7807d060 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.938+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417327640 con 0x563417315c90 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.940+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.940+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94781727469888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417327560 con 0x563417315c90 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.940+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417328540 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.940+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94781727460336] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.943+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94781727469888] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.943+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.943+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94781727472176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417328050 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.943+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417328e10 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.944+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94781727472176] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.944+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.944+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94781727467632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417328ca0 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.944+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173294f0 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94781727467632] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94781727476176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417329380 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=0 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=1 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=2 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=3 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=4 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=5 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.946+0000 7f6f8ab06800 20 add_watcher() i=6 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94781727476176] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f8ab06800 20 add_watcher() i=7 2024-09-21T08:51:57.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f8ab06800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341732c8f0 con 0x563417315c90 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.947+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94781727477296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417329db0 con 0x563417315c90 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94781727477296] v34'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6e3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6f8ab06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6f8ab06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6f8ab06800 5 note: GC not initialized 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6e3d7e2640 20 reqs_thread_entry: start 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.948+0000 7f6f8ab06800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6f8ab06800 20 Filter name: none 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6daeffd640 20 reqs_thread_entry: start 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6f8ab06800 20 rados->read ofs=0 len=0 2024-09-21T08:51:57.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56341735f8f0 con 0x563417315c90 2024-09-21T08:51:57.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.949+0000 7f6f8ab06800 20 rados_obj.operate() r=0 bl.length=502 2024-09-21T08:51:57.955 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T08:51:57.818632Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.950+0000 7f6e3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.950+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94781727477296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56341735e340 con 0x563417315c90 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.951+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94781727477296] v34'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.951+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94781727456112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56341735d6a0 con 0x7f6f7807d060 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.952+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94781727456112] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.952+0000 7f6f8ab06800 20 remove_watcher() i=0 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.952+0000 7f6f8ab06800 2 removed watcher, disabling cache 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.952+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94781727454384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56341735d6a0 con 0x563417315c90 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.953+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94781727454384] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.953+0000 7f6f8ab06800 20 remove_watcher() i=1 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.953+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94781727462832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56341735d6a0 con 0x56341731f100 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.954+0000 7f6f885fa640 1 -- 172.21.15.196:0/3876140723 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94781727462832] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f7807a030 con 0x56341731f100 2024-09-21T08:51:57.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.954+0000 7f6f8ab06800 20 remove_watcher() i=2 2024-09-21T08:51:57.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.955+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94781727460336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173234b0 con 0x7f6f7807d060 2024-09-21T08:51:57.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.955+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94781727460336] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x7f6f7807d060 2024-09-21T08:51:57.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.955+0000 7f6f8ab06800 20 remove_watcher() i=3 2024-09-21T08:51:57.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.955+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94781727469888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173255b0 con 0x563417315c90 2024-09-21T08:51:57.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.957+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94781727469888] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f700391c0 con 0x563417315c90 2024-09-21T08:51:57.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.957+0000 7f6f8ab06800 20 remove_watcher() i=4 2024-09-21T08:51:57.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.957+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94781727472176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417324bf0 con 0x56341731a500 2024-09-21T08:51:57.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94781727472176] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f8ab06800 20 remove_watcher() i=5 2024-09-21T08:51:57.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94781727467632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563417327140 con 0x56341731a500 2024-09-21T08:51:57.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94781727467632] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f8ab06800 20 remove_watcher() i=6 2024-09-21T08:51:57.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.958+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94781727476176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634173255b0 con 0x56341731a500 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.959+0000 7f6f88dfb640 1 -- 172.21.15.196:0/3876140723 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94781727476176] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f8002a070 con 0x56341731a500 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.959+0000 7f6f8ab06800 20 remove_watcher() i=7 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.959+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56341731a500 msgr2=0x56341731c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.959+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56341731a500 0x56341731c8f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563417315c90 msgr2=0x563417318150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563417315c90 0x563417318150 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6f7807d060 msgr2=0x7f6f7805e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6f7807d060 0x7f6f7805e8a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56341731f100 msgr2=0x5634173215c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56341731f100 0x5634173215c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e58036b40 msgr2=0x7f6e58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e58036b40 0x7f6e58039000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f7807c730 tx=0x7f6f78093000 comp rx=0 tx=0).stop 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 msgr2=0x56341730a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3876140723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563417302b70 0x56341730a060 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f8004ccc0 tx=0x7f6f8004cc50 comp rx=0 tx=0).stop 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 reap_dead start 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f7fdf9640 1 -- 172.21.15.196:0/3876140723 reap_dead start 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 shutdown_connections 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 >> 172.21.15.196:0/3876140723 conn(0x5634172feed0 msgr2=0x5634172fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 shutdown_connections 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3876140723 wait complete. 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 msgr2=0x7f6e60039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 0x7f6e60039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f78068fd0 tx=0x7f6f7808ec10 comp rx=0 tx=0).stop 2024-09-21T08:51:57.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 msgr2=0x5634172f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5634172e2c50 tx=0x7f6f80018830 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 shutdown_connections 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e60036b40 0x7f6e60039000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3017133644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634172f5f10 0x5634172f6330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 >> 172.21.15.196:0/3017133644 conn(0x5634172eaea0 msgr2=0x5634172eda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 shutdown_connections 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3017133644 wait complete. 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 msgr2=0x5634172e6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 0x5634172e6fc0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 msgr2=0x5634172e22a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.960+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 0x5634172e22a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 msgr2=0x7f6e70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 0x7f6e70039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000f60 tx=0x7f6f700012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 msgr2=0x5634172db230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5634172d4700 tx=0x7f6f78002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 shutdown_connections 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634172e4bd0 0x5634172e6fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634171e50a0 0x5634172e22a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6e70036b90 0x7f6e70039050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 --2- 172.21.15.196:0/3112175961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634171e4760 0x5634172db230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 >> 172.21.15.196:0/3112175961 conn(0x5634171dfff0 msgr2=0x5634172cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 shutdown_connections 2024-09-21T08:51:57.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:57.961+0000 7f6f8ab06800 1 -- 172.21.15.196:0/3112175961 wait complete. 2024-09-21T08:51:57.971 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T08:51:57.818632Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:57.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-21T08:51:57.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-21T08:51:57.972 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-21T08:51:58.018 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.018 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f78faf800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564d1ce974e0 0x564d1ce978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f78faf800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d1cd57b30 con 0x564d1ce97e20 2024-09-21T08:51:58.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f78faf800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564d1cd39360 con 0x564d1ce974e0 2024-09-21T08:51:58.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.016+0000 7f8f76aa3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564d1ce974e0 0x564d1ce978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.017+0000 7f8f76aa3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564d1ce974e0 0x564d1ce978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34384/0 (socket says 172.21.15.196:34384) 2024-09-21T08:51:58.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.017+0000 7f8f76aa3640 1 -- 172.21.15.196:0/3430860101 learned_addr learned my addr 172.21.15.196:0/3430860101 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.017+0000 7f8f6ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564d1ce97e20 0x564d1ce9c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46858/0 (socket says 172.21.15.196:46858) 2024-09-21T08:51:58.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.017+0000 7f8f76aa3640 1 -- 172.21.15.196:0/3430860101 >> v1:172.21.15.29:6789/0 conn(0x564d1ce97e20 legacy=0x564d1ce9c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.017+0000 7f8f76aa3640 1 -- 172.21.15.196:0/3430860101 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cd5fe00 con 0x564d1ce974e0 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/3430860101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1ce978e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800a6b0 tx=0x7f8f68047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d125341281bb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f762a2640 1 -- 172.21.15.196:0/3430860101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f6800a200 con 0x564d1ce974e0 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f762a2640 1 -- 172.21.15.196:0/3430860101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6800a3a0 con 0x564d1ce974e0 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f762a2640 1 -- 172.21.15.196:0/3430860101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f68008700 con 0x564d1ce974e0 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 -- 172.21.15.196:0/3430860101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 msgr2=0x564d1ce978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3430860101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1ce978e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800a6b0 tx=0x7f8f68047e30 comp rx=0 tx=0).stop 2024-09-21T08:51:58.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 -- 172.21.15.196:0/3430860101 shutdown_connections 2024-09-21T08:51:58.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3430860101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1ce978e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 -- 172.21.15.196:0/3430860101 >> 172.21.15.196:0/3430860101 conn(0x564d1ce92db0 msgr2=0x564d1ce951d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 -- 172.21.15.196:0/3430860101 shutdown_connections 2024-09-21T08:51:58.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.019+0000 7f8f78faf800 1 -- 172.21.15.196:0/3430860101 wait complete. 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.033+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.033+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.033+0000 7f8f78faf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.033+0000 7f8f78faf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564d1cde4360 con 0x564d1ce974e0 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8f76aa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8f76aa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34396/0 (socket says 172.21.15.196:34396) 2024-09-21T08:51:58.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8f76aa3640 1 -- 172.21.15.196:0/3359091835 learned_addr learned my addr 172.21.15.196:0/3359091835 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8f76aa3640 1 -- 172.21.15.196:0/3359091835 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cd31bc0 con 0x564d1ce974e0 2024-09-21T08:51:58.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/3359091835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f68048360 tx=0x7f8f68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1422ca6a9fa35897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8e64e09640 1 -- 172.21.15.196:0/3359091835 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f6800a200 con 0x564d1ce974e0 2024-09-21T08:51:58.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8e64e09640 1 -- 172.21.15.196:0/3359091835 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68008400 con 0x564d1ce974e0 2024-09-21T08:51:58.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.034+0000 7f8e64e09640 1 -- 172.21.15.196:0/3359091835 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f680088f0 con 0x564d1ce974e0 2024-09-21T08:51:58.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- 172.21.15.196:0/3359091835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 msgr2=0x564d1cf89aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3359091835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f68048360 tx=0x7f8f68051000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- 172.21.15.196:0/3359091835 shutdown_connections 2024-09-21T08:51:58.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3359091835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf89aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- 172.21.15.196:0/3359091835 >> 172.21.15.196:0/3359091835 conn(0x564d1ce92db0 msgr2=0x564d1cf81050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- 172.21.15.196:0/3359091835 shutdown_connections 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- 172.21.15.196:0/3359091835 wait complete. 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.035+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f78faf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f78faf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564d1ce9e4a0 con 0x564d1ce974e0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f76aa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f76aa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34406/0 (socket says 172.21.15.196:34406) 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f76aa3640 1 -- 172.21.15.196:0/4152805086 learned_addr learned my addr 172.21.15.196:0/4152805086 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f76aa3640 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cd45fe0 con 0x564d1ce974e0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.036+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f68059040 tx=0x7f8f68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8e63606640 1 -- 172.21.15.196:0/4152805086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f6806f070 con 0x564d1ce974e0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8e63606640 1 -- 172.21.15.196:0/4152805086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68008a20 con 0x564d1ce974e0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d1cf918e0 con 0x564d1ce974e0 2024-09-21T08:51:58.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8e63606640 1 -- 172.21.15.196:0/4152805086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f68008d00 con 0x564d1ce974e0 2024-09-21T08:51:58.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1cf91e00 con 0x564d1ce974e0 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8e63606640 1 -- 172.21.15.196:0/4152805086 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f68072070 con 0x564d1ce974e0 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.037+0000 7f8e63606640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 0x7f8e5c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8e63606640 1 -- 172.21.15.196:0/4152805086 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8f68064020 con 0x564d1ce974e0 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 0x7f8e5c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 0x564d1cf98410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cf98990 con 0x564d1ce97e20 2024-09-21T08:51:58.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f772a4640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 0x564d1cf98410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 0x7f8e5c039000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000f60 tx=0x7f8f60001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f772a4640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 0x564d1cf98410 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f772a4640 1 -- 172.21.15.196:0/4152805086 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f7000a4a0 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.038+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cf959c0 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.039+0000 7f8f772a4640 1 -- 172.21.15.196:0/4152805086 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f7000a4a0 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.039+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 0x564d1cf9d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.039+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cf9d730 con 0x564d1cf9aca0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.039+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 0x564d1cf9d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.039+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 0x564d1cf9d090 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f76aa3640 1 -- 172.21.15.196:0/4152805086 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cf9aca0 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cf99b10 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f772a4640 1 -- 172.21.15.196:0/4152805086 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f7000a4a0 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cf99fb0 con 0x564d1ce97e20 2024-09-21T08:51:58.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f772a4640 1 -- 172.21.15.196:0/4152805086 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f7000a4a0 con 0x564d1ce97e20 2024-09-21T08:51:58.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.040+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f78faf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f78faf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564d1cd33580 con 0x564d1cfac080 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34420/0 (socket says 172.21.15.196:34420) 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f772a4640 1 -- 172.21.15.196:0/685017671 learned_addr learned my addr 172.21.15.196:0/685017671 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.041+0000 7f8f772a4640 1 -- 172.21.15.196:0/685017671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cfac9e0 con 0x564d1cfac080 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8f772a4640 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x564d1cf92450 tx=0x7f8f700188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8e60e01640 1 -- 172.21.15.196:0/685017671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70014450 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8e60e01640 1 -- 172.21.15.196:0/685017671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f700145f0 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d1cfacc70 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8e60e01640 1 -- 172.21.15.196:0/685017671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f700148d0 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.042+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1cfaf950 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8e60e01640 1 -- 172.21.15.196:0/685017671 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f70011040 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8e60e01640 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 0x7f8e50039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8e60e01640 1 -- 172.21.15.196:0/685017671 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8f7001e070 con 0x564d1cfac080 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 0x7f8e50039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 0x7f8e50039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f68005770 tx=0x7f8f6808edc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f78faf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f78faf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564d1cf8a1f0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34430/0 (socket says 172.21.15.196:34430) 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.043+0000 7f8f772a4640 1 -- 172.21.15.196:0/3112118377 learned_addr learned my addr 172.21.15.196:0/3112118377 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f772a4640 1 -- 172.21.15.196:0/3112118377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cfb9690 con 0x564d1cfb8cc0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f772a4640 1 --2- 172.21.15.196:0/3112118377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f7004cb90 tx=0x7f8f70011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7e4d521e1452b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8e5a7fc640 1 -- 172.21.15.196:0/3112118377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70044070 con 0x564d1cfb8cc0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8e5a7fc640 1 -- 172.21.15.196:0/3112118377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70016930 con 0x564d1cfb8cc0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8e5a7fc640 1 -- 172.21.15.196:0/3112118377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7002ba60 con 0x564d1cfb8cc0 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 -- 172.21.15.196:0/3112118377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 msgr2=0x564d1cfb90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3112118377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f7004cb90 tx=0x7f8f70011700 comp rx=0 tx=0).stop 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 -- 172.21.15.196:0/3112118377 shutdown_connections 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 --2- 172.21.15.196:0/3112118377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfb90c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 -- 172.21.15.196:0/3112118377 >> 172.21.15.196:0/3112118377 conn(0x564d1cfb50b0 msgr2=0x564d1cfb31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 -- 172.21.15.196:0/3112118377 shutdown_connections 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.044+0000 7f8f78faf800 1 -- 172.21.15.196:0/3112118377 wait complete. 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f78faf800 1 Processor -- start 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f78faf800 1 -- start start 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f78faf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f78faf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564d1cfb9cd0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f772a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34442/0 (socket says 172.21.15.196:34442) 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 learned_addr learned my addr 172.21.15.196:0/710177428 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1cfc06b0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.045+0000 7f8f772a4640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f70011e10 tx=0x7f8f7004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8e58ff9640 1 -- 172.21.15.196:0/710177428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7004e2e0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8e58ff9640 1 -- 172.21.15.196:0/710177428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7003c070 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8e58ff9640 1 -- 172.21.15.196:0/710177428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7004e5b0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d1cfc0940 con 0x564d1cfb8cc0 2024-09-21T08:51:58.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1cfc35f0 con 0x564d1cfb8cc0 2024-09-21T08:51:58.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.046+0000 7f8e58ff9640 1 -- 172.21.15.196:0/710177428 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f7004e920 con 0x564d1cfb8cc0 2024-09-21T08:51:58.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8e58ff9640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e40036af0 0x7f8e40038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8e58ff9640 1 -- 172.21.15.196:0/710177428 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8f7000e040 con 0x564d1cfb8cc0 2024-09-21T08:51:58.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e40036af0 0x7f8e40038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e40036af0 0x7f8e40038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f68059ff0 tx=0x7f8f68085000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1cfcbc40 0x564d1cfce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfce850 con 0x564d1cfcbc40 2024-09-21T08:51:58.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.047+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1cfcbc40 0x564d1cfce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1cfcbc40 0x564d1cfce100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6000f610 con 0x564d1cfcbc40 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 realm 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfcb090 con 0x564d1cfcbc40 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6000f610 con 0x564d1cfcbc40 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfcf340 con 0x564d1cfcbc40 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6000f610 con 0x564d1cfcbc40 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.048+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfcfc10 con 0x564d1cfcbc40 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f6000f610 con 0x564d1cfcbc40 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f78faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cfd0630 0x564d1cfd2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd3110 con 0x564d1cfd0630 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f772a4640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cfd0630 0x564d1cfd2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.049+0000 7f8f772a4640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cfd0630 0x564d1cfd2a20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f78faf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f78faf800 20 searching for the correct realm 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564d1cfd50e0 0x564d1cfd75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd50e0 2024-09-21T08:51:58.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564d1cfd50e0 0x564d1cfd75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564d1cfd50e0 0x564d1cfd75a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.050+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f76aa3640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f8f6808c070 0x7f8f6808d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x7f8f6808c070 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f8f6808c070 0x7f8f6808d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f6ffff640 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f8f6808c070 0x7f8f6808d3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6000f610 con 0x7f8f6808c070 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.051+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd0630 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfcbc40 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6000f610 con 0x564d1cfcbc40 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfcbc40 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.052+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x7f8f6808c070 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd50e0 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfcbc40 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.053+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfcbc40 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x7f8f6808c070 2024-09-21T08:51:58.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd7c70 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.054+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd0630 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfcbc40 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.055+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfcbc40 2024-09-21T08:51:58.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x7f8f6808c070 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.056+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfcbc40 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.057+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x7f8f6808c070 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd50e0 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfd0630 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x564d1cfcbc40 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.058+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8f680aa040 con 0x7f8f6808c070 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd3ad0 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd3710 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd4470 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 zone default found 2024-09-21T08:51:58.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 4 Realm: () 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 zonegroup default 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.059+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd8180 con 0x564d1cfd0630 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfda450 con 0x564d1cfd50e0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfda7f0 con 0x564d1cfd50e0 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 started sync module instance, tier type = 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.060+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd9890 con 0x7f8f6808c070 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.061+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.061+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889198853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd9890 con 0x7f8f6808c070 2024-09-21T08:51:58.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.061+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdb230 con 0x564d1cfcbc40 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.062+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94889198853552] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.062+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.062+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889198857472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd9890 con 0x564d1cfcbc40 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.062+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdbc80 con 0x564d1cfd50e0 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.063+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94889198857472] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.063+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.063+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94889198851040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfd9800 con 0x564d1cfd50e0 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.064+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdcb70 con 0x7f8f6808c070 2024-09-21T08:51:58.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.064+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.064+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94889198864544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdd310 con 0x7f8f6808c070 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.064+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdde30 con 0x564d1cfcbc40 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.064+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94889198851040] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.065+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.065+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889198868736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdddf0 con 0x564d1cfcbc40 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.066+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfde840 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.066+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94889198864544] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.066+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.066+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889198871440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdec30 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.067+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdf630 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.067+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94889198868736] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.068+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94889198871440] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.068+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.068+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889198865760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdf140 con 0x564d1cfd0630 2024-09-21T08:51:58.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.068+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdfb00 con 0x564d1cfd0630 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94889198865760] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889198862496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfdfb00 con 0x564d1cfd0630 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=0 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=1 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=2 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=3 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=4 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=5 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.069+0000 7f8f78faf800 20 add_watcher() i=6 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94889198862496] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f78faf800 20 add_watcher() i=7 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f78faf800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfe2f60 con 0x564d1cfcbc40 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.070+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94889198876704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1cfe0480 con 0x564d1cfcbc40 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94889198876704] v34'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8e2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f78faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f78faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f78faf800 5 note: GC not initialized 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8da7fff640 20 reqs_thread_entry: start 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f78faf800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8f78faf800 20 Filter name: none 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.071+0000 7f8da5ffb640 20 reqs_thread_entry: start 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0163c0 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 20 rados_obj.operate() r=0 bl.length=502 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.072+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d01cb20 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f78faf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f78faf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f78faf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94889199125728 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1d018160 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94889198868736 notify 146028888068 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8f60018040 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94889199125728 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8e5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94889198868736 notifier 4363 bl.length()=567 2024-09-21T08:51:58.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8e5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8e5a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.073+0000 7f8e5a7fc640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8e3c003ea0 con 0x564d1cfcbc40 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.074+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.074+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94889199125728 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f60009050 con 0x564d1cfcbc40 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.074+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d01c4e0 con 0x564d1cfd0630 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f78faf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94889199125728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d1d017cb0 con 0x564d1cfd50e0 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 94889198851040 notify 146028888065 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f8f680a4040 con 0x564d1cfd50e0 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8e5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94889198851040 notifier 4363 bl.length()=170 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8e5a7fc640 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8e3c003ea0 con 0x564d1cfd50e0 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 notify.2 [notify cookie 94889199125728 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.075+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== watch-notify(notify_complete (2) cookie 94889199125728 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d1cf91e00 con 0x564d1cfd50e0 2024-09-21T08:51:58.086 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.076+0000 7f8e2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.076+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94889198876704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfcbc40 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.077+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94889198876704] v34'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.077+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94889198853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x7f8f6808c070 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.078+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94889198853552] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.078+0000 7f8f78faf800 20 remove_watcher() i=0 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.078+0000 7f8f78faf800 2 removed watcher, disabling cache 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.078+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94889198857472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfcbc40 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.079+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94889198857472] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.079+0000 7f8f78faf800 20 remove_watcher() i=1 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.079+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94889198851040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfd50e0 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.080+0000 7f8f76aa3640 1 -- 172.21.15.196:0/710177428 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94889198851040] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6807b070 con 0x564d1cfd50e0 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.080+0000 7f8f78faf800 20 remove_watcher() i=2 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.080+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94889198864544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x7f8f6808c070 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.081+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94889198864544] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x7f8f6808c070 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.081+0000 7f8f78faf800 20 remove_watcher() i=3 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.081+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94889198868736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfcbc40 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.082+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94889198868736] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6002b040 con 0x564d1cfcbc40 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.082+0000 7f8f78faf800 20 remove_watcher() i=4 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.082+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94889198871440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfd0630 2024-09-21T08:51:58.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.083+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94889198871440] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.083+0000 7f8f78faf800 20 remove_watcher() i=5 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.083+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94889198865760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfd0630 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.084+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94889198865760] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.084+0000 7f8f78faf800 20 remove_watcher() i=6 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.084+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94889198862496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d1d0140c0 con 0x564d1cfd0630 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f772a4640 1 -- 172.21.15.196:0/710177428 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94889198862496] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7002a070 con 0x564d1cfd0630 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 20 remove_watcher() i=7 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cfd0630 msgr2=0x564d1cfd2a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cfd0630 0x564d1cfd2a20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1cfcbc40 msgr2=0x564d1cfce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1cfcbc40 0x564d1cfce100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f8f6808c070 msgr2=0x7f8f6808d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f8f6808c070 0x7f8f6808d3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564d1cfd50e0 msgr2=0x564d1cfd75a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564d1cfd50e0 0x564d1cfd75a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e40036af0 msgr2=0x7f8e40038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e40036af0 0x7f8e40038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f68059ff0 tx=0x7f8f68085000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 msgr2=0x564d1cfc0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f6ffff640 1 -- 172.21.15.196:0/710177428 reap_dead start 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f70011e10 tx=0x7f8f7004cb20 comp rx=0 tx=0).stop 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 shutdown_connections 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/710177428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfb8cc0 0x564d1cfc0170 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 >> 172.21.15.196:0/710177428 conn(0x564d1cfb50b0 msgr2=0x564d1cfb3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 shutdown_connections 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/710177428 wait complete. 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 msgr2=0x7f8e50039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 0x7f8e50039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f68005770 tx=0x7f8f6808edc0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.085+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 msgr2=0x564d1cfac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x564d1cf92450 tx=0x7f8f700188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 shutdown_connections 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e50036b40 0x7f8e50039000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/685017671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1cfac080 0x564d1cfac4a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 >> 172.21.15.196:0/685017671 conn(0x564d1cfa1010 msgr2=0x564d1cfa3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 shutdown_connections 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/685017671 wait complete. 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 msgr2=0x564d1cf9d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 0x564d1cf9d090 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 msgr2=0x564d1cf98410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 0x564d1cf98410 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 msgr2=0x7f8e5c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 0x7f8e5c039000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000f60 tx=0x7f8f60001370 comp rx=0 tx=0).stop 2024-09-21T08:51:58.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 msgr2=0x564d1cf913a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f68059040 tx=0x7f8f68002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 shutdown_connections 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564d1cf9aca0 0x564d1cf9d090 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564d1ce97e20 0x564d1cf98410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f8e5c036b40 0x7f8e5c039000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 --2- 172.21.15.196:0/4152805086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564d1ce974e0 0x564d1cf913a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 >> 172.21.15.196:0/4152805086 conn(0x564d1ce92db0 msgr2=0x564d1cf7f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 shutdown_connections 2024-09-21T08:51:58.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.086+0000 7f8f78faf800 1 -- 172.21.15.196:0/4152805086 wait complete. 2024-09-21T08:51:58.097 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-21T08:51:58.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-21T08:51:58.098 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-21T08:51:58.144 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.144 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64ebf17800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5603397e5b50 0x5603397e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64ebf17800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603396a5b30 con 0x5603397e6490 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64ebf17800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x560339687360 con 0x5603397e5b50 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64e9a0b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5603397e5b50 0x5603397e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64e9a0b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5603397e5b50 0x5603397e5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34452/0 (socket says 172.21.15.196:34452) 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64e9a0b640 1 -- 172.21.15.196:0/498312457 learned_addr learned my addr 172.21.15.196:0/498312457 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64e9a0b640 1 -- 172.21.15.196:0/498312457 >> v1:172.21.15.29:6789/0 conn(0x5603397e6490 legacy=0x5603397ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.143+0000 7f64e9a0b640 1 -- 172.21.15.196:0/498312457 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603396ade00 con 0x5603397e5b50 2024-09-21T08:51:58.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.145+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/498312457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e5f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00a520 tx=0x7f64dc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4d88af0f5dcf91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.145+0000 7f64e8a09640 1 -- 172.21.15.196:0/498312457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc055070 con 0x5603397e5b50 2024-09-21T08:51:58.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.145+0000 7f64e8a09640 1 -- 172.21.15.196:0/498312457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc0515b0 con 0x5603397e5b50 2024-09-21T08:51:58.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.145+0000 7f64e8a09640 1 -- 172.21.15.196:0/498312457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc0518d0 con 0x5603397e5b50 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 -- 172.21.15.196:0/498312457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 msgr2=0x5603397e5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 --2- 172.21.15.196:0/498312457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e5f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00a520 tx=0x7f64dc045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 -- 172.21.15.196:0/498312457 shutdown_connections 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 --2- 172.21.15.196:0/498312457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e5f50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 -- 172.21.15.196:0/498312457 >> 172.21.15.196:0/498312457 conn(0x5603397e0550 msgr2=0x5603397e2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 -- 172.21.15.196:0/498312457 shutdown_connections 2024-09-21T08:51:58.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.146+0000 7f64ebf17800 1 -- 172.21.15.196:0/498312457 wait complete. 2024-09-21T08:51:58.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64ebf17800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64ebf17800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560339732360 con 0x5603397e5b50 2024-09-21T08:51:58.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64e9a0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64e9a0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34458/0 (socket says 172.21.15.196:34458) 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.160+0000 7f64e9a0b640 1 -- 172.21.15.196:0/3870655572 learned_addr learned my addr 172.21.15.196:0/3870655572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.161+0000 7f64e9a0b640 1 -- 172.21.15.196:0/3870655572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033967fbc0 con 0x5603397e5b50 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.161+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/3870655572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f64dc025da0 tx=0x7f64dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3057f302fac98a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.161+0000 7f63d7e07640 1 -- 172.21.15.196:0/3870655572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc051950 con 0x5603397e5b50 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.161+0000 7f63d7e07640 1 -- 172.21.15.196:0/3870655572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc051af0 con 0x5603397e5b50 2024-09-21T08:51:58.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.161+0000 7f63d7e07640 1 -- 172.21.15.196:0/3870655572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc051dd0 con 0x5603397e5b50 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- 172.21.15.196:0/3870655572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 msgr2=0x5603397e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 --2- 172.21.15.196:0/3870655572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f64dc025da0 tx=0x7f64dc051000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- 172.21.15.196:0/3870655572 shutdown_connections 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 --2- 172.21.15.196:0/3870655572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603397e52e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- 172.21.15.196:0/3870655572 >> 172.21.15.196:0/3870655572 conn(0x5603397e0550 msgr2=0x5603398d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- 172.21.15.196:0/3870655572 shutdown_connections 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- 172.21.15.196:0/3870655572 wait complete. 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.162+0000 7f64ebf17800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5603397ec500 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64e9a0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64e9a0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34474/0 (socket says 172.21.15.196:34474) 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64e9a0b640 1 -- 172.21.15.196:0/785359458 learned_addr learned my addr 172.21.15.196:0/785359458 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64e9a0b640 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560339693fe0 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f64dc067040 tx=0x7f64dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f63d6604640 1 -- 172.21.15.196:0/785359458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc073070 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f63d6604640 1 -- 172.21.15.196:0/785359458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc05a450 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603398d4600 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f63d6604640 1 -- 172.21.15.196:0/785359458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64dc05a730 con 0x5603397e5b50 2024-09-21T08:51:58.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.163+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603398d4b80 con 0x5603397e5b50 2024-09-21T08:51:58.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f63d6604640 1 -- 172.21.15.196:0/785359458 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64dc076070 con 0x5603397e5b50 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f63d6604640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 0x7f63d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f63d6604640 1 -- 172.21.15.196:0/785359458 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64dc062070 con 0x5603397e5b50 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f64e920a640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 0x7f63d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 0x5603398e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.164+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603398e6a40 con 0x5603397e6490 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ea20c640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 0x5603398e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64e920a640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 0x7f63d0039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f64e0001e10 tx=0x7f64e0001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ea20c640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 0x5603398e6500 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ea20c640 1 -- 172.21.15.196:0/785359458 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64e400a4a0 con 0x5603397e6490 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603398e7290 con 0x5603397e6490 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ea20c640 1 -- 172.21.15.196:0/785359458 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64e400a4a0 con 0x5603397e6490 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 0x5603398eb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.165+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603398eb8c0 con 0x5603398e8cc0 2024-09-21T08:51:58.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 0x5603398eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 0x5603398eb130 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64e9a0b640 1 -- 172.21.15.196:0/785359458 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64dc07f070 con 0x5603398e8cc0 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603398e7ae0 con 0x5603397e6490 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64ea20c640 1 -- 172.21.15.196:0/785359458 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64e400a4a0 con 0x5603397e6490 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.166+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603398e7e80 con 0x5603397e6490 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ea20c640 1 -- 172.21.15.196:0/785359458 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64e400a4a0 con 0x5603397e6490 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ebf17800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ebf17800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5603398d6450 con 0x5603398fa200 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34490/0 (socket says 172.21.15.196:34490) 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.167+0000 7f64ea20c640 1 -- 172.21.15.196:0/1074941770 learned_addr learned my addr 172.21.15.196:0/1074941770 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f64ea20c640 1 -- 172.21.15.196:0/1074941770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603398fab60 con 0x5603398fa200 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f64ea20c640 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5603398d5580 tx=0x7f64e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f63cf7fe640 1 -- 172.21.15.196:0/1074941770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4014450 con 0x5603398fa200 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f63cf7fe640 1 -- 172.21.15.196:0/1074941770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4014610 con 0x5603398fa200 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f63cf7fe640 1 -- 172.21.15.196:0/1074941770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4014930 con 0x5603398fa200 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603398fadf0 con 0x5603398fa200 2024-09-21T08:51:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.168+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603398fdad0 con 0x5603398fa200 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f63cf7fe640 1 -- 172.21.15.196:0/1074941770 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64e4011040 con 0x5603398fa200 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f63cf7fe640 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 0x7f63c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f63cf7fe640 1 -- 172.21.15.196:0/1074941770 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64e401e070 con 0x5603398fa200 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 0x7f63c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 0x7f63c4039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5603398d50f0 tx=0x7f64dc08f220 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64ebf17800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.169+0000 7f64ebf17800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560339681580 con 0x560339906e60 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34500/0 (socket says 172.21.15.196:34500) 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f64ea20c640 1 -- 172.21.15.196:0/4140600531 learned_addr learned my addr 172.21.15.196:0/4140600531 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f64ea20c640 1 -- 172.21.15.196:0/4140600531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603399077a0 con 0x560339906e60 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f64ea20c640 1 --2- 172.21.15.196:0/4140600531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f64e404cba0 tx=0x7f64e402b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93229004b7b292ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f63cd7fa640 1 -- 172.21.15.196:0/4140600531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4028040 con 0x560339906e60 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f63cd7fa640 1 -- 172.21.15.196:0/4140600531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e40401f0 con 0x560339906e60 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.170+0000 7f63cd7fa640 1 -- 172.21.15.196:0/4140600531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4016ad0 con 0x560339906e60 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- 172.21.15.196:0/4140600531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 msgr2=0x560339907260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4140600531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f64e404cba0 tx=0x7f64e402b410 comp rx=0 tx=0).stop 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- 172.21.15.196:0/4140600531 shutdown_connections 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4140600531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x560339907260 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- 172.21.15.196:0/4140600531 >> 172.21.15.196:0/4140600531 conn(0x560339903210 msgr2=0x560339901310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- 172.21.15.196:0/4140600531 shutdown_connections 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- 172.21.15.196:0/4140600531 wait complete. 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 Processor -- start 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- start start 2024-09-21T08:51:58.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ebf17800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560339907cc0 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ea20c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34510/0 (socket says 172.21.15.196:34510) 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.171+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 learned_addr learned my addr 172.21.15.196:0/4285351136 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033990e7c0 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f64ea20c640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64e40403c0 tx=0x7f64e404cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f63bb7fe640 1 -- 172.21.15.196:0/4285351136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4031070 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f63bb7fe640 1 -- 172.21.15.196:0/4285351136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e404e070 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56033990ea50 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f63bb7fe640 1 -- 172.21.15.196:0/4285351136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4028070 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.172+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560339911700 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.173+0000 7f63bb7fe640 1 -- 172.21.15.196:0/4285351136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64e4034070 con 0x560339906e60 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.173+0000 7f63bb7fe640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63b4036b40 0x7f63b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.173+0000 7f63bb7fe640 1 -- 172.21.15.196:0/4285351136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64e400e040 con 0x560339906e60 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.173+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63b4036b40 0x7f63b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.173+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63b4036b40 0x7f63b4039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5603398ebcc0 tx=0x7f64dc092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560339919eb0 0x56033991c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56033991cac0 con 0x560339919eb0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64e920a640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560339919eb0 0x56033991c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64e920a640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560339919eb0 0x56033991c370 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64e000bdb0 con 0x560339919eb0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 realm 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339919300 con 0x560339919eb0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64e000bdb0 con 0x560339919eb0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.174+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56033991d5b0 con 0x560339919eb0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64e000bdb0 con 0x560339919eb0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56033991de80 con 0x560339919eb0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64e000bdb0 con 0x560339919eb0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56033991e7c0 0x560339920bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339921380 con 0x56033991e7c0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.175+0000 7f64ea20c640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56033991e7c0 0x560339920bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ea20c640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56033991e7c0 0x560339920bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ebf17800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ebf17800 20 searching for the correct realm 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560339923350 0x560339925810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560339923350 0x560339925810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.176+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560339923350 0x560339925810 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e9a0b640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f64dc078070 0x7f64dc08f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e920a640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f64dc078070 0x7f64dc08f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e920a640 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f64dc078070 0x7f64dc08f670 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e000bdb0 con 0x7f64dc078070 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.177+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e000bdb0 con 0x560339919eb0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.178+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.179+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.180+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.181+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.182+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.183+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339923350 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x56033991e7c0 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x560339919eb0 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.184+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560339925ee0 con 0x7f64dc078070 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339921d40 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339921980 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603399226a0 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 zone default found 2024-09-21T08:51:58.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 4 Realm: () 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 zonegroup default 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.185+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339926360 con 0x56033991e7c0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339928610 con 0x560339923350 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603399289b0 con 0x560339923350 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 started sync module instance, tier type = 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.186+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339927aa0 con 0x7f64dc078070 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.187+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.187+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571850792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339927aa0 con 0x7f64dc078070 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.187+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603399293b0 con 0x560339919eb0 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.188+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571850792944] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.189+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.189+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571850796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339927aa0 con 0x560339919eb0 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.189+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339929e20 con 0x560339923350 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.189+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571850796736] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.190+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.190+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571850790384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339927a10 con 0x560339923350 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.190+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992ac00 con 0x7f64dc078070 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.191+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571850790384] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.191+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.191+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571850801728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992aff0 con 0x7f64dc078070 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.191+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992ba10 con 0x560339919eb0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.192+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.192+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571850806528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992b9d0 con 0x560339919eb0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.192+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992c950 con 0x56033991e7c0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.192+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571850801728] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.193+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.193+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571850810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992cd40 con 0x56033991e7c0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.193+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571850806528] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.193+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992d740 con 0x56033991e7c0 2024-09-21T08:51:58.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.194+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571850810496] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.194+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.194+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571850802784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992d250 con 0x56033991e7c0 2024-09-21T08:51:58.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.194+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992dc50 con 0x56033991e7c0 2024-09-21T08:51:58.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571850802784] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571850808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992dc10 con 0x56033991e7c0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=1 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=2 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=3 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=4 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=5 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.195+0000 7f64ebf17800 20 add_watcher() i=6 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571850808832] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64ebf17800 20 add_watcher() i=7 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64ebf17800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603399310a0 con 0x560339919eb0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.196+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571850815792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992e560 con 0x560339919eb0 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.197+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571850815792] v34'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.197+0000 7f639b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.197+0000 7f64ebf17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.197+0000 7f64ebf17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.197+0000 7f64ebf17800 5 note: GC not initialized 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f639a7fc640 20 reqs_thread_entry: start 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 20 Filter name: none 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f630bfff640 20 reqs_thread_entry: start 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603399644c0 con 0x560339919eb0 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.198+0000 7f64ebf17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339964f30 con 0x560339919eb0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.199+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033996a9d0 con 0x560339919eb0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64ebf17800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64ebf17800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64ebf17800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94571851064208 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339965f40 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify (1) cookie 94571850806528 notify 146028888069 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5603396a5b30 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f63cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94571850806528 notifier 4370 bl.length()=732 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify cookie 94571851064208 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f63cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f63cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.200+0000 7f63cd7fa640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63ac003ea0 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.201+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94571851064208 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f64e003da00 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.201+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.201+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033996a390 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64ebf17800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-21T08:51:58.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64ebf17800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64ebf17800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94571851064208 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560339965a90 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== watch-notify(notify (1) cookie 94571850792944 notify 146028888066 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f64e003da00 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f63cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94571850792944 notifier 4370 bl.length()=166 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f63cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f63cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.0 [notify cookie 94571851064208 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f63cd7fa640 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63ac003ea0 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== watch-notify(notify_complete (2) cookie 94571851064208 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f64e003dd70 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.202+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.213 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"3eni8qFkaJGtWOhb8lA5fdBGXUG2HFiXgOSm236J","active":true,"create_date":"2024-09-21T08:51:58.201005Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.203+0000 7f639b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.203+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571850815792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339962210 con 0x560339919eb0 2024-09-21T08:51:58.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.204+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94571850815792] v34'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.204+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571850792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339962210 con 0x7f64dc078070 2024-09-21T08:51:58.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.205+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94571850792944] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.205+0000 7f64ebf17800 20 remove_watcher() i=0 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.205+0000 7f64ebf17800 2 removed watcher, disabling cache 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.205+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571850796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339962210 con 0x560339919eb0 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.206+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94571850796736] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.206+0000 7f64ebf17800 20 remove_watcher() i=1 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.206+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571850790384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560339962210 con 0x560339923350 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.207+0000 7f64e9a0b640 1 -- 172.21.15.196:0/4285351136 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94571850790384] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64dc07f070 con 0x560339923350 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.207+0000 7f64ebf17800 20 remove_watcher() i=2 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.207+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571850801728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603399275f0 con 0x7f64dc078070 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.208+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94571850801728] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x7f64dc078070 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.208+0000 7f64ebf17800 20 remove_watcher() i=3 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.208+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571850806528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992a240 con 0x560339919eb0 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.209+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94571850806528] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e002a040 con 0x560339919eb0 2024-09-21T08:51:58.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.209+0000 7f64ebf17800 20 remove_watcher() i=4 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.209+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571850810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603399275f0 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.210+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94571850810496] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.210+0000 7f64ebf17800 20 remove_watcher() i=5 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.210+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571850802784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56033992b500 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.211+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94571850802784] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.211+0000 7f64ebf17800 20 remove_watcher() i=6 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.211+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571850808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603399275f0 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ea20c640 1 -- 172.21.15.196:0/4285351136 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94571850808832] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e4033030 con 0x56033991e7c0 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 20 remove_watcher() i=7 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56033991e7c0 msgr2=0x560339920bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56033991e7c0 0x560339920bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560339919eb0 msgr2=0x56033991c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560339919eb0 0x56033991c370 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f64dc078070 msgr2=0x7f64dc08f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f64dc078070 0x7f64dc08f670 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560339923350 msgr2=0x560339925810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.212+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560339923350 0x560339925810 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63b4036b40 msgr2=0x7f63b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63b4036b40 0x7f63b4039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5603398ebcc0 tx=0x7f64dc092000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 msgr2=0x56033990e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64e920a640 1 -- 172.21.15.196:0/4285351136 reap_dead start 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64e40403c0 tx=0x7f64e404cb30 comp rx=0 tx=0).stop 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 shutdown_connections 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/4285351136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560339906e60 0x56033990e280 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 >> 172.21.15.196:0/4285351136 conn(0x560339903210 msgr2=0x5603399012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 shutdown_connections 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/4285351136 wait complete. 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 msgr2=0x7f63c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 0x7f63c4039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5603398d50f0 tx=0x7f64dc08f220 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 msgr2=0x5603398fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5603398d5580 tx=0x7f64e4018830 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 shutdown_connections 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63c4036b40 0x7f63c4039000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/1074941770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603398fa200 0x5603398fa620 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 >> 172.21.15.196:0/1074941770 conn(0x5603398ef190 msgr2=0x5603398f1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 shutdown_connections 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/1074941770 wait complete. 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 msgr2=0x5603398eb130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 0x5603398eb130 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 msgr2=0x5603398e6500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.213+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 0x5603398e6500 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 msgr2=0x7f63d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 0x7f63d0039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f64e0001e10 tx=0x7f64e0001390 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 msgr2=0x5603398d5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f64dc067040 tx=0x7f64dc002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 shutdown_connections 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5603398e8cc0 0x5603398eb130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5603397e6490 0x5603398e6500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f63d0036b40 0x7f63d0039000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 --2- 172.21.15.196:0/785359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5603397e5b50 0x5603398d5f10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 >> 172.21.15.196:0/785359458 conn(0x5603397e0550 msgr2=0x5603398cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 shutdown_connections 2024-09-21T08:51:58.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.214+0000 7f64ebf17800 1 -- 172.21.15.196:0/785359458 wait complete. 2024-09-21T08:51:58.225 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': '3eni8qFkaJGtWOhb8lA5fdBGXUG2HFiXgOSm236J', 'active': True, 'create_date': '2024-09-21T08:51:58.201005Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.225 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-21T08:51:58.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-21T08:51:58.225 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-21T08:51:58.273 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.273 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.271+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.271+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae5232800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a414c9a630 0x55a414d2b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae5232800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a414be5b30 con 0x55a414d2bbd0 2024-09-21T08:51:58.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae5232800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a414bc7360 con 0x55a414c9a630 2024-09-21T08:51:58.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae054b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a414c9a630 0x55a414d2b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae054b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a414c9a630 0x55a414d2b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34520/0 (socket says 172.21.15.196:34520) 2024-09-21T08:51:58.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae054b640 1 -- 172.21.15.196:0/2394387795 learned_addr learned my addr 172.21.15.196:0/2394387795 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6adfd4a640 1 --1- 172.21.15.196:0/2394387795 >> v1:172.21.15.29:6789/0 conn(0x55a414d2bbd0 0x55a414d2dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46890/0 (socket says 172.21.15.196:46890) 2024-09-21T08:51:58.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae054b640 1 -- 172.21.15.196:0/2394387795 >> v1:172.21.15.29:6789/0 conn(0x55a414d2bbd0 legacy=0x55a414d2dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.272+0000 7f6ae054b640 1 -- 172.21.15.196:0/2394387795 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414bede00 con 0x55a414c9a630 2024-09-21T08:51:58.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.274+0000 7f6ae054b640 1 --2- 172.21.15.196:0/2394387795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414d2b690 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005fd0 tx=0x7f6ad0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb48baaf3a914710 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.274+0000 7f6adf549640 1 -- 172.21.15.196:0/2394387795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad004e600 con 0x55a414c9a630 2024-09-21T08:51:58.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.274+0000 7f6adf549640 1 -- 172.21.15.196:0/2394387795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad004e7a0 con 0x55a414c9a630 2024-09-21T08:51:58.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.274+0000 7f6adf549640 1 -- 172.21.15.196:0/2394387795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad004eaa0 con 0x55a414c9a630 2024-09-21T08:51:58.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 -- 172.21.15.196:0/2394387795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 msgr2=0x55a414d2b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 --2- 172.21.15.196:0/2394387795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414d2b690 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0005fd0 tx=0x7f6ad0045cf0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 -- 172.21.15.196:0/2394387795 shutdown_connections 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 --2- 172.21.15.196:0/2394387795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414d2b690 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 -- 172.21.15.196:0/2394387795 >> 172.21.15.196:0/2394387795 conn(0x55a414d20e00 msgr2=0x55a414d23220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 -- 172.21.15.196:0/2394387795 shutdown_connections 2024-09-21T08:51:58.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.275+0000 7f6ae5232800 1 -- 172.21.15.196:0/2394387795 wait complete. 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.288+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae5232800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae5232800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a414c72350 con 0x55a414c9a630 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae054b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae054b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34530/0 (socket says 172.21.15.196:34530) 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae054b640 1 -- 172.21.15.196:0/809223482 learned_addr learned my addr 172.21.15.196:0/809223482 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.289+0000 7f6ae054b640 1 -- 172.21.15.196:0/809223482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414bbfbc0 con 0x55a414c9a630 2024-09-21T08:51:58.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f6ae054b640 1 --2- 172.21.15.196:0/809223482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0045d30 tx=0x7f6ad0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f785394ae430 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f69ce60c640 1 -- 172.21.15.196:0/809223482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad004eb40 con 0x55a414c9a630 2024-09-21T08:51:58.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f69ce60c640 1 -- 172.21.15.196:0/809223482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad005c040 con 0x55a414c9a630 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f69ce60c640 1 -- 172.21.15.196:0/809223482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad004ee10 con 0x55a414c9a630 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f6ae5232800 1 -- 172.21.15.196:0/809223482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 msgr2=0x55a414e17b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.290+0000 7f6ae5232800 1 --2- 172.21.15.196:0/809223482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0045d30 tx=0x7f6ad0050000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- 172.21.15.196:0/809223482 shutdown_connections 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 --2- 172.21.15.196:0/809223482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e17b20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- 172.21.15.196:0/809223482 >> 172.21.15.196:0/809223482 conn(0x55a414d20e00 msgr2=0x55a414e134e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- 172.21.15.196:0/809223482 shutdown_connections 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- 172.21.15.196:0/809223482 wait complete. 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae5232800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a414d2f9b0 con 0x55a414c9a630 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae054b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae054b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34540/0 (socket says 172.21.15.196:34540) 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae054b640 1 -- 172.21.15.196:0/46229926 learned_addr learned my addr 172.21.15.196:0/46229926 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.291+0000 7f6ae054b640 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414bd3fe0 con 0x55a414c9a630 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f6ae054b640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0045d30 tx=0x7f6ad0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f69cce09640 1 -- 172.21.15.196:0/46229926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0061420 con 0x55a414c9a630 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f69cce09640 1 -- 172.21.15.196:0/46229926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad0070070 con 0x55a414c9a630 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a414e1f8e0 con 0x55a414c9a630 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f69cce09640 1 -- 172.21.15.196:0/46229926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad00616f0 con 0x55a414c9a630 2024-09-21T08:51:58.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.292+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a414e1fe00 con 0x55a414c9a630 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f69cce09640 1 -- 172.21.15.196:0/46229926 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad00618e0 con 0x55a414c9a630 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f69cce09640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 0x7f69c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f69cce09640 1 -- 172.21.15.196:0/46229926 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ad0066070 con 0x55a414c9a630 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 0x7f69c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 0x55a414e26410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e26990 con 0x55a414d2bbd0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 0x55a414e26410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 0x7f69c8039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4000f60 tx=0x7f6ad4001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.293+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 0x55a414e26410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/46229926 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad80083e0 con 0x55a414d2bbd0 2024-09-21T08:51:58.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e239a0 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/46229926 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ad80083e0 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 0x55a414e2b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e2b760 con 0x55a414e28ca0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.294+0000 7f6ae054b640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 0x55a414e2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae054b640 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 0x55a414e2b090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae054b640 1 -- 172.21.15.196:0/46229926 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e28ca0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e27b40 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/46229926 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ad80083e0 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e27fa0 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.295+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/46229926 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ad80083e0 con 0x55a414d2bbd0 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae5232800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae5232800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a414bc1580 con 0x55a414e3a100 2024-09-21T08:51:58.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34550/0 (socket says 172.21.15.196:34550) 2024-09-21T08:51:58.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/708314510 learned_addr learned my addr 172.21.15.196:0/708314510 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.296+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/708314510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414e3aa60 con 0x55a414e3a100 2024-09-21T08:51:58.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55a414e20450 tx=0x7f6ad800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f69c5ffb640 1 -- 172.21.15.196:0/708314510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad8007d00 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f69c5ffb640 1 -- 172.21.15.196:0/708314510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad801e020 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a414e3acf0 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f69c5ffb640 1 -- 172.21.15.196:0/708314510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad8019420 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.297+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a414e3d9d0 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f69c5ffb640 1 -- 172.21.15.196:0/708314510 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad8016040 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f69c5ffb640 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 0x7f69b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f69c5ffb640 1 -- 172.21.15.196:0/708314510 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ad801f030 con 0x55a414e3a100 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae054b640 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 0x7f69b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae054b640 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 0x7f69b8039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a414e26dd0 tx=0x7f6ad0046130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae5232800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae5232800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a414e18210 con 0x55a414e46cc0 2024-09-21T08:51:58.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34552/0 (socket says 172.21.15.196:34552) 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.298+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/2169678226 learned_addr learned my addr 172.21.15.196:0/2169678226 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/2169678226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414e47690 con 0x55a414e46cc0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/2169678226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6ad804cf20 tx=0x7f6ad8017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95027aa757a71a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f69bf7fe640 1 -- 172.21.15.196:0/2169678226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad801d030 con 0x55a414e46cc0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f69bf7fe640 1 -- 172.21.15.196:0/2169678226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8015d00 con 0x55a414e46cc0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f69bf7fe640 1 -- 172.21.15.196:0/2169678226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad80197f0 con 0x55a414e46cc0 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 -- 172.21.15.196:0/2169678226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 msgr2=0x55a414e470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 --2- 172.21.15.196:0/2169678226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6ad804cf20 tx=0x7f6ad8017fa0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 -- 172.21.15.196:0/2169678226 shutdown_connections 2024-09-21T08:51:58.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 --2- 172.21.15.196:0/2169678226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e470c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 -- 172.21.15.196:0/2169678226 >> 172.21.15.196:0/2169678226 conn(0x55a414e430b0 msgr2=0x55a414e411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 -- 172.21.15.196:0/2169678226 shutdown_connections 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.299+0000 7f6ae5232800 1 -- 172.21.15.196:0/2169678226 wait complete. 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae5232800 1 Processor -- start 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae5232800 1 -- start start 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae5232800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae5232800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a414e47ca0 con 0x55a414e46cc0 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae0d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34566/0 (socket says 172.21.15.196:34566) 2024-09-21T08:51:58.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 learned_addr learned my addr 172.21.15.196:0/988325449 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.300+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a414e4e650 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8048010 tx=0x7f6ad804ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f69bdffb640 1 -- 172.21.15.196:0/988325449 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad803b070 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f69bdffb640 1 -- 172.21.15.196:0/988325449 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8019b70 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a414e4e8e0 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f69bdffb640 1 -- 172.21.15.196:0/988325449 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad80179a0 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.301+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a414e51590 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f69bdffb640 1 -- 172.21.15.196:0/988325449 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad80153e0 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f69bdffb640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b0036b40 0x7f69b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f69bdffb640 1 -- 172.21.15.196:0/988325449 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ad8037c30 con 0x55a414e46cc0 2024-09-21T08:51:58.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f6ae054b640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b0036b40 0x7f69b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f6ae054b640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b0036b40 0x7f69b0039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006cfd0 tx=0x7f6ad0081000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.302+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414e59c30 0x55a414e5c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e5c840 con 0x55a414e59c30 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414e59c30 0x55a414e5c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414e59c30 0x55a414e5c0f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad400f610 con 0x55a414e59c30 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 20 realm 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e59080 con 0x55a414e59c30 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad400f610 con 0x55a414e59c30 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.303+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e5d330 con 0x55a414e59c30 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad400f610 con 0x55a414e59c30 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e5dc00 con 0x55a414e59c30 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ad400f610 con 0x55a414e59c30 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e5e620 0x55a414e60a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e61100 con 0x55a414e5e620 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e5e620 0x55a414e60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.304+0000 7f6ae0d4c640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e5e620 0x55a414e60a10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae5232800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae5232800 20 searching for the correct realm 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a414e630d0 0x55a414e65590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae054b640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a414e630d0 0x55a414e65590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae054b640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a414e630d0 0x55a414e65590 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae054b640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ad00a5040 0x7f6ad00630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.305+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ad00a5040 0x7f6ad00630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6adfd4a640 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ad00a5040 0x7f6ad00630d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad400f610 con 0x7f6ad00a5040 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad400f610 con 0x55a414e59c30 2024-09-21T08:51:58.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.306+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.307+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.308+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.309+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.310+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.311+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.312+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e630d0 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e5e620 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.313+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x55a414e59c30 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a414e65c60 con 0x7f6ad00a5040 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e61ac0 con 0x55a414e59c30 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e61700 con 0x55a414e59c30 2024-09-21T08:51:58.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.314+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e62460 con 0x55a414e59c30 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 zone default found 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 4 Realm: () 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 zonegroup default 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e66140 con 0x55a414e5e620 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e68410 con 0x55a414e630d0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.315+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e687b0 con 0x55a414e630d0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae5232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae5232800 20 started sync module instance, tier type = 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae5232800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.316+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e67850 con 0x7f6ad00a5040 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.317+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.317+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94163213647216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e67850 con 0x7f6ad00a5040 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.317+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e691b0 con 0x55a414e59c30 2024-09-21T08:51:58.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.318+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94163213647216] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.318+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.318+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94163213651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e67850 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.318+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e69c70 con 0x55a414e630d0 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.319+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94163213651136] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.319+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.319+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94163213644704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e677c0 con 0x55a414e630d0 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.319+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6ab30 con 0x7f6ad00a5040 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.320+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.320+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94163213658208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6b2f0 con 0x7f6ad00a5040 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.320+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6be10 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.320+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94163213644704] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.321+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.321+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94163213662432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6bdd0 con 0x55a414e59c30 2024-09-21T08:51:58.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.321+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6c820 con 0x55a414e5e620 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.321+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94163213658208] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.322+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.322+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94163213662432] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.322+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94163213659456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6c820 con 0x55a414e5e620 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.322+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6a060 con 0x55a414e5e620 2024-09-21T08:51:58.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.323+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94163213659456] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.323+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.323+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94163213665136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6c790 con 0x55a414e5e620 2024-09-21T08:51:58.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.323+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6d850 con 0x55a414e5e620 2024-09-21T08:51:58.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.324+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94163213669280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6dc70 con 0x55a414e5e620 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=0 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94163213665136] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=1 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=2 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=3 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=4 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=5 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=6 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94163213669280] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 20 add_watcher() i=7 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.325+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6dc70 con 0x55a414e59c30 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.326+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.326+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94163213670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414e6dc10 con 0x55a414e59c30 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94163213670336] v34'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f69967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6ae5232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6ae5232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6ae5232800 5 note: GC not initialized 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f69957e2640 20 reqs_thread_entry: start 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6ae5232800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6ae5232800 20 Filter name: none 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.327+0000 7f6906ffd640 20 reqs_thread_entry: start 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea4050 con 0x55a414e59c30 2024-09-21T08:51:58.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T08:51:58.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:58.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:58.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.328+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414eaa850 con 0x55a414e59c30 2024-09-21T08:51:58.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6ae5232800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6ae5232800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6ae5232800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:58.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94163213918736 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea5ed0 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94163213662432 notify 146028888070 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f6ad4018040 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f69bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94163213662432 notifier 4377 bl.length()=732 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f69bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f69bf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94163213918736 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.329+0000 7f69bf7fe640 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f69a4003ea0 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.330+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.330+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94163213918736 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6ad4009050 con 0x55a414e59c30 2024-09-21T08:51:58.342 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.331+0000 7f69967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.331+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94163213670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea5a20 con 0x55a414e59c30 2024-09-21T08:51:58.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.331+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94163213670336] v34'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.331+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94163213647216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x7f6ad00a5040 2024-09-21T08:51:58.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.332+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94163213647216] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.332+0000 7f6ae5232800 20 remove_watcher() i=0 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.332+0000 7f6ae5232800 2 removed watcher, disabling cache 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.332+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94163213651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e59c30 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.334+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94163213651136] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.334+0000 7f6ae5232800 20 remove_watcher() i=1 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.334+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94163213644704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e630d0 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.335+0000 7f6ae054b640 1 -- 172.21.15.196:0/988325449 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94163213644704] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad007c070 con 0x55a414e630d0 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.335+0000 7f6ae5232800 20 remove_watcher() i=2 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.335+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94163213658208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x7f6ad00a5040 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.336+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94163213658208] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x7f6ad00a5040 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.336+0000 7f6ae5232800 20 remove_watcher() i=3 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.336+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94163213662432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e59c30 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.337+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94163213662432] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad402b040 con 0x55a414e59c30 2024-09-21T08:51:58.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.337+0000 7f6ae5232800 20 remove_watcher() i=4 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.337+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94163213659456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.338+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94163213659456] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.338+0000 7f6ae5232800 20 remove_watcher() i=5 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.338+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94163213665136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.339+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94163213665136] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.339+0000 7f6ae5232800 20 remove_watcher() i=6 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.339+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94163213669280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a414ea1d60 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae0d4c640 1 -- 172.21.15.196:0/988325449 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94163213669280] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad802a070 con 0x55a414e5e620 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 20 remove_watcher() i=7 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e5e620 msgr2=0x55a414e60a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e5e620 0x55a414e60a10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414e59c30 msgr2=0x55a414e5c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414e59c30 0x55a414e5c0f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ad00a5040 msgr2=0x7f6ad00630d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ad00a5040 0x7f6ad00630d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a414e630d0 msgr2=0x55a414e65590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a414e630d0 0x55a414e65590 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b0036b40 msgr2=0x7f69b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b0036b40 0x7f69b0039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006cfd0 tx=0x7f6ad0081000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6adfd4a640 1 -- 172.21.15.196:0/988325449 reap_dead start 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 msgr2=0x55a414e4e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8048010 tx=0x7f6ad804ce80 comp rx=0 tx=0).stop 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 shutdown_connections 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 --2- 172.21.15.196:0/988325449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e46cc0 0x55a414e4e110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 >> 172.21.15.196:0/988325449 conn(0x55a414e430b0 msgr2=0x55a414e48410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 shutdown_connections 2024-09-21T08:51:58.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.340+0000 7f6ae5232800 1 -- 172.21.15.196:0/988325449 wait complete. 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 msgr2=0x7f69b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 0x7f69b8039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a414e26dd0 tx=0x7f6ad0046130 comp rx=0 tx=0).stop 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 msgr2=0x55a414e3a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55a414e20450 tx=0x7f6ad800aec0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 shutdown_connections 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69b8036b40 0x7f69b8039000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/708314510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414e3a100 0x55a414e3a520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 >> 172.21.15.196:0/708314510 conn(0x55a414e2f090 msgr2=0x55a414e31c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 shutdown_connections 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/708314510 wait complete. 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 msgr2=0x55a414e2b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 0x55a414e2b090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 msgr2=0x55a414e26410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.351 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 0x55a414e26410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 msgr2=0x7f69c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 0x7f69c8039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4000f60 tx=0x7f6ad4001370 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 msgr2=0x55a414e1f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0045d30 tx=0x7f6ad0003330 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 shutdown_connections 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a414e28ca0 0x55a414e2b090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a414d2bbd0 0x55a414e26410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f69c8036b40 0x7f69c8039000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 --2- 172.21.15.196:0/46229926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a414c9a630 0x55a414e1f3a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 >> 172.21.15.196:0/46229926 conn(0x55a414d20e00 msgr2=0x55a414e11d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 shutdown_connections 2024-09-21T08:51:58.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.341+0000 7f6ae5232800 1 -- 172.21.15.196:0/46229926 wait complete. 2024-09-21T08:51:58.353 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.354 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:58.397 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.398 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f4586230800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556a85847610 0x556a858d6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f4586230800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a85792b30 con 0x556a858d67b0 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f4586230800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556a85774360 con 0x556a85847610 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f458154b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556a85847610 0x556a858d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f457bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556a858d67b0 0x556a858d8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46892/0 (socket says 172.21.15.196:46892) 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.396+0000 7f457bfff640 1 -- 172.21.15.196:0/2384778746 learned_addr learned my addr 172.21.15.196:0/2384778746 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.397+0000 7f458154b640 1 -- 172.21.15.196:0/2384778746 >> v1:172.21.15.29:6789/0 conn(0x556a858d67b0 legacy=0x556a858d8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.397+0000 7f458154b640 1 -- 172.21.15.196:0/2384778746 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8579ae00 con 0x556a85847610 2024-09-21T08:51:58.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.398+0000 7f458154b640 1 --2- 172.21.15.196:0/2384778746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a858d6270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f457400a470 tx=0x7f4574045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfe922e9067d333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.398+0000 7f4580d4a640 1 -- 172.21.15.196:0/2384778746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4574053570 con 0x556a85847610 2024-09-21T08:51:58.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.398+0000 7f4580d4a640 1 -- 172.21.15.196:0/2384778746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4574058070 con 0x556a85847610 2024-09-21T08:51:58.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.398+0000 7f4580d4a640 1 -- 172.21.15.196:0/2384778746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4574053880 con 0x556a85847610 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 -- 172.21.15.196:0/2384778746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 msgr2=0x556a858d6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 --2- 172.21.15.196:0/2384778746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a858d6270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f457400a470 tx=0x7f4574045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 -- 172.21.15.196:0/2384778746 shutdown_connections 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 --2- 172.21.15.196:0/2384778746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a858d6270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 -- 172.21.15.196:0/2384778746 >> 172.21.15.196:0/2384778746 conn(0x556a858cdde0 msgr2=0x556a858d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 -- 172.21.15.196:0/2384778746 shutdown_connections 2024-09-21T08:51:58.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.399+0000 7f4586230800 1 -- 172.21.15.196:0/2384778746 wait complete. 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f4586230800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f4586230800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556a8581f330 con 0x556a85847610 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f458154b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f458154b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34570/0 (socket says 172.21.15.196:34570) 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.413+0000 7f458154b640 1 -- 172.21.15.196:0/2580342002 learned_addr learned my addr 172.21.15.196:0/2580342002 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.414+0000 7f458154b640 1 -- 172.21.15.196:0/2580342002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8576cbc0 con 0x556a85847610 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.414+0000 7f458154b640 1 --2- 172.21.15.196:0/2580342002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4574025c20 tx=0x7f4574051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b6ef4fa1593342 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.414+0000 7f446f606640 1 -- 172.21.15.196:0/2580342002 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457405c580 con 0x556a85847610 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.414+0000 7f446f606640 1 -- 172.21.15.196:0/2580342002 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4574063030 con 0x556a85847610 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.414+0000 7f446f606640 1 -- 172.21.15.196:0/2580342002 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457405c850 con 0x556a85847610 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- 172.21.15.196:0/2580342002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 msgr2=0x556a859c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 --2- 172.21.15.196:0/2580342002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4574025c20 tx=0x7f4574051000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- 172.21.15.196:0/2580342002 shutdown_connections 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 --2- 172.21.15.196:0/2580342002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859c2880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- 172.21.15.196:0/2580342002 >> 172.21.15.196:0/2580342002 conn(0x556a858cdde0 msgr2=0x556a859be240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- 172.21.15.196:0/2580342002 shutdown_connections 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- 172.21.15.196:0/2580342002 wait complete. 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.415+0000 7f4586230800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556a858da680 con 0x556a85847610 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f458154b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f458154b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34576/0 (socket says 172.21.15.196:34576) 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f458154b640 1 -- 172.21.15.196:0/1037081123 learned_addr learned my addr 172.21.15.196:0/1037081123 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f458154b640 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a85780fe0 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f458154b640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556a859c36e0 tx=0x7f4574002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f446de03640 1 -- 172.21.15.196:0/1037081123 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4574054ad0 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f446de03640 1 -- 172.21.15.196:0/1037081123 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4574054c70 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a859ca740 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f446de03640 1 -- 172.21.15.196:0/1037081123 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4574068420 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.416+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a859cac60 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f446de03640 1 -- 172.21.15.196:0/1037081123 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f45740685c0 con 0x556a85847610 2024-09-21T08:51:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f446de03640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 0x7f4468039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f446de03640 1 -- 172.21.15.196:0/1037081123 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4574070030 con 0x556a85847610 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f457bfff640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 0x7f4468039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 0x556a859d1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.417+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a859d1840 con 0x556a858d67b0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 0x556a859d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f457bfff640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 0x7f4468039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f456c000f60 tx=0x7f456c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 0x556a859d1270 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4581d4c640 1 -- 172.21.15.196:0/1037081123 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f457c00a4a0 con 0x556a858d67b0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a859ce840 con 0x556a858d67b0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4581d4c640 1 -- 172.21.15.196:0/1037081123 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f457c00a4a0 con 0x556a858d67b0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 0x556a859d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.418+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a859d6680 con 0x556a859d3ba0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.419+0000 7f458154b640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 0x556a859d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.419+0000 7f458154b640 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 0x556a859d5f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.419+0000 7f458154b640 1 -- 172.21.15.196:0/1037081123 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4574051070 con 0x556a859d3ba0 2024-09-21T08:51:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.419+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a859d2a40 con 0x556a858d67b0 2024-09-21T08:51:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4581d4c640 1 -- 172.21.15.196:0/1037081123 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f457c00a4a0 con 0x556a858d67b0 2024-09-21T08:51:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a859d2ea0 con 0x556a858d67b0 2024-09-21T08:51:58.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4581d4c640 1 -- 172.21.15.196:0/1037081123 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f457c00a4a0 con 0x556a858d67b0 2024-09-21T08:51:58.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4586230800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4586230800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556a8576e580 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.420+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34582/0 (socket says 172.21.15.196:34582) 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4581d4c640 1 -- 172.21.15.196:0/1712757004 learned_addr learned my addr 172.21.15.196:0/1712757004 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4581d4c640 1 -- 172.21.15.196:0/1712757004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a859e5900 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556a859d1c00 tx=0x7f457c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4466ffd640 1 -- 172.21.15.196:0/1712757004 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c014450 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4466ffd640 1 -- 172.21.15.196:0/1712757004 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457c014610 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a859e5b90 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4466ffd640 1 -- 172.21.15.196:0/1712757004 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c014930 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.421+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a859e8870 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f4466ffd640 1 -- 172.21.15.196:0/1712757004 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f457c011040 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f4466ffd640 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 0x7f4458039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f4466ffd640 1 -- 172.21.15.196:0/1712757004 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f457c01e070 con 0x556a859e4fa0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f458154b640 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 0x7f4458039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.422+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f458154b640 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 0x7f4458039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x556a859d1cf0 tx=0x7f4574060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4586230800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4586230800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556a859c2fd0 con 0x556a859f1c70 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34598/0 (socket says 172.21.15.196:34598) 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4581d4c640 1 -- 172.21.15.196:0/677719827 learned_addr learned my addr 172.21.15.196:0/677719827 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4581d4c640 1 -- 172.21.15.196:0/677719827 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a859f2640 con 0x556a859f1c70 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.423+0000 7f4581d4c640 1 --2- 172.21.15.196:0/677719827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f457c04ce70 tx=0x7f457c04cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fa43228ab4c6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4464ff9640 1 -- 172.21.15.196:0/677719827 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c0113f0 con 0x556a859f1c70 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4464ff9640 1 -- 172.21.15.196:0/677719827 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457c042070 con 0x556a859f1c70 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4464ff9640 1 -- 172.21.15.196:0/677719827 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c013da0 con 0x556a859f1c70 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- 172.21.15.196:0/677719827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 msgr2=0x556a859f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 --2- 172.21.15.196:0/677719827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f457c04ce70 tx=0x7f457c04cf60 comp rx=0 tx=0).stop 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- 172.21.15.196:0/677719827 shutdown_connections 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 --2- 172.21.15.196:0/677719827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f2070 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- 172.21.15.196:0/677719827 >> 172.21.15.196:0/677719827 conn(0x556a859edfd0 msgr2=0x556a859ec0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- 172.21.15.196:0/677719827 shutdown_connections 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- 172.21.15.196:0/677719827 wait complete. 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 Processor -- start 2024-09-21T08:51:58.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- start start 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.424+0000 7f4586230800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556a859f2cf0 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4581d4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34604/0 (socket says 172.21.15.196:34604) 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 learned_addr learned my addr 172.21.15.196:0/1416958396 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a859f9690 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f9150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f457c04cfa0 tx=0x7f457c04cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4456ffd640 1 -- 172.21.15.196:0/1416958396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c0113f0 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4456ffd640 1 -- 172.21.15.196:0/1416958396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457c04e050 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a859f9920 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.425+0000 7f4456ffd640 1 -- 172.21.15.196:0/1416958396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457c04e370 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.426+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a859fc5d0 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.426+0000 7f4456ffd640 1 -- 172.21.15.196:0/1416958396 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f457c036030 con 0x556a859f1c70 2024-09-21T08:51:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.426+0000 7f4456ffd640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f444c036b40 0x7f444c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.426+0000 7f4456ffd640 1 -- 172.21.15.196:0/1416958396 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f457c034070 con 0x556a859f1c70 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f458154b640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f444c036b40 0x7f444c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a85a04db0 0x556a85a07270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a079c0 con 0x556a85a04db0 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f457bfff640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a85a04db0 0x556a85a07270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f458154b640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f444c036b40 0x7f444c039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f457408f110 tx=0x7f4574091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f457bfff640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a85a04db0 0x556a85a07270 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f456c009050 con 0x556a85a04db0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 20 realm 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.427+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a04200 con 0x556a85a04db0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f456c009050 con 0x556a85a04db0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a084a0 con 0x556a85a04db0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f456c009050 con 0x556a85a04db0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a08d70 con 0x556a85a04db0 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f456c009050 con 0x556a85a04db0 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a85a09620 0x556a85a0ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a0c150 con 0x556a85a09620 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.428+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a85a09620 0x556a85a0ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4581d4c640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a85a09620 0x556a85a0ba10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4586230800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4586230800 20 searching for the correct realm 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556a85a0e200 0x556a85a106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f458154b640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556a85a0e200 0x556a85a106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.429+0000 7f458154b640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556a85a0e200 0x556a85a106c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f458154b640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f457405c070 0x7f4574090450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f457bfff640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f457405c070 0x7f4574090450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f457bfff640 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f457405c070 0x7f4574090450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c009050 con 0x7f457405c070 2024-09-21T08:51:58.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.430+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c009050 con 0x556a85a04db0 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.431+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x7f457405c070 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.432+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f456c029040 con 0x7f457405c070 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.433+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.434+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.435+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x7f457405c070 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.436+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x7f457405c070 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a0e200 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a09620 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.437+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x556a85a04db0 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a85a10d90 con 0x7f457405c070 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f456c029040 con 0x7f457405c070 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a0cc30 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a0d0b0 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f456c029040 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.438+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a0d550 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 zone default found 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 4 Realm: () 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 zonegroup default 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a11210 con 0x556a85a09620 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a13440 con 0x556a85a0e200 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a137e0 con 0x556a85a0e200 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 started sync module instance, tier type = 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.439+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a12880 con 0x7f457405c070 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.440+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.440+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93915996826736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a12880 con 0x7f457405c070 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.440+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a141a0 con 0x556a85a04db0 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.442+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.442+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93915996826736] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.442+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93915996830960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a14600 con 0x556a85a04db0 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.442+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a14bc0 con 0x556a85a0e200 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.443+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93915996830960] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.443+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.443+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93915996824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a14fb0 con 0x556a85a0e200 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.443+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a15970 con 0x7f457405c070 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.444+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.444+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93915996824528] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.444+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93915996837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a16210 con 0x7f457405c070 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.444+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a14150 con 0x556a85a04db0 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.445+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.445+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93915996841888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a14150 con 0x556a85a04db0 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.445+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93915996837568] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.445+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a15d60 con 0x556a85a09620 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.446+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93915996841888] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.447+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.447+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93915996842944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a17690 con 0x556a85a09620 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.447+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a17f20 con 0x556a85a09620 2024-09-21T08:51:58.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.447+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93915996842944] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93915996844512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a17e50 con 0x556a85a09620 2024-09-21T08:51:58.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a18970 con 0x556a85a09620 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93915996849216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a18de0 con 0x556a85a09620 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.448+0000 7f4586230800 20 add_watcher() i=0 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=1 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=2 2024-09-21T08:51:58.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=3 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=4 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=5 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93915996844512] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=6 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93915996849216] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 20 add_watcher() i=7 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.449+0000 7f4586230800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.450+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a18de0 con 0x556a85a04db0 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.450+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.450+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93915996850480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a18d90 con 0x556a85a04db0 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93915996850480] v34'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f44377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f4586230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f4586230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f4586230800 5 note: GC not initialized 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f44367e4640 20 reqs_thread_entry: start 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f4586230800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f4586230800 20 Filter name: none 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.451+0000 7f43a7fff640 20 reqs_thread_entry: start 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.452+0000 7f4586230800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.452+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a85a4ed60 con 0x556a85a04db0 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.452+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.452+0000 7f4586230800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T08:51:58.464 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.453+0000 7f44377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.453+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93915996850480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a4d7b0 con 0x556a85a04db0 2024-09-21T08:51:58.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.454+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93915996850480] v34'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.454+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93915996826736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a18930 con 0x7f457405c070 2024-09-21T08:51:58.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.455+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93915996826736] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.455+0000 7f4586230800 20 remove_watcher() i=0 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.455+0000 7f4586230800 2 removed watcher, disabling cache 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.455+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93915996830960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a12c70 con 0x556a85a04db0 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.456+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93915996830960] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.456+0000 7f4586230800 20 remove_watcher() i=1 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.456+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93915996824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a12c70 con 0x556a85a0e200 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.457+0000 7f458154b640 1 -- 172.21.15.196:0/1416958396 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93915996824528] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4574051070 con 0x556a85a0e200 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.457+0000 7f4586230800 20 remove_watcher() i=2 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.457+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93915996837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a123d0 con 0x7f457405c070 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.458+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93915996837568] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x7f457405c070 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.458+0000 7f4586230800 20 remove_watcher() i=3 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.458+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93915996841888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a123d0 con 0x556a85a04db0 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.459+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93915996841888] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f456c0391c0 con 0x556a85a04db0 2024-09-21T08:51:58.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.459+0000 7f4586230800 20 remove_watcher() i=4 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.459+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93915996842944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a123d0 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.460+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93915996842944] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.460+0000 7f4586230800 20 remove_watcher() i=5 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.460+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93915996844512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a123d0 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.461+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93915996844512] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.461+0000 7f4586230800 20 remove_watcher() i=6 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.461+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93915996849216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a85a16c50 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4581d4c640 1 -- 172.21.15.196:0/1416958396 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93915996849216] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c02a070 con 0x556a85a09620 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 20 remove_watcher() i=7 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a85a09620 msgr2=0x556a85a0ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a85a09620 0x556a85a0ba10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a85a04db0 msgr2=0x556a85a07270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a85a04db0 0x556a85a07270 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f457405c070 msgr2=0x7f4574090450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f457405c070 0x7f4574090450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556a85a0e200 msgr2=0x556a85a106c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556a85a0e200 0x556a85a106c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f444c036b40 msgr2=0x7f444c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f444c036b40 0x7f444c039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f457408f110 tx=0x7f4574091000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 msgr2=0x556a859f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1416958396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859f1c70 0x556a859f9150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f457c04cfa0 tx=0x7f457c04cc10 comp rx=0 tx=0).stop 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 reap_dead start 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f457bfff640 1 -- 172.21.15.196:0/1416958396 reap_dead start 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 shutdown_connections 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 >> 172.21.15.196:0/1416958396 conn(0x556a859edfd0 msgr2=0x556a859ec0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 shutdown_connections 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1416958396 wait complete. 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 msgr2=0x7f4458039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 0x7f4458039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x556a859d1cf0 tx=0x7f4574060ee0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 msgr2=0x556a859e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556a859d1c00 tx=0x7f457c018830 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 shutdown_connections 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4458036b40 0x7f4458039000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 --2- 172.21.15.196:0/1712757004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a859e4fa0 0x556a859e53c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 >> 172.21.15.196:0/1712757004 conn(0x556a859d9f30 msgr2=0x556a859dcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.462+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 shutdown_connections 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1712757004 wait complete. 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 msgr2=0x556a859d5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 0x556a859d5f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 msgr2=0x556a859d1270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 0x556a859d1270 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 msgr2=0x7f4468039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 0x7f4468039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f456c000f60 tx=0x7f456c0012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 msgr2=0x556a859ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556a859c36e0 tx=0x7f4574002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 shutdown_connections 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556a859d3ba0 0x556a859d5f90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556a858d67b0 0x556a859d1270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4468036b40 0x7f4468039000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 --2- 172.21.15.196:0/1037081123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556a85847610 0x556a859ca200 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 >> 172.21.15.196:0/1037081123 conn(0x556a858cdde0 msgr2=0x556a859bcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 shutdown_connections 2024-09-21T08:51:58.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.463+0000 7f4586230800 1 -- 172.21.15.196:0/1037081123 wait complete. 2024-09-21T08:51:58.475 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.475 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:58.520 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.520 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.518+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.518+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.518+0000 7fdaded2e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556e1a1db5f0 0x556e1a26c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.518+0000 7fdaded2e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e1a126b30 con 0x556e1a26cbd0 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.518+0000 7fdaded2e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556e1a108360 con 0x556e1a1db5f0 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.519+0000 7fdadaa5c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556e1a1db5f0 0x556e1a26c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.519+0000 7fdad3fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556e1a26cbd0 0x556e1a26efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46904/0 (socket says 172.21.15.196:46904) 2024-09-21T08:51:58.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.519+0000 7fdad3fff640 1 -- 172.21.15.196:0/357419344 learned_addr learned my addr 172.21.15.196:0/357419344 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:58.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.519+0000 7fdadaa5c640 1 -- 172.21.15.196:0/357419344 >> v1:172.21.15.29:6789/0 conn(0x556e1a26cbd0 legacy=0x556e1a26efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.519+0000 7fdadaa5c640 1 -- 172.21.15.196:0/357419344 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a12ee00 con 0x556e1a1db5f0 2024-09-21T08:51:58.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/357419344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a26c690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00a470 tx=0x7fdacc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73ade7116dae8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdada25b640 1 -- 172.21.15.196:0/357419344 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc053570 con 0x556e1a1db5f0 2024-09-21T08:51:58.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdada25b640 1 -- 172.21.15.196:0/357419344 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc058070 con 0x556e1a1db5f0 2024-09-21T08:51:58.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdada25b640 1 -- 172.21.15.196:0/357419344 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc053880 con 0x556e1a1db5f0 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 -- 172.21.15.196:0/357419344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 msgr2=0x556e1a26c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 --2- 172.21.15.196:0/357419344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a26c690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00a470 tx=0x7fdacc045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 -- 172.21.15.196:0/357419344 shutdown_connections 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 --2- 172.21.15.196:0/357419344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a26c690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 -- 172.21.15.196:0/357419344 >> 172.21.15.196:0/357419344 conn(0x556e1a261de0 msgr2=0x556e1a264200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 -- 172.21.15.196:0/357419344 shutdown_connections 2024-09-21T08:51:58.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.521+0000 7fdaded2e800 1 -- 172.21.15.196:0/357419344 wait complete. 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdaded2e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdaded2e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e1a1b3330 con 0x556e1a1db5f0 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdadaa5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdadaa5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34618/0 (socket says 172.21.15.196:34618) 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.535+0000 7fdadaa5c640 1 -- 172.21.15.196:0/55414087 learned_addr learned my addr 172.21.15.196:0/55414087 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.536+0000 7fdadaa5c640 1 -- 172.21.15.196:0/55414087 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a100bc0 con 0x556e1a1db5f0 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.536+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/55414087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdacc025c20 tx=0x7fdacc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24a1dfb76c827dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.536+0000 7fd9c8e09640 1 -- 172.21.15.196:0/55414087 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc053ba0 con 0x556e1a1db5f0 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.536+0000 7fd9c8e09640 1 -- 172.21.15.196:0/55414087 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc063030 con 0x556e1a1db5f0 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.536+0000 7fd9c8e09640 1 -- 172.21.15.196:0/55414087 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc053440 con 0x556e1a1db5f0 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- 172.21.15.196:0/55414087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 msgr2=0x556e1a358a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 --2- 172.21.15.196:0/55414087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdacc025c20 tx=0x7fdacc051000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- 172.21.15.196:0/55414087 shutdown_connections 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 --2- 172.21.15.196:0/55414087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a358a70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- 172.21.15.196:0/55414087 >> 172.21.15.196:0/55414087 conn(0x556e1a261de0 msgr2=0x556e1a354430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- 172.21.15.196:0/55414087 shutdown_connections 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- 172.21.15.196:0/55414087 wait complete. 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdaded2e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e1a270980 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdadaa5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdadaa5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34630/0 (socket says 172.21.15.196:34630) 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.537+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1182335696 learned_addr learned my addr 172.21.15.196:0/1182335696 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a114fe0 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556e1a3598d0 tx=0x7fdacc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fd9c7606640 1 -- 172.21.15.196:0/1182335696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc078070 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fd9c7606640 1 -- 172.21.15.196:0/1182335696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc053570 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e1a3608b0 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fd9c7606640 1 -- 172.21.15.196:0/1182335696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdacc053850 con 0x556e1a1db5f0 2024-09-21T08:51:58.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.538+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e1a360e30 con 0x556e1a1db5f0 2024-09-21T08:51:58.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fd9c7606640 1 -- 172.21.15.196:0/1182335696 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdacc07b070 con 0x556e1a1db5f0 2024-09-21T08:51:58.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fd9c7606640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 0x7fd9c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fd9c7606640 1 -- 172.21.15.196:0/1182335696 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdacc070070 con 0x556e1a1db5f0 2024-09-21T08:51:58.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 0x7fd9c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 0x556e1a3673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a367a00 con 0x556e1a26cbd0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fdadb25d640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 0x556e1a3673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.539+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 0x7fd9c0039000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000f60 tx=0x7fdac40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdadb25d640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 0x556e1a3673e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdadb25d640 1 -- 172.21.15.196:0/1182335696 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdad400a4a0 con 0x556e1a26cbd0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3649b0 con 0x556e1a26cbd0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdadb25d640 1 -- 172.21.15.196:0/1182335696 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdad400a4a0 con 0x556e1a26cbd0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 0x556e1a36c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a36c830 con 0x556e1a369d50 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.540+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 0x556e1a36c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.541+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 0x556e1a36c140 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.541+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1182335696 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a369d50 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.541+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a368b30 con 0x556e1a26cbd0 2024-09-21T08:51:58.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdadb25d640 1 -- 172.21.15.196:0/1182335696 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdad400a4a0 con 0x556e1a26cbd0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a368fd0 con 0x556e1a26cbd0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdadb25d640 1 -- 172.21.15.196:0/1182335696 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdad400a4a0 con 0x556e1a26cbd0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdaded2e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.542+0000 7fdaded2e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e1a102580 con 0x556e1a37b0d0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34646/0 (socket says 172.21.15.196:34646) 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdadb25d640 1 -- 172.21.15.196:0/2413861739 learned_addr learned my addr 172.21.15.196:0/2413861739 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdadb25d640 1 -- 172.21.15.196:0/2413861739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a37ba30 con 0x556e1a37b0d0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdadb25d640 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x556e1a367e00 tx=0x7fdad4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fd9c4e01640 1 -- 172.21.15.196:0/2413861739 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4014450 con 0x556e1a37b0d0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fd9c4e01640 1 -- 172.21.15.196:0/2413861739 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad4014610 con 0x556e1a37b0d0 2024-09-21T08:51:58.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e1a37bcc0 con 0x556e1a37b0d0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.543+0000 7fd9c4e01640 1 -- 172.21.15.196:0/2413861739 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4014930 con 0x556e1a37b0d0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.544+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e1a37e9a0 con 0x556e1a37b0d0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.544+0000 7fd9c4e01640 1 -- 172.21.15.196:0/2413861739 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdad4011040 con 0x556e1a37b0d0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.544+0000 7fd9c4e01640 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 0x7fd9b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.544+0000 7fd9c4e01640 1 -- 172.21.15.196:0/2413861739 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdad401e070 con 0x556e1a37b0d0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.544+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 0x7fd9b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 0x7fd9b4039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x556e1a367ea0 tx=0x7fdacc08ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdaded2e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdaded2e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e1a3591c0 con 0x556e1a387d80 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34650/0 (socket says 172.21.15.196:34650) 2024-09-21T08:51:58.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdadb25d640 1 -- 172.21.15.196:0/3693026899 learned_addr learned my addr 172.21.15.196:0/3693026899 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.545+0000 7fdadb25d640 1 -- 172.21.15.196:0/3693026899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a388750 con 0x556e1a387d80 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdadb25d640 1 --2- 172.21.15.196:0/3693026899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdad404cbb0 tx=0x7fdad404ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c521c0e3c17986f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fd9be7fc640 1 -- 172.21.15.196:0/3693026899 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4040150 con 0x556e1a387d80 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fd9be7fc640 1 -- 172.21.15.196:0/3693026899 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad4016960 con 0x556e1a387d80 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fd9be7fc640 1 -- 172.21.15.196:0/3693026899 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4016440 con 0x556e1a387d80 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 -- 172.21.15.196:0/3693026899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 msgr2=0x556e1a388180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 --2- 172.21.15.196:0/3693026899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdad404cbb0 tx=0x7fdad404ce60 comp rx=0 tx=0).stop 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 -- 172.21.15.196:0/3693026899 shutdown_connections 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 --2- 172.21.15.196:0/3693026899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a388180 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 -- 172.21.15.196:0/3693026899 >> 172.21.15.196:0/3693026899 conn(0x556e1a3840e0 msgr2=0x556e1a3821e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 -- 172.21.15.196:0/3693026899 shutdown_connections 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 -- 172.21.15.196:0/3693026899 wait complete. 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.546+0000 7fdaded2e800 1 Processor -- start 2024-09-21T08:51:58.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdaded2e800 1 -- start start 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdaded2e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdaded2e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e1a388dc0 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdadb25d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34652/0 (socket says 172.21.15.196:34652) 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 learned_addr learned my addr 172.21.15.196:0/1871313268 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e1a38f770 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdadb25d640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdad403e040 tx=0x7fdad404cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fd9bcff9640 1 -- 172.21.15.196:0/1871313268 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4011c00 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fd9bcff9640 1 -- 172.21.15.196:0/1871313268 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad4031030 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e1a38fa00 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fd9bcff9640 1 -- 172.21.15.196:0/1871313268 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad4011720 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.547+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e1a3926b0 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.548+0000 7fd9bcff9640 1 -- 172.21.15.196:0/1871313268 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdad4014b20 con 0x556e1a387d80 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.548+0000 7fd9bcff9640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9a4036b40 0x7fd9a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.548+0000 7fd9bcff9640 1 -- 172.21.15.196:0/1871313268 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdad400e040 con 0x556e1a387d80 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9a4036b40 0x7fd9a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a39ae10 0x556e1a39d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a39da20 con 0x556e1a39ae10 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a39ae10 0x556e1a39d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9a4036b40 0x7fd9a4039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdacc05ffd0 tx=0x7fdacc093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.549+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a39ae10 0x556e1a39d2d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdac4009050 con 0x556e1a39ae10 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 realm 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a39a260 con 0x556e1a39ae10 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdac4009050 con 0x556e1a39ae10 2024-09-21T08:51:58.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a39e500 con 0x556e1a39ae10 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdac4009050 con 0x556e1a39ae10 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a39edd0 con 0x556e1a39ae10 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdac4009050 con 0x556e1a39ae10 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a39f680 0x556e1a3a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.550+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a21b0 con 0x556e1a39f680 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdadb25d640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a39f680 0x556e1a3a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdadb25d640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a39f680 0x556e1a3a1a70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdaded2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdaded2e800 20 searching for the correct realm 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e1a3a4260 0x556e1a3a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.551+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e1a3a4260 0x556e1a3a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e1a3a4260 0x556e1a3a6720 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdadaa5c640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fdacc07d060 0x7fdacc0908f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fdacc07d060 0x7fdacc0908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdad3fff640 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fdacc07d060 0x7fdacc0908f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4009050 con 0x7fdacc07d060 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.552+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4009050 con 0x556e1a39ae10 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.553+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x7fdacc07d060 2024-09-21T08:51:58.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.554+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdac4029040 con 0x7fdacc07d060 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.555+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.556+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.557+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x7fdacc07d060 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.558+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x7fdacc07d060 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a3a4260 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.559+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39f680 2024-09-21T08:51:58.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x556e1a39ae10 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a6df0 con 0x7fdacc07d060 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdac4029040 con 0x7fdacc07d060 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a2c60 con 0x556e1a39ae10 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.560+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a30e0 con 0x556e1a39ae10 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdac4029040 con 0x556e1a39ae10 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a3580 con 0x556e1a39ae10 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 zone default found 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 4 Realm: () 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 zonegroup default 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a7270 con 0x556e1a39f680 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a94a0 con 0x556e1a3a4260 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.561+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a9840 con 0x556e1a3a4260 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 20 started sync module instance, tier type = 2024-09-21T08:51:58.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.562+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a88e0 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.563+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.563+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931374808272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a88e0 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.563+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aa200 con 0x556e1a39ae10 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.564+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93931374808272] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.564+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.564+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931374806544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aa200 con 0x556e1a39ae10 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.564+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aabc0 con 0x556e1a3a4260 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.565+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.565+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931374814992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ab460 con 0x556e1a3a4260 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.565+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3abf00 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.565+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93931374806544] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.566+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93931374814992] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.566+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.566+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931374817200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a9d50 con 0x7fdacc07d060 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.566+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ac7a0 con 0x556e1a39ae10 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.567+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93931374817200] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.567+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.567+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931374819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ac750 con 0x556e1a39ae10 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.567+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ad150 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.568+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93931374819792] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.569+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.569+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931374822048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ac6c0 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.569+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae010 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.570+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93931374822048] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.570+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.570+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931374826816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae010 con 0x556e1a39f680 2024-09-21T08:51:58.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.570+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aea10 con 0x556e1a39f680 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931374830880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aee30 con 0x556e1a39f680 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=0 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=1 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=2 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=3 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=4 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=5 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93931374826816] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.571+0000 7fdaded2e800 20 add_watcher() i=6 2024-09-21T08:51:58.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93931374830880] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdaded2e800 20 add_watcher() i=7 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdaded2e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3adbb0 con 0x556e1a39ae10 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.572+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931374831936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3af7f0 con 0x556e1a39ae10 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.573+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93931374831936] v34'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.573+0000 7fd9917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.573+0000 7fdaded2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.573+0000 7fdaded2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.573+0000 7fdaded2e800 5 note: GC not initialized 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fd90bfff640 20 reqs_thread_entry: start 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdaded2e800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdaded2e800 20 Filter name: none 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fd909ffb640 20 reqs_thread_entry: start 2024-09-21T08:51:58.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdaded2e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3e4f60 con 0x556e1a39ae10 2024-09-21T08:51:58.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.574+0000 7fdaded2e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T08:51:58.586 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.575+0000 7fd9917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.575+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931374831936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3e39b0 con 0x556e1a39ae10 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.576+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93931374831936] v34'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.576+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931374808272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae940 con 0x7fdacc07d060 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.577+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93931374808272] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.577+0000 7fdaded2e800 20 remove_watcher() i=0 2024-09-21T08:51:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.577+0000 7fdaded2e800 2 removed watcher, disabling cache 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.577+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931374806544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae940 con 0x556e1a39ae10 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.578+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93931374806544] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.578+0000 7fdaded2e800 20 remove_watcher() i=1 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.578+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931374814992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3a8610 con 0x556e1a3a4260 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.579+0000 7fdadaa5c640 1 -- 172.21.15.196:0/1871313268 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93931374814992] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdacc07a030 con 0x556e1a3a4260 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.579+0000 7fdaded2e800 20 remove_watcher() i=2 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.579+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931374817200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae940 con 0x7fdacc07d060 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.580+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93931374817200] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x7fdacc07d060 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.580+0000 7fdaded2e800 20 remove_watcher() i=3 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.580+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931374819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aa710 con 0x556e1a39ae10 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.581+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93931374819792] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdac40391c0 con 0x556e1a39ae10 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.581+0000 7fdaded2e800 20 remove_watcher() i=4 2024-09-21T08:51:58.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.581+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931374822048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aafb0 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.582+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93931374822048] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.582+0000 7fdaded2e800 20 remove_watcher() i=5 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.582+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931374826816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3ae940 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.583+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93931374826816] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.583+0000 7fdaded2e800 20 remove_watcher() i=6 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.583+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931374830880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e1a3aa710 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdadb25d640 1 -- 172.21.15.196:0/1871313268 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93931374830880] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdad402a070 con 0x556e1a39f680 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 20 remove_watcher() i=7 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a39f680 msgr2=0x556e1a3a1a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a39f680 0x556e1a3a1a70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a39ae10 msgr2=0x556e1a39d2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a39ae10 0x556e1a39d2d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fdacc07d060 msgr2=0x7fdacc0908f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fdacc07d060 0x7fdacc0908f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e1a3a4260 msgr2=0x556e1a3a6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e1a3a4260 0x556e1a3a6720 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9a4036b40 msgr2=0x7fd9a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9a4036b40 0x7fd9a4039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdacc05ffd0 tx=0x7fdacc093000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 msgr2=0x556e1a38f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdad3fff640 1 -- 172.21.15.196:0/1871313268 reap_dead start 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdad403e040 tx=0x7fdad404cb40 comp rx=0 tx=0).stop 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 shutdown_connections 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1871313268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a387d80 0x556e1a38f230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 >> 172.21.15.196:0/1871313268 conn(0x556e1a3840e0 msgr2=0x556e1a3821b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 shutdown_connections 2024-09-21T08:51:58.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.584+0000 7fdaded2e800 1 -- 172.21.15.196:0/1871313268 wait complete. 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 msgr2=0x7fd9b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 0x7fd9b4039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x556e1a367ea0 tx=0x7fdacc08ec10 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 msgr2=0x556e1a37b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x556e1a367e00 tx=0x7fdad4018830 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 shutdown_connections 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9b4036b40 0x7fd9b4039000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/2413861739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a37b0d0 0x556e1a37b4f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 >> 172.21.15.196:0/2413861739 conn(0x556e1a370060 msgr2=0x556e1a372be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 shutdown_connections 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/2413861739 wait complete. 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 msgr2=0x556e1a36c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 0x556e1a36c140 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 msgr2=0x556e1a3673e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 0x556e1a3673e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 msgr2=0x7fd9c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 0x7fd9c0039000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000f60 tx=0x7fdac40012b0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 msgr2=0x556e1a360370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556e1a3598d0 tx=0x7fdacc002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 shutdown_connections 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e1a369d50 0x556e1a36c140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e1a26cbd0 0x556e1a3673e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd9c0036b40 0x7fd9c0039000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 --2- 172.21.15.196:0/1182335696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1a1db5f0 0x556e1a360370 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 >> 172.21.15.196:0/1182335696 conn(0x556e1a261de0 msgr2=0x556e1a352ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 shutdown_connections 2024-09-21T08:51:58.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.585+0000 7fdaded2e800 1 -- 172.21.15.196:0/1182335696 wait complete. 2024-09-21T08:51:58.597 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-21T08:51:58.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-21T08:51:58.598 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-21T08:51:58.645 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.645 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.643+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.643+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f3035887800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f56ba15ac0 0x55f56ba15ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f3035887800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f56b8d5b30 con 0x55f56ba16430 2024-09-21T08:51:58.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f3035887800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f56b8b7360 con 0x55f56ba15ac0 2024-09-21T08:51:58.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f303337b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f56ba15ac0 0x55f56ba15ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f302bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f56ba16430 0x55f56ba1aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46920/0 (socket says 172.21.15.196:46920) 2024-09-21T08:51:58.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f302bfff640 1 -- 172.21.15.196:0/1488253742 learned_addr learned my addr 172.21.15.196:0/1488253742 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:58.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f303337b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f56ba15ac0 0x55f56ba15ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34666/0 (socket says 172.21.15.196:34666) 2024-09-21T08:51:58.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f303337b640 1 -- 172.21.15.196:0/1488253742 >> v1:172.21.15.29:6789/0 conn(0x55f56ba16430 legacy=0x55f56ba1aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f3032b7a640 1 -- 172.21.15.196:0/1488253742 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636515375 0 0) 0x55f56b8d5b30 con 0x55f56ba16430 2024-09-21T08:51:58.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.644+0000 7f303337b640 1 -- 172.21.15.196:0/1488253742 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56b8dde00 con 0x55f56ba15ac0 2024-09-21T08:51:58.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.646+0000 7f303337b640 1 --2- 172.21.15.196:0/1488253742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56ba15ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f302400a600 tx=0x7f3024047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f8b1983ac8311a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.646+0000 7f3032b7a640 1 -- 172.21.15.196:0/1488253742 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024056070 con 0x55f56ba15ac0 2024-09-21T08:51:58.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.646+0000 7f3032b7a640 1 -- 172.21.15.196:0/1488253742 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302400a200 con 0x55f56ba15ac0 2024-09-21T08:51:58.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.646+0000 7f3032b7a640 1 -- 172.21.15.196:0/1488253742 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024008590 con 0x55f56ba15ac0 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 -- 172.21.15.196:0/1488253742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 msgr2=0x55f56ba15ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 --2- 172.21.15.196:0/1488253742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56ba15ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f302400a600 tx=0x7f3024047cb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 -- 172.21.15.196:0/1488253742 shutdown_connections 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 --2- 172.21.15.196:0/1488253742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56ba15ec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 -- 172.21.15.196:0/1488253742 >> 172.21.15.196:0/1488253742 conn(0x55f56ba105e0 msgr2=0x55f56ba12a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 -- 172.21.15.196:0/1488253742 shutdown_connections 2024-09-21T08:51:58.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.647+0000 7f3035887800 1 -- 172.21.15.196:0/1488253742 wait complete. 2024-09-21T08:51:58.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f3035887800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f3035887800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f56b962350 con 0x55f56ba15ac0 2024-09-21T08:51:58.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f303337b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f303337b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34674/0 (socket says 172.21.15.196:34674) 2024-09-21T08:51:58.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.661+0000 7f303337b640 1 -- 172.21.15.196:0/878330836 learned_addr learned my addr 172.21.15.196:0/878330836 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.662+0000 7f303337b640 1 -- 172.21.15.196:0/878330836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56b8afbc0 con 0x55f56ba15ac0 2024-09-21T08:51:58.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.662+0000 7f303337b640 1 --2- 172.21.15.196:0/878330836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3024027ae0 tx=0x7f3024053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98220a296545821 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.662+0000 7f2f2160a640 1 -- 172.21.15.196:0/878330836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024008780 con 0x55f56ba15ac0 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.662+0000 7f2f2160a640 1 -- 172.21.15.196:0/878330836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024008920 con 0x55f56ba15ac0 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.662+0000 7f2f2160a640 1 -- 172.21.15.196:0/878330836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024008c00 con 0x55f56ba15ac0 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- 172.21.15.196:0/878330836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 msgr2=0x55f56bb034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 --2- 172.21.15.196:0/878330836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3024027ae0 tx=0x7f3024053000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- 172.21.15.196:0/878330836 shutdown_connections 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 --2- 172.21.15.196:0/878330836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb034f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- 172.21.15.196:0/878330836 >> 172.21.15.196:0/878330836 conn(0x55f56ba105e0 msgr2=0x55f56bafeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- 172.21.15.196:0/878330836 shutdown_connections 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- 172.21.15.196:0/878330836 wait complete. 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.663+0000 7f3035887800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f56ba1c570 con 0x55f56ba15ac0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f303337b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f303337b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34684/0 (socket says 172.21.15.196:34684) 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f303337b640 1 -- 172.21.15.196:0/2933043663 learned_addr learned my addr 172.21.15.196:0/2933043663 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f303337b640 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56b8c3fe0 con 0x55f56ba15ac0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f303337b640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3024047cf0 tx=0x7f3024002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f2f1fe07640 1 -- 172.21.15.196:0/2933043663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024075070 con 0x55f56ba15ac0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f2f1fe07640 1 -- 172.21.15.196:0/2933043663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3024008ad0 con 0x55f56ba15ac0 2024-09-21T08:51:58.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f2f1fe07640 1 -- 172.21.15.196:0/2933043663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3024008780 con 0x55f56ba15ac0 2024-09-21T08:51:58.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56bb0b200 con 0x55f56ba15ac0 2024-09-21T08:51:58.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.664+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56bb0b780 con 0x55f56ba15ac0 2024-09-21T08:51:58.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.665+0000 7f2f1fe07640 1 -- 172.21.15.196:0/2933043663 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3024078070 con 0x55f56ba15ac0 2024-09-21T08:51:58.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.665+0000 7f2f1fe07640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 0x7f2f18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.665+0000 7f2f1fe07640 1 -- 172.21.15.196:0/2933043663 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f302406d070 con 0x55f56ba15ac0 2024-09-21T08:51:58.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.665+0000 7f302bfff640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 0x7f2f18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.665+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 0x55f56bb11d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb123a0 con 0x55f56ba16430 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3033b7c640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 0x55f56bb11d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f302bfff640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 0x7f2f18039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f301c000c00 tx=0x7f301c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3033b7c640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 0x55f56bb11d30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3033b7c640 1 -- 172.21.15.196:0/2933043663 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f302c00a4a0 con 0x55f56ba16430 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb0f2c0 con 0x55f56ba16430 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3033b7c640 1 -- 172.21.15.196:0/2933043663 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f302c00a4a0 con 0x55f56ba16430 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.666+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 0x55f56bb16ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.667+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb17190 con 0x55f56bb146d0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.667+0000 7f303337b640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 0x55f56bb16ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.667+0000 7f303337b640 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 0x55f56bb16ac0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.667+0000 7f303337b640 1 -- 172.21.15.196:0/2933043663 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3024077030 con 0x55f56bb146d0 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.667+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb134b0 con 0x55f56ba16430 2024-09-21T08:51:58.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3033b7c640 1 -- 172.21.15.196:0/2933043663 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f302c00a4a0 con 0x55f56ba16430 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb138f0 con 0x55f56ba16430 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3033b7c640 1 -- 172.21.15.196:0/2933043663 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f302c00a4a0 con 0x55f56ba16430 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3035887800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.668+0000 7f3035887800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f56b8b1580 con 0x55f56bb25a10 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34692/0 (socket says 172.21.15.196:34692) 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3033b7c640 1 -- 172.21.15.196:0/1940316559 learned_addr learned my addr 172.21.15.196:0/1940316559 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3033b7c640 1 -- 172.21.15.196:0/1940316559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56bb26370 con 0x55f56bb25a10 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3033b7c640 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55f56bb0bee0 tx=0x7f302c012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f2f1d602640 1 -- 172.21.15.196:0/1940316559 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c014450 con 0x55f56bb25a10 2024-09-21T08:51:58.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f2f1d602640 1 -- 172.21.15.196:0/1940316559 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c014610 con 0x55f56bb25a10 2024-09-21T08:51:58.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56bb26600 con 0x55f56bb25a10 2024-09-21T08:51:58.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f2f1d602640 1 -- 172.21.15.196:0/1940316559 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c014930 con 0x55f56bb25a10 2024-09-21T08:51:58.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.669+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56bb292e0 con 0x55f56bb25a10 2024-09-21T08:51:58.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.670+0000 7f2f1d602640 1 -- 172.21.15.196:0/1940316559 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f302c011040 con 0x55f56bb25a10 2024-09-21T08:51:58.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.670+0000 7f2f1d602640 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 0x7f2f0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.670+0000 7f2f1d602640 1 -- 172.21.15.196:0/1940316559 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f302c01e070 con 0x55f56bb25a10 2024-09-21T08:51:58.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.670+0000 7f303337b640 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 0x7f2f0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f303337b640 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 0x7f2f0c039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f56bb12800 tx=0x7f3024090280 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3035887800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3035887800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f56bb03be0 con 0x55f56bb32600 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34706/0 (socket says 172.21.15.196:34706) 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3033b7c640 1 -- 172.21.15.196:0/3032020688 learned_addr learned my addr 172.21.15.196:0/3032020688 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3033b7c640 1 -- 172.21.15.196:0/3032020688 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56bb32fd0 con 0x55f56bb32600 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f3033b7c640 1 --2- 172.21.15.196:0/3032020688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f302c04ccc0 tx=0x7f302c04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36feeb76d82eb11c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f2f16ffd640 1 -- 172.21.15.196:0/3032020688 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c0168f0 con 0x55f56bb32600 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f2f16ffd640 1 -- 172.21.15.196:0/3032020688 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c014ad0 con 0x55f56bb32600 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.671+0000 7f2f16ffd640 1 -- 172.21.15.196:0/3032020688 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c011330 con 0x55f56bb32600 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- 172.21.15.196:0/3032020688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 msgr2=0x55f56bb32a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 --2- 172.21.15.196:0/3032020688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f302c04ccc0 tx=0x7f302c04cf90 comp rx=0 tx=0).stop 2024-09-21T08:51:58.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- 172.21.15.196:0/3032020688 shutdown_connections 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 --2- 172.21.15.196:0/3032020688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb32a00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- 172.21.15.196:0/3032020688 >> 172.21.15.196:0/3032020688 conn(0x55f56bb2e9f0 msgr2=0x55f56bb2caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- 172.21.15.196:0/3032020688 shutdown_connections 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- 172.21.15.196:0/3032020688 wait complete. 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 Processor -- start 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- start start 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb39b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3035887800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f56bb33640 con 0x55f56bb32600 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.672+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb39b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3033b7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb39b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34710/0 (socket says 172.21.15.196:34710) 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 learned_addr learned my addr 172.21.15.196:0/3369421306 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56bb3a0b0 con 0x55f56bb32600 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3033b7c640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb39b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f302c011e10 tx=0x7f302c04cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f2f157fa640 1 -- 172.21.15.196:0/3369421306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c016440 con 0x55f56bb32600 2024-09-21T08:51:58.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f2f157fa640 1 -- 172.21.15.196:0/3369421306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c014c80 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56bb3a340 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f2f157fa640 1 -- 172.21.15.196:0/3369421306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f302c02b350 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.673+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56bb3cff0 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.674+0000 7f2f157fa640 1 -- 172.21.15.196:0/3369421306 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f302c044020 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.674+0000 7f2f157fa640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2efc036b40 0x7f2efc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.674+0000 7f2f157fa640 1 -- 172.21.15.196:0/3369421306 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f302c034070 con 0x55f56bb32600 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.674+0000 7f303337b640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2efc036b40 0x7f2efc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f303337b640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2efc036b40 0x7f2efc039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f302400a1d0 tx=0x7f302408d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56bb45820 0x55f56bb47ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb48430 con 0x55f56bb45820 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f302bfff640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56bb45820 0x55f56bb47ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f302bfff640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56bb45820 0x55f56bb47ce0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f301c00f5f0 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 20 realm 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.675+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb44c70 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f301c00f5f0 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb48f20 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f301c00f5f0 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb497f0 con 0x55f56bb45820 2024-09-21T08:51:58.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f301c00f5f0 con 0x55f56bb45820 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb4a210 0x55f56bb4c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb4cd70 con 0x55f56bb4a210 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.676+0000 7f3033b7c640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb4a210 0x55f56bb4c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3033b7c640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb4a210 0x55f56bb4c600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3035887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3035887800 20 searching for the correct realm 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f56bb4ed20 0x55f56bb511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4ed20 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f303337b640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f56bb4ed20 0x55f56bb511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.677+0000 7f303337b640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f56bb4ed20 0x55f56bb511e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f303337b640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f302407a060 0x7f3024064360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x7f302407a060 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f302bfff640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f302407a060 0x7f3024064360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f302bfff640 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f302407a060 0x7f3024064360 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c00f5f0 con 0x7f302407a060 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.678+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4a210 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb45820 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c00f5f0 con 0x55f56bb45820 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb45820 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4a210 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.679+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4a210 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x7f302407a060 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4ed20 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb45820 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.680+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4a210 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb45820 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x7f302407a060 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb518b0 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.681+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4a210 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb45820 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.682+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb45820 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4a210 2024-09-21T08:51:58.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.683+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x7f302407a060 2024-09-21T08:51:58.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb45820 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4a210 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.684+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4a210 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x7f302407a060 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4ed20 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.685+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb4a210 2024-09-21T08:51:58.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x55f56bb45820 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f30240aa040 con 0x7f302407a060 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb4d730 con 0x55f56bb45820 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.686+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb4dfd0 con 0x55f56bb45820 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb4d370 con 0x55f56bb45820 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 zone default found 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 4 Realm: () 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 zonegroup default 2024-09-21T08:51:58.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.687+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb51d30 con 0x55f56bb4a210 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb53fe0 con 0x55f56bb4ed20 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb54380 con 0x55f56bb4ed20 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 started sync module instance, tier type = 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.688+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb53420 con 0x7f302407a060 2024-09-21T08:51:58.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.689+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.689+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512562387232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb53420 con 0x7f302407a060 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.689+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb54da0 con 0x55f56bb45820 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.690+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.690+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512562387232] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.690+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512562384752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb54d60 con 0x55f56bb45820 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.690+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb55850 con 0x55f56bb4ed20 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.691+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512562384752] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.691+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.691+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512562393952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb55c40 con 0x55f56bb4ed20 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.691+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb56640 con 0x7f302407a060 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.692+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.692+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512562393952] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.692+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512562397520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb56f10 con 0x7f302407a060 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.692+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb548d0 con 0x55f56bb45820 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.693+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512562397520] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.693+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.693+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512562399584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb574a0 con 0x55f56bb45820 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.693+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb57e60 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.694+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.694+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512562403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb57e10 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.694+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb58e10 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.695+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512562399584] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.696+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.696+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512562400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb58dd0 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.696+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb59840 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.696+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512562403760] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512562400640] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512562410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb58920 con 0x55f56bb4a210 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=0 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=1 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=2 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=3 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=4 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=5 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.697+0000 7f3035887800 20 add_watcher() i=6 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512562410256] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f3035887800 20 add_watcher() i=7 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f3035887800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb5c940 con 0x55f56bb45820 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.698+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512562405888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb59dc0 con 0x55f56bb45820 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.699+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512562405888] v34'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.699+0000 7f2ee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 5 note: GC not initialized 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f2ee8fe1640 20 reqs_thread_entry: start 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 Filter name: none 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f2e627fc640 20 reqs_thread_entry: start 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:58.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8fc30 con 0x55f56bb45820 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.700+0000 7f3035887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb909c0 con 0x7f302407a060 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T08:51:58.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.701+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb967c0 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f3035887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f3035887800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f3035887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94512562659760 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb932b0 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94512562399584 notify 146028888071 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f301c018040 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f2f16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94512562399584 notifier 4398 bl.length()=849 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f2f16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f2f16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(65 notify.4 [notify cookie 94512562659760 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f2f16ffd640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2ef8003ea0 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.702+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.703+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94512562659760 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f301c03ecd0 con 0x55f56bb45820 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.703+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb961b0 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f3035887800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f3035887800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f3035887800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94512562659760 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb93260 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== watch-notify(notify (1) cookie 94512562387232 notify 146028888067 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f301c03ecd0 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f2f167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94512562387232 notifier 4398 bl.length()=166 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f2f167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f2f167fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(68 notify.0 [notify cookie 94512562659760 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.704+0000 7f2f167fc640 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2e68003400 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.705+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== watch-notify(notify_complete (2) cookie 94512562659760 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f301c02f450 con 0x7f302407a060 2024-09-21T08:51:58.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.705+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.716 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T08:51:58.703046Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.705+0000 7f2ee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.705+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512562405888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb45820 2024-09-21T08:51:58.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.706+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94512562405888] v34'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.706+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512562387232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x7f302407a060 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.707+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94512562387232] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.707+0000 7f3035887800 20 remove_watcher() i=0 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.707+0000 7f3035887800 2 removed watcher, disabling cache 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.707+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512562384752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb45820 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.708+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94512562384752] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.708+0000 7f3035887800 20 remove_watcher() i=1 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.708+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512562393952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb4ed20 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.710+0000 7f303337b640 1 -- 172.21.15.196:0/3369421306 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94512562393952] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302409b070 con 0x55f56bb4ed20 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.710+0000 7f3035887800 20 remove_watcher() i=2 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.710+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512562397520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x7f302407a060 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.711+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94512562397520] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x7f302407a060 2024-09-21T08:51:58.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.711+0000 7f3035887800 20 remove_watcher() i=3 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.711+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512562399584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb45820 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.712+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94512562399584] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f301c02b040 con 0x55f56bb45820 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.712+0000 7f3035887800 20 remove_watcher() i=4 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.712+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512562403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94512562403760] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3035887800 20 remove_watcher() i=5 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512562400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94512562400640] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3035887800 20 remove_watcher() i=6 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.713+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512562410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f56bb8d940 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.714+0000 7f3033b7c640 1 -- 172.21.15.196:0/3369421306 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94512562410256] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f302c02a070 con 0x55f56bb4a210 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.714+0000 7f3035887800 20 remove_watcher() i=7 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb4a210 msgr2=0x55f56bb4c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb4a210 0x55f56bb4c600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56bb45820 msgr2=0x55f56bb47ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56bb45820 0x55f56bb47ce0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f302407a060 msgr2=0x7f3024064360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f302407a060 0x7f3024064360 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f56bb4ed20 msgr2=0x55f56bb511e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f56bb4ed20 0x55f56bb511e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2efc036b40 msgr2=0x7f2efc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2efc036b40 0x7f2efc039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f302400a1d0 tx=0x7f302408d000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 msgr2=0x55f56bb39b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/3369421306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb32600 0x55f56bb39b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f302c011e10 tx=0x7f302c04cc50 comp rx=0 tx=0).stop 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 reap_dead start 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f302bfff640 1 -- 172.21.15.196:0/3369421306 reap_dead start 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 shutdown_connections 2024-09-21T08:51:58.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 >> 172.21.15.196:0/3369421306 conn(0x55f56bb2e9f0 msgr2=0x55f56bb2cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 shutdown_connections 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/3369421306 wait complete. 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 msgr2=0x7f2f0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 0x7f2f0c039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f56bb12800 tx=0x7f3024090280 comp rx=0 tx=0).stop 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 msgr2=0x55f56bb25e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55f56bb0bee0 tx=0x7f302c012fd0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 shutdown_connections 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f0c036b90 0x7f2f0c039050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 --2- 172.21.15.196:0/1940316559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56bb25a10 0x55f56bb25e30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 >> 172.21.15.196:0/1940316559 conn(0x55f56bb1a9a0 msgr2=0x55f56bb1d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 shutdown_connections 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.715+0000 7f3035887800 1 -- 172.21.15.196:0/1940316559 wait complete. 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 msgr2=0x55f56bb16ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 0x55f56bb16ac0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 msgr2=0x55f56bb11d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 0x55f56bb11d30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 msgr2=0x7f2f18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 0x7f2f18039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f301c000c00 tx=0x7f301c0013b0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 msgr2=0x55f56bb0acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3024047cf0 tx=0x7f3024002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 shutdown_connections 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f56bb146d0 0x55f56bb16ac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f56ba16430 0x55f56bb11d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2f18036b40 0x7f2f18039000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 --2- 172.21.15.196:0/2933043663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f56ba15ac0 0x55f56bb0acc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 >> 172.21.15.196:0/2933043663 conn(0x55f56ba105e0 msgr2=0x55f56bafd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 shutdown_connections 2024-09-21T08:51:58.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.716+0000 7f3035887800 1 -- 172.21.15.196:0/2933043663 wait complete. 2024-09-21T08:51:58.727 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T08:51:58.703046Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.727 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:51:58.727 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:51:58.771 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.771 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.769+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.769+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.769+0000 7fec5dc36800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f1cd65ed00 0x55f1cd6610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.769+0000 7fec5dc36800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1cd517b30 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.769+0000 7fec5dc36800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f1cd4f9360 con 0x55f1cd65ed00 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec50751640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f1cd65ed00 0x55f1cd6610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec58f52640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f1cd5cbdf0 0x55f1cd65d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46936/0 (socket says 172.21.15.196:46936) 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec50751640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f1cd65ed00 0x55f1cd6610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34716/0 (socket says 172.21.15.196:34716) 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec58f52640 1 -- 172.21.15.196:0/366429768 learned_addr learned my addr 172.21.15.196:0/366429768 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec50751640 1 -- 172.21.15.196:0/366429768 >> v1:172.21.15.29:6789/0 conn(0x55f1cd5cbdf0 legacy=0x55f1cd65d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.770+0000 7fec50751640 1 -- 172.21.15.196:0/366429768 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd51fe00 con 0x55f1cd65ed00 2024-09-21T08:51:58.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec50751640 1 --2- 172.21.15.196:0/366429768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd65ed00 0x55f1cd6610f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fec4000a470 tx=0x7fec40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa6e2845a290ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec53fff640 1 -- 172.21.15.196:0/366429768 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40053570 con 0x55f1cd65ed00 2024-09-21T08:51:58.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec53fff640 1 -- 172.21.15.196:0/366429768 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec40058070 con 0x55f1cd65ed00 2024-09-21T08:51:58.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec53fff640 1 -- 172.21.15.196:0/366429768 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40053880 con 0x55f1cd65ed00 2024-09-21T08:51:58.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 -- 172.21.15.196:0/366429768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd65ed00 msgr2=0x55f1cd6610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 --2- 172.21.15.196:0/366429768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd65ed00 0x55f1cd6610f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fec4000a470 tx=0x7fec40045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:58.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 -- 172.21.15.196:0/366429768 shutdown_connections 2024-09-21T08:51:58.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 --2- 172.21.15.196:0/366429768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd65ed00 0x55f1cd6610f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 -- 172.21.15.196:0/366429768 >> 172.21.15.196:0/366429768 conn(0x55f1cd652df0 msgr2=0x55f1cd655210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 -- 172.21.15.196:0/366429768 shutdown_connections 2024-09-21T08:51:58.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.772+0000 7fec5dc36800 1 -- 172.21.15.196:0/366429768 wait complete. 2024-09-21T08:51:58.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.786+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.786+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.786+0000 7fec5dc36800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.786+0000 7fec5dc36800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1cd5a4330 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7fec58f52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7fec58f52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34726/0 (socket says 172.21.15.196:34726) 2024-09-21T08:51:58.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7fec58f52640 1 -- 172.21.15.196:0/334762550 learned_addr learned my addr 172.21.15.196:0/334762550 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7fec58f52640 1 -- 172.21.15.196:0/334762550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd4f1bc0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7fec58f52640 1 --2- 172.21.15.196:0/334762550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec48001e10 tx=0x7fec4800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7455993f71d0fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7feb46e0d640 1 -- 172.21.15.196:0/334762550 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec48012020 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7feb46e0d640 1 -- 172.21.15.196:0/334762550 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4800e5a0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.787+0000 7feb46e0d640 1 -- 172.21.15.196:0/334762550 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4800e8e0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- 172.21.15.196:0/334762550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 msgr2=0x55f1cd749a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 --2- 172.21.15.196:0/334762550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec48001e10 tx=0x7fec4800b780 comp rx=0 tx=0).stop 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- 172.21.15.196:0/334762550 shutdown_connections 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 --2- 172.21.15.196:0/334762550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd749a60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- 172.21.15.196:0/334762550 >> 172.21.15.196:0/334762550 conn(0x55f1cd652df0 msgr2=0x55f1cd745420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- 172.21.15.196:0/334762550 shutdown_connections 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- 172.21.15.196:0/334762550 wait complete. 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.788+0000 7fec5dc36800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1cd661900 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec58f52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec58f52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34730/0 (socket says 172.21.15.196:34730) 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec58f52640 1 -- 172.21.15.196:0/57078159 learned_addr learned my addr 172.21.15.196:0/57078159 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec58f52640 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd505fe0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec58f52640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b7c0 tx=0x7fec48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7feb4560a640 1 -- 172.21.15.196:0/57078159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec48012030 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7feb4560a640 1 -- 172.21.15.196:0/57078159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48001470 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1cd751980 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7feb4560a640 1 -- 172.21.15.196:0/57078159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4801a8d0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.789+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1cd751ea0 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.790+0000 7feb4560a640 1 -- 172.21.15.196:0/57078159 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec48015020 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.790+0000 7feb4560a640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 0x7feb40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.790+0000 7feb4560a640 1 -- 172.21.15.196:0/57078159 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fec48020030 con 0x55f1cd5cbdf0 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.790+0000 7fec50751640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 0x7feb40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.790+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 0x55f1cd7584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd758a80 con 0x55f1cd65ed00 2024-09-21T08:51:58.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec59753640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 0x55f1cd7584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec50751640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 0x7feb40039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fec40057000 tx=0x7fec40052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec59753640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 0x55f1cd7584b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec59753640 1 -- 172.21.15.196:0/57078159 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec5400a4a0 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd755a80 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec59753640 1 -- 172.21.15.196:0/57078159 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec5400a4a0 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.791+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 0x55f1cd75d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.792+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd75d820 con 0x55f1cd75ad90 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.792+0000 7fec58f52640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 0x55f1cd75d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.792+0000 7fec58f52640 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 0x55f1cd75d180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.792+0000 7fec58f52640 1 -- 172.21.15.196:0/57078159 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd75ad90 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.792+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd759c30 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec59753640 1 -- 172.21.15.196:0/57078159 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec5400a4a0 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd75a0d0 con 0x55f1cd65ed00 2024-09-21T08:51:58.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec59753640 1 -- 172.21.15.196:0/57078159 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec5400a4a0 con 0x55f1cd65ed00 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec5dc36800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.793+0000 7fec5dc36800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1cd4f3580 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34742/0 (socket says 172.21.15.196:34742) 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec59753640 1 -- 172.21.15.196:0/2493289635 learned_addr learned my addr 172.21.15.196:0/2493289635 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec59753640 1 -- 172.21.15.196:0/2493289635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd76cb10 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec59753640 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55f1cd7524f0 tx=0x7fec540188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7feb3e7fc640 1 -- 172.21.15.196:0/2493289635 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54014450 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7feb3e7fc640 1 -- 172.21.15.196:0/2493289635 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540145f0 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7feb3e7fc640 1 -- 172.21.15.196:0/2493289635 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540148d0 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1cd76cda0 con 0x55f1cd76c1b0 2024-09-21T08:51:58.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.794+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1cd76fa80 con 0x55f1cd76c1b0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7feb3e7fc640 1 -- 172.21.15.196:0/2493289635 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec54011040 con 0x55f1cd76c1b0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7feb3e7fc640 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7feb3e7fc640 1 -- 172.21.15.196:0/2493289635 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fec5401e070 con 0x55f1cd76c1b0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7fec58f52640 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.795+0000 7fec58f52640 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 0x7feb30039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55f1cd758eb0 tx=0x7fec4804b080 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec5dc36800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec5dc36800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1cd74a210 con 0x55f1cd778e30 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34746/0 (socket says 172.21.15.196:34746) 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec59753640 1 -- 172.21.15.196:0/909799869 learned_addr learned my addr 172.21.15.196:0/909799869 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec59753640 1 -- 172.21.15.196:0/909799869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd779800 con 0x55f1cd778e30 2024-09-21T08:51:58.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7fec59753640 1 --2- 172.21.15.196:0/909799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec5404cbb0 tx=0x7fec54011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea9acc6d07886e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7feb2ffff640 1 -- 172.21.15.196:0/909799869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54013dc0 con 0x55f1cd778e30 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7feb2ffff640 1 -- 172.21.15.196:0/909799869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54014a70 con 0x55f1cd778e30 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.796+0000 7feb2ffff640 1 -- 172.21.15.196:0/909799869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54014d50 con 0x55f1cd778e30 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- 172.21.15.196:0/909799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 msgr2=0x55f1cd779230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 --2- 172.21.15.196:0/909799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec5404cbb0 tx=0x7fec54011970 comp rx=0 tx=0).stop 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- 172.21.15.196:0/909799869 shutdown_connections 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 --2- 172.21.15.196:0/909799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd779230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- 172.21.15.196:0/909799869 >> 172.21.15.196:0/909799869 conn(0x55f1cd775190 msgr2=0x55f1cd773290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- 172.21.15.196:0/909799869 shutdown_connections 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- 172.21.15.196:0/909799869 wait complete. 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 Processor -- start 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- start start 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd7802a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec5dc36800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1cd779e70 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd7802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec59753640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd7802a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34750/0 (socket says 172.21.15.196:34750) 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.797+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 learned_addr learned my addr 172.21.15.196:0/1224644457 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1cd7807e0 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7fec59753640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd7802a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec54011be0 tx=0x7fec5404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7feb2e7fc640 1 -- 172.21.15.196:0/1224644457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54044030 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7feb2e7fc640 1 -- 172.21.15.196:0/1224644457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54022a80 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1cd780a70 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7feb2e7fc640 1 -- 172.21.15.196:0/1224644457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54016440 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.798+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1cd783720 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7feb2e7fc640 1 -- 172.21.15.196:0/1224644457 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec5402b350 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7feb2e7fc640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb24036b90 0x7feb24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7feb2e7fc640 1 -- 172.21.15.196:0/1224644457 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fec54045070 con 0x55f1cd778e30 2024-09-21T08:51:58.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7fec58f52640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb24036b90 0x7feb24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd78bf90 0x55f1cd78e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd78eba0 con 0x55f1cd78bf90 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.799+0000 7fec50751640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd78bf90 0x55f1cd78e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec58f52640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb24036b90 0x7feb24039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec4801a6a0 tx=0x7fec48036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec50751640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd78bf90 0x55f1cd78e450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 realm 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd78efd0 con 0x55f1cd78bf90 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd78f8a0 con 0x55f1cd78bf90 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.800+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd78fc40 con 0x55f1cd78bf90 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec5dc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd7909a0 0x55f1cd792d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7932d0 con 0x55f1cd7909a0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec59753640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd7909a0 0x55f1cd792d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.801+0000 7fec59753640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd7909a0 0x55f1cd792d90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec5dc36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec5dc36800 20 searching for the correct realm 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f1cd795310 0x55f1cd7977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec58f52640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f1cd795310 0x55f1cd7977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec58f52640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f1cd795310 0x55f1cd7977d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec58f52640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fec4803a040 0x7fec4803f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.802+0000 7fec50751640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fec4803a040 0x7fec4803f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec50751640 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fec4803a040 0x7fec4803f5f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.803+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.804+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.805+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.806+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.807+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.808+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd795310 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.809+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd7909a0 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.810+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.810+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x55f1cd78bf90 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.810+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.810+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd797ea0 con 0x7fec4803a040 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd793d10 con 0x55f1cd78bf90 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd794190 con 0x55f1cd78bf90 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd794630 con 0x55f1cd78bf90 2024-09-21T08:51:58.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 zone default found 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 4 Realm: () 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 zonegroup default 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.811+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd798320 con 0x55f1cd7909a0 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79a550 con 0x55f1cd795310 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79a8f0 con 0x55f1cd795310 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 started sync module instance, tier type = 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.812+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd799990 con 0x7fec4803a040 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.813+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.813+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94497022778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd799990 con 0x7fec4803a040 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.813+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b1c0 con 0x55f1cd78bf90 2024-09-21T08:51:58.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.814+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.814+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94497022782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b180 con 0x55f1cd78bf90 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.814+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79c1a0 con 0x55f1cd795310 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.814+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94497022778800] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.815+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94497022782608] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.816+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.816+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94497022784944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7994e0 con 0x55f1cd795310 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.816+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79ca40 con 0x7fec4803a040 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.817+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.817+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94497022784944] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.817+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94497022789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79ce30 con 0x7fec4803a040 2024-09-21T08:51:58.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.817+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79d860 con 0x55f1cd78bf90 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.818+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.818+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94497022792560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79d790 con 0x55f1cd78bf90 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.818+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79e790 con 0x55f1cd7909a0 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.818+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94497022789520] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.819+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94497022792560] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.819+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.819+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94497022794832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79e2a0 con 0x55f1cd7909a0 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.819+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79e2a0 con 0x55f1cd7909a0 2024-09-21T08:51:58.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.820+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94497022794832] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.820+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.820+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94497022786736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79f080 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.820+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79fa40 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94497022786736] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94497022798640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79fa40 con 0x55f1cd7909a0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=0 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=1 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=2 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=3 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=4 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=5 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.821+0000 7fec5dc36800 20 add_watcher() i=6 2024-09-21T08:51:58.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94497022798640] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec5dc36800 20 add_watcher() i=7 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec5dc36800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7a2ec0 con 0x55f1cd78bf90 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.822+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94497022801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7a0410 con 0x55f1cd78bf90 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.823+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94497022801760] v34'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.823+0000 7feb0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 5 note: GC not initialized 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7feb0dfe3640 20 reqs_thread_entry: start 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 20 Filter name: none 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fea7f7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.824+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7d5d70 con 0x55f1cd78bf90 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.825+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.825+0000 7fec5dc36800 20 rados_obj.operate() r=0 bl.length=673 2024-09-21T08:51:58.837 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T08:51:58.703046Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.825+0000 7feb0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.825+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94497022801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd7d62b0 con 0x55f1cd78bf90 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.826+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94497022801760] v34'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.826+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94497022778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79f730 con 0x7fec4803a040 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.827+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94497022778800] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.827+0000 7fec5dc36800 20 remove_watcher() i=0 2024-09-21T08:51:58.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.827+0000 7fec5dc36800 2 removed watcher, disabling cache 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.827+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94497022782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd799db0 con 0x55f1cd78bf90 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.828+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94497022782608] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.828+0000 7fec5dc36800 20 remove_watcher() i=1 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.828+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94497022784944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd799db0 con 0x55f1cd795310 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.830+0000 7fec58f52640 1 -- 172.21.15.196:0/1224644457 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94497022784944] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4802dcf0 con 0x55f1cd795310 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.830+0000 7fec5dc36800 20 remove_watcher() i=2 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.830+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94497022789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b5b0 con 0x7fec4803a040 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.831+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94497022789520] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x7fec4803a040 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.831+0000 7fec5dc36800 20 remove_watcher() i=3 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.831+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94497022792560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b5b0 con 0x55f1cd78bf90 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.832+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94497022792560] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec40051070 con 0x55f1cd78bf90 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.832+0000 7fec5dc36800 20 remove_watcher() i=4 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.832+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94497022794832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b5b0 con 0x55f1cd7909a0 2024-09-21T08:51:58.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.833+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94497022794832] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.833+0000 7fec5dc36800 20 remove_watcher() i=5 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.833+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94497022786736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79dc50 con 0x55f1cd7909a0 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.834+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94497022786736] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.834+0000 7fec5dc36800 20 remove_watcher() i=6 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.834+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94497022798640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1cd79b5b0 con 0x55f1cd7909a0 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.834+0000 7fec59753640 1 -- 172.21.15.196:0/1224644457 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94497022798640] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5402a070 con 0x55f1cd7909a0 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 20 remove_watcher() i=7 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd7909a0 msgr2=0x55f1cd792d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd7909a0 0x55f1cd792d90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd78bf90 msgr2=0x55f1cd78e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd78bf90 0x55f1cd78e450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fec4803a040 msgr2=0x7fec4803f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fec4803a040 0x7fec4803f5f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f1cd795310 msgr2=0x55f1cd7977d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f1cd795310 0x55f1cd7977d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb24036b90 msgr2=0x7feb24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb24036b90 0x7feb24039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec4801a6a0 tx=0x7fec48036000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 msgr2=0x55f1cd7802a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/1224644457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd778e30 0x55f1cd7802a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec54011be0 tx=0x7fec5404cb10 comp rx=0 tx=0).stop 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 reap_dead start 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec50751640 1 -- 172.21.15.196:0/1224644457 reap_dead start 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 shutdown_connections 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 >> 172.21.15.196:0/1224644457 conn(0x55f1cd775190 msgr2=0x55f1cd773260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 shutdown_connections 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/1224644457 wait complete. 2024-09-21T08:51:58.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 msgr2=0x7feb30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 0x7feb30039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55f1cd758eb0 tx=0x7fec4804b080 comp rx=0 tx=0).stop 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 msgr2=0x55f1cd76c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55f1cd7524f0 tx=0x7fec540188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 shutdown_connections 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 --2- 172.21.15.196:0/2493289635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd76c1b0 0x55f1cd76c5d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 >> 172.21.15.196:0/2493289635 conn(0x55f1cd761140 msgr2=0x55f1cd763cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 shutdown_connections 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.835+0000 7fec5dc36800 1 -- 172.21.15.196:0/2493289635 wait complete. 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 msgr2=0x55f1cd75d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 0x55f1cd75d180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 msgr2=0x55f1cd7584b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 0x55f1cd7584b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 msgr2=0x7feb40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 0x7feb40039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fec40057000 tx=0x7fec40052000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 msgr2=0x55f1cd751440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b7c0 tx=0x7fec48000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 shutdown_connections 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f1cd75ad90 0x55f1cd75d180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f1cd65ed00 0x55f1cd7584b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feb40036b40 0x7feb40039000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 --2- 172.21.15.196:0/57078159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1cd5cbdf0 0x55f1cd751440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 >> 172.21.15.196:0/57078159 conn(0x55f1cd652df0 msgr2=0x55f1cd743cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 shutdown_connections 2024-09-21T08:51:58.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.836+0000 7fec5dc36800 1 -- 172.21.15.196:0/57078159 wait complete. 2024-09-21T08:51:58.848 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T08:51:58.703046Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-21T08:51:58.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-21T08:51:58.849 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-21T08:51:58.894 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:58.894 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:58.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.892+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37c2f3e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651ced81630 0x5651cee12600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37c2f3e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651cecccb30 con 0x5651cee12b40 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37c2f3e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5651cecae360 con 0x5651ced81630 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37bec3b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651ced81630 0x5651cee12600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37be43a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5651cee12b40 0x5651cee14f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46942/0 (socket says 172.21.15.196:46942) 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37be43a640 1 -- 172.21.15.196:0/2616676593 learned_addr learned my addr 172.21.15.196:0/2616676593 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37bec3b640 1 -- 172.21.15.196:0/2616676593 >> v1:172.21.15.29:6789/0 conn(0x5651cee12b40 legacy=0x5651cee14f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37bec3b640 1 -- 172.21.15.196:0/2616676593 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cecd4e00 con 0x5651ced81630 2024-09-21T08:51:58.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.893+0000 7f37bdc39640 1 -- 172.21.15.196:0/2616676593 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731095855 0 0) 0x5651cecccb30 con 0x5651cee12b40 2024-09-21T08:51:58.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.895+0000 7f37bec3b640 1 --2- 172.21.15.196:0/2616676593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cee12600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005fd0 tx=0x7f37b0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35947826766728e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.895+0000 7f37bdc39640 1 -- 172.21.15.196:0/2616676593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0058530 con 0x5651ced81630 2024-09-21T08:51:58.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.895+0000 7f37bdc39640 1 -- 172.21.15.196:0/2616676593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b00586d0 con 0x5651ced81630 2024-09-21T08:51:58.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.895+0000 7f37bdc39640 1 -- 172.21.15.196:0/2616676593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b00589d0 con 0x5651ced81630 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 -- 172.21.15.196:0/2616676593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 msgr2=0x5651cee12600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/2616676593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cee12600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005fd0 tx=0x7f37b0045c30 comp rx=0 tx=0).stop 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 -- 172.21.15.196:0/2616676593 shutdown_connections 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/2616676593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cee12600 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 -- 172.21.15.196:0/2616676593 >> 172.21.15.196:0/2616676593 conn(0x5651cee07db0 msgr2=0x5651cee0a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 -- 172.21.15.196:0/2616676593 shutdown_connections 2024-09-21T08:51:58.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.896+0000 7f37c2f3e800 1 -- 172.21.15.196:0/2616676593 wait complete. 2024-09-21T08:51:58.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37c2f3e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37c2f3e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651ced59360 con 0x5651ced81630 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37bec3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37bec3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34780/0 (socket says 172.21.15.196:34780) 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37bec3b640 1 -- 172.21.15.196:0/1862192301 learned_addr learned my addr 172.21.15.196:0/1862192301 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.910+0000 7f37bec3b640 1 -- 172.21.15.196:0/1862192301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ceca6bc0 con 0x5651ced81630 2024-09-21T08:51:58.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37bec3b640 1 --2- 172.21.15.196:0/1862192301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f37b000a3f0 tx=0x7f37b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f7daa74c8cbc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f36ace09640 1 -- 172.21.15.196:0/1862192301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0068070 con 0x5651ced81630 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f36ace09640 1 -- 172.21.15.196:0/1862192301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0058880 con 0x5651ced81630 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f36ace09640 1 -- 172.21.15.196:0/1862192301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0058b60 con 0x5651ced81630 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1862192301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 msgr2=0x5651ceefe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1862192301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f37b000a3f0 tx=0x7f37b0051000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1862192301 shutdown_connections 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1862192301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651ceefe8d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.911+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1862192301 >> 172.21.15.196:0/1862192301 conn(0x5651cee07db0 msgr2=0x5651ceefa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1862192301 shutdown_connections 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1862192301 wait complete. 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37c2f3e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cee16920 con 0x5651ced81630 2024-09-21T08:51:58.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37bec3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37bec3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34786/0 (socket says 172.21.15.196:34786) 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.912+0000 7f37bec3b640 1 -- 172.21.15.196:0/64772567 learned_addr learned my addr 172.21.15.196:0/64772567 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f37bec3b640 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cecbafe0 con 0x5651ced81630 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f37bec3b640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37b0066040 tx=0x7f37b0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f36ab606640 1 -- 172.21.15.196:0/64772567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0071070 con 0x5651ced81630 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f36ab606640 1 -- 172.21.15.196:0/64772567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0063780 con 0x5651ced81630 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651cef067b0 con 0x5651ced81630 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f36ab606640 1 -- 172.21.15.196:0/64772567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0068040 con 0x5651ced81630 2024-09-21T08:51:58.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.913+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651cef06cd0 con 0x5651ced81630 2024-09-21T08:51:58.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f36ab606640 1 -- 172.21.15.196:0/64772567 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b0074070 con 0x5651ced81630 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f36ab606640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 0x7f36a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f36ab606640 1 -- 172.21.15.196:0/64772567 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b008f920 con 0x5651ced81630 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f37be43a640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 0x7f36a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 0x5651cef0d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef0d8b0 con 0x5651cee12b40 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f37bf43c640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 0x5651cef0d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.914+0000 7f37be43a640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 0x7f36a4039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37bf43c640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 0x5651cef0d2e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37bf43c640 1 -- 172.21.15.196:0/64772567 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b800a4e0 con 0x5651cee12b40 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef0a870 con 0x5651cee12b40 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37bf43c640 1 -- 172.21.15.196:0/64772567 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b800a4e0 con 0x5651cee12b40 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 0x5651cef11fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef12650 con 0x5651cef0fbc0 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.915+0000 7f37bec3b640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 0x5651cef11fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.916+0000 7f37bec3b640 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 0x5651cef11fb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.916+0000 7f37bec3b640 1 -- 172.21.15.196:0/64772567 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef0fbc0 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.916+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef0ea60 con 0x5651cee12b40 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.916+0000 7f37bf43c640 1 -- 172.21.15.196:0/64772567 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b800a4e0 con 0x5651cee12b40 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.916+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef0eee0 con 0x5651cee12b40 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37bf43c640 1 -- 172.21.15.196:0/64772567 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37b800a4e0 con 0x5651cee12b40 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37c2f3e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37c2f3e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651ceca8580 con 0x5651cef20f00 2024-09-21T08:51:58.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34790/0 (socket says 172.21.15.196:34790) 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.917+0000 7f37bf43c640 1 -- 172.21.15.196:0/1769102281 learned_addr learned my addr 172.21.15.196:0/1769102281 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f37bf43c640 1 -- 172.21.15.196:0/1769102281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cef21860 con 0x5651cef20f00 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f37bf43c640 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5651cef06ec0 tx=0x7f37b8007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f36a8e01640 1 -- 172.21.15.196:0/1769102281 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8008e00 con 0x5651cef20f00 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f36a8e01640 1 -- 172.21.15.196:0/1769102281 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b801e020 con 0x5651cef20f00 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651cef21af0 con 0x5651cef20f00 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f36a8e01640 1 -- 172.21.15.196:0/1769102281 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8019590 con 0x5651cef20f00 2024-09-21T08:51:58.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.918+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651cef247d0 con 0x5651cef20f00 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f36a8e01640 1 -- 172.21.15.196:0/1769102281 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b8016040 con 0x5651cef20f00 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f36a8e01640 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f36a8e01640 1 -- 172.21.15.196:0/1769102281 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b801f030 con 0x5651cef20f00 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37bec3b640 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37bec3b640 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5651cef0dcf0 tx=0x7f37b006bcf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37c2f3e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.919+0000 7f37c2f3e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651ceefefc0 con 0x5651cef2db00 2024-09-21T08:51:58.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34794/0 (socket says 172.21.15.196:34794) 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f37bf43c640 1 -- 172.21.15.196:0/543198692 learned_addr learned my addr 172.21.15.196:0/543198692 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f37bf43c640 1 -- 172.21.15.196:0/543198692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cef2e4d0 con 0x5651cef2db00 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f37bf43c640 1 --2- 172.21.15.196:0/543198692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f37b804cf60 tx=0x7f37b8017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaebb430058cac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f36a27fc640 1 -- 172.21.15.196:0/543198692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b801d030 con 0x5651cef2db00 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f36a27fc640 1 -- 172.21.15.196:0/543198692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8019910 con 0x5651cef2db00 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.920+0000 7f36a27fc640 1 -- 172.21.15.196:0/543198692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8015d00 con 0x5651cef2db00 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- 172.21.15.196:0/543198692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 msgr2=0x5651cef2df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/543198692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f37b804cf60 tx=0x7f37b8017fa0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- 172.21.15.196:0/543198692 shutdown_connections 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/543198692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef2df00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- 172.21.15.196:0/543198692 >> 172.21.15.196:0/543198692 conn(0x5651cef29e60 msgr2=0x5651cef27f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- 172.21.15.196:0/543198692 shutdown_connections 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- 172.21.15.196:0/543198692 wait complete. 2024-09-21T08:51:58.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 Processor -- start 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- start start 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37c2f3e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cef2ea50 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37bf43c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34800/0 (socket says 172.21.15.196:34800) 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.921+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 learned_addr learned my addr 172.21.15.196:0/4046144209 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cef35490 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f37bf43c640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f37b8022f90 tx=0x7f37b804cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f36a0ff9640 1 -- 172.21.15.196:0/4046144209 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b80153e0 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f36a0ff9640 1 -- 172.21.15.196:0/4046144209 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8015580 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651cef35720 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f36a0ff9640 1 -- 172.21.15.196:0/4046144209 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8019dc0 con 0x5651cef2db00 2024-09-21T08:51:58.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.922+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651cef383d0 con 0x5651cef2db00 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f36a0ff9640 1 -- 172.21.15.196:0/4046144209 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b8015770 con 0x5651cef2db00 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f36a0ff9640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f36a0ff9640 1 -- 172.21.15.196:0/4046144209 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b8038c80 con 0x5651cef2db00 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f37bec3b640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f37bec3b640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5651cef12a50 tx=0x7f37b0088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.923+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cef40a00 0x5651cef42ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef43610 con 0x5651cef40a00 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37be43a640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cef40a00 0x5651cef42ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37be43a640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cef40a00 0x5651cef42ec0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f5f0 con 0x5651cef40a00 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 20 realm 2024-09-21T08:51:58.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef3fe50 con 0x5651cef40a00 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f5f0 con 0x5651cef40a00 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.924+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef44100 con 0x5651cef40a00 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f5f0 con 0x5651cef40a00 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef449d0 con 0x5651cef40a00 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b400f5f0 con 0x5651cef40a00 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef453f0 0x5651cef477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef47f50 con 0x5651cef453f0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37bf43c640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef453f0 0x5651cef477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.925+0000 7f37bf43c640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef453f0 0x5651cef477e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37c2f3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37c2f3e800 20 searching for the correct realm 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651cef49f00 0x5651cef4c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bec3b640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651cef49f00 0x5651cef4c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bec3b640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651cef49f00 0x5651cef4c3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bec3b640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0076060 0x7f37b008f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.926+0000 7f37be43a640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0076060 0x7f37b008f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37be43a640 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0076060 0x7f37b008f0f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b400f5f0 con 0x7f37b0076060 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b400f5f0 con 0x5651cef40a00 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.927+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.928+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.929+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.930+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.931+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.932+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.933+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef49f00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef453f0 2024-09-21T08:51:58.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.934+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x5651cef40a00 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ca90 con 0x7f37b0076060 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef48910 con 0x5651cef40a00 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef491b0 con 0x5651cef40a00 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.935+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef48550 con 0x5651cef40a00 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 zone default found 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 4 Realm: () 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:58.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 zonegroup default 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4cf50 con 0x5651cef453f0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4f220 con 0x5651cef49f00 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4f5c0 con 0x5651cef49f00 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 started sync module instance, tier type = 2024-09-21T08:51:58.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.936+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e6b0 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.937+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.938+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909364497408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e6b0 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.938+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4ffd0 con 0x5651cef40a00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.939+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909364497408] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.939+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.939+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909364501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e6b0 con 0x5651cef40a00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.939+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef50a20 con 0x5651cef49f00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.940+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909364501760] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.940+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.940+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909364494848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e620 con 0x5651cef49f00 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.940+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef518e0 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.941+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.941+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909364508176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef52020 con 0x7f37b0076060 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.941+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909364494848] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.941+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef50e50 con 0x5651cef40a00 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.942+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909364508176] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.942+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.942+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909364509296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef50e50 con 0x5651cef40a00 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.942+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef530e0 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.943+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.943+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909364509296] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.943+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909364512272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef530e0 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.943+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef53aa0 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.944+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909364512272] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.944+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.944+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909364513840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef53c80 con 0x5651cef453f0 2024-09-21T08:51:58.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.944+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef544d0 con 0x5651cef453f0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909364518528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef548d0 con 0x5651cef453f0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=1 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=2 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=3 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=4 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=5 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909364513840] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.945+0000 7f37c2f3e800 20 add_watcher() i=6 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909364518528] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37c2f3e800 20 add_watcher() i=7 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37c2f3e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef537d0 con 0x5651cef40a00 2024-09-21T08:51:58.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.946+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909364519776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef537d0 con 0x5651cef40a00 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.947+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909364519776] v34'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.947+0000 7f36757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.947+0000 7f37c2f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.947+0000 7f37c2f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 5 note: GC not initialized 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f35effff640 20 reqs_thread_entry: start 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 20 Filter name: none 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f35edffb640 20 reqs_thread_entry: start 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 20 rados->read ofs=0 len=0 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef8adf0 con 0x5651cef40a00 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 20 rados_obj.operate() r=0 bl.length=673 2024-09-21T08:51:58.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:58.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:58.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.948+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef919c0 con 0x5651cef40a00 2024-09-21T08:51:58.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37c2f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37c2f3e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37c2f3e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94909364769728 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef8d080 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94909364509296 notify 146028888072 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f37b4018040 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f36a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94909364509296 notifier 4412 bl.length()=758 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f36a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f36a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94909364769728 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f36a27fc640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3684003ea0 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94909364769728 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f37b403e840 con 0x5651cef40a00 2024-09-21T08:51:58.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.950+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef913c0 con 0x5651cef40a00 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 foo:foo1 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f37c2f3e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94909364769728 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651cef8cbd0 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== watch-notify(notify (1) cookie 94909364497408 notify 146028888068 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f37b403e840 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f36a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94909364497408 notifier 4412 bl.length()=159 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f36a27fc640 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3684003ea0 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.951+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.0 [notify cookie 94909364769728 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.952+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.952+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify_complete (2) cookie 94909364769728 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f37b403ebb0 con 0x7f37b0076060 2024-09-21T08:51:58.965 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T08:51:58.703046Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:58.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.953+0000 7f36757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:58.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.953+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909364519776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef88b60 con 0x5651cef40a00 2024-09-21T08:51:58.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.954+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94909364519776] v34'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.954+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909364497408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef88b60 con 0x7f37b0076060 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.954+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94909364497408] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.954+0000 7f37c2f3e800 20 remove_watcher() i=0 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.954+0000 7f37c2f3e800 2 removed watcher, disabling cache 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.955+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909364501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef88b60 con 0x5651cef40a00 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.956+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94909364501760] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.956+0000 7f37c2f3e800 20 remove_watcher() i=1 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.956+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909364494848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef88b60 con 0x5651cef49f00 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.957+0000 7f37bec3b640 1 -- 172.21.15.196:0/4046144209 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94909364494848] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b0073030 con 0x5651cef49f00 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.957+0000 7f37c2f3e800 20 remove_watcher() i=2 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.957+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909364508176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e200 con 0x7f37b0076060 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.958+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94909364508176] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0076060 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.958+0000 7f37c2f3e800 20 remove_watcher() i=3 2024-09-21T08:51:58.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.958+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909364509296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef51610 con 0x5651cef40a00 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.959+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94909364509296] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x5651cef40a00 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.959+0000 7f37c2f3e800 20 remove_watcher() i=4 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.959+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909364512272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e200 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.960+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94909364512272] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.960+0000 7f37c2f3e800 20 remove_watcher() i=5 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.960+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909364513840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef52610 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.961+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94909364513840] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.961+0000 7f37c2f3e800 20 remove_watcher() i=6 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.961+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909364518528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651cef4e200 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37bf43c640 1 -- 172.21.15.196:0/4046144209 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94909364518528] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x5651cef453f0 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 20 remove_watcher() i=7 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef453f0 msgr2=0x5651cef477e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef453f0 0x5651cef477e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cef40a00 msgr2=0x5651cef42ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cef40a00 0x5651cef42ec0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0076060 msgr2=0x7f37b008f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0076060 0x7f37b008f0f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651cef49f00 msgr2=0x5651cef4c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651cef49f00 0x5651cef4c3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 msgr2=0x7f3688039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5651cef12a50 tx=0x7f37b0088000 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 msgr2=0x5651cef34f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37be43a640 1 -- 172.21.15.196:0/4046144209 reap_dead start 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f37b8022f90 tx=0x7f37b804cef0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 shutdown_connections 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/4046144209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef2db00 0x5651cef34f50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 >> 172.21.15.196:0/4046144209 conn(0x5651cef29e60 msgr2=0x5651cef27f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 shutdown_connections 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/4046144209 wait complete. 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 msgr2=0x7f3698039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5651cef0dcf0 tx=0x7f37b006bcf0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 msgr2=0x5651cef21320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5651cef06ec0 tx=0x7f37b8007740 comp rx=0 tx=0).stop 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 shutdown_connections 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/1769102281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cef20f00 0x5651cef21320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.962+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 >> 172.21.15.196:0/1769102281 conn(0x5651cef15f00 msgr2=0x5651cef18a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 shutdown_connections 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/1769102281 wait complete. 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 msgr2=0x5651cef11fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 0x5651cef11fb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 msgr2=0x5651cef0d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 0x5651cef0d2e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 msgr2=0x7f36a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 0x7f36a4039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b40013b0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 msgr2=0x5651cef06270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37b0066040 tx=0x7f37b0003330 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 shutdown_connections 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651cef0fbc0 0x5651cef11fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651cee12b40 0x5651cef0d2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b90 0x7f36a4039050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 --2- 172.21.15.196:0/64772567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ced81630 0x5651cef06270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 >> 172.21.15.196:0/64772567 conn(0x5651cee07db0 msgr2=0x5651ceef8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 shutdown_connections 2024-09-21T08:51:58.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:58.963+0000 7f37c2f3e800 1 -- 172.21.15.196:0/64772567 wait complete. 2024-09-21T08:51:58.976 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T08:51:58.703046Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:58.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-21T08:51:58.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-21T08:51:58.977 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-21T08:51:59.020 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.020 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8f71f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561c35662760 0x561c35662b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8f71f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c35521b30 con 0x561c356630a0 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8f71f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561c35503360 con 0x561c35662760 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8b39c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561c35662760 0x561c35662b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8b39c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561c35662760 0x561c35662b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34802/0 (socket says 172.21.15.196:34802) 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1760316298 learned_addr learned my addr 172.21.15.196:0/1760316298 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc82b9b640 1 --1- 172.21.15.196:0/1760316298 >> v1:172.21.15.29:6789/0 conn(0x561c356630a0 0x561c35667ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46950/0 (socket says 172.21.15.196:46950) 2024-09-21T08:51:59.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1760316298 >> v1:172.21.15.29:6789/0 conn(0x561c356630a0 legacy=0x561c35667ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1760316298 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c35529e00 con 0x561c35662760 2024-09-21T08:51:59.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.019+0000 7fbc8ab9b640 1 -- 172.21.15.196:0/1760316298 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970751052 0 0) 0x561c35521b30 con 0x561c356630a0 2024-09-21T08:51:59.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.021+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/1760316298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35662b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00a520 tx=0x7fbc7c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf896d2eb0a4265 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.021+0000 7fbc8ab9b640 1 -- 172.21.15.196:0/1760316298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c055070 con 0x561c35662760 2024-09-21T08:51:59.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.021+0000 7fbc8ab9b640 1 -- 172.21.15.196:0/1760316298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0515b0 con 0x561c35662760 2024-09-21T08:51:59.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.021+0000 7fbc8ab9b640 1 -- 172.21.15.196:0/1760316298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c0518d0 con 0x561c35662760 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1760316298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 msgr2=0x561c35662b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1760316298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35662b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00a520 tx=0x7fbc7c045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1760316298 shutdown_connections 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1760316298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35662b60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1760316298 >> 172.21.15.196:0/1760316298 conn(0x561c3565dff0 msgr2=0x561c35660410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1760316298 shutdown_connections 2024-09-21T08:51:59.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.022+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1760316298 wait complete. 2024-09-21T08:51:59.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.035+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8f71f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8f71f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561c355ae330 con 0x561c35662760 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8b39c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8b39c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34818/0 (socket says 172.21.15.196:34818) 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2129320983 learned_addr learned my addr 172.21.15.196:0/2129320983 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2129320983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c354fbbc0 con 0x561c35662760 2024-09-21T08:51:59.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.036+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2129320983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000c00 tx=0x7fbc7c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3f196b1e406fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbb7960a640 1 -- 172.21.15.196:0/2129320983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c0519d0 con 0x561c35662760 2024-09-21T08:51:59.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbb7960a640 1 -- 172.21.15.196:0/2129320983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c051b70 con 0x561c35662760 2024-09-21T08:51:59.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbb7960a640 1 -- 172.21.15.196:0/2129320983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c051e50 con 0x561c35662760 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2129320983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 msgr2=0x561c35751660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2129320983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000c00 tx=0x7fbc7c051000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2129320983 shutdown_connections 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2129320983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c35751660 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2129320983 >> 172.21.15.196:0/2129320983 conn(0x561c3565dff0 msgr2=0x561c3574d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2129320983 shutdown_connections 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.037+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2129320983 wait complete. 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8f71f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8f71f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561c35669640 con 0x561c35662760 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8b39c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8b39c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34826/0 (socket says 172.21.15.196:34826) 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1030944883 learned_addr learned my addr 172.21.15.196:0/1030944883 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3550ffe0 con 0x561c35662760 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.038+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005570 tx=0x7fbc7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbb77e07640 1 -- 172.21.15.196:0/1030944883 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c073070 con 0x561c35662760 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbb77e07640 1 -- 172.21.15.196:0/1030944883 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c05a580 con 0x561c35662760 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c355d6db0 con 0x561c35662760 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbb77e07640 1 -- 172.21.15.196:0/1030944883 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc7c05a8a0 con 0x561c35662760 2024-09-21T08:51:59.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c355d7330 con 0x561c35662760 2024-09-21T08:51:59.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.039+0000 7fbb77e07640 1 -- 172.21.15.196:0/1030944883 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbc7c076070 con 0x561c35662760 2024-09-21T08:51:59.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbb77e07640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 0x7fbb70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbb77e07640 1 -- 172.21.15.196:0/1030944883 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbc7c062070 con 0x561c35662760 2024-09-21T08:51:59.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 0x7fbb70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 0x561c357622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35762830 con 0x561c356630a0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 0x561c357622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 0x7fbb70039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc740013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 0x561c357622f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/1030944883 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc8400a4a0 con 0x561c356630a0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.040+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35763080 con 0x561c356630a0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.041+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/1030944883 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc8400a4a0 con 0x561c356630a0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.041+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 0x561c35766ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.041+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35767650 con 0x561c35764ab0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.041+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 0x561c35766ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.041+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 0x561c35766ec0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.042+0000 7fbc8b39c640 1 -- 172.21.15.196:0/1030944883 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc7c07f070 con 0x561c35764ab0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.042+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357638d0 con 0x561c356630a0 2024-09-21T08:51:59.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.042+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/1030944883 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc8400a4a0 con 0x561c356630a0 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.042+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35763c70 con 0x561c356630a0 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.042+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/1030944883 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc8400a4a0 con 0x561c356630a0 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8f71f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8f71f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561c355d8c00 con 0x561c35776020 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34842/0 (socket says 172.21.15.196:34842) 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/371251158 learned_addr learned my addr 172.21.15.196:0/371251158 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/371251158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c35776980 con 0x561c35776020 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561c355d8220 tx=0x7fbc84012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.043+0000 7fbb75602640 1 -- 172.21.15.196:0/371251158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc84014450 con 0x561c35776020 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbb75602640 1 -- 172.21.15.196:0/371251158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84014610 con 0x561c35776020 2024-09-21T08:51:59.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c35776c10 con 0x561c35776020 2024-09-21T08:51:59.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbb75602640 1 -- 172.21.15.196:0/371251158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc84014930 con 0x561c35776020 2024-09-21T08:51:59.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c357798f0 con 0x561c35776020 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbb75602640 1 -- 172.21.15.196:0/371251158 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbc84011040 con 0x561c35776020 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbb75602640 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 0x7fbb64039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.044+0000 7fbb75602640 1 -- 172.21.15.196:0/371251158 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbc8401e070 con 0x561c35776020 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 0x7fbb64039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 0x7fbb64039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x561c355d7880 tx=0x7fbc7c00a2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8f71f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8f71f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561c354fd580 con 0x561c35782c50 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34858/0 (socket says 172.21.15.196:34858) 2024-09-21T08:51:59.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2839482884 learned_addr learned my addr 172.21.15.196:0/2839482884 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.045+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2839482884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c35783590 con 0x561c35782c50 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/2839482884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc8404cca0 tx=0x7fbc8404cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b003ebece2deb80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbb6effd640 1 -- 172.21.15.196:0/2839482884 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc84013db0 con 0x561c35782c50 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbb6effd640 1 -- 172.21.15.196:0/2839482884 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84014ad0 con 0x561c35782c50 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbb6effd640 1 -- 172.21.15.196:0/2839482884 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc84014db0 con 0x561c35782c50 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2839482884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 msgr2=0x561c35783050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2839482884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbc8404cca0 tx=0x7fbc8404cf70 comp rx=0 tx=0).stop 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2839482884 shutdown_connections 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2839482884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c35783050 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2839482884 >> 172.21.15.196:0/2839482884 conn(0x561c3577f000 msgr2=0x561c3577d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2839482884 shutdown_connections 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2839482884 wait complete. 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.046+0000 7fbc8f71f800 1 Processor -- start 2024-09-21T08:51:59.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8f71f800 1 -- start start 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8f71f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8f71f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561c35783ab0 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8bb9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34866/0 (socket says 172.21.15.196:34866) 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 learned_addr learned my addr 172.21.15.196:0/2502433048 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3578a560 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc84016ad0 tx=0x7fbc8404cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbb6d7fa640 1 -- 172.21.15.196:0/2502433048 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc84016440 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbb6d7fa640 1 -- 172.21.15.196:0/2502433048 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84022c90 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c3578a7f0 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.047+0000 7fbb6d7fa640 1 -- 172.21.15.196:0/2502433048 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc840133b0 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.048+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3578d4a0 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.048+0000 7fbb6d7fa640 1 -- 172.21.15.196:0/2502433048 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbc84013550 con 0x561c35782c50 2024-09-21T08:51:59.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.048+0000 7fbb6d7fa640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb54036b40 0x7fbb54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.048+0000 7fbb6d7fa640 1 -- 172.21.15.196:0/2502433048 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbc84034070 con 0x561c35782c50 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb54036b40 0x7fbb54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb54036b40 0x7fbb54039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0514a0 tx=0x7fbc7c094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c35795b10 0x561c35797fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35798720 con 0x561c35795b10 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c35795b10 0x561c35797fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.049+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c35795b10 0x561c35797fd0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc7400f5f0 con 0x561c35795b10 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 realm 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35794f60 con 0x561c35795b10 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc7400f5f0 con 0x561c35795b10 2024-09-21T08:51:59.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35799210 con 0x561c35795b10 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc7400f5f0 con 0x561c35795b10 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c35799ae0 con 0x561c35795b10 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc7400f5f0 con 0x561c35795b10 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c3579a500 0x561c3579c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.050+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c3579d060 con 0x561c3579a500 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c3579a500 0x561c3579c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8bb9d640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c3579a500 0x561c3579c8f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8f71f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8f71f800 20 searching for the correct realm 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561c3579f010 0x561c357a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561c357a1ba0 con 0x561c3579f010 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.051+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561c3579f010 0x561c357a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561c3579f010 0x561c357a14d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc8b39c640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbc7c078070 0x7fbc7c068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbc7c078070 0x7fbc7c068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc82b9b640 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbc7c078070 0x7fbc7c068120 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7400f5f0 con 0x7fbc7c078070 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.052+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7400f5f0 con 0x561c35795b10 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.053+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.054+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.055+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.056+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.057+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.058+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579f010 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c3579a500 2024-09-21T08:51:59.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x561c35795b10 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbc7c0a9040 con 0x7fbc7c078070 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.059+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c3579da20 con 0x561c35795b10 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c3579e2c0 con 0x561c35795b10 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c3579d660 con 0x561c35795b10 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 zone default found 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 4 Realm: () 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 zonegroup default 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357a2060 con 0x561c3579a500 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.060+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357a4330 con 0x561c3579f010 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357a46d0 con 0x561c3579f010 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 20 started sync module instance, tier type = 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.061+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a37c0 con 0x7fbc7c078070 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.062+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.062+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94679156276496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a37c0 con 0x7fbc7c078070 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.062+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a50e0 con 0x561c35795b10 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.063+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94679156276496] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.063+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.063+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94679156273936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a50e0 con 0x561c35795b10 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.063+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a5b40 con 0x561c3579f010 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.064+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94679156273936] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.064+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.064+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94679156280368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a5050 con 0x561c3579f010 2024-09-21T08:51:59.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.064+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a6a00 con 0x7fbc7c078070 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.065+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94679156280368] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.065+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.065+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94679156286800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a6e20 con 0x7fbc7c078070 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.065+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a77e0 con 0x561c35795b10 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.066+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.066+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94679156290352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a7c00 con 0x561c35795b10 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.066+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a8630 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.067+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94679156286800] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.067+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.067+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94679156293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a8630 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.067+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a90d0 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.068+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94679156290352] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.068+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94679156293952] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.068+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.068+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94679156287856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a9090 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.069+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a9970 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.069+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94679156287856] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94679156296640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a9090 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=0 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=1 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=2 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=3 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=4 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=5 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=6 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94679156296640] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 20 add_watcher() i=7 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.070+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357aca00 con 0x561c35795b10 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.071+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.071+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94679156298944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a9eb0 con 0x561c35795b10 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94679156298944] v34'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbb41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc8f71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc8f71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc8f71f800 5 note: GC not initialized 2024-09-21T08:51:59.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbb40fe1640 20 reqs_thread_entry: start 2024-09-21T08:51:59.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc8f71f800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbc8f71f800 20 Filter name: none 2024-09-21T08:51:59.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.072+0000 7fbaba7fc640 20 reqs_thread_entry: start 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357dfe20 con 0x561c35795b10 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 20 rados_obj.operate() r=0 bl.length=582 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.073+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357e6530 con 0x561c35795b10 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.074+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.074+0000 7fbc8f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.074+0000 7fbc8f71f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.074+0000 7fbc8f71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:59.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.074+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94679156547312 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561c357e1e20 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94679156290352 notify 146028888073 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fbc74018040 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbb6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94679156290352 notifier 4419 bl.length()=732 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94679156547312 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbb6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbb6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbb6effd640 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbb50003ea0 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.075+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94679156547312 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbc7403ebb0 con 0x561c35795b10 2024-09-21T08:51:59.088 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-21T08:51:58.703046Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.076+0000 7fbb41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.076+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94679156298944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357ddb70 con 0x561c35795b10 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.077+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94679156298944] v34'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.077+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94679156276496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357ddb70 con 0x7fbc7c078070 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.078+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94679156276496] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.078+0000 7fbc8f71f800 20 remove_watcher() i=0 2024-09-21T08:51:59.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.078+0000 7fbc8f71f800 2 removed watcher, disabling cache 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.078+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94679156273936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357ddb70 con 0x561c35795b10 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.079+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94679156273936] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.079+0000 7fbc8f71f800 20 remove_watcher() i=1 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.079+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94679156280368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357ddb70 con 0x561c3579f010 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.080+0000 7fbc8b39c640 1 -- 172.21.15.196:0/2502433048 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94679156280368] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7c09a040 con 0x561c3579f010 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.080+0000 7fbc8f71f800 20 remove_watcher() i=2 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.080+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94679156286800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a4c30 con 0x7fbc7c078070 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.081+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94679156286800] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x7fbc7c078070 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.081+0000 7fbc8f71f800 20 remove_watcher() i=3 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.081+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94679156290352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a6550 con 0x561c35795b10 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.082+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94679156290352] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc7402b040 con 0x561c35795b10 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.082+0000 7fbc8f71f800 20 remove_watcher() i=4 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.082+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94679156293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a4c30 con 0x561c3579a500 2024-09-21T08:51:59.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.083+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94679156293952] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.083+0000 7fbc8f71f800 20 remove_watcher() i=5 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.083+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94679156287856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a4c30 con 0x561c3579a500 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.084+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94679156287856] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.084+0000 7fbc8f71f800 20 remove_watcher() i=6 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.084+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94679156296640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561c357a4c30 con 0x561c3579a500 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8bb9d640 1 -- 172.21.15.196:0/2502433048 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94679156296640] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc8402a070 con 0x561c3579a500 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 20 remove_watcher() i=7 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c3579a500 msgr2=0x561c3579c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c3579a500 0x561c3579c8f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c35795b10 msgr2=0x561c35797fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c35795b10 0x561c35797fd0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbc7c078070 msgr2=0x7fbc7c068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbc7c078070 0x7fbc7c068120 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561c3579f010 msgr2=0x561c357a14d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x561c3579f010 0x561c357a14d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb54036b40 msgr2=0x7fbb54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb54036b40 0x7fbb54039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0514a0 tx=0x7fbc7c094000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 msgr2=0x561c3578a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc84016ad0 tx=0x7fbc8404cc30 comp rx=0 tx=0).stop 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc82b9b640 1 -- 172.21.15.196:0/2502433048 reap_dead start 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 shutdown_connections 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/2502433048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35782c50 0x561c3578a020 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 >> 172.21.15.196:0/2502433048 conn(0x561c3577f000 msgr2=0x561c3577d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 shutdown_connections 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.085+0000 7fbc8f71f800 1 -- 172.21.15.196:0/2502433048 wait complete. 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 msgr2=0x7fbb64039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 0x7fbb64039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x561c355d7880 tx=0x7fbc7c00a2c0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 msgr2=0x561c35776440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x561c355d8220 tx=0x7fbc84012fd0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 shutdown_connections 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb64036b90 0x7fbb64039050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/371251158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35776020 0x561c35776440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 >> 172.21.15.196:0/371251158 conn(0x561c3576afb0 msgr2=0x561c3576db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 shutdown_connections 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/371251158 wait complete. 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 msgr2=0x561c35766ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 0x561c35766ec0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 msgr2=0x561c357622f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 0x561c357622f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 msgr2=0x7fbb70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 0x7fbb70039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc740013b0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 msgr2=0x561c355d86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005570 tx=0x7fbc7c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 shutdown_connections 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561c35764ab0 0x561c35766ec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561c356630a0 0x561c357622f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbb70036b90 0x7fbb70039050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 --2- 172.21.15.196:0/1030944883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561c35662760 0x561c355d86c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 >> 172.21.15.196:0/1030944883 conn(0x561c3565dff0 msgr2=0x561c3574b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 shutdown_connections 2024-09-21T08:51:59.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.086+0000 7fbc8f71f800 1 -- 172.21.15.196:0/1030944883 wait complete. 2024-09-21T08:51:59.099 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-21T08:51:58.703046Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:59.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-21T08:51:59.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-21T08:51:59.099 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-21T08:51:59.147 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.147 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe4a2524800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5599fc989650 0x5599fca18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe4a2524800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599fc8d4b30 con 0x5599fca187b0 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe4a2524800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5599fc8b6360 con 0x5599fc989650 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe49e2e0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5599fc989650 0x5599fca18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe497fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5599fca187b0 0x5599fca1aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46964/0 (socket says 172.21.15.196:46964) 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.145+0000 7fe497fff640 1 -- 172.21.15.196:0/2798660636 learned_addr learned my addr 172.21.15.196:0/2798660636 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.146+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2798660636 >> v1:172.21.15.29:6789/0 conn(0x5599fca187b0 legacy=0x5599fca1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.146+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2798660636 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fc8dce00 con 0x5599fc989650 2024-09-21T08:51:59.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.147+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2798660636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fca18270 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe49000a470 tx=0x7fe490045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c413e0d8dcf7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe49dadf640 1 -- 172.21.15.196:0/2798660636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490053570 con 0x5599fc989650 2024-09-21T08:51:59.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe49dadf640 1 -- 172.21.15.196:0/2798660636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490058070 con 0x5599fc989650 2024-09-21T08:51:59.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe49dadf640 1 -- 172.21.15.196:0/2798660636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490053880 con 0x5599fc989650 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 -- 172.21.15.196:0/2798660636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 msgr2=0x5599fca18270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2798660636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fca18270 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe49000a470 tx=0x7fe490045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 -- 172.21.15.196:0/2798660636 shutdown_connections 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2798660636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fca18270 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 -- 172.21.15.196:0/2798660636 >> 172.21.15.196:0/2798660636 conn(0x5599fca0fe00 msgr2=0x5599fca12220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 -- 172.21.15.196:0/2798660636 shutdown_connections 2024-09-21T08:51:59.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.148+0000 7fe4a2524800 1 -- 172.21.15.196:0/2798660636 wait complete. 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.162+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.162+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.162+0000 7fe4a2524800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.162+0000 7fe4a2524800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5599fc961350 con 0x5599fc989650 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe49e2e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe49e2e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34880/0 (socket says 172.21.15.196:34880) 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe49e2e0640 1 -- 172.21.15.196:0/3793602544 learned_addr learned my addr 172.21.15.196:0/3793602544 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe49e2e0640 1 -- 172.21.15.196:0/3793602544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fc8aebc0 con 0x5599fc989650 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/3793602544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe490025c20 tx=0x7fe490051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e14c47db28e5b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe38c608640 1 -- 172.21.15.196:0/3793602544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490053ba0 con 0x5599fc989650 2024-09-21T08:51:59.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe38c608640 1 -- 172.21.15.196:0/3793602544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490063030 con 0x5599fc989650 2024-09-21T08:51:59.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.163+0000 7fe38c608640 1 -- 172.21.15.196:0/3793602544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490053440 con 0x5599fc989650 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- 172.21.15.196:0/3793602544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 msgr2=0x5599fcb04850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3793602544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe490025c20 tx=0x7fe490051000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- 172.21.15.196:0/3793602544 shutdown_connections 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3793602544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb04850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- 172.21.15.196:0/3793602544 >> 172.21.15.196:0/3793602544 conn(0x5599fca0fe00 msgr2=0x5599fcb00210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- 172.21.15.196:0/3793602544 shutdown_connections 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- 172.21.15.196:0/3793602544 wait complete. 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.164+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe4a2524800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe4a2524800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5599fca1c6b0 con 0x5599fc989650 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe49e2e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe49e2e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34886/0 (socket says 172.21.15.196:34886) 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe49e2e0640 1 -- 172.21.15.196:0/1109382391 learned_addr learned my addr 172.21.15.196:0/1109382391 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe49e2e0640 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fc8c2fe0 con 0x5599fc989650 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5599fcb056b0 tx=0x7fe490002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe38ae05640 1 -- 172.21.15.196:0/1109382391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490078070 con 0x5599fc989650 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe38ae05640 1 -- 172.21.15.196:0/1109382391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490053570 con 0x5599fc989650 2024-09-21T08:51:59.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599fcb0c6a0 con 0x5599fc989650 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe38ae05640 1 -- 172.21.15.196:0/1109382391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe490053850 con 0x5599fc989650 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.165+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fcb0cc20 con 0x5599fc989650 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.166+0000 7fe38ae05640 1 -- 172.21.15.196:0/1109382391 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe49007b070 con 0x5599fc989650 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.166+0000 7fe38ae05640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 0x7fe384039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.166+0000 7fe38ae05640 1 -- 172.21.15.196:0/1109382391 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe490070070 con 0x5599fc989650 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.166+0000 7fe497fff640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 0x7fe384039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.166+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 0x5599fcb131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb137f0 con 0x5599fca187b0 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe49eae1640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 0x5599fcb131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe497fff640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 0x7fe384039000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe488001d90 tx=0x7fe4880012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe49eae1640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 0x5599fcb131d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe49eae1640 1 -- 172.21.15.196:0/1109382391 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe49800a4a0 con 0x5599fca187b0 2024-09-21T08:51:59.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.167+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb14100 con 0x5599fca187b0 2024-09-21T08:51:59.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe49eae1640 1 -- 172.21.15.196:0/1109382391 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe49800a4a0 con 0x5599fca187b0 2024-09-21T08:51:59.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 0x5599fcb17ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb18670 con 0x5599fcb15a50 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 0x5599fcb17ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 0x5599fcb17ee0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.168+0000 7fe49e2e0640 1 -- 172.21.15.196:0/1109382391 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb15a50 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.169+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb14950 con 0x5599fca187b0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.169+0000 7fe49eae1640 1 -- 172.21.15.196:0/1109382391 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe49800a4a0 con 0x5599fca187b0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.169+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb14cf0 con 0x5599fca187b0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.169+0000 7fe49eae1640 1 -- 172.21.15.196:0/1109382391 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe49800a4a0 con 0x5599fca187b0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe4a2524800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe4a2524800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5599fc8b0580 con 0x5599fcb26ef0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34902/0 (socket says 172.21.15.196:34902) 2024-09-21T08:51:59.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe49eae1640 1 -- 172.21.15.196:0/3029190655 learned_addr learned my addr 172.21.15.196:0/3029190655 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe49eae1640 1 -- 172.21.15.196:0/3029190655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcb27850 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.170+0000 7fe49eae1640 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5599fcb13bd0 tx=0x7fe498018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe383fff640 1 -- 172.21.15.196:0/3029190655 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe498014450 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe383fff640 1 -- 172.21.15.196:0/3029190655 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498014610 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe383fff640 1 -- 172.21.15.196:0/3029190655 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe498014930 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599fcb27ae0 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fcb2a7c0 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe383fff640 1 -- 172.21.15.196:0/3029190655 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe498011040 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.171+0000 7fe383fff640 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 0x7fe378039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe383fff640 1 -- 172.21.15.196:0/3029190655 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe49801e070 con 0x5599fcb26ef0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 0x7fe378039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 0x7fe378039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5599fcb108d0 tx=0x7fe49008ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe4a2524800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe4a2524800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5599fcb04fa0 con 0x5599fca154a0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34918/0 (socket says 172.21.15.196:34918) 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.172+0000 7fe49eae1640 1 -- 172.21.15.196:0/3424469288 learned_addr learned my addr 172.21.15.196:0/3424469288 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe49eae1640 1 -- 172.21.15.196:0/3424469288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fca15e70 con 0x5599fca154a0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe49eae1640 1 --2- 172.21.15.196:0/3424469288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe49804cc70 tx=0x7fe49804ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc24fe35f0e3a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe381ffb640 1 -- 172.21.15.196:0/3424469288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe498042070 con 0x5599fca154a0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe381ffb640 1 -- 172.21.15.196:0/3424469288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498014c00 con 0x5599fca154a0 2024-09-21T08:51:59.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe381ffb640 1 -- 172.21.15.196:0/3424469288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe49802b480 con 0x5599fca154a0 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 -- 172.21.15.196:0/3424469288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 msgr2=0x5599fca158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3424469288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe49804cc70 tx=0x7fe49804ce70 comp rx=0 tx=0).stop 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 -- 172.21.15.196:0/3424469288 shutdown_connections 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3424469288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fca158a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 -- 172.21.15.196:0/3424469288 >> 172.21.15.196:0/3424469288 conn(0x5599fcb2feb0 msgr2=0x5599fcb2dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 -- 172.21.15.196:0/3424469288 shutdown_connections 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.173+0000 7fe4a2524800 1 -- 172.21.15.196:0/3424469288 wait complete. 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe4a2524800 1 Processor -- start 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe4a2524800 1 -- start start 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe4a2524800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fcb3d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe4a2524800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5599fca141d0 con 0x5599fca154a0 2024-09-21T08:51:59.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fcb3d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe49eae1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fcb3d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34922/0 (socket says 172.21.15.196:34922) 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 learned_addr learned my addr 172.21.15.196:0/2994832354 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcb3d770 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe49eae1640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fcb3d230 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe49804cc70 tx=0x7fe49804cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.174+0000 7fe36ffff640 1 -- 172.21.15.196:0/2994832354 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe498011980 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe36ffff640 1 -- 172.21.15.196:0/2994832354 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498033070 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599fcb3da00 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe36ffff640 1 -- 172.21.15.196:0/2994832354 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe49804e100 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fcb406b0 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe36ffff640 1 -- 172.21.15.196:0/2994832354 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe49804e2a0 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.175+0000 7fe36ffff640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe368036b90 0x7fe368039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe36ffff640 1 -- 172.21.15.196:0/2994832354 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe49800e040 con 0x5599fca154a0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe368036b90 0x7fe368039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe368036b90 0x7fe368039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe49000a470 tx=0x7fe490093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fcb48e80 0x5599fcb4b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb4ba90 con 0x5599fcb48e80 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.176+0000 7fe497fff640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fcb48e80 0x5599fcb4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe497fff640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fcb48e80 0x5599fcb4b340 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe488009050 con 0x5599fcb48e80 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 realm 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb482d0 con 0x5599fcb48e80 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe488009050 con 0x5599fcb48e80 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb4c580 con 0x5599fcb48e80 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe488009050 con 0x5599fcb48e80 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.177+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb4ce50 con 0x5599fcb48e80 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe488009050 con 0x5599fcb48e80 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb4d740 0x5599fcb4fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb50320 con 0x5599fcb4d740 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe49eae1640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb4d740 0x5599fcb4fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe49eae1640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb4d740 0x5599fcb4fb90 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.178+0000 7fe4a2524800 20 searching for the correct realm 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5599fcb522d0 0x5599fcb54790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5599fcb522d0 0x5599fcb54790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5599fcb522d0 0x5599fcb54790 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe49e2e0640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe49007d060 0x7fe4900908f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.179+0000 7fe497fff640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe49007d060 0x7fe4900908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe49007d060 0x7fe4900908f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488009050 con 0x7fe49007d060 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488009050 con 0x5599fcb48e80 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.180+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x7fe49007d060 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.181+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe488029040 con 0x7fe49007d060 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.182+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.183+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.184+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x7fe49007d060 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.185+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x7fe49007d060 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb522d0 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb4d740 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.186+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x5599fcb48e80 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb54e60 con 0x7fe49007d060 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe488029040 con 0x7fe49007d060 2024-09-21T08:51:59.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb50ce0 con 0x5599fcb48e80 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb51580 con 0x5599fcb48e80 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe488029040 con 0x5599fcb48e80 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.187+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb50920 con 0x5599fcb48e80 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 zone default found 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 4 Realm: () 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 zonegroup default 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb552e0 con 0x5599fcb4d740 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb57590 con 0x5599fcb522d0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb57930 con 0x5599fcb522d0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.188+0000 7fe4a2524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.189+0000 7fe4a2524800 20 started sync module instance, tier type = 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.189+0000 7fe4a2524800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.189+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb56a20 con 0x7fe49007d060 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.190+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.190+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94119858106192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb56a20 con 0x7fe49007d060 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.190+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb58380 con 0x5599fcb48e80 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.191+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94119858106192] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.191+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.191+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94119858110096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb56a20 con 0x5599fcb48e80 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.191+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb58dd0 con 0x5599fcb522d0 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.192+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94119858110096] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.192+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.192+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94119858103664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb56990 con 0x5599fcb522d0 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.192+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb59b90 con 0x7fe49007d060 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.193+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94119858103664] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.195+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.195+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94119858115056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb59f80 con 0x7fe49007d060 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.195+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5a9a0 con 0x5599fcb48e80 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.196+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94119858115056] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.196+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.196+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94119858119824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5a960 con 0x5599fcb48e80 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.196+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5b3b0 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.197+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94119858119824] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.197+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.197+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94119858122496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5b7a0 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.197+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5c160 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.198+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.198+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94119858126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5c5e0 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.198+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5d0c0 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.198+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94119858122496] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94119858129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5d0c0 con 0x5599fcb4d740 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=0 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=1 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=2 2024-09-21T08:51:59.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=3 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=4 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=5 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94119858126000] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.199+0000 7fe4a2524800 20 add_watcher() i=6 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94119858129872] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe4a2524800 20 add_watcher() i=7 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe4a2524800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5c0d0 con 0x5599fcb48e80 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.200+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94119858116112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5c0d0 con 0x5599fcb48e80 2024-09-21T08:51:59.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94119858116112] v34'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe4a2524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe4a2524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe4a2524800 5 note: GC not initialized 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe2cf7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe4a2524800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.201+0000 7fe4a2524800 20 Filter name: none 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe2cd7fa640 20 reqs_thread_entry: start 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb93570 con 0x5599fcb48e80 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 20 rados_obj.operate() r=0 bl.length=556 2024-09-21T08:51:59.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.202+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb99d60 con 0x5599fcb48e80 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.203+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.203+0000 7fe4a2524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.203+0000 7fe4a2524800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.203+0000 7fe4a2524800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.203+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94119858378528 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb95380 con 0x5599fcb48e80 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94119858119824 notify 146028888074 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5599fc8d4b30 con 0x5599fcb48e80 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe381ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94119858119824 notifier 4426 bl.length()=567 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe381ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe381ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe381ffb640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe364003ea0 con 0x5599fcb48e80 2024-09-21T08:51:59.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94119858378528 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94119858378528 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe48802fc80 con 0x5599fcb48e80 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.204+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb99720 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 foo:foo2 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe4a2524800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94119858378528 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb94ed0 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== watch-notify(notify (1) cookie 94119858106192 notify 146028888069 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fe48802fc80 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe3817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94119858106192 notifier 4426 bl.length()=159 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe3817fa640 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe2d40032c0 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.205+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(67 notify.0 [notify cookie 94119858378528 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.206+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify_complete (2) cookie 94119858378528 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe48802d450 con 0x7fe49007d060 2024-09-21T08:51:59.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.206+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.216 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:51:59.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.207+0000 7fe354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.207+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94119858116112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb912e0 con 0x5599fcb48e80 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94119858116112] v34'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94119858106192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb912e0 con 0x7fe49007d060 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94119858106192] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe4a2524800 20 remove_watcher() i=0 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe4a2524800 2 removed watcher, disabling cache 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.208+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94119858110096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb912e0 con 0x5599fcb48e80 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.209+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94119858110096] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.209+0000 7fe4a2524800 20 remove_watcher() i=1 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.209+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94119858103664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb912e0 con 0x5599fcb522d0 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.210+0000 7fe49e2e0640 1 -- 172.21.15.196:0/2994832354 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94119858103664] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49007a030 con 0x5599fcb522d0 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.210+0000 7fe4a2524800 20 remove_watcher() i=2 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.211+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94119858115056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb57e90 con 0x7fe49007d060 2024-09-21T08:51:59.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.211+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94119858115056] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x7fe49007d060 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.211+0000 7fe4a2524800 20 remove_watcher() i=3 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.211+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94119858119824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb57e90 con 0x5599fcb48e80 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.212+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94119858119824] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4880391c0 con 0x5599fcb48e80 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.212+0000 7fe4a2524800 20 remove_watcher() i=4 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.212+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94119858122496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5a490 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.213+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94119858122496] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.213+0000 7fe4a2524800 20 remove_watcher() i=5 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.213+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94119858126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb57e90 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.214+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94119858126000] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.214+0000 7fe4a2524800 20 remove_watcher() i=6 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.214+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94119858129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599fcb5bcb0 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe49eae1640 1 -- 172.21.15.196:0/2994832354 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94119858129872] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49802a070 con 0x5599fcb4d740 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 20 remove_watcher() i=7 2024-09-21T08:51:59.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb4d740 msgr2=0x5599fcb4fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb4d740 0x5599fcb4fb90 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fcb48e80 msgr2=0x5599fcb4b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fcb48e80 0x5599fcb4b340 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe49007d060 msgr2=0x7fe4900908f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe49007d060 0x7fe4900908f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5599fcb522d0 msgr2=0x5599fcb54790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5599fcb522d0 0x5599fcb54790 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe368036b90 msgr2=0x7fe368039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe368036b90 0x7fe368039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe49000a470 tx=0x7fe490093000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 msgr2=0x5599fcb3d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 --2- 172.21.15.196:0/2994832354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fca154a0 0x5599fcb3d230 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe49804cc70 tx=0x7fe49804cc00 comp rx=0 tx=0).stop 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 reap_dead start 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe497fff640 1 -- 172.21.15.196:0/2994832354 reap_dead start 2024-09-21T08:51:59.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 shutdown_connections 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.215+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 >> 172.21.15.196:0/2994832354 conn(0x5599fcb2feb0 msgr2=0x5599fcb2df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 shutdown_connections 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/2994832354 wait complete. 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 msgr2=0x7fe378039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 0x7fe378039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5599fcb108d0 tx=0x7fe49008ec10 comp rx=0 tx=0).stop 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 msgr2=0x5599fcb27310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5599fcb13bd0 tx=0x7fe498018830 comp rx=0 tx=0).stop 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 shutdown_connections 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe378036b90 0x7fe378039050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/3029190655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fcb26ef0 0x5599fcb27310 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 >> 172.21.15.196:0/3029190655 conn(0x5599fcb1be80 msgr2=0x5599fcb1ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 shutdown_connections 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/3029190655 wait complete. 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 msgr2=0x5599fcb17ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 0x5599fcb17ee0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 msgr2=0x5599fcb131d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 0x5599fcb131d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 msgr2=0x7fe384039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 0x7fe384039000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe488001d90 tx=0x7fe4880012f0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 msgr2=0x5599fcb0c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5599fcb056b0 tx=0x7fe490002fb0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 shutdown_connections 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5599fcb15a50 0x5599fcb17ee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5599fca187b0 0x5599fcb131d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe384036b40 0x7fe384039000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 --2- 172.21.15.196:0/1109382391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599fc989650 0x5599fcb0c160 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.216+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 >> 172.21.15.196:0/1109382391 conn(0x5599fca0fe00 msgr2=0x5599fcafea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.217+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 shutdown_connections 2024-09-21T08:51:59.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.217+0000 7fe4a2524800 1 -- 172.21.15.196:0/1109382391 wait complete. 2024-09-21T08:51:59.228 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:51:59.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-21T08:51:59.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-21T08:51:59.228 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-21T08:51:59.272 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.272 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.270+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.270+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.270+0000 7f3738724800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55cb348d9d00 0x55cb348dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.270+0000 7f3738724800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb34792b30 con 0x55cb34846df0 2024-09-21T08:51:59.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.270+0000 7f3738724800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55cb34774360 con 0x55cb348d9d00 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f372bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55cb348d9d00 0x55cb348dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f37344ac640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55cb34846df0 0x55cb348d85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46978/0 (socket says 172.21.15.196:46978) 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f37344ac640 1 -- 172.21.15.196:0/2942639280 learned_addr learned my addr 172.21.15.196:0/2942639280 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f372bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55cb348d9d00 0x55cb348dc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34936/0 (socket says 172.21.15.196:34936) 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f372bfff640 1 -- 172.21.15.196:0/2942639280 >> v1:172.21.15.29:6789/0 conn(0x55cb34846df0 legacy=0x55cb348d85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.271+0000 7f372bfff640 1 -- 172.21.15.196:0/2942639280 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3479ae00 con 0x55cb348d9d00 2024-09-21T08:51:59.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f372bfff640 1 --2- 172.21.15.196:0/2942639280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb348d9d00 0x55cb348dc0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a470 tx=0x7f371c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609ec01f2a351150 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3733cab640 1 -- 172.21.15.196:0/2942639280 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c053570 con 0x55cb348d9d00 2024-09-21T08:51:59.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3733cab640 1 -- 172.21.15.196:0/2942639280 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c058070 con 0x55cb348d9d00 2024-09-21T08:51:59.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3733cab640 1 -- 172.21.15.196:0/2942639280 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c053880 con 0x55cb348d9d00 2024-09-21T08:51:59.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 -- 172.21.15.196:0/2942639280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb348d9d00 msgr2=0x55cb348dc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 --2- 172.21.15.196:0/2942639280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb348d9d00 0x55cb348dc0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a470 tx=0x7f371c045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:59.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 -- 172.21.15.196:0/2942639280 shutdown_connections 2024-09-21T08:51:59.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 --2- 172.21.15.196:0/2942639280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb348d9d00 0x55cb348dc0f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 -- 172.21.15.196:0/2942639280 >> 172.21.15.196:0/2942639280 conn(0x55cb348cddf0 msgr2=0x55cb348d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 -- 172.21.15.196:0/2942639280 shutdown_connections 2024-09-21T08:51:59.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.273+0000 7f3738724800 1 -- 172.21.15.196:0/2942639280 wait complete. 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f3738724800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f3738724800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cb3481f330 con 0x55cb34846df0 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f37344ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f37344ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34938/0 (socket says 172.21.15.196:34938) 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.287+0000 7f37344ac640 1 -- 172.21.15.196:0/4249705522 learned_addr learned my addr 172.21.15.196:0/4249705522 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.288+0000 7f37344ac640 1 -- 172.21.15.196:0/4249705522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3476cbc0 con 0x55cb34846df0 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.288+0000 7f37344ac640 1 --2- 172.21.15.196:0/4249705522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3724001e10 tx=0x7f372400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22e0d3c121951e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.288+0000 7f362260c640 1 -- 172.21.15.196:0/4249705522 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724012020 con 0x55cb34846df0 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.288+0000 7f362260c640 1 -- 172.21.15.196:0/4249705522 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372400e5a0 con 0x55cb34846df0 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.288+0000 7f362260c640 1 -- 172.21.15.196:0/4249705522 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372400e8e0 con 0x55cb34846df0 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- 172.21.15.196:0/4249705522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 msgr2=0x55cb349c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 --2- 172.21.15.196:0/4249705522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3724001e10 tx=0x7f372400b780 comp rx=0 tx=0).stop 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- 172.21.15.196:0/4249705522 shutdown_connections 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 --2- 172.21.15.196:0/4249705522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349c4a60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- 172.21.15.196:0/4249705522 >> 172.21.15.196:0/4249705522 conn(0x55cb348cddf0 msgr2=0x55cb349c0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- 172.21.15.196:0/4249705522 shutdown_connections 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- 172.21.15.196:0/4249705522 wait complete. 2024-09-21T08:51:59.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f3738724800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cb348dc900 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.289+0000 7f37344ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f37344ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34946/0 (socket says 172.21.15.196:34946) 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f37344ac640 1 -- 172.21.15.196:0/4022587614 learned_addr learned my addr 172.21.15.196:0/4022587614 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f37344ac640 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb34780fe0 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f37344ac640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f372400b7c0 tx=0x7f3724000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f3620e09640 1 -- 172.21.15.196:0/4022587614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724012030 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f3620e09640 1 -- 172.21.15.196:0/4022587614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3724001470 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb349cc980 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f3620e09640 1 -- 172.21.15.196:0/4022587614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372401a8d0 con 0x55cb34846df0 2024-09-21T08:51:59.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.290+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb349ccea0 con 0x55cb34846df0 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3620e09640 1 -- 172.21.15.196:0/4022587614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3724015020 con 0x55cb34846df0 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3620e09640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 0x7f361c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3620e09640 1 -- 172.21.15.196:0/4022587614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3724020030 con 0x55cb34846df0 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f372bfff640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 0x7f361c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 0x55cb349d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb349d39f0 con 0x55cb348d9d00 2024-09-21T08:51:59.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.291+0000 7f3734cad640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 0x55cb349d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f372bfff640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 0x7f361c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f371c057000 tx=0x7f371c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3734cad640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 0x55cb349d34b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3734cad640 1 -- 172.21.15.196:0/4022587614 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f372c00a4a0 con 0x55cb348d9d00 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb349d0a80 con 0x55cb348d9d00 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3734cad640 1 -- 172.21.15.196:0/4022587614 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f372c00a4a0 con 0x55cb348d9d00 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 0x55cb349d8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.292+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb349d8820 con 0x55cb349d5d40 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.293+0000 7f37344ac640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 0x55cb349d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.293+0000 7f37344ac640 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 0x55cb349d8130 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.293+0000 7f37344ac640 1 -- 172.21.15.196:0/4022587614 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3724018950 con 0x55cb349d5d40 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.293+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb349d4be0 con 0x55cb348d9d00 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3734cad640 1 -- 172.21.15.196:0/4022587614 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f372c00a4a0 con 0x55cb348d9d00 2024-09-21T08:51:59.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb349d5080 con 0x55cb348d9d00 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3734cad640 1 -- 172.21.15.196:0/4022587614 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f372c00a4a0 con 0x55cb348d9d00 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3738724800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.294+0000 7f3738724800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cb3476e580 con 0x55cb349e7170 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34950/0 (socket says 172.21.15.196:34950) 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3734cad640 1 -- 172.21.15.196:0/1766437179 learned_addr learned my addr 172.21.15.196:0/1766437179 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3734cad640 1 -- 172.21.15.196:0/1766437179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb349e7ad0 con 0x55cb349e7170 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3734cad640 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55cb349d3df0 tx=0x7f372c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3619ffb640 1 -- 172.21.15.196:0/1766437179 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c014450 con 0x55cb349e7170 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3619ffb640 1 -- 172.21.15.196:0/1766437179 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c014610 con 0x55cb349e7170 2024-09-21T08:51:59.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3619ffb640 1 -- 172.21.15.196:0/1766437179 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c014930 con 0x55cb349e7170 2024-09-21T08:51:59.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb349e7d60 con 0x55cb349e7170 2024-09-21T08:51:59.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.295+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb349eaa40 con 0x55cb349e7170 2024-09-21T08:51:59.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f3619ffb640 1 -- 172.21.15.196:0/1766437179 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f372c011040 con 0x55cb349e7170 2024-09-21T08:51:59.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f3619ffb640 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 0x7f360c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f3619ffb640 1 -- 172.21.15.196:0/1766437179 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f372c01e070 con 0x55cb349e7170 2024-09-21T08:51:59.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f37344ac640 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 0x7f360c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f37344ac640 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 0x7f360c039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55cb349d3e90 tx=0x7f372404b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.296+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3738724800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3738724800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cb349c5210 con 0x55cb349f3dd0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34966/0 (socket says 172.21.15.196:34966) 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3734cad640 1 -- 172.21.15.196:0/1044414342 learned_addr learned my addr 172.21.15.196:0/1044414342 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3734cad640 1 -- 172.21.15.196:0/1044414342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb349f47a0 con 0x55cb349f3dd0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f3734cad640 1 --2- 172.21.15.196:0/1044414342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f372c04cbc0 tx=0x7f372c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2acba5389495b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.297+0000 7f360b7fe640 1 -- 172.21.15.196:0/1044414342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c040150 con 0x55cb349f3dd0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f360b7fe640 1 -- 172.21.15.196:0/1044414342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c0167e0 con 0x55cb349f3dd0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f360b7fe640 1 -- 172.21.15.196:0/1044414342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c014ad0 con 0x55cb349f3dd0 2024-09-21T08:51:59.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- 172.21.15.196:0/1044414342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 msgr2=0x55cb349f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 --2- 172.21.15.196:0/1044414342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f372c04cbc0 tx=0x7f372c011b10 comp rx=0 tx=0).stop 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- 172.21.15.196:0/1044414342 shutdown_connections 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 --2- 172.21.15.196:0/1044414342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349f41d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- 172.21.15.196:0/1044414342 >> 172.21.15.196:0/1044414342 conn(0x55cb349f0130 msgr2=0x55cb349ee230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- 172.21.15.196:0/1044414342 shutdown_connections 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- 172.21.15.196:0/1044414342 wait complete. 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 Processor -- start 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 -- start start 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.298+0000 7f3738724800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349fb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3738724800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cb349f4e10 con 0x55cb349f3dd0 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3734cad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349fb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34982/0 (socket says 172.21.15.196:34982) 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 learned_addr learned my addr 172.21.15.196:0/4039015124 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb349fb780 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3734cad640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349fb240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f372c011fd0 tx=0x7f372c04cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3609ffb640 1 -- 172.21.15.196:0/4039015124 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c011510 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3609ffb640 1 -- 172.21.15.196:0/4039015124 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c0116b0 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb349fba10 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3609ffb640 1 -- 172.21.15.196:0/4039015124 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372c0133b0 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.299+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb349fe6c0 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.300+0000 7f3609ffb640 1 -- 172.21.15.196:0/4039015124 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f372c013550 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.300+0000 7f3609ffb640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f35fc036b40 0x7f35fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.300+0000 7f3609ffb640 1 -- 172.21.15.196:0/4039015124 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f372c046040 con 0x55cb349f3dd0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.300+0000 7f37344ac640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f35fc036b40 0x7f35fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.300+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb34a06e90 0x55cb34a09350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a09aa0 con 0x55cb34a06e90 2024-09-21T08:51:59.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f37344ac640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f35fc036b40 0x7f35fc039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f372400e530 tx=0x7f3724037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f372bfff640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb34a06e90 0x55cb34a09350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f372bfff640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb34a06e90 0x55cb34a09350 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 20 realm 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a09ed0 con 0x55cb34a06e90 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.301+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0a7a0 con 0x55cb34a06e90 2024-09-21T08:51:59.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0ab40 con 0x55cb34a06e90 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb34a0b8a0 0x55cb34a0dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0e1d0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3734cad640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb34a0b8a0 0x55cb34a0dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.302+0000 7f3734cad640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb34a0b8a0 0x55cb34a0dc90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f3738724800 20 searching for the correct realm 2024-09-21T08:51:59.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55cb34a10210 0x55cb34a126d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f37344ac640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55cb34a10210 0x55cb34a126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f37344ac640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55cb34a10210 0x55cb34a126d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f37344ac640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3724017050 0x7f3724024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.303+0000 7f372bfff640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3724017050 0x7f3724024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.304+0000 7f372bfff640 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3724017050 0x7f3724024420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.304+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.304+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.304+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.304+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.305+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.306+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.307+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.308+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.309+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.310+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a10210 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x55cb34a06e90 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.311+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a12da0 con 0x7f3724017050 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0ec10 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0f060 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0f4c0 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 zone default found 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 4 Realm: () 2024-09-21T08:51:59.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 zonegroup default 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.312+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a13220 con 0x55cb34a0b8a0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a0e850 con 0x55cb34a10210 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a155a0 con 0x55cb34a10210 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 started sync module instance, tier type = 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.313+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a148e0 con 0x7f3724017050 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.314+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.314+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94331249708512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a148e0 con 0x7f3724017050 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.314+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a16120 con 0x55cb34a06e90 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.315+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94331249708512] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.316+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.316+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94331249712112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a148e0 con 0x55cb34a06e90 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.316+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a16bb0 con 0x55cb34a10210 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.316+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.317+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94331249714816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a17450 con 0x55cb34a10210 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.317+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a17f10 con 0x7f3724017050 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.317+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94331249712112] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.317+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94331249714816] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.318+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.318+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94331249717152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a14430 con 0x7f3724017050 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.318+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a187b0 con 0x55cb34a06e90 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.319+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.319+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94331249717152] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.319+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94331249721984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a18be0 con 0x55cb34a06e90 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.319+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a19210 con 0x55cb34a0b8a0 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.320+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.320+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94331249719776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a19a60 con 0x55cb34a0b8a0 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.320+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a1a4b0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.320+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94331249721984] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.321+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94331249719776] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.321+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.321+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94331249729440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a19610 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.321+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a1ab40 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94331249729440] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94331249723040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a1ab40 con 0x55cb34a0b8a0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=0 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=1 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=2 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=3 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=4 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=5 2024-09-21T08:51:59.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.322+0000 7f3738724800 20 add_watcher() i=6 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94331249723040] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f3738724800 20 add_watcher() i=7 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f3738724800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a1dd60 con 0x55cb34a06e90 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.323+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94331249731584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a1b0d0 con 0x55cb34a06e90 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94331249731584] v34'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f35ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f3738724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f3738724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f3738724800 5 note: GC not initialized 2024-09-21T08:51:59.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.324+0000 7f35e97e2640 20 reqs_thread_entry: start 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 20 Filter name: none 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f355affd640 20 reqs_thread_entry: start 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a50d10 con 0x55cb34a06e90 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.325+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a51700 con 0x55cb34a06e90 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.326+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.326+0000 7f3738724800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.326+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a52710 con 0x7f3724017050 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.326+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.327+0000 7f35ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.327+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94331249731584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a4eb00 con 0x55cb34a06e90 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.328+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94331249731584] v34'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.328+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94331249708512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a4eb00 con 0x7f3724017050 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.329+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94331249708512] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.329+0000 7f3738724800 20 remove_watcher() i=0 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.329+0000 7f3738724800 2 removed watcher, disabling cache 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.329+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94331249712112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a4eb00 con 0x55cb34a06e90 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94331249712112] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f3738724800 20 remove_watcher() i=1 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94331249714816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a4eb00 con 0x55cb34a10210 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f37344ac640 1 -- 172.21.15.196:0/4039015124 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94331249714816] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724018950 con 0x55cb34a10210 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f3738724800 20 remove_watcher() i=2 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.330+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94331249717152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a14de0 con 0x7f3724017050 2024-09-21T08:51:59.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.332+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94331249717152] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x7f3724017050 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.332+0000 7f3738724800 20 remove_watcher() i=3 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.332+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94331249721984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a15bf0 con 0x55cb34a06e90 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.333+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94331249721984] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c051070 con 0x55cb34a06e90 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.333+0000 7f3738724800 20 remove_watcher() i=4 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.333+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94331249719776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a16680 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.334+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94331249719776] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.334+0000 7f3738724800 20 remove_watcher() i=5 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.334+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94331249729440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a16fa0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.335+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94331249729440] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.335+0000 7f3738724800 20 remove_watcher() i=6 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.335+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94331249723040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb34a14de0 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3734cad640 1 -- 172.21.15.196:0/4039015124 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94331249723040] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372c02a070 con 0x55cb34a0b8a0 2024-09-21T08:51:59.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 20 remove_watcher() i=7 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb34a0b8a0 msgr2=0x55cb34a0dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb34a0b8a0 0x55cb34a0dc90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb34a06e90 msgr2=0x55cb34a09350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb34a06e90 0x55cb34a09350 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3724017050 msgr2=0x7f3724024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3724017050 0x7f3724024420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55cb34a10210 msgr2=0x55cb34a126d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55cb34a10210 0x55cb34a126d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f35fc036b40 msgr2=0x7f35fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f35fc036b40 0x7f35fc039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f372400e530 tx=0x7f3724037000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 msgr2=0x55cb349fb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/4039015124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349f3dd0 0x55cb349fb240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f372c011fd0 tx=0x7f372c04cb50 comp rx=0 tx=0).stop 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 reap_dead start 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f372bfff640 1 -- 172.21.15.196:0/4039015124 reap_dead start 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 shutdown_connections 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 >> 172.21.15.196:0/4039015124 conn(0x55cb349f0130 msgr2=0x55cb349ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 shutdown_connections 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/4039015124 wait complete. 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 msgr2=0x7f360c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 0x7f360c039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55cb349d3e90 tx=0x7f372404b030 comp rx=0 tx=0).stop 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 msgr2=0x55cb349e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.336+0000 7f3738724800 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55cb349d3df0 tx=0x7f372c018830 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 shutdown_connections 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f360c036b90 0x7f360c039050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/1766437179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb349e7170 0x55cb349e7590 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 >> 172.21.15.196:0/1766437179 conn(0x55cb349dc100 msgr2=0x55cb349dec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 shutdown_connections 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/1766437179 wait complete. 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 msgr2=0x55cb349d8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 0x55cb349d8130 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 msgr2=0x55cb349d34b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 0x55cb349d34b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 msgr2=0x7f361c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 0x7f361c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f371c057000 tx=0x7f371c052000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 msgr2=0x55cb349cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f372400b7c0 tx=0x7f3724000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 shutdown_connections 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55cb349d5d40 0x55cb349d8130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55cb348d9d00 0x55cb349d34b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f361c036b90 0x7f361c039050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 --2- 172.21.15.196:0/4022587614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cb34846df0 0x55cb349cc440 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 >> 172.21.15.196:0/4022587614 conn(0x55cb348cddf0 msgr2=0x55cb349becf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 shutdown_connections 2024-09-21T08:51:59.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.337+0000 7f3738724800 1 -- 172.21.15.196:0/4022587614 wait complete. 2024-09-21T08:51:59.348 INFO:teuthology.orchestra.run.smithi196.stdout:[] 2024-09-21T08:51:59.348 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T08:51:59.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-21T08:51:59.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-21T08:51:59.349 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-21T08:51:59.392 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.393 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.391+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.391+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.391+0000 7fa66602f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b3c1824990 0x55b3c1826d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.391+0000 7fa66602f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3c16e0b30 con 0x55b3c1820550 2024-09-21T08:51:59.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.391+0000 7fa66602f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b3c16c2360 con 0x55b3c1824990 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa65bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b3c1824990 0x55b3c1826d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa65bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b3c1824990 0x55b3c1826d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34998/0 (socket says 172.21.15.196:34998) 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa65bfff640 1 -- 172.21.15.196:0/3422812811 learned_addr learned my addr 172.21.15.196:0/3422812811 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa663b2a640 1 --1- 172.21.15.196:0/3422812811 >> v1:172.21.15.29:6789/0 conn(0x55b3c1820550 0x55b3c1820950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46980/0 (socket says 172.21.15.196:46980) 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa65bfff640 1 -- 172.21.15.196:0/3422812811 >> v1:172.21.15.29:6789/0 conn(0x55b3c1820550 legacy=0x55b3c1820950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa663329640 1 -- 172.21.15.196:0/3422812811 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355320236 0 0) 0x55b3c16e0b30 con 0x55b3c1820550 2024-09-21T08:51:59.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.392+0000 7fa65bfff640 1 -- 172.21.15.196:0/3422812811 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c16e8e00 con 0x55b3c1824990 2024-09-21T08:51:59.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa65bfff640 1 --2- 172.21.15.196:0/3422812811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1824990 0x55b3c1826d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00a520 tx=0x7fa64c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e37d7e10f9d8ece server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa663329640 1 -- 172.21.15.196:0/3422812811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64c055070 con 0x55b3c1824990 2024-09-21T08:51:59.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa663329640 1 -- 172.21.15.196:0/3422812811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c0515b0 con 0x55b3c1824990 2024-09-21T08:51:59.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa663329640 1 -- 172.21.15.196:0/3422812811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64c0518d0 con 0x55b3c1824990 2024-09-21T08:51:59.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 -- 172.21.15.196:0/3422812811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1824990 msgr2=0x55b3c1826d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 --2- 172.21.15.196:0/3422812811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1824990 0x55b3c1826d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00a520 tx=0x7fa64c045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 -- 172.21.15.196:0/3422812811 shutdown_connections 2024-09-21T08:51:59.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 --2- 172.21.15.196:0/3422812811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1824990 0x55b3c1826d80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 -- 172.21.15.196:0/3422812811 >> 172.21.15.196:0/3422812811 conn(0x55b3c181bde0 msgr2=0x55b3c181e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 -- 172.21.15.196:0/3422812811 shutdown_connections 2024-09-21T08:51:59.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.394+0000 7fa66602f800 1 -- 172.21.15.196:0/3422812811 wait complete. 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.408+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.408+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.408+0000 7fa66602f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.408+0000 7fa66602f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b3c176d330 con 0x55b3c1820550 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.408+0000 7fa663b2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa663b2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35002/0 (socket says 172.21.15.196:35002) 2024-09-21T08:51:59.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa663b2a640 1 -- 172.21.15.196:0/3296092208 learned_addr learned my addr 172.21.15.196:0/3296092208 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa663b2a640 1 -- 172.21.15.196:0/3296092208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c16babc0 con 0x55b3c1820550 2024-09-21T08:51:59.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa663b2a640 1 --2- 172.21.15.196:0/3296092208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b240 tx=0x7fa65400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbed8b22e0f5fce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa551e0b640 1 -- 172.21.15.196:0/3296092208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa654008070 con 0x55b3c1820550 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa551e0b640 1 -- 172.21.15.196:0/3296092208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65400d500 con 0x55b3c1820550 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.409+0000 7fa551e0b640 1 -- 172.21.15.196:0/3296092208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65400d860 con 0x55b3c1820550 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- 172.21.15.196:0/3296092208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 msgr2=0x55b3c17955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 --2- 172.21.15.196:0/3296092208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b240 tx=0x7fa65400b700 comp rx=0 tx=0).stop 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- 172.21.15.196:0/3296092208 shutdown_connections 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 --2- 172.21.15.196:0/3296092208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c17955a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- 172.21.15.196:0/3296092208 >> 172.21.15.196:0/3296092208 conn(0x55b3c181bde0 msgr2=0x55b3c190af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- 172.21.15.196:0/3296092208 shutdown_connections 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- 172.21.15.196:0/3296092208 wait complete. 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.410+0000 7fa66602f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b3c18275c0 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa663b2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa663b2a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35012/0 (socket says 172.21.15.196:35012) 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa663b2a640 1 -- 172.21.15.196:0/1643975830 learned_addr learned my addr 172.21.15.196:0/1643975830 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa663b2a640 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c16cefe0 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55b3c1794ca0 tx=0x7fa654000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa54bfff640 1 -- 172.21.15.196:0/1643975830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa654019870 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa54bfff640 1 -- 172.21.15.196:0/1643975830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa654019a10 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c1918640 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa54bfff640 1 -- 172.21.15.196:0/1643975830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa654019d30 con 0x55b3c1820550 2024-09-21T08:51:59.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.411+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c1918b60 con 0x55b3c1820550 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa54bfff640 1 -- 172.21.15.196:0/1643975830 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa654017040 con 0x55b3c1820550 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa54bfff640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 0x7fa54c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa54bfff640 1 -- 172.21.15.196:0/1643975830 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa654015020 con 0x55b3c1820550 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 0x7fa54c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 0x55b3c191f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.412+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c191f6b0 con 0x55b3c1824990 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66432b640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 0x55b3c191f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 0x7fa54c039000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa64c057000 tx=0x7fa64c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66432b640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 0x55b3c191f170 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66432b640 1 -- 172.21.15.196:0/1643975830 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa65c00a4a0 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c191c740 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66432b640 1 -- 172.21.15.196:0/1643975830 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa65c00a4a0 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 0x55b3c1923db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.413+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1924450 con 0x55b3c19219c0 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.414+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 0x55b3c1923db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.414+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 0x55b3c1923db0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.414+0000 7fa663b2a640 1 -- 172.21.15.196:0/1643975830 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa65402d070 con 0x55b3c19219c0 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.414+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1920860 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66432b640 1 -- 172.21.15.196:0/1643975830 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa65c00a4a0 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1920d00 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66432b640 1 -- 172.21.15.196:0/1643975830 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa65c00a4a0 con 0x55b3c1824990 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66602f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.415+0000 7fa66602f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b3c16bc580 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35024/0 (socket says 172.21.15.196:35024) 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66432b640 1 -- 172.21.15.196:0/374446512 learned_addr learned my addr 172.21.15.196:0/374446512 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66432b640 1 -- 172.21.15.196:0/374446512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c1933740 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66432b640 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b3c19191b0 tx=0x7fa65c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa5497fa640 1 -- 172.21.15.196:0/374446512 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c014450 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa5497fa640 1 -- 172.21.15.196:0/374446512 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c0145f0 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa5497fa640 1 -- 172.21.15.196:0/374446512 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c0148d0 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.416+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c19339d0 con 0x55b3c1932de0 2024-09-21T08:51:59.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.417+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c19366b0 con 0x55b3c1932de0 2024-09-21T08:51:59.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.417+0000 7fa5497fa640 1 -- 172.21.15.196:0/374446512 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa65c011040 con 0x55b3c1932de0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.417+0000 7fa5497fa640 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 0x7fa53c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.417+0000 7fa5497fa640 1 -- 172.21.15.196:0/374446512 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa65c01e070 con 0x55b3c1932de0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.417+0000 7fa663b2a640 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 0x7fa53c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa663b2a640 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 0x7fa53c039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b3c191fae0 tx=0x7fa65401b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66602f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66602f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1913530 con 0x55b3c193f9d0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35032/0 (socket says 172.21.15.196:35032) 2024-09-21T08:51:59.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66432b640 1 -- 172.21.15.196:0/3792653407 learned_addr learned my addr 172.21.15.196:0/3792653407 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66432b640 1 -- 172.21.15.196:0/3792653407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c19403a0 con 0x55b3c193f9d0 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa66432b640 1 --2- 172.21.15.196:0/3792653407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa65c04cbb0 tx=0x7fa65c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4adb2573c7b6c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.418+0000 7fa542ffd640 1 -- 172.21.15.196:0/3792653407 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c013dc0 con 0x55b3c193f9d0 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa542ffd640 1 -- 172.21.15.196:0/3792653407 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c014a70 con 0x55b3c193f9d0 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa542ffd640 1 -- 172.21.15.196:0/3792653407 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c014d50 con 0x55b3c193f9d0 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- 172.21.15.196:0/3792653407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 msgr2=0x55b3c193fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 --2- 172.21.15.196:0/3792653407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa65c04cbb0 tx=0x7fa65c011970 comp rx=0 tx=0).stop 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- 172.21.15.196:0/3792653407 shutdown_connections 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 --2- 172.21.15.196:0/3792653407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c193fdd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- 172.21.15.196:0/3792653407 >> 172.21.15.196:0/3792653407 conn(0x55b3c193bdc0 msgr2=0x55b3c1939ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- 172.21.15.196:0/3792653407 shutdown_connections 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- 172.21.15.196:0/3792653407 wait complete. 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 Processor -- start 2024-09-21T08:51:59.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.419+0000 7fa66602f800 1 -- start start 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66602f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c1910cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66602f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1940a10 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c1910cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66432b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c1910cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35034/0 (socket says 172.21.15.196:35034) 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 learned_addr learned my addr 172.21.15.196:0/1128465965 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c190f3a0 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66432b640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c1910cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa65c011be0 tx=0x7fa65c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa5417fa640 1 -- 172.21.15.196:0/1128465965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c044030 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa5417fa640 1 -- 172.21.15.196:0/1128465965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c022a80 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c190f630 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa5417fa640 1 -- 172.21.15.196:0/1128465965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c016440 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.420+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c190fad0 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.421+0000 7fa5417fa640 1 -- 172.21.15.196:0/1128465965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa65c02b350 con 0x55b3c193f9d0 2024-09-21T08:51:59.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.421+0000 7fa5417fa640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa52c036b40 0x7fa52c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.421+0000 7fa5417fa640 1 -- 172.21.15.196:0/1128465965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa65c045070 con 0x55b3c193f9d0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.421+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa52c036b40 0x7fa52c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.421+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1954d40 0x55b3c1957200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1957950 con 0x55b3c1954d40 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1954d40 0x55b3c1957200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa52c036b40 0x7fa52c039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa654040fd0 tx=0x7fa654035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1954d40 0x55b3c1957200 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 20 realm 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1957d80 con 0x55b3c1954d40 2024-09-21T08:51:59.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.422+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1958650 con 0x55b3c1954d40 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c19589f0 con 0x55b3c1954d40 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c1959750 0x55b3c195bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c195c080 con 0x55b3c1959750 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66432b640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c1959750 0x55b3c195bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.423+0000 7fa66432b640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c1959750 0x55b3c195bb40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa66602f800 20 searching for the correct realm 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b3c195e0c0 0x55b3c1960580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c195e0c0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b3c195e0c0 0x55b3c1960580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b3c195e0c0 0x55b3c1960580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa663b2a640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa65403d070 0x7fa6540187f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.424+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x7fa65403d070 2024-09-21T08:51:59.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa65403d070 0x7fa6540187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa65bfff640 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa65403d070 0x7fa6540187f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.425+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1954d40 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1954d40 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.426+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x7fa65403d070 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c195e0c0 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1954d40 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.427+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1959750 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c1954d40 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x7fa65403d070 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1960c50 con 0x55b3c195e0c0 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.428+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1959750 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1954d40 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.429+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1954d40 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1959750 2024-09-21T08:51:59.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x7fa65403d070 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1954d40 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.430+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1959750 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1959750 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x7fa65403d070 2024-09-21T08:51:59.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.431+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c195e0c0 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1959750 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x55b3c1954d40 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa65405a040 con 0x7fa65403d070 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.432+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c195cac0 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c195cf10 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c195d3b0 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 zone default found 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 4 Realm: () 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 zonegroup default 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.433+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c19610d0 con 0x55b3c1959750 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c195c700 con 0x55b3c195e0c0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1963480 con 0x55b3c195e0c0 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 started sync module instance, tier type = 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.434+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962790 con 0x7fa65403d070 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.435+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.435+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230535351440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962790 con 0x7fa65403d070 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.435+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1963fb0 con 0x55b3c1954d40 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.436+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230535351440] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.436+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.436+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230535355008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962790 con 0x55b3c1954d40 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.436+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1964a60 con 0x55b3c195e0c0 2024-09-21T08:51:59.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.437+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230535355008] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.438+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.438+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230535348960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962700 con 0x55b3c195e0c0 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.438+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1965920 con 0x7fa65403d070 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.439+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230535348960] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.439+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.439+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230535361648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1965d40 con 0x7fa65403d070 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.439+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1966700 con 0x55b3c1954d40 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.440+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.440+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230535361648] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.440+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230535365200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1966b20 con 0x55b3c1954d40 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.440+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1967110 con 0x55b3c1959750 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.441+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.441+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230535362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c19679b0 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.441+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1968370 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.441+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230535365200] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.442+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.442+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230535366256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1968370 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.442+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1968e50 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.442+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230535362704] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230535366256] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230535375200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1967ec0 con 0x55b3c1959750 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=0 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=1 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=2 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=3 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=4 2024-09-21T08:51:59.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=5 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.443+0000 7fa66602f800 20 add_watcher() i=6 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230535375200] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa66602f800 20 add_watcher() i=7 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa66602f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1967ec0 con 0x55b3c1954d40 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.444+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230535369984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1967ec0 con 0x55b3c1954d40 2024-09-21T08:51:59.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.445+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230535369984] v34'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.445+0000 7fa519fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.445+0000 7fa66602f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.445+0000 7fa66602f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.445+0000 7fa66602f800 5 note: GC not initialized 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa518fe1640 20 reqs_thread_entry: start 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 20 Filter name: none 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa4927fc640 20 reqs_thread_entry: start 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199ec50 con 0x55b3c1954d40 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.446+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199f640 con 0x55b3c1954d40 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.447+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.447+0000 7fa66602f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.447+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3c19a0650 con 0x7fa65403d070 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.447+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.448+0000 7fa519fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.448+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230535369984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199ca00 con 0x55b3c1954d40 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.448+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94230535369984] v34'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.449+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230535351440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199ca00 con 0x7fa65403d070 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.450+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94230535351440] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.450+0000 7fa66602f800 20 remove_watcher() i=0 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.450+0000 7fa66602f800 2 removed watcher, disabling cache 2024-09-21T08:51:59.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.450+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230535355008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199ca00 con 0x55b3c1954d40 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.451+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94230535355008] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.451+0000 7fa66602f800 20 remove_watcher() i=1 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.451+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230535348960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c199ca00 con 0x55b3c195e0c0 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.452+0000 7fa663b2a640 1 -- 172.21.15.196:0/1128465965 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94230535348960] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa654044d70 con 0x55b3c195e0c0 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.452+0000 7fa66602f800 20 remove_watcher() i=2 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.452+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230535361648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962c90 con 0x7fa65403d070 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.453+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94230535361648] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x7fa65403d070 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.453+0000 7fa66602f800 20 remove_watcher() i=3 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.453+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230535365200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1963a80 con 0x55b3c1954d40 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.454+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94230535365200] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa64c057030 con 0x55b3c1954d40 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.454+0000 7fa66602f800 20 remove_watcher() i=4 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.454+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230535362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c19622e0 con 0x55b3c1959750 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.455+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94230535362704] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.455+0000 7fa66602f800 20 remove_watcher() i=5 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.455+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230535366256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1962c90 con 0x55b3c1959750 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.456+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94230535366256] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.456+0000 7fa66602f800 20 remove_watcher() i=6 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.456+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230535375200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3c1963a80 con 0x55b3c1959750 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66432b640 1 -- 172.21.15.196:0/1128465965 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94230535375200] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa65c02a070 con 0x55b3c1959750 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 20 remove_watcher() i=7 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c1959750 msgr2=0x55b3c195bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c1959750 0x55b3c195bb40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1954d40 msgr2=0x55b3c1957200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1954d40 0x55b3c1957200 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa65403d070 msgr2=0x7fa6540187f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa65403d070 0x7fa6540187f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b3c195e0c0 msgr2=0x55b3c1960580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b3c195e0c0 0x55b3c1960580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa52c036b40 msgr2=0x7fa52c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa52c036b40 0x7fa52c039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa654040fd0 tx=0x7fa654035000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 msgr2=0x55b3c1910cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/1128465965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c193f9d0 0x55b3c1910cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa65c011be0 tx=0x7fa65c04cb10 comp rx=0 tx=0).stop 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 reap_dead start 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa65bfff640 1 -- 172.21.15.196:0/1128465965 reap_dead start 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 shutdown_connections 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 >> 172.21.15.196:0/1128465965 conn(0x55b3c193bdc0 msgr2=0x55b3c1939e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 shutdown_connections 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/1128465965 wait complete. 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 msgr2=0x7fa53c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 0x7fa53c039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b3c191fae0 tx=0x7fa65401b540 comp rx=0 tx=0).stop 2024-09-21T08:51:59.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 msgr2=0x55b3c1933200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b3c19191b0 tx=0x7fa65c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 shutdown_connections 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa53c036b90 0x7fa53c039050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 --2- 172.21.15.196:0/374446512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1932de0 0x55b3c1933200 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.457+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 >> 172.21.15.196:0/374446512 conn(0x55b3c1927d70 msgr2=0x55b3c192a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 shutdown_connections 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/374446512 wait complete. 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 msgr2=0x55b3c1923db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 0x55b3c1923db0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 msgr2=0x55b3c191f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 0x55b3c191f170 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 msgr2=0x7fa54c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 0x7fa54c039000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa64c057000 tx=0x7fa64c052000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 msgr2=0x55b3c1918100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55b3c1794ca0 tx=0x7fa654000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 shutdown_connections 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b3c19219c0 0x55b3c1923db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b3c1824990 0x55b3c191f170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa54c036b40 0x7fa54c039000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 --2- 172.21.15.196:0/1643975830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b3c1820550 0x55b3c1918100 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 >> 172.21.15.196:0/1643975830 conn(0x55b3c181bde0 msgr2=0x55b3c19097e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 shutdown_connections 2024-09-21T08:51:59.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.458+0000 7fa66602f800 1 -- 172.21.15.196:0/1643975830 wait complete. 2024-09-21T08:51:59.470 INFO:teuthology.orchestra.run.smithi196.stdout:[] 2024-09-21T08:51:59.470 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T08:51:59.484 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.484 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-21T08:51:59.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-21T08:51:59.485 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-21T08:51:59.528 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.529 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94fb939800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e5c3109dd0 0x55e5c319b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94fb939800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5c3055b30 con 0x55e5c319bb40 2024-09-21T08:51:59.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94fb939800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e5c3037360 con 0x55e5c3109dd0 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94f75d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e5c3109dd0 0x55e5c319b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94f75d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e5c3109dd0 0x55e5c319b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35044/0 (socket says 172.21.15.196:35044) 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94f75d1640 1 -- 172.21.15.196:0/561796701 learned_addr learned my addr 172.21.15.196:0/561796701 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.527+0000 7f94effff640 1 --1- 172.21.15.196:0/561796701 >> v1:172.21.15.29:6789/0 conn(0x55e5c319bb40 0x55e5c319df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:46990/0 (socket says 172.21.15.196:46990) 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.528+0000 7f94f75d1640 1 -- 172.21.15.196:0/561796701 >> v1:172.21.15.29:6789/0 conn(0x55e5c319bb40 legacy=0x55e5c319df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.528+0000 7f94f6dd0640 1 -- 172.21.15.196:0/561796701 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563256804 0 0) 0x55e5c3055b30 con 0x55e5c319bb40 2024-09-21T08:51:59.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.528+0000 7f94f75d1640 1 -- 172.21.15.196:0/561796701 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c305de00 con 0x55e5c3109dd0 2024-09-21T08:51:59.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.529+0000 7f94f75d1640 1 --2- 172.21.15.196:0/561796701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c319b600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94e800a520 tx=0x7f94e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c900b6d178e775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94f6dd0640 1 -- 172.21.15.196:0/561796701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8055070 con 0x55e5c3109dd0 2024-09-21T08:51:59.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94f6dd0640 1 -- 172.21.15.196:0/561796701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e80515b0 con 0x55e5c3109dd0 2024-09-21T08:51:59.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94f6dd0640 1 -- 172.21.15.196:0/561796701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e80518d0 con 0x55e5c3109dd0 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 -- 172.21.15.196:0/561796701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 msgr2=0x55e5c319b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 --2- 172.21.15.196:0/561796701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c319b600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94e800a520 tx=0x7f94e8045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 -- 172.21.15.196:0/561796701 shutdown_connections 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 --2- 172.21.15.196:0/561796701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c319b600 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 -- 172.21.15.196:0/561796701 >> 172.21.15.196:0/561796701 conn(0x55e5c3190df0 msgr2=0x55e5c3193210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 -- 172.21.15.196:0/561796701 shutdown_connections 2024-09-21T08:51:59.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.530+0000 7f94fb939800 1 -- 172.21.15.196:0/561796701 wait complete. 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94fb939800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94fb939800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e5c30e2330 con 0x55e5c3109dd0 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94f75d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94f75d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35048/0 (socket says 172.21.15.196:35048) 2024-09-21T08:51:59.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.544+0000 7f94f75d1640 1 -- 172.21.15.196:0/3722834310 learned_addr learned my addr 172.21.15.196:0/3722834310 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.545+0000 7f94f75d1640 1 -- 172.21.15.196:0/3722834310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c302fbc0 con 0x55e5c3109dd0 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.545+0000 7f94f75d1640 1 --2- 172.21.15.196:0/3722834310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f94e8025da0 tx=0x7f94e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9786fadbdfa2454 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.545+0000 7f93e560a640 1 -- 172.21.15.196:0/3722834310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8051ac0 con 0x55e5c3109dd0 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.545+0000 7f93e560a640 1 -- 172.21.15.196:0/3722834310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8051c60 con 0x55e5c3109dd0 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.545+0000 7f93e560a640 1 -- 172.21.15.196:0/3722834310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8066460 con 0x55e5c3109dd0 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- 172.21.15.196:0/3722834310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 msgr2=0x55e5c3287800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 --2- 172.21.15.196:0/3722834310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f94e8025da0 tx=0x7f94e8051000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- 172.21.15.196:0/3722834310 shutdown_connections 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 --2- 172.21.15.196:0/3722834310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c3287800 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- 172.21.15.196:0/3722834310 >> 172.21.15.196:0/3722834310 conn(0x55e5c3190df0 msgr2=0x55e5c32831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- 172.21.15.196:0/3722834310 shutdown_connections 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- 172.21.15.196:0/3722834310 wait complete. 2024-09-21T08:51:59.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94fb939800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e5c319f8f0 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94f75d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94f75d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35060/0 (socket says 172.21.15.196:35060) 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.546+0000 7f94f75d1640 1 -- 172.21.15.196:0/2617804788 learned_addr learned my addr 172.21.15.196:0/2617804788 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f94f75d1640 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c3043fe0 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f94f75d1640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f94e80460a0 tx=0x7f94e8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f93e3e07640 1 -- 172.21.15.196:0/2617804788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8066650 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f93e3e07640 1 -- 172.21.15.196:0/2617804788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8066810 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c328f6b0 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f93e3e07640 1 -- 172.21.15.196:0/2617804788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8066b30 con 0x55e5c3109dd0 2024-09-21T08:51:59.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.547+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c328fbd0 con 0x55e5c3109dd0 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f93e3e07640 1 -- 172.21.15.196:0/2617804788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94e8079060 con 0x55e5c3109dd0 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f93e3e07640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 0x7f93dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f93e3e07640 1 -- 172.21.15.196:0/2617804788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94e8062070 con 0x55e5c3109dd0 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f94effff640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 0x7f93dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 0x55e5c32961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3296760 con 0x55e5c319bb40 2024-09-21T08:51:59.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.548+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 0x55e5c32961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94effff640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 0x7f93dc039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000c00 tx=0x7f94e00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 0x55e5c32961e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94f7dd2640 1 -- 172.21.15.196:0/2617804788 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4a0 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3293790 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94f7dd2640 1 -- 172.21.15.196:0/2617804788 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94f000a4a0 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 0x55e5c329ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.549+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c329b530 con 0x55e5c3298a70 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.550+0000 7f94f75d1640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 0x55e5c329ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.550+0000 7f94f75d1640 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 0x55e5c329ae60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.550+0000 7f94f75d1640 1 -- 172.21.15.196:0/2617804788 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c3298a70 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.550+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3297910 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.551+0000 7f94f7dd2640 1 -- 172.21.15.196:0/2617804788 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94f000a4a0 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.551+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3297d70 con 0x55e5c319bb40 2024-09-21T08:51:59.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.551+0000 7f94f7dd2640 1 -- 172.21.15.196:0/2617804788 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94f000a4a0 con 0x55e5c319bb40 2024-09-21T08:51:59.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.551+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94fb939800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94fb939800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e5c3031580 con 0x55e5c32a9e90 2024-09-21T08:51:59.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35074/0 (socket says 172.21.15.196:35074) 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94f7dd2640 1 -- 172.21.15.196:0/1416130062 learned_addr learned my addr 172.21.15.196:0/1416130062 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94f7dd2640 1 -- 172.21.15.196:0/1416130062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c32aa7f0 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.552+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e5c3296b40 tx=0x7f94f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f93e1602640 1 -- 172.21.15.196:0/1416130062 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0014450 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f93e1602640 1 -- 172.21.15.196:0/1416130062 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f00145f0 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c32aaa80 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f93e1602640 1 -- 172.21.15.196:0/1416130062 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0014910 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c32ad760 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.553+0000 7f93e1602640 1 -- 172.21.15.196:0/1416130062 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94f0011040 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f93e1602640 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 0x7f93d00390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f93e1602640 1 -- 172.21.15.196:0/1416130062 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94f001e070 con 0x55e5c32a9e90 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94f75d1640 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 0x7f93d00390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94f75d1640 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 0x7f93d00390a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55e5c3296be0 tx=0x7f94e808e5d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94fb939800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94fb939800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e5c3287ef0 con 0x55e5c32b6ac0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35090/0 (socket says 172.21.15.196:35090) 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.554+0000 7f94f7dd2640 1 -- 172.21.15.196:0/3078423288 learned_addr learned my addr 172.21.15.196:0/3078423288 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94f7dd2640 1 -- 172.21.15.196:0/3078423288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c32b7490 con 0x55e5c32b6ac0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/3078423288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94f004cb60 tx=0x7f94f003bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b8293a1255f229 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f93daffd640 1 -- 172.21.15.196:0/3078423288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0013c90 con 0x55e5c32b6ac0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f93daffd640 1 -- 172.21.15.196:0/3078423288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0013e30 con 0x55e5c32b6ac0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f93daffd640 1 -- 172.21.15.196:0/3078423288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0014be0 con 0x55e5c32b6ac0 2024-09-21T08:51:59.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 -- 172.21.15.196:0/3078423288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 msgr2=0x55e5c32b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 --2- 172.21.15.196:0/3078423288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94f004cb60 tx=0x7f94f003bf40 comp rx=0 tx=0).stop 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 -- 172.21.15.196:0/3078423288 shutdown_connections 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 --2- 172.21.15.196:0/3078423288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32b6ec0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 -- 172.21.15.196:0/3078423288 >> 172.21.15.196:0/3078423288 conn(0x55e5c32b2e20 msgr2=0x55e5c32b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 -- 172.21.15.196:0/3078423288 shutdown_connections 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.555+0000 7f94fb939800 1 -- 172.21.15.196:0/3078423288 wait complete. 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94fb939800 1 Processor -- start 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94fb939800 1 -- start start 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94fb939800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94fb939800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e5c32b7b00 con 0x55e5c32b6ac0 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94f7dd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35104/0 (socket says 172.21.15.196:35104) 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 learned_addr learned my addr 172.21.15.196:0/870534500 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c32be500 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.556+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f94f002bfd0 tx=0x7f94f004caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f93d97fa640 1 -- 172.21.15.196:0/870534500 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0046040 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f93d97fa640 1 -- 172.21.15.196:0/870534500 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f004e2e0 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c32be790 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f93d97fa640 1 -- 172.21.15.196:0/870534500 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0013c90 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c32c1440 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.557+0000 7f93d97fa640 1 -- 172.21.15.196:0/870534500 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94f004b250 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f93d97fa640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f93d97fa640 1 -- 172.21.15.196:0/870534500 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94f000e040 con 0x55e5c32b6ac0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94f75d1640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c32c9c50 0x55e5c32cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32cc860 con 0x55e5c32c9c50 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94effff640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c32c9c50 0x55e5c32cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94f75d1640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94e8051830 tx=0x7f94e8089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94effff640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c32c9c50 0x55e5c32cc110 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000f5f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 20 realm 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.558+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32c90a0 con 0x55e5c32c9c50 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000f5f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32cd340 con 0x55e5c32c9c50 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000f5f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32cdc10 con 0x55e5c32c9c50 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94e000f5f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c32ce510 0x55e5c32d0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d1080 con 0x55e5c32ce510 2024-09-21T08:51:59.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.559+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c32ce510 0x55e5c32d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94f7dd2640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c32ce510 0x55e5c32d0920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94fb939800 20 searching for the correct realm 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e5c32d3120 0x55e5c32d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94f75d1640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e5c32d3120 0x55e5c32d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.560+0000 7f94f75d1640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e5c32d3120 0x55e5c32d55e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94f75d1640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e8087030 0x7f94e80659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94effff640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e8087030 0x7f94e80659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94effff640 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e8087030 0x7f94e80659c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000f5f0 con 0x7f94e8087030 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.561+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000f5f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.562+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.563+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.564+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.565+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.566+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.567+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32d3120 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.568+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x55e5c32c9c50 2024-09-21T08:51:59.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d5cb0 con 0x7f94e8087030 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d1b20 con 0x55e5c32c9c50 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d1700 con 0x55e5c32c9c50 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d2400 con 0x55e5c32c9c50 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.569+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 zone default found 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 4 Realm: () 2024-09-21T08:51:59.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 zonegroup default 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d6130 con 0x55e5c32ce510 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d1fd0 con 0x55e5c32d3120 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.570+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d8400 con 0x55e5c32d3120 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.571+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.571+0000 7f94fb939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.571+0000 7f94fb939800 20 started sync module instance, tier type = 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.571+0000 7f94fb939800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.571+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d77f0 con 0x7f94e8087030 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.572+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.572+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94445310410000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d77f0 con 0x7f94e8087030 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.572+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d8f40 con 0x55e5c32c9c50 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.573+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94445310410000] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.573+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.573+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94445310413392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d77f0 con 0x55e5c32c9c50 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.573+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d9a00 con 0x55e5c32d3120 2024-09-21T08:51:59.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.574+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.574+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94445310416080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32da2a0 con 0x55e5c32d3120 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.574+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dad60 con 0x7f94e8087030 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.574+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94445310413392] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.575+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94445310416080] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.575+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.575+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94445310418416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d7340 con 0x7f94e8087030 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.575+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32db640 con 0x55e5c32c9c50 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.576+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.576+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94445310423248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dba30 con 0x55e5c32c9c50 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.576+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dc530 con 0x55e5c32ce510 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.576+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94445310418416] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.577+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.577+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94445310423248] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.577+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94445310427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32da830 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.577+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dce00 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.578+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94445310427168] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.578+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.578+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94445310424304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dcd80 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.578+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dd7f0 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94445310424304] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94445310431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32dd7b0 con 0x55e5c32ce510 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=0 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=1 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=2 2024-09-21T08:51:59.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=3 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=4 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=5 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.579+0000 7f94fb939800 20 add_watcher() i=6 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.580+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94445310431936] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.580+0000 7f94fb939800 20 add_watcher() i=7 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.580+0000 7f94fb939800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.580+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32e0c70 con 0x55e5c32c9c50 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.581+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.581+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94445310429392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32de120 con 0x55e5c32c9c50 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.581+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94445310429392] v34'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f93adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 5 note: GC not initialized 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f93acfe1640 20 reqs_thread_entry: start 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 Filter name: none 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f93267fc640 20 reqs_thread_entry: start 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3313ba0 con 0x55e5c32c9c50 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.582+0000 7f94fb939800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.583+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3314590 con 0x55e5c32c9c50 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.583+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.583+0000 7f94fb939800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:51:59.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.583+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5c33155a0 con 0x7f94e8087030 2024-09-21T08:51:59.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.583+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.584+0000 7f93adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.584+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94445310429392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3311970 con 0x55e5c32c9c50 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.585+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94445310429392] v34'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.585+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94445310410000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3311970 con 0x7f94e8087030 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.586+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94445310410000] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.586+0000 7f94fb939800 20 remove_watcher() i=0 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.586+0000 7f94fb939800 2 removed watcher, disabling cache 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.586+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94445310413392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3311970 con 0x55e5c32c9c50 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.587+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94445310413392] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.587+0000 7f94fb939800 20 remove_watcher() i=1 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.587+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94445310416080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c3311970 con 0x55e5c32d3120 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.588+0000 7f94f75d1640 1 -- 172.21.15.196:0/870534500 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94445310416080] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8057030 con 0x55e5c32d3120 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.588+0000 7f94fb939800 20 remove_watcher() i=2 2024-09-21T08:51:59.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.588+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94445310418416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d7d10 con 0x7f94e8087030 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.589+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94445310418416] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x7f94e8087030 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.589+0000 7f94fb939800 20 remove_watcher() i=3 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.589+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94445310423248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d8a50 con 0x55e5c32c9c50 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.590+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94445310423248] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002b040 con 0x55e5c32c9c50 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.590+0000 7f94fb939800 20 remove_watcher() i=4 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.590+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94445310427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d94d0 con 0x55e5c32ce510 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.591+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94445310427168] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.591+0000 7f94fb939800 20 remove_watcher() i=5 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.591+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94445310424304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d9df0 con 0x55e5c32ce510 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.592+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94445310424304] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.592+0000 7f94fb939800 20 remove_watcher() i=6 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.592+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94445310431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5c32d7d10 con 0x55e5c32ce510 2024-09-21T08:51:59.603 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.592+0000 7f94f7dd2640 1 -- 172.21.15.196:0/870534500 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94445310431936] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x55e5c32ce510 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 20 remove_watcher() i=7 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c32ce510 msgr2=0x55e5c32d0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c32ce510 0x55e5c32d0920 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c32c9c50 msgr2=0x55e5c32cc110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c32c9c50 0x55e5c32cc110 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e8087030 msgr2=0x7f94e80659c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e8087030 0x7f94e80659c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e5c32d3120 msgr2=0x55e5c32d55e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e5c32d3120 0x55e5c32d55e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 msgr2=0x7f93c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94e8051830 tx=0x7f94e8089000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 msgr2=0x55e5c32bdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94effff640 1 -- 172.21.15.196:0/870534500 reap_dead start 2024-09-21T08:51:59.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f94f002bfd0 tx=0x7f94f004caf0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 shutdown_connections 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/870534500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32b6ac0 0x55e5c32bdfc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 >> 172.21.15.196:0/870534500 conn(0x55e5c32b2e20 msgr2=0x55e5c32b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 shutdown_connections 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/870534500 wait complete. 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 msgr2=0x7f93d00390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 0x7f93d00390a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55e5c3296be0 tx=0x7f94e808e5d0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 msgr2=0x55e5c32aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e5c3296b40 tx=0x7f94f0018830 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 shutdown_connections 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036be0 0x7f93d00390a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 --2- 172.21.15.196:0/1416130062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c32a9e90 0x55e5c32aa2b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 >> 172.21.15.196:0/1416130062 conn(0x55e5c329ee20 msgr2=0x55e5c32a19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 shutdown_connections 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.593+0000 7f94fb939800 1 -- 172.21.15.196:0/1416130062 wait complete. 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 msgr2=0x55e5c329ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 0x55e5c329ae60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 msgr2=0x55e5c32961e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 0x55e5c32961e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 msgr2=0x7f93dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 0x7f93dc039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000c00 tx=0x7f94e00013b0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 msgr2=0x55e5c328f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f94e80460a0 tx=0x7f94e8003020 comp rx=0 tx=0).stop 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 shutdown_connections 2024-09-21T08:51:59.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e5c3298a70 0x55e5c329ae60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e5c319bb40 0x55e5c32961e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93dc036b90 0x7f93dc039050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 --2- 172.21.15.196:0/2617804788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e5c3109dd0 0x55e5c328f170 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 >> 172.21.15.196:0/2617804788 conn(0x55e5c3190df0 msgr2=0x55e5c3281ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 shutdown_connections 2024-09-21T08:51:59.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.594+0000 7f94fb939800 1 -- 172.21.15.196:0/2617804788 wait complete. 2024-09-21T08:51:59.608 INFO:teuthology.orchestra.run.smithi196.stdout:["myfoo"] 2024-09-21T08:51:59.608 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-21T08:51:59.611 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-21T08:51:59.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-21T08:51:59.611 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-21T08:51:59.653 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.653 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.651+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.651+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.651+0000 7fb19e93b800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556174b23da0 0x556174b26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.651+0000 7fb19e93b800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561749dcb30 con 0x556174a915e0 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.651+0000 7fb19e93b800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5561749be360 con 0x556174b23da0 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb199df4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556174b23da0 0x556174b26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb199df4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556174b23da0 0x556174b26190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35108/0 (socket says 172.21.15.196:35108) 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb199df4640 1 -- 172.21.15.196:0/2132086070 learned_addr learned my addr 172.21.15.196:0/2132086070 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb19a5f5640 1 --1- 172.21.15.196:0/2132086070 >> v1:172.21.15.29:6789/0 conn(0x556174a915e0 0x556174b22680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47002/0 (socket says 172.21.15.196:47002) 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb199df4640 1 -- 172.21.15.196:0/2132086070 >> v1:172.21.15.29:6789/0 conn(0x556174a915e0 legacy=0x556174b22680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb1995f3640 1 -- 172.21.15.196:0/2132086070 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593620944 0 0) 0x5561749dcb30 con 0x556174a915e0 2024-09-21T08:51:59.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.652+0000 7fb199df4640 1 -- 172.21.15.196:0/2132086070 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561749e4e00 con 0x556174b23da0 2024-09-21T08:51:59.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.654+0000 7fb199df4640 1 --2- 172.21.15.196:0/2132086070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174b23da0 0x556174b26190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb19000a520 tx=0x7fb190045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda5194d8dafae64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.654+0000 7fb1995f3640 1 -- 172.21.15.196:0/2132086070 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb190055070 con 0x556174b23da0 2024-09-21T08:51:59.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.654+0000 7fb1995f3640 1 -- 172.21.15.196:0/2132086070 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1900515b0 con 0x556174b23da0 2024-09-21T08:51:59.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.654+0000 7fb1995f3640 1 -- 172.21.15.196:0/2132086070 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1900518d0 con 0x556174b23da0 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 -- 172.21.15.196:0/2132086070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174b23da0 msgr2=0x556174b26190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2132086070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174b23da0 0x556174b26190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb19000a520 tx=0x7fb190045ba0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 -- 172.21.15.196:0/2132086070 shutdown_connections 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2132086070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174b23da0 0x556174b26190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 -- 172.21.15.196:0/2132086070 >> 172.21.15.196:0/2132086070 conn(0x556174b17dd0 msgr2=0x556174b1a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 -- 172.21.15.196:0/2132086070 shutdown_connections 2024-09-21T08:51:59.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.655+0000 7fb19e93b800 1 -- 172.21.15.196:0/2132086070 wait complete. 2024-09-21T08:51:59.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.668+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.668+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19e93b800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19e93b800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556174a69320 con 0x556174a915e0 2024-09-21T08:51:59.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19a5f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19a5f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35124/0 (socket says 172.21.15.196:35124) 2024-09-21T08:51:59.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19a5f5640 1 -- 172.21.15.196:0/2869597010 learned_addr learned my addr 172.21.15.196:0/2869597010 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19a5f5640 1 -- 172.21.15.196:0/2869597010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561749b6bc0 con 0x556174a915e0 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/2869597010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b240 tx=0x7fb18c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bd7c126d4648a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb088608640 1 -- 172.21.15.196:0/2869597010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c008070 con 0x556174a915e0 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.669+0000 7fb088608640 1 -- 172.21.15.196:0/2869597010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c00d500 con 0x556174a915e0 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb088608640 1 -- 172.21.15.196:0/2869597010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c00d860 con 0x556174a915e0 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 -- 172.21.15.196:0/2869597010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 msgr2=0x556174c0e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2869597010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b240 tx=0x7fb18c00b700 comp rx=0 tx=0).stop 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 -- 172.21.15.196:0/2869597010 shutdown_connections 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2869597010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c0e880 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 -- 172.21.15.196:0/2869597010 >> 172.21.15.196:0/2869597010 conn(0x556174b17dd0 msgr2=0x556174c0a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 -- 172.21.15.196:0/2869597010 shutdown_connections 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.670+0000 7fb19e93b800 1 -- 172.21.15.196:0/2869597010 wait complete. 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19e93b800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19e93b800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556174b26970 con 0x556174a915e0 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19a5f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19a5f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35140/0 (socket says 172.21.15.196:35140) 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19a5f5640 1 -- 172.21.15.196:0/3768620703 learned_addr learned my addr 172.21.15.196:0/3768620703 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19a5f5640 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561749cafe0 con 0x556174a915e0 2024-09-21T08:51:59.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.671+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x556174c0f6e0 tx=0x7fb18c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb086e05640 1 -- 172.21.15.196:0/3768620703 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c019870 con 0x556174a915e0 2024-09-21T08:51:59.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb086e05640 1 -- 172.21.15.196:0/3768620703 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c019a10 con 0x556174a915e0 2024-09-21T08:51:59.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556174c16820 con 0x556174a915e0 2024-09-21T08:51:59.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb086e05640 1 -- 172.21.15.196:0/3768620703 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c019d30 con 0x556174a915e0 2024-09-21T08:51:59.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556174c16d40 con 0x556174a915e0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.672+0000 7fb086e05640 1 -- 172.21.15.196:0/3768620703 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb18c017040 con 0x556174a915e0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb086e05640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 0x7fb080039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb086e05640 1 -- 172.21.15.196:0/3768620703 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb18c015020 con 0x556174a915e0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb199df4640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 0x7fb080039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 0x556174c1d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c1d890 con 0x556174b23da0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19adf6640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 0x556174c1d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb199df4640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 0x7fb080039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb190057000 tx=0x7fb190052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19adf6640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 0x556174c1d350 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19adf6640 1 -- 172.21.15.196:0/3768620703 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19400a4a0 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.673+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c1a920 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.674+0000 7fb19adf6640 1 -- 172.21.15.196:0/3768620703 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb19400a4a0 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.674+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 0x556174c21f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.674+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c22680 con 0x556174c1fba0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.674+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 0x556174c21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.674+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 0x556174c21f90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.675+0000 7fb19a5f5640 1 -- 172.21.15.196:0/3768620703 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c1fba0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.675+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c1ea40 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.675+0000 7fb19adf6640 1 -- 172.21.15.196:0/3768620703 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb19400a4a0 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.675+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c1eee0 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.675+0000 7fb19adf6640 1 -- 172.21.15.196:0/3768620703 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb19400a4a0 con 0x556174b23da0 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19e93b800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19e93b800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5561749b8580 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35148/0 (socket says 172.21.15.196:35148) 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19adf6640 1 -- 172.21.15.196:0/2597443934 learned_addr learned my addr 172.21.15.196:0/2597443934 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19adf6640 1 -- 172.21.15.196:0/2597443934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556174c31930 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.676+0000 7fb19adf6640 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x556174c1dc50 tx=0x7fb194018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb07ffff640 1 -- 172.21.15.196:0/2597443934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014450 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb07ffff640 1 -- 172.21.15.196:0/2597443934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194014610 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556174c31bc0 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb07ffff640 1 -- 172.21.15.196:0/2597443934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014930 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556174c348a0 con 0x556174c30fd0 2024-09-21T08:51:59.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.677+0000 7fb07ffff640 1 -- 172.21.15.196:0/2597443934 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb194011040 con 0x556174c30fd0 2024-09-21T08:51:59.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb07ffff640 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 0x7fb074039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb07ffff640 1 -- 172.21.15.196:0/2597443934 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb19401e070 con 0x556174c30fd0 2024-09-21T08:51:59.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 0x7fb074039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 0x7fb074039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x556174c1dcf0 tx=0x7fb18c01b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19e93b800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19e93b800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556174c0f030 con 0x556174c3dc30 2024-09-21T08:51:59.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35154/0 (socket says 172.21.15.196:35154) 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.678+0000 7fb19adf6640 1 -- 172.21.15.196:0/661437406 learned_addr learned my addr 172.21.15.196:0/661437406 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19adf6640 1 -- 172.21.15.196:0/661437406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556174c3e600 con 0x556174c3dc30 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19adf6640 1 --2- 172.21.15.196:0/661437406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb19404cbc0 tx=0x7fb194011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f7936712033a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb07dffb640 1 -- 172.21.15.196:0/661437406 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194040150 con 0x556174c3dc30 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb07dffb640 1 -- 172.21.15.196:0/661437406 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1940167e0 con 0x556174c3dc30 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb07dffb640 1 -- 172.21.15.196:0/661437406 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014ad0 con 0x556174c3dc30 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 -- 172.21.15.196:0/661437406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 msgr2=0x556174c3e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 --2- 172.21.15.196:0/661437406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb19404cbc0 tx=0x7fb194011b10 comp rx=0 tx=0).stop 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 -- 172.21.15.196:0/661437406 shutdown_connections 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 --2- 172.21.15.196:0/661437406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c3e030 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 -- 172.21.15.196:0/661437406 >> 172.21.15.196:0/661437406 conn(0x556174c39f90 msgr2=0x556174c38090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 -- 172.21.15.196:0/661437406 shutdown_connections 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.679+0000 7fb19e93b800 1 -- 172.21.15.196:0/661437406 wait complete. 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19e93b800 1 Processor -- start 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19e93b800 1 -- start start 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19e93b800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c45070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19e93b800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556174c3ec70 con 0x556174c3dc30 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c45070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19adf6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c45070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35160/0 (socket says 172.21.15.196:35160) 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 learned_addr learned my addr 172.21.15.196:0/1490359018 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556174c455b0 con 0x556174c3dc30 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.680+0000 7fb19adf6640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c45070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb194011fd0 tx=0x7fb19404cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb06bfff640 1 -- 172.21.15.196:0/1490359018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194013cf0 con 0x556174c3dc30 2024-09-21T08:51:59.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb06bfff640 1 -- 172.21.15.196:0/1490359018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194011720 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556174c45840 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb06bfff640 1 -- 172.21.15.196:0/1490359018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1940134e0 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556174c484f0 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.681+0000 7fb06bfff640 1 -- 172.21.15.196:0/1490359018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb194013680 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb06bfff640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb064036b40 0x7fb064039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb06bfff640 1 -- 172.21.15.196:0/1490359018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb194033030 con 0x556174c3dc30 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb064036b40 0x7fb064039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174c50ce0 0x556174c531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c538f0 con 0x556174c50ce0 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb064036b40 0x7fb064039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e6d0 tx=0x7fb18c040f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb199df4640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174c50ce0 0x556174c531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.682+0000 7fb199df4640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174c50ce0 0x556174c531a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 realm 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c53d20 con 0x556174c50ce0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c545f0 con 0x556174c50ce0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c54990 con 0x556174c50ce0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c556f0 0x556174c57ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.683+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c58020 con 0x556174c556f0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19adf6640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c556f0 0x556174c57ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19adf6640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c556f0 0x556174c57ae0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19e93b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19e93b800 20 searching for the correct realm 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556174c5a060 0x556174c5c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c5a060 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.684+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556174c5a060 0x556174c5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556174c5a060 0x556174c5c520 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb19a5f5640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb18c03d070 0x7fb18c018810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x7fb18c03d070 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb199df4640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb18c03d070 0x7fb18c018810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.685+0000 7fb199df4640 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb18c03d070 0x7fb18c018810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c556f0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c50ce0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c50ce0 2024-09-21T08:51:59.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.686+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c556f0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c556f0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x7fb18c03d070 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c5a060 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.687+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c50ce0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c556f0 2024-09-21T08:51:59.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c50ce0 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x7fb18c03d070 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c5cbf0 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.688+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c556f0 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.689+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c556f0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.690+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x7fb18c03d070 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.702 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c556f0 2024-09-21T08:51:59.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.691+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c556f0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x7fb18c03d070 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c5a060 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c556f0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.692+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x556174c50ce0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb18c05a040 con 0x7fb18c03d070 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c58a60 con 0x556174c50ce0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.693+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c59380 con 0x556174c50ce0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 zone default found 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 4 Realm: () 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 zonegroup default 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c5d070 con 0x556174c556f0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c5f2a0 con 0x556174c5a060 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c5f640 con 0x556174c5a060 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 started sync module instance, tier type = 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.694+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c5e6e0 con 0x7fb18c03d070 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.695+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.696+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93877059316784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c5e6e0 con 0x7fb18c03d070 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.696+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c60000 con 0x556174c50ce0 2024-09-21T08:51:59.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.697+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93877059316784] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.697+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.697+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93877059321136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c5e6e0 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.697+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c60a50 con 0x556174c5a060 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.698+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93877059321136] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.698+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.698+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93877059314224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c5e650 con 0x556174c5a060 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.698+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c61940 con 0x7fb18c03d070 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.699+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93877059314224] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.699+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.699+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93877059327120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c618b0 con 0x7fb18c03d070 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.699+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c62800 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.700+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.700+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93877059330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c62c20 con 0x556174c50ce0 2024-09-21T08:51:59.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.700+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.700+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93877059327120] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.701+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.701+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93877059334448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c63a50 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.701+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c64470 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.701+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93877059330896] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.702+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93877059334448] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.702+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.702+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93877059329328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c62770 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.702+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c64a50 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93877059329328] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93877059338080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c64a50 con 0x556174c556f0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=0 2024-09-21T08:51:59.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=1 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=2 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=3 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=4 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=5 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.703+0000 7fb19e93b800 20 add_watcher() i=6 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93877059338080] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb19e93b800 20 add_watcher() i=7 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb19e93b800 2 all 8 watchers are set, enabling cache 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556174c67d20 con 0x556174c50ce0 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.704+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93877059340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c64fe0 con 0x556174c50ce0 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.705+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93877059340048] v34'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.705+0000 7fb050fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.705+0000 7fb19e93b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.705+0000 7fb19e93b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.705+0000 7fb19e93b800 5 note: GC not initialized 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fafcb7fe640 20 reqs_thread_entry: start 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19e93b800 20 init_complete bucket index max shards: 11 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19e93b800 20 Filter name: none 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fafc97fa640 20 reqs_thread_entry: start 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c9a760 con 0x556174c5a060 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c9a760 con 0x556174c5a060 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.706+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c9a760 con 0x556174c50ce0 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v34'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x7fb18c03d070 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c5a060 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.707+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c5a060 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x7fb18c03d070 2024-09-21T08:51:59.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c5a060 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(72 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.708+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c5a060 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.709+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c5a060 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x7fb18c03d070 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(80 [pgnls start_epoch 34 out=70b] v34'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c50ce0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.710+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c50ce0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c5a060 2024-09-21T08:51:59.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x7fb18c03d070 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c50ce0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.711+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(86 [pgnls start_epoch 34 out=127b] v34'2 uv2 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c5a060 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x7fb18c03d070 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c556f0 2024-09-21T08:51:59.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v34'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.712+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c50ce0 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x556174c5a060 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556174c63660 con 0x7fb18c03d070 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb19e93b800 20 RGWRados::pool_iterate: got myfoo 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.713+0000 7fb19e93b800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.714+0000 7fb050fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:51:59.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.714+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93877059340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.715+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93877059340048] v34'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.715+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93877059316784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x7fb18c03d070 2024-09-21T08:51:59.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.716+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93877059316784] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.716+0000 7fb19e93b800 20 remove_watcher() i=0 2024-09-21T08:51:59.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.716+0000 7fb19e93b800 2 removed watcher, disabling cache 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.716+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93877059321136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c50ce0 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.717+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93877059321136] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.717+0000 7fb19e93b800 20 remove_watcher() i=1 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.717+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93877059314224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c58ee0 con 0x556174c5a060 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.718+0000 7fb19a5f5640 1 -- 172.21.15.196:0/1490359018 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93877059314224] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c02d070 con 0x556174c5a060 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.718+0000 7fb19e93b800 20 remove_watcher() i=2 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.718+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93877059327120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c98a60 con 0x7fb18c03d070 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.719+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93877059327120] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x7fb18c03d070 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.719+0000 7fb19e93b800 20 remove_watcher() i=3 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.719+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93877059330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c98a60 con 0x556174c50ce0 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.721+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93877059330896] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb190057030 con 0x556174c50ce0 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.721+0000 7fb19e93b800 20 remove_watcher() i=4 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.721+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93877059334448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c98a60 con 0x556174c556f0 2024-09-21T08:51:59.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.722+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93877059334448] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.722+0000 7fb19e93b800 20 remove_watcher() i=5 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.722+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93877059329328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c5e230 con 0x556174c556f0 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.723+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93877059329328] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.723+0000 7fb19e93b800 20 remove_watcher() i=6 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.723+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93877059338080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556174c61490 con 0x556174c556f0 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19adf6640 1 -- 172.21.15.196:0/1490359018 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93877059338080] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19402a070 con 0x556174c556f0 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 20 remove_watcher() i=7 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c556f0 msgr2=0x556174c57ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c556f0 0x556174c57ae0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174c50ce0 msgr2=0x556174c531a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174c50ce0 0x556174c531a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb18c03d070 msgr2=0x7fb18c018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb18c03d070 0x7fb18c018810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556174c5a060 msgr2=0x556174c5c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556174c5a060 0x556174c5c520 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb064036b40 msgr2=0x7fb064039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb064036b40 0x7fb064039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e6d0 tx=0x7fb18c040f90 comp rx=0 tx=0).stop 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 msgr2=0x556174c45070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 --2- 172.21.15.196:0/1490359018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c3dc30 0x556174c45070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb194011fd0 tx=0x7fb19404cb50 comp rx=0 tx=0).stop 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 reap_dead start 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb199df4640 1 -- 172.21.15.196:0/1490359018 reap_dead start 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 shutdown_connections 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 >> 172.21.15.196:0/1490359018 conn(0x556174c39f90 msgr2=0x556174c38060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 shutdown_connections 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.724+0000 7fb19e93b800 1 -- 172.21.15.196:0/1490359018 wait complete. 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 msgr2=0x7fb074039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 0x7fb074039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x556174c1dcf0 tx=0x7fb18c01b520 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 msgr2=0x556174c313f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x556174c1dc50 tx=0x7fb194018830 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 shutdown_connections 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb074036b90 0x7fb074039050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/2597443934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174c30fd0 0x556174c313f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 >> 172.21.15.196:0/2597443934 conn(0x556174c25f60 msgr2=0x556174c28ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 shutdown_connections 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/2597443934 wait complete. 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 msgr2=0x556174c21f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 0x556174c21f90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 msgr2=0x556174c1d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 0x556174c1d350 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 msgr2=0x7fb080039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 0x7fb080039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb190057000 tx=0x7fb190052000 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 msgr2=0x556174c162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x556174c0f6e0 tx=0x7fb18c000ed0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 shutdown_connections 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556174c1fba0 0x556174c21f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556174b23da0 0x556174c1d350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb080036b90 0x7fb080039050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 --2- 172.21.15.196:0/3768620703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556174a915e0 0x556174c162e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 >> 172.21.15.196:0/3768620703 conn(0x556174b17dd0 msgr2=0x556174c08ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 shutdown_connections 2024-09-21T08:51:59.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.725+0000 7fb19e93b800 1 -- 172.21.15.196:0/3768620703 wait complete. 2024-09-21T08:51:59.740 INFO:teuthology.orchestra.run.smithi196.stdout:["myfoo"] 2024-09-21T08:51:59.740 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-21T08:51:59.750 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.762 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.774 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.819 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-21T08:51:59.847 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.873 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.901 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:51:59.901 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:51:59.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:51:59.902 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T08:51:59.946 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:51:59.946 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.944+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.944+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.944+0000 7fe08a742800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5557da0ee900 0x5557da0f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.944+0000 7fe08a742800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557d9faab30 con 0x5557da0ea4c0 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.944+0000 7fe08a742800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5557d9f8c360 con 0x5557da0ee900 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.945+0000 7fe07dc8f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5557da0ee900 0x5557da0f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.945+0000 7fe086490640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5557da0ea4c0 0x5557da0ea8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47010/0 (socket says 172.21.15.196:47010) 2024-09-21T08:51:59.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.945+0000 7fe086490640 1 -- 172.21.15.196:0/3643593581 learned_addr learned my addr 172.21.15.196:0/3643593581 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:51:59.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.945+0000 7fe07dc8f640 1 -- 172.21.15.196:0/3643593581 >> v1:172.21.15.29:6789/0 conn(0x5557da0ea4c0 legacy=0x5557da0ea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.945+0000 7fe07dc8f640 1 -- 172.21.15.196:0/3643593581 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d9fb2e00 con 0x5557da0ee900 2024-09-21T08:51:59.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.947+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/3643593581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ee900 0x5557da0f0cf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe07000a470 tx=0x7fe070045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23042f9343c9189 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.947+0000 7fe085c8f640 1 -- 172.21.15.196:0/3643593581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe070053570 con 0x5557da0ee900 2024-09-21T08:51:59.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.947+0000 7fe085c8f640 1 -- 172.21.15.196:0/3643593581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe070058070 con 0x5557da0ee900 2024-09-21T08:51:59.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.947+0000 7fe085c8f640 1 -- 172.21.15.196:0/3643593581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe070053880 con 0x5557da0ee900 2024-09-21T08:51:59.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 -- 172.21.15.196:0/3643593581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ee900 msgr2=0x5557da0f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 --2- 172.21.15.196:0/3643593581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ee900 0x5557da0f0cf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe07000a470 tx=0x7fe070045a20 comp rx=0 tx=0).stop 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 -- 172.21.15.196:0/3643593581 shutdown_connections 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 --2- 172.21.15.196:0/3643593581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ee900 0x5557da0f0cf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 -- 172.21.15.196:0/3643593581 >> 172.21.15.196:0/3643593581 conn(0x5557da0e5df0 msgr2=0x5557da0e8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 -- 172.21.15.196:0/3643593581 shutdown_connections 2024-09-21T08:51:59.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.948+0000 7fe08a742800 1 -- 172.21.15.196:0/3643593581 wait complete. 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.961+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.961+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.961+0000 7fe08a742800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.961+0000 7fe08a742800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5557da037330 con 0x5557da0ea4c0 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fe086490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fe086490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35170/0 (socket says 172.21.15.196:35170) 2024-09-21T08:51:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fe086490640 1 -- 172.21.15.196:0/3119099603 learned_addr learned my addr 172.21.15.196:0/3119099603 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fe086490640 1 -- 172.21.15.196:0/3119099603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d9f84bc0 con 0x5557da0ea4c0 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fe086490640 1 --2- 172.21.15.196:0/3119099603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe078001e10 tx=0x7fe07800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ea0e5408ff700f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fdf74608640 1 -- 172.21.15.196:0/3119099603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078012020 con 0x5557da0ea4c0 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fdf74608640 1 -- 172.21.15.196:0/3119099603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07800e5a0 con 0x5557da0ea4c0 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.962+0000 7fdf74608640 1 -- 172.21.15.196:0/3119099603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07800e8e0 con 0x5557da0ea4c0 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- 172.21.15.196:0/3119099603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 msgr2=0x5557da05ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 --2- 172.21.15.196:0/3119099603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe078001e10 tx=0x7fe07800b780 comp rx=0 tx=0).stop 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- 172.21.15.196:0/3119099603 shutdown_connections 2024-09-21T08:51:59.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 --2- 172.21.15.196:0/3119099603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da05ed80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- 172.21.15.196:0/3119099603 >> 172.21.15.196:0/3119099603 conn(0x5557da0e5df0 msgr2=0x5557da1d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- 172.21.15.196:0/3119099603 shutdown_connections 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- 172.21.15.196:0/3119099603 wait complete. 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.963+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe08a742800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe08a742800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5557da0f1530 con 0x5557da0ea4c0 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe086490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe086490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35184/0 (socket says 172.21.15.196:35184) 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe086490640 1 -- 172.21.15.196:0/2467749479 learned_addr learned my addr 172.21.15.196:0/2467749479 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe086490640 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d9f98fe0 con 0x5557da0ea4c0 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe086490640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b7c0 tx=0x7fe078000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fdf72e05640 1 -- 172.21.15.196:0/2467749479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078012030 con 0x5557da0ea4c0 2024-09-21T08:51:59.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fdf72e05640 1 -- 172.21.15.196:0/2467749479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe078001470 con 0x5557da0ea4c0 2024-09-21T08:51:59.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557da1d95a0 con 0x5557da0ea4c0 2024-09-21T08:51:59.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fdf72e05640 1 -- 172.21.15.196:0/2467749479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07801a8d0 con 0x5557da0ea4c0 2024-09-21T08:51:59.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.964+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557da1d9ac0 con 0x5557da0ea4c0 2024-09-21T08:51:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.965+0000 7fdf72e05640 1 -- 172.21.15.196:0/2467749479 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe078015020 con 0x5557da0ea4c0 2024-09-21T08:51:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.965+0000 7fdf72e05640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 0x7fdf6c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fdf72e05640 1 -- 172.21.15.196:0/2467749479 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe078020030 con 0x5557da0ea4c0 2024-09-21T08:51:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 0x7fdf6c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 0x5557da1eb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da1ebb60 con 0x5557da0ee900 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe086c91640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 0x5557da1eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 0x7fdf6c039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe070057000 tx=0x7fe070052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe086c91640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 0x5557da1eb620 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe086c91640 1 -- 172.21.15.196:0/2467749479 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe08000a4a0 con 0x5557da0ee900 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.966+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da1ec3b0 con 0x5557da0ee900 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.967+0000 7fe086c91640 1 -- 172.21.15.196:0/2467749479 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe08000a4a0 con 0x5557da0ee900 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.967+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 0x5557da1f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.967+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da1f0930 con 0x5557da1edd00 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.967+0000 7fe086490640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 0x5557da1f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.967+0000 7fe086490640 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 0x5557da1f01a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe086490640 1 -- 172.21.15.196:0/2467749479 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da1edd00 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da1ecc00 con 0x5557da0ee900 2024-09-21T08:51:59.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe086c91640 1 -- 172.21.15.196:0/2467749479 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe08000a4a0 con 0x5557da0ee900 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da1ecfa0 con 0x5557da0ee900 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe086c91640 1 -- 172.21.15.196:0/2467749479 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe08000a4a0 con 0x5557da0ee900 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.968+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe08a742800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe08a742800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5557da1db3f0 con 0x5557da1ff2b0 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35192/0 (socket says 172.21.15.196:35192) 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe086c91640 1 -- 172.21.15.196:0/4004545561 learned_addr learned my addr 172.21.15.196:0/4004545561 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe086c91640 1 -- 172.21.15.196:0/4004545561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557da1ffc10 con 0x5557da1ff2b0 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe086c91640 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5557da1da8a0 tx=0x7fe0800188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fdf6bfff640 1 -- 172.21.15.196:0/4004545561 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe080014450 con 0x5557da1ff2b0 2024-09-21T08:51:59.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fdf6bfff640 1 -- 172.21.15.196:0/4004545561 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0800145f0 con 0x5557da1ff2b0 2024-09-21T08:51:59.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557da1ffea0 con 0x5557da1ff2b0 2024-09-21T08:51:59.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fdf6bfff640 1 -- 172.21.15.196:0/4004545561 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0800148d0 con 0x5557da1ff2b0 2024-09-21T08:51:59.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.969+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557da202b80 con 0x5557da1ff2b0 2024-09-21T08:51:59.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.970+0000 7fdf6bfff640 1 -- 172.21.15.196:0/4004545561 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe080011040 con 0x5557da1ff2b0 2024-09-21T08:51:59.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.970+0000 7fdf6bfff640 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 0x7fdf60039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.970+0000 7fdf6bfff640 1 -- 172.21.15.196:0/4004545561 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe08001e070 con 0x5557da1ff2b0 2024-09-21T08:51:59.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.970+0000 7fe086490640 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 0x7fdf60039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe086490640 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 0x7fdf60039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5557da1d9f90 tx=0x7fe07804b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe08a742800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe08a742800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5557d9f86580 con 0x5557da20bf60 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35202/0 (socket says 172.21.15.196:35202) 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe086c91640 1 -- 172.21.15.196:0/3381981445 learned_addr learned my addr 172.21.15.196:0/3381981445 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.971+0000 7fe086c91640 1 -- 172.21.15.196:0/3381981445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557da20c930 con 0x5557da20bf60 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe086c91640 1 --2- 172.21.15.196:0/3381981445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe08004cb80 tx=0x7fe08003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d536d52bb0f28dea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fdf69ffb640 1 -- 172.21.15.196:0/3381981445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0800168f0 con 0x5557da20bf60 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fdf69ffb640 1 -- 172.21.15.196:0/3381981445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe080013c80 con 0x5557da20bf60 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fdf69ffb640 1 -- 172.21.15.196:0/3381981445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe080014a70 con 0x5557da20bf60 2024-09-21T08:51:59.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 -- 172.21.15.196:0/3381981445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 msgr2=0x5557da20c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 --2- 172.21.15.196:0/3381981445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe08004cb80 tx=0x7fe08003bf60 comp rx=0 tx=0).stop 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 -- 172.21.15.196:0/3381981445 shutdown_connections 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 --2- 172.21.15.196:0/3381981445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da20c360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 -- 172.21.15.196:0/3381981445 >> 172.21.15.196:0/3381981445 conn(0x5557da208300 msgr2=0x5557da206400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 -- 172.21.15.196:0/3381981445 shutdown_connections 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.972+0000 7fe08a742800 1 -- 172.21.15.196:0/3381981445 wait complete. 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe08a742800 1 Processor -- start 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe08a742800 1 -- start start 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe08a742800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da213230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe08a742800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5557da20cdd0 con 0x5557da20bf60 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da213230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe086c91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da213230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35214/0 (socket says 172.21.15.196:35214) 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 learned_addr learned my addr 172.21.15.196:0/2400053049 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557da213770 con 0x5557da20bf60 2024-09-21T08:51:59.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fe086c91640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da213230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe08003e040 tx=0x7fe08004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.973+0000 7fdf57fff640 1 -- 172.21.15.196:0/2400053049 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe080044030 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fdf57fff640 1 -- 172.21.15.196:0/2400053049 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe080013e30 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557da213a00 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fdf57fff640 1 -- 172.21.15.196:0/2400053049 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe080022bb0 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557da2166b0 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fdf57fff640 1 -- 172.21.15.196:0/2400053049 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0800133b0 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fdf57fff640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf50036b40 0x7fdf50039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.974+0000 7fdf57fff640 1 -- 172.21.15.196:0/2400053049 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe080045070 con 0x5557da20bf60 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe086490640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf50036b40 0x7fdf50039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe086490640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf50036b40 0x7fdf50039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe078000fd0 tx=0x7fe078033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da21ee90 0x5557da221350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da221aa0 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da21ee90 0x5557da221350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.975+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da21ee90 0x5557da221350 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 realm 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da221ed0 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da2227a0 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da222b40 con 0x5557da21ee90 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da2238a0 0x5557da225c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da2261d0 con 0x5557da2238a0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.976+0000 7fe086c91640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da2238a0 0x5557da225c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe086c91640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da2238a0 0x5557da225c90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe08a742800 20 searching for the correct realm 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5557da228210 0x5557da22a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.977+0000 7fe086490640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5557da228210 0x5557da22a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe086490640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5557da228210 0x5557da22a6d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe086490640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe078017050 0x7fe0780405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe078017050 0x7fe0780405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.978+0000 7fe07dc8f640 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe078017050 0x7fe0780405b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.979+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.980+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.981+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.982+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.983+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.984+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:51:59.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:51:59.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:51:59.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:52:00.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.985+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da228210 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da2238a0 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x5557da21ee90 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5557da22ada0 con 0x7fe078017050 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.986+0000 7fe08a742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da226c10 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da227060 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da227500 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 zone default found 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 4 Realm: () 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 zonegroup default 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.987+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da22b220 con 0x5557da2238a0 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da22d450 con 0x5557da228210 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da22d7f0 con 0x5557da228210 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 started sync module instance, tier type = 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.988+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22c890 con 0x7fe078017050 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.989+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.989+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835810229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22c890 con 0x7fe078017050 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.989+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22e1b0 con 0x5557da21ee90 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.990+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835810229424] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.991+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.991+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835810227648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22e1b0 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.991+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22eb70 con 0x5557da228210 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.992+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835810227648] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.992+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.992+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835810233600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22e120 con 0x5557da228210 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.992+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22fa60 con 0x7fe078017050 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.993+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835810233600] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.993+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.993+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835810239920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da22fe80 con 0x7fe078017050 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.993+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da230840 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.995+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.995+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835810243472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da230c60 con 0x5557da21ee90 2024-09-21T08:52:00.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.995+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da231740 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.996+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835810239920] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.996+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.996+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835810247248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da231b30 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.996+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da232530 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.996+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835810243472] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.997+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835810247248] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.997+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.997+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835810240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da232040 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.997+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da232a00 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835810252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da232e20 con 0x5557da2238a0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=0 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=1 2024-09-21T08:52:00.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=2 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=3 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=4 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=5 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835810240976] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.998+0000 7fe08a742800 20 add_watcher() i=6 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.999+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835810252112] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.999+0000 7fe08a742800 20 add_watcher() i=7 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.999+0000 7fe08a742800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.999+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da232e20 con 0x5557da21ee90 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:51:59.999+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.000+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835810253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da232d90 con 0x5557da21ee90 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.000+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835810253168] v34'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fdf3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 5 note: GC not initialized 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fdeb77fe640 20 reqs_thread_entry: start 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 20 Filter name: none 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fdeb57fa640 20 reqs_thread_entry: start 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.001+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da269210 con 0x7fe078017050 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da269b30 con 0x5557da21ee90 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.002+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da269b70 con 0x7fe078017050 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da26b250 con 0x5557da21ee90 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 4.3d 4:bcf4508d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da26a7a0 con 0x5557da228210 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 4.22 4:46bb70b8:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da26fa80 con 0x5557da21ee90 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 4.21 4:870d7801:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da2725a0 con 0x5557da2238a0 2024-09-21T08:52:00.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 4.1b 4:d95102f9:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da2750d0 con 0x7fe078017050 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 4.1e 4:79fd6c1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da277b60 con 0x5557da2238a0 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 4.20 4:0604dc28:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da27a680 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da27d090 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 4.17 4:e9270044:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da27fb60 con 0x5557da2238a0 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 4.22 4:45547614:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da2824b0 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 4.23 4:c4aa99aa:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da285340 con 0x5557da2238a0 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.003+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 4.32 4:4c77f74f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557da287d70 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(68 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(72 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(75 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(74 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(71 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.004+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(76 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.005+0000 7fdf3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.005+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835810253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da285340 con 0x5557da21ee90 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.006+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93835810253168] v34'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.006+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835810229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da266c10 con 0x7fe078017050 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.007+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93835810229424] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.007+0000 7fe08a742800 20 remove_watcher() i=0 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.007+0000 7fe08a742800 2 removed watcher, disabling cache 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.007+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835810227648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da266c10 con 0x5557da21ee90 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.008+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93835810227648] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.008+0000 7fe08a742800 20 remove_watcher() i=1 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.008+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835810233600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da266c10 con 0x5557da228210 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.009+0000 7fe086490640 1 -- 172.21.15.196:0/2400053049 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93835810233600] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe07802dcf0 con 0x5557da228210 2024-09-21T08:52:00.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.009+0000 7fe08a742800 20 remove_watcher() i=2 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.009+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835810239920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da2519b0 con 0x7fe078017050 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.010+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93835810239920] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x7fe078017050 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.010+0000 7fe08a742800 20 remove_watcher() i=3 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.010+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835810243472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da2519b0 con 0x5557da21ee90 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93835810243472] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe070051070 con 0x5557da21ee90 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe08a742800 20 remove_watcher() i=4 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835810247248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da2519b0 con 0x5557da2238a0 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93835810247248] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe08a742800 20 remove_watcher() i=5 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.012+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835810240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da2519b0 con 0x5557da2238a0 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.013+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93835810240976] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.014+0000 7fe08a742800 20 remove_watcher() i=6 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.014+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835810252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5557da2519b0 con 0x5557da2238a0 2024-09-21T08:52:00.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.014+0000 7fe086c91640 1 -- 172.21.15.196:0/2400053049 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93835810252112] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe08002a070 con 0x5557da2238a0 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 20 remove_watcher() i=7 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da2238a0 msgr2=0x5557da225c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da2238a0 0x5557da225c90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da21ee90 msgr2=0x5557da221350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da21ee90 0x5557da221350 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe078017050 msgr2=0x7fe0780405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe078017050 0x7fe0780405b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5557da228210 msgr2=0x5557da22a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5557da228210 0x5557da22a6d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf50036b40 msgr2=0x7fdf50039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf50036b40 0x7fdf50039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe078000fd0 tx=0x7fe078033000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 msgr2=0x5557da213230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/2400053049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da20bf60 0x5557da213230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe08003e040 tx=0x7fe08004cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:00.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 reap_dead start 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe07dc8f640 1 -- 172.21.15.196:0/2400053049 reap_dead start 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 shutdown_connections 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 >> 172.21.15.196:0/2400053049 conn(0x5557da208300 msgr2=0x5557da2063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 shutdown_connections 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/2400053049 wait complete. 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 msgr2=0x7fdf60039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 0x7fdf60039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5557da1d9f90 tx=0x7fe07804b030 comp rx=0 tx=0).stop 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 msgr2=0x5557da1ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5557da1da8a0 tx=0x7fe0800188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 shutdown_connections 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf60036b40 0x7fdf60039000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 --2- 172.21.15.196:0/4004545561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da1ff2b0 0x5557da1ff6d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 >> 172.21.15.196:0/4004545561 conn(0x5557da1f4240 msgr2=0x5557da1f6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 shutdown_connections 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.015+0000 7fe08a742800 1 -- 172.21.15.196:0/4004545561 wait complete. 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 msgr2=0x5557da1f01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 0x5557da1f01a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 msgr2=0x5557da1eb620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 0x5557da1eb620 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 msgr2=0x7fdf6c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 0x7fdf6c039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe070057000 tx=0x7fe070052000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 msgr2=0x5557da1daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b7c0 tx=0x7fe078000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 shutdown_connections 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5557da1edd00 0x5557da1f01a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5557da0ee900 0x5557da1eb620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdf6c036b90 0x7fdf6c039050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 --2- 172.21.15.196:0/2467749479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5557da0ea4c0 0x5557da1daeb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 >> 172.21.15.196:0/2467749479 conn(0x5557da0e5df0 msgr2=0x5557da1d3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 shutdown_connections 2024-09-21T08:52:00.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.016+0000 7fe08a742800 1 -- 172.21.15.196:0/2467749479 wait complete. 2024-09-21T08:52:00.029 INFO:teuthology.orchestra.run.smithi196.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0bf56418-c298-49e5-b663-8247e6a1b700","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T08:51:59.478567Z","creation_time":"2024-09-21T08:51:59.475959Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T08:52:00.029 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:51:59.478567Z', 'creation_time': '2024-09-21T08:51:59.475959Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:52:00.029 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-21T08:52:00.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-21T08:52:00.029 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-21T08:52:00.074 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.074 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c78bb800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2ad9444c0 0x55a2ad9448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c78bb800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2ad804b30 con 0x55a2ad944e00 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c78bb800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a2ad7e6360 con 0x55a2ad9444c0 2024-09-21T08:52:00.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.072+0000 7fe1c53af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2ad9444c0 0x55a2ad9448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.073+0000 7fe1c53af640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a2ad9444c0 0x55a2ad9448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35230/0 (socket says 172.21.15.196:35230) 2024-09-21T08:52:00.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.073+0000 7fe1c53af640 1 -- 172.21.15.196:0/1655119356 learned_addr learned my addr 172.21.15.196:0/1655119356 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.073+0000 7fe1bffff640 1 --1- 172.21.15.196:0/1655119356 >> v1:172.21.15.29:6789/0 conn(0x55a2ad944e00 0x55a2ad949980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47026/0 (socket says 172.21.15.196:47026) 2024-09-21T08:52:00.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.073+0000 7fe1c53af640 1 -- 172.21.15.196:0/1655119356 >> v1:172.21.15.29:6789/0 conn(0x55a2ad944e00 legacy=0x55a2ad949980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.073+0000 7fe1c53af640 1 -- 172.21.15.196:0/1655119356 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ad80ce00 con 0x55a2ad9444c0 2024-09-21T08:52:00.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c53af640 1 --2- 172.21.15.196:0/1655119356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ad9448c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000a6b0 tx=0x7fe1b0047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a9e4762907329d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c4bae640 1 -- 172.21.15.196:0/1655119356 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000a200 con 0x55a2ad9444c0 2024-09-21T08:52:00.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c4bae640 1 -- 172.21.15.196:0/1655119356 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b000a3a0 con 0x55a2ad9444c0 2024-09-21T08:52:00.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c4bae640 1 -- 172.21.15.196:0/1655119356 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0008700 con 0x55a2ad9444c0 2024-09-21T08:52:00.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1655119356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 msgr2=0x55a2ad9448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/1655119356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ad9448c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000a6b0 tx=0x7fe1b0047e30 comp rx=0 tx=0).stop 2024-09-21T08:52:00.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1655119356 shutdown_connections 2024-09-21T08:52:00.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/1655119356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ad9448c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1655119356 >> 172.21.15.196:0/1655119356 conn(0x55a2ad93fdf0 msgr2=0x55a2ad942210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1655119356 shutdown_connections 2024-09-21T08:52:00.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.075+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1655119356 wait complete. 2024-09-21T08:52:00.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.092 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c78bb800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c78bb800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad891330 con 0x55a2ad9444c0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c53af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c53af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35234/0 (socket says 172.21.15.196:35234) 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.089+0000 7fe1c53af640 1 -- 172.21.15.196:0/1467034975 learned_addr learned my addr 172.21.15.196:0/1467034975 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.090+0000 7fe1c53af640 1 -- 172.21.15.196:0/1467034975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ad7debc0 con 0x55a2ad9444c0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.090+0000 7fe1c53af640 1 --2- 172.21.15.196:0/1467034975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0048360 tx=0x7fe1b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1160669b5a5f8eed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.090+0000 7fe0b2614640 1 -- 172.21.15.196:0/1467034975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0064070 con 0x55a2ad9444c0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.090+0000 7fe0b2614640 1 -- 172.21.15.196:0/1467034975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b004f4c0 con 0x55a2ad9444c0 2024-09-21T08:52:00.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.090+0000 7fe0b2614640 1 -- 172.21.15.196:0/1467034975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000a200 con 0x55a2ad9444c0 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1467034975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 msgr2=0x55a2ada36a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/1467034975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0048360 tx=0x7fe1b0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1467034975 shutdown_connections 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/1467034975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada36a30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1467034975 >> 172.21.15.196:0/1467034975 conn(0x55a2ad93fdf0 msgr2=0x55a2ada2dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1467034975 shutdown_connections 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- 172.21.15.196:0/1467034975 wait complete. 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.091+0000 7fe1c78bb800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad94b480 con 0x55a2ad9444c0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c53af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c53af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35246/0 (socket says 172.21.15.196:35246) 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c53af640 1 -- 172.21.15.196:0/3006915829 learned_addr learned my addr 172.21.15.196:0/3006915829 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c53af640 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ad7f2fe0 con 0x55a2ad9444c0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c53af640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe0b0e11640 1 -- 172.21.15.196:0/3006915829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b006c030 con 0x55a2ad9444c0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe0b0e11640 1 -- 172.21.15.196:0/3006915829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b004f930 con 0x55a2ad9444c0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ada3e950 con 0x55a2ad9444c0 2024-09-21T08:52:00.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe0b0e11640 1 -- 172.21.15.196:0/3006915829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b0064040 con 0x55a2ad9444c0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.092+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ada3ee10 con 0x55a2ad9444c0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe0b0e11640 1 -- 172.21.15.196:0/3006915829 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe1b006f070 con 0x55a2ad9444c0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe0b0e11640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 0x7fe0ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe0b0e11640 1 -- 172.21.15.196:0/3006915829 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe1b006d070 con 0x55a2ad9444c0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe1bffff640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 0x7fe0ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 0x55a2ada453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada459d0 con 0x55a2ad944e00 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.093+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 0x55a2ada453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1bffff640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 0x7fe0ac039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000f60 tx=0x7fe1b8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 0x55a2ada453b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/3006915829 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1c000a4a0 con 0x55a2ad944e00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada42a30 con 0x55a2ad944e00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/3006915829 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1c000a4a0 con 0x55a2ad944e00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 0x55a2ada4a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.094+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada4a790 con 0x55a2ada47d00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.095+0000 7fe1c53af640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 0x55a2ada4a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.095+0000 7fe1c53af640 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 0x55a2ada4a0f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.095+0000 7fe1c53af640 1 -- 172.21.15.196:0/3006915829 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada47d00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.095+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada46ba0 con 0x55a2ad944e00 2024-09-21T08:52:00.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/3006915829 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1c000a4a0 con 0x55a2ad944e00 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada47040 con 0x55a2ad944e00 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/3006915829 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1c000a4a0 con 0x55a2ad944e00 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c78bb800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c78bb800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad7e0580 con 0x55a2ada59120 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35262/0 (socket says 172.21.15.196:35262) 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.096+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/539573540 learned_addr learned my addr 172.21.15.196:0/539573540 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/539573540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ada59a80 con 0x55a2ada59120 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55a2ada3f4c0 tx=0x7fe1c00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe0a9ffb640 1 -- 172.21.15.196:0/539573540 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0014450 con 0x55a2ada59120 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe0a9ffb640 1 -- 172.21.15.196:0/539573540 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c00145f0 con 0x55a2ada59120 2024-09-21T08:52:00.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ada59d10 con 0x55a2ada59120 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe0a9ffb640 1 -- 172.21.15.196:0/539573540 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c00148d0 con 0x55a2ada59120 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.097+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ada5c9f0 con 0x55a2ada59120 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe0a9ffb640 1 -- 172.21.15.196:0/539573540 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe1c0011040 con 0x55a2ada59120 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe0a9ffb640 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 0x7fe09c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe0a9ffb640 1 -- 172.21.15.196:0/539573540 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe1c001e070 con 0x55a2ada59120 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe1c53af640 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 0x7fe09c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe1c53af640 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 0x7fe09c039050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a2ada45e40 tx=0x7fe1b0071c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.098+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c78bb800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c78bb800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ada37180 con 0x55a2ada65da0 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35272/0 (socket says 172.21.15.196:35272) 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/4211516387 learned_addr learned my addr 172.21.15.196:0/4211516387 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/4211516387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ada66770 con 0x55a2ada65da0 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/4211516387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe1c004cb40 tx=0x7fe1c003bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6a3e5d68a3b6a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe0a37fe640 1 -- 172.21.15.196:0/4211516387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c00168f0 con 0x55a2ada65da0 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe0a37fe640 1 -- 172.21.15.196:0/4211516387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c0013cb0 con 0x55a2ada65da0 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.099+0000 7fe0a37fe640 1 -- 172.21.15.196:0/4211516387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0014a70 con 0x55a2ada65da0 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- 172.21.15.196:0/4211516387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 msgr2=0x55a2ada661a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/4211516387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe1c004cb40 tx=0x7fe1c003bf20 comp rx=0 tx=0).stop 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- 172.21.15.196:0/4211516387 shutdown_connections 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/4211516387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada661a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- 172.21.15.196:0/4211516387 >> 172.21.15.196:0/4211516387 conn(0x55a2ada62100 msgr2=0x55a2ada60200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- 172.21.15.196:0/4211516387 shutdown_connections 2024-09-21T08:52:00.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- 172.21.15.196:0/4211516387 wait complete. 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 Processor -- start 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- start start 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c78bb800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2ada66de0 con 0x55a2ada65da0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c5bb0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35288/0 (socket says 172.21.15.196:35288) 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.100+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 learned_addr learned my addr 172.21.15.196:0/466301813 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ada6d760 con 0x55a2ada65da0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe1c003e040 tx=0x7fe1c004cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe0a1ffb640 1 -- 172.21.15.196:0/466301813 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0031070 con 0x55a2ada65da0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe0a1ffb640 1 -- 172.21.15.196:0/466301813 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c0022a50 con 0x55a2ada65da0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2ada6d9f0 con 0x55a2ada65da0 2024-09-21T08:52:00.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe0a1ffb640 1 -- 172.21.15.196:0/466301813 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c0013e60 con 0x55a2ada65da0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.101+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ada706a0 con 0x55a2ada65da0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe0a1ffb640 1 -- 172.21.15.196:0/466301813 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe1c0034070 con 0x55a2ada65da0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe0a1ffb640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe094036b40 0x7fe094039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe0a1ffb640 1 -- 172.21.15.196:0/466301813 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe1c000e040 con 0x55a2ada65da0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe1c53af640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe094036b40 0x7fe094039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ada78ed0 0x55a2ada7b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.102+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada7bae0 con 0x55a2ada78ed0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1bffff640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ada78ed0 0x55a2ada7b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c53af640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe094036b40 0x7fe094039000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00054e0 tx=0x7fe1b0082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1bffff640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ada78ed0 0x55a2ada7b390 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1b800f610 con 0x55a2ada78ed0 2024-09-21T08:52:00.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 20 realm 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada78320 con 0x55a2ada78ed0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1b800f610 con 0x55a2ada78ed0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.103+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada7c5c0 con 0x55a2ada78ed0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1b800f610 con 0x55a2ada78ed0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada7ce90 con 0x55a2ada78ed0 2024-09-21T08:52:00.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1b800f610 con 0x55a2ada78ed0 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada7d740 0x55a2ada7fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada802b0 con 0x55a2ada7d740 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.104+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada7d740 0x55a2ada7fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c5bb0640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada7d740 0x55a2ada7fb50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c78bb800 20 searching for the correct realm 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ada823b0 0x55a2ada84870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c53af640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ada823b0 0x55a2ada84870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.105+0000 7fe1c53af640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ada823b0 0x55a2ada84870 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1c53af640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe1b009c040 0x7fe1b0079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1bffff640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe1b009c040 0x7fe1b0079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1bffff640 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe1b009c040 0x7fe1b0079780 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b800f610 con 0x7fe1b009c040 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.106+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b800f610 con 0x55a2ada78ed0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.107+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.108+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.109+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.110+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.111+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.112+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada823b0 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada7d740 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x55a2ada78ed0 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.113+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada84f40 con 0x7fe1b009c040 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada80db0 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada81200 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada816a0 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 zone default found 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 4 Realm: () 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 zonegroup default 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.114+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada853c0 con 0x55a2ada7d740 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada809e0 con 0x55a2ada823b0 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada876f0 con 0x55a2ada823b0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 started sync module instance, tier type = 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.115+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada86a80 con 0x7fe1b009c040 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.116+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.116+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157186559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada86a80 con 0x7fe1b009c040 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.116+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada88210 con 0x55a2ada78ed0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.117+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157186559872] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.117+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.117+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157186563360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada86a80 con 0x55a2ada78ed0 2024-09-21T08:52:00.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.117+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada88cc0 con 0x55a2ada823b0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.119+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.119+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157186566096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada89550 con 0x55a2ada823b0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.119+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8a040 con 0x7fe1b009c040 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.119+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157186563360] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.120+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157186566096] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.120+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.120+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157186571024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada89060 con 0x7fe1b009c040 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.120+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8a8e0 con 0x55a2ada78ed0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.121+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.121+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157186573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8a800 con 0x55a2ada78ed0 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.121+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8b820 con 0x55a2ada7d740 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.121+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157186571024] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.122+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.122+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157186577136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8bc10 con 0x55a2ada7d740 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.122+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8bc10 con 0x55a2ada7d740 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.122+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157186573280] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.123+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157186577136] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.123+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.123+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157186575568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8c120 con 0x55a2ada7d740 2024-09-21T08:52:00.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.123+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8cc80 con 0x55a2ada7d740 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157186582480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8d0a0 con 0x55a2ada7d740 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=0 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=1 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=2 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=3 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=4 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=5 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157186575568] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.124+0000 7fe1c78bb800 20 add_watcher() i=6 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157186582480] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1c78bb800 20 add_watcher() i=7 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1c78bb800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada900d0 con 0x55a2ada78ed0 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.125+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157186583536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2ada8d4c0 con 0x55a2ada78ed0 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157186583536] v34'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe07a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe1c78bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe1c78bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe1c78bb800 5 note: GC not initialized 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.126+0000 7fe0797e2640 20 reqs_thread_entry: start 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 20 Filter name: none 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fdfeaffd640 20 reqs_thread_entry: start 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac2e10 con 0x55a2ada78ed0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac3800 con 0x55a2ada78ed0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.127+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac4810 con 0x7fe1b009c040 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac1f60 con 0x7fe1b009c040 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.128+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac47d0 con 0x55a2ada78ed0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 4.3d 4:bcf4508d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac4240 con 0x55a2ada823b0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 4.22 4:46bb70b8:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac9120 con 0x55a2ada78ed0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 4.21 4:870d7801:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adacb9d0 con 0x55a2ada7d740 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 4.1b 4:d95102f9:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adace690 con 0x7fe1b009c040 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 4.1e 4:79fd6c1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adad0f80 con 0x55a2ada7d740 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 4.20 4:0604dc28:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adad3870 con 0x55a2ada78ed0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adad3870 con 0x55a2ada78ed0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(71 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 4.17 4:e9270044:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac9970 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 4.22 4:45547614:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adacb280 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 4.23 4:c4aa99aa:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac6c50 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(72 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 4.32 4:4c77f74f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2adad13a0 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(70 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(73 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(74 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.129+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(75 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.130+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(77 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.130+0000 7fe07a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.130+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157186583536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adad13a0 con 0x55a2ada78ed0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.131+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94157186583536] v34'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.131+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157186559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x7fe1b009c040 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.132+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94157186559872] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.132+0000 7fe1c78bb800 20 remove_watcher() i=0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.132+0000 7fe1c78bb800 2 removed watcher, disabling cache 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.132+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157186563360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada78ed0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.134+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94157186563360] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.134+0000 7fe1c78bb800 20 remove_watcher() i=1 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.134+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157186566096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada823b0 2024-09-21T08:52:00.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.135+0000 7fe1c53af640 1 -- 172.21.15.196:0/466301813 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94157186566096] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b00719d0 con 0x55a2ada823b0 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.135+0000 7fe1c78bb800 20 remove_watcher() i=2 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.135+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157186571024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x7fe1b009c040 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.136+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94157186571024] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x7fe1b009c040 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.136+0000 7fe1c78bb800 20 remove_watcher() i=3 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.136+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157186573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada78ed0 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.136+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94157186573280] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b802b040 con 0x55a2ada78ed0 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.137+0000 7fe1c78bb800 20 remove_watcher() i=4 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.137+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157186577136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada7d740 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.137+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94157186577136] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.137+0000 7fe1c78bb800 20 remove_watcher() i=5 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.137+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157186575568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada7d740 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.139+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94157186575568] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.139+0000 7fe1c78bb800 20 remove_watcher() i=6 2024-09-21T08:52:00.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.139+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157186582480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2adac0be0 con 0x55a2ada7d740 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c5bb0640 1 -- 172.21.15.196:0/466301813 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94157186582480] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033030 con 0x55a2ada7d740 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 20 remove_watcher() i=7 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada7d740 msgr2=0x55a2ada7fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada7d740 0x55a2ada7fb50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ada78ed0 msgr2=0x55a2ada7b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ada78ed0 0x55a2ada7b390 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe1b009c040 msgr2=0x7fe1b0079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe1b009c040 0x7fe1b0079780 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ada823b0 msgr2=0x55a2ada84870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a2ada823b0 0x55a2ada84870 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe094036b40 msgr2=0x7fe094039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe094036b40 0x7fe094039000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00054e0 tx=0x7fe1b0082000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 msgr2=0x55a2ada6d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe1c003e040 tx=0x7fe1c004cad0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1bffff640 1 -- 172.21.15.196:0/466301813 reap_dead start 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 shutdown_connections 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/466301813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada65da0 0x55a2ada6d220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 >> 172.21.15.196:0/466301813 conn(0x55a2ada62100 msgr2=0x55a2ada601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 shutdown_connections 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/466301813 wait complete. 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 msgr2=0x7fe09c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 0x7fe09c039050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a2ada45e40 tx=0x7fe1b0071c80 comp rx=0 tx=0).stop 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 msgr2=0x55a2ada59540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55a2ada3f4c0 tx=0x7fe1c00188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 shutdown_connections 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe09c036b90 0x7fe09c039050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/539573540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ada59120 0x55a2ada59540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 >> 172.21.15.196:0/539573540 conn(0x55a2ada4e0b0 msgr2=0x55a2ada50c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 shutdown_connections 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.140+0000 7fe1c78bb800 1 -- 172.21.15.196:0/539573540 wait complete. 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 msgr2=0x55a2ada4a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 0x55a2ada4a0f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 msgr2=0x55a2ada453b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 0x55a2ada453b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 msgr2=0x7fe0ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 0x7fe0ac039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000f60 tx=0x7fe1b8001370 comp rx=0 tx=0).stop 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 msgr2=0x55a2ada3e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 shutdown_connections 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a2ada47d00 0x55a2ada4a0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a2ad944e00 0x55a2ada453b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe0ac036b90 0x7fe0ac039050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 --2- 172.21.15.196:0/3006915829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2ad9444c0 0x55a2ada3e410 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 >> 172.21.15.196:0/3006915829 conn(0x55a2ad93fdf0 msgr2=0x55a2ada2c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 shutdown_connections 2024-09-21T08:52:00.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.141+0000 7fe1c78bb800 1 -- 172.21.15.196:0/3006915829 wait complete. 2024-09-21T08:52:00.157 INFO:teuthology.orchestra.run.smithi196.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0bf56418-c298-49e5-b663-8247e6a1b700","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T08:51:59.478567Z","creation_time":"2024-09-21T08:51:59.475959Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-21T08:52:00.157 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:51:59.478567Z', 'creation_time': '2024-09-21T08:51:59.475959Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-21T08:52:00.163 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T08:52:00.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:52:00.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:52:00.164 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T08:52:00.208 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.208 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.206+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.206+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd27d340800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b68be9ad90 0x55b68be9d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd27d340800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b68bd53b30 con 0x55b68be08610 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd27d340800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b68bd35360 con 0x55b68be9ad90 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2708c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b68be9ad90 0x55b68be9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2708c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b68be9ad90 0x55b68be9d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35296/0 (socket says 172.21.15.196:35296) 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2790ca640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b68be08610 0x55b68be99670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47034/0 (socket says 172.21.15.196:47034) 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2708c9640 1 -- 172.21.15.196:0/1136471872 learned_addr learned my addr 172.21.15.196:0/1136471872 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2708c9640 1 -- 172.21.15.196:0/1136471872 >> v1:172.21.15.29:6789/0 conn(0x55b68be08610 legacy=0x55b68be99670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.207+0000 7fd2708c9640 1 -- 172.21.15.196:0/1136471872 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bd5be00 con 0x55b68be9ad90 2024-09-21T08:52:00.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.209+0000 7fd2708c9640 1 --2- 172.21.15.196:0/1136471872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be9ad90 0x55b68be9d180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd26400a520 tx=0x7fd264045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2234d508ec499457 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd2788c9640 1 -- 172.21.15.196:0/1136471872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd264055070 con 0x55b68be9ad90 2024-09-21T08:52:00.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd2788c9640 1 -- 172.21.15.196:0/1136471872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2640515b0 con 0x55b68be9ad90 2024-09-21T08:52:00.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd2788c9640 1 -- 172.21.15.196:0/1136471872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2640518d0 con 0x55b68be9ad90 2024-09-21T08:52:00.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 -- 172.21.15.196:0/1136471872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be9ad90 msgr2=0x55b68be9d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 --2- 172.21.15.196:0/1136471872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be9ad90 0x55b68be9d180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd26400a520 tx=0x7fd264045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 -- 172.21.15.196:0/1136471872 shutdown_connections 2024-09-21T08:52:00.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 --2- 172.21.15.196:0/1136471872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be9ad90 0x55b68be9d180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 -- 172.21.15.196:0/1136471872 >> 172.21.15.196:0/1136471872 conn(0x55b68be8ede0 msgr2=0x55b68be91200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 -- 172.21.15.196:0/1136471872 shutdown_connections 2024-09-21T08:52:00.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.210+0000 7fd27d340800 1 -- 172.21.15.196:0/1136471872 wait complete. 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd27d340800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd27d340800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b68bde0330 con 0x55b68be08610 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd2790ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd2790ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35302/0 (socket says 172.21.15.196:35302) 2024-09-21T08:52:00.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.224+0000 7fd2790ca640 1 -- 172.21.15.196:0/1019025298 learned_addr learned my addr 172.21.15.196:0/1019025298 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.225+0000 7fd2790ca640 1 -- 172.21.15.196:0/1019025298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bd2dbc0 con 0x55b68be08610 2024-09-21T08:52:00.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.225+0000 7fd2790ca640 1 --2- 172.21.15.196:0/1019025298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b230 tx=0x7fd26c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5ffd302652d895 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.225+0000 7fd167606640 1 -- 172.21.15.196:0/1019025298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd26c00e5c0 con 0x55b68be08610 2024-09-21T08:52:00.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.225+0000 7fd167606640 1 -- 172.21.15.196:0/1019025298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26c006070 con 0x55b68be08610 2024-09-21T08:52:00.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.225+0000 7fd167606640 1 -- 172.21.15.196:0/1019025298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd26c00e890 con 0x55b68be08610 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- 172.21.15.196:0/1019025298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 msgr2=0x55b68bf85a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 --2- 172.21.15.196:0/1019025298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b230 tx=0x7fd26c00b6f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- 172.21.15.196:0/1019025298 shutdown_connections 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 --2- 172.21.15.196:0/1019025298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf85a90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- 172.21.15.196:0/1019025298 >> 172.21.15.196:0/1019025298 conn(0x55b68be8ede0 msgr2=0x55b68bf81450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- 172.21.15.196:0/1019025298 shutdown_connections 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- 172.21.15.196:0/1019025298 wait complete. 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.226+0000 7fd27d340800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b68be9d990 con 0x55b68be08610 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd2790ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd2790ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35310/0 (socket says 172.21.15.196:35310) 2024-09-21T08:52:00.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd2790ca640 1 -- 172.21.15.196:0/2067387565 learned_addr learned my addr 172.21.15.196:0/2067387565 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd2790ca640 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bd41fe0 con 0x55b68be08610 2024-09-21T08:52:00.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd2790ca640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd165e03640 1 -- 172.21.15.196:0/2067387565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd26c00f8d0 con 0x55b68be08610 2024-09-21T08:52:00.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd165e03640 1 -- 172.21.15.196:0/2067387565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26c00fa90 con 0x55b68be08610 2024-09-21T08:52:00.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b68bf8da00 con 0x55b68be08610 2024-09-21T08:52:00.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd165e03640 1 -- 172.21.15.196:0/2067387565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd26c00fdb0 con 0x55b68be08610 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.227+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68bf8df20 con 0x55b68be08610 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd165e03640 1 -- 172.21.15.196:0/2067387565 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd26c017070 con 0x55b68be08610 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd165e03640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 0x7fd160039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd165e03640 1 -- 172.21.15.196:0/2067387565 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd26c015020 con 0x55b68be08610 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd2708c9640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 0x7fd160039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 0x55b68bf94530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.228+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bf94b00 con 0x55b68be9ad90 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd2798cb640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 0x55b68bf94530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd2708c9640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 0x7fd160039000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd264057000 tx=0x7fd264052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd2798cb640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 0x55b68bf94530 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd2798cb640 1 -- 172.21.15.196:0/2067387565 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd27400a4a0 con 0x55b68be9ad90 2024-09-21T08:52:00.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bf91b00 con 0x55b68be9ad90 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd2798cb640 1 -- 172.21.15.196:0/2067387565 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd27400a4a0 con 0x55b68be9ad90 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 0x55b68bf99200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.229+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bf998a0 con 0x55b68bf96e10 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.230+0000 7fd2790ca640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 0x55b68bf99200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.230+0000 7fd2790ca640 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 0x55b68bf99200 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.230+0000 7fd2790ca640 1 -- 172.21.15.196:0/2067387565 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bf96e10 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.230+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bf95c80 con 0x55b68be9ad90 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd2798cb640 1 -- 172.21.15.196:0/2067387565 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd27400a4a0 con 0x55b68be9ad90 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bf96120 con 0x55b68be9ad90 2024-09-21T08:52:00.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd2798cb640 1 -- 172.21.15.196:0/2067387565 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd27400a4a0 con 0x55b68be9ad90 2024-09-21T08:52:00.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd27d340800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.231+0000 7fd27d340800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b68bd2f580 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35322/0 (socket says 172.21.15.196:35322) 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd2798cb640 1 -- 172.21.15.196:0/1904848568 learned_addr learned my addr 172.21.15.196:0/1904848568 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd2798cb640 1 -- 172.21.15.196:0/1904848568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bfa8b50 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd2798cb640 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b68bf8e570 tx=0x7fd2740188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd15effd640 1 -- 172.21.15.196:0/1904848568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd274014450 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd15effd640 1 -- 172.21.15.196:0/1904848568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2740145f0 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b68bfa8de0 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd15effd640 1 -- 172.21.15.196:0/1904848568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2740148d0 con 0x55b68bfa81f0 2024-09-21T08:52:00.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.232+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68bfabac0 con 0x55b68bfa81f0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.233+0000 7fd15effd640 1 -- 172.21.15.196:0/1904848568 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd274011040 con 0x55b68bfa81f0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.233+0000 7fd15effd640 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 0x7fd150039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.233+0000 7fd15effd640 1 -- 172.21.15.196:0/1904848568 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd27401e070 con 0x55b68bfa81f0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.233+0000 7fd2790ca640 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 0x7fd150039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.233+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2790ca640 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 0x7fd150039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0176e0 tx=0x7fd26c04b740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd27d340800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd27d340800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b68bf86240 con 0x55b68bfb4e20 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35338/0 (socket says 172.21.15.196:35338) 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2798cb640 1 -- 172.21.15.196:0/3007195320 learned_addr learned my addr 172.21.15.196:0/3007195320 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2798cb640 1 -- 172.21.15.196:0/3007195320 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bfb57f0 con 0x55b68bfb4e20 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd2798cb640 1 --2- 172.21.15.196:0/3007195320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd27404cb40 tx=0x7fd274011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cead911a901a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.234+0000 7fd15cff9640 1 -- 172.21.15.196:0/3007195320 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd274013cb0 con 0x55b68bfb4e20 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd15cff9640 1 -- 172.21.15.196:0/3007195320 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274014a70 con 0x55b68bfb4e20 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd15cff9640 1 -- 172.21.15.196:0/3007195320 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd274014d90 con 0x55b68bfb4e20 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- 172.21.15.196:0/3007195320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 msgr2=0x55b68bfb5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 --2- 172.21.15.196:0/3007195320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd27404cb40 tx=0x7fd274011970 comp rx=0 tx=0).stop 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- 172.21.15.196:0/3007195320 shutdown_connections 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 --2- 172.21.15.196:0/3007195320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfb5220 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- 172.21.15.196:0/3007195320 >> 172.21.15.196:0/3007195320 conn(0x55b68bfb1180 msgr2=0x55b68bfaf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- 172.21.15.196:0/3007195320 shutdown_connections 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- 172.21.15.196:0/3007195320 wait complete. 2024-09-21T08:52:00.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 Processor -- start 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- start start 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.235+0000 7fd27d340800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b68bfb5dc0 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd2798cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35340/0 (socket says 172.21.15.196:35340) 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 learned_addr learned my addr 172.21.15.196:0/725669552 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b68bfbc7b0 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd2798cb640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2740119b0 tx=0x7fd27404cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd14effd640 1 -- 172.21.15.196:0/725669552 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd274016440 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd14effd640 1 -- 172.21.15.196:0/725669552 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274022a50 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b68bfbca40 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd14effd640 1 -- 172.21.15.196:0/725669552 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd274022db0 con 0x55b68bfb4e20 2024-09-21T08:52:00.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.236+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b68bfbf6f0 con 0x55b68bfb4e20 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd14effd640 1 -- 172.21.15.196:0/725669552 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd2740133b0 con 0x55b68bfb4e20 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd14effd640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd144036af0 0x7fd144038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd14effd640 1 -- 172.21.15.196:0/725669552 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd27400e040 con 0x55b68bfb4e20 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd2790ca640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd144036af0 0x7fd144038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68bfc7f30 0x55b68bfca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.237+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcab40 con 0x55b68bfc7f30 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd2708c9640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68bfc7f30 0x55b68bfca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd2790ca640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd144036af0 0x7fd144038fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd26c001600 tx=0x7fd26c035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd2708c9640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68bfc7f30 0x55b68bfca3f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 20 realm 2024-09-21T08:52:00.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcaf70 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.238+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcb840 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcbbe0 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bfcc940 0x55b68bfced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcf270 con 0x55b68bfcc940 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd2798cb640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bfcc940 0x55b68bfced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.239+0000 7fd2798cb640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bfcc940 0x55b68bfced30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd27d340800 20 searching for the correct realm 2024-09-21T08:52:00.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b68bfd1350 0x55b68bfd3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd2790ca640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b68bfd1350 0x55b68bfd3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.240+0000 7fd2790ca640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b68bfd1350 0x55b68bfd3810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2790ca640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd26c00f070 0x7fd26c019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2708c9640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd26c00f070 0x7fd26c019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2708c9640 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd26c00f070 0x7fd26c019860 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.241+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.242+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.243+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.244+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.245+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.246+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.247+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfd1350 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.248+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfcc940 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x55b68bfc7f30 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd3ee0 con 0x7fd26c00f070 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd0870 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.249+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfcfc90 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd0130 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 zone default found 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 4 Realm: () 2024-09-21T08:52:00.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 zonegroup default 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd4810 con 0x55b68bfcc940 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd65c0 con 0x55b68bfd1350 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.250+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd6a50 con 0x55b68bfd1350 2024-09-21T08:52:00.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 20 started sync module instance, tier type = 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.251+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd5a30 con 0x7fd26c00f070 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.252+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.252+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94242521046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd5a30 con 0x7fd26c00f070 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.252+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7550 con 0x55b68bfc7f30 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.253+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94242521046832] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.253+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.253+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94242521051168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7510 con 0x55b68bfc7f30 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.253+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7fd0 con 0x55b68bfd1350 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.254+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.254+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94242521053952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd8820 con 0x55b68bfd1350 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.254+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd9320 con 0x7fd26c00f070 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.255+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94242521051168] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.255+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94242521053952] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.255+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.255+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94242521056112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd5580 con 0x7fd26c00f070 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.256+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd9d30 con 0x55b68bfc7f30 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.257+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94242521056112] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.257+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.257+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94242521058832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd9d30 con 0x55b68bfc7f30 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.257+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfda5c0 con 0x55b68bfcc940 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.258+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.258+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94242521063216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdae60 con 0x55b68bfcc940 2024-09-21T08:52:00.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.258+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdb8d0 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.258+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94242521058832] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.259+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94242521063216] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.259+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.259+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94242521068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfda9f0 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.259+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdbf60 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94242521068448] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94242521061504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdbf60 con 0x55b68bfcc940 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=0 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=1 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=2 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=3 2024-09-21T08:52:00.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=4 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=5 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.260+0000 7fd27d340800 20 add_watcher() i=6 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94242521061504] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd27d340800 20 add_watcher() i=7 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd27d340800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdf170 con 0x55b68bfc7f30 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.261+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94242521070256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfdc380 con 0x55b68bfc7f30 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94242521070256] v34'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd12ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd27d340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd27d340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd27d340800 5 note: GC not initialized 2024-09-21T08:52:00.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.262+0000 7fd12efe5640 20 reqs_thread_entry: start 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 20 Filter name: none 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd12cfe1640 20 reqs_thread_entry: start 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c012470 con 0x7fd26c00f070 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.263+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c012da0 con 0x55b68bfc7f30 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c012de0 con 0x7fd26c00f070 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c014530 con 0x55b68bfc7f30 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 4.3d 4:bcf4508d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c013b30 con 0x55b68bfd1350 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 4.22 4:46bb70b8:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c019090 con 0x55b68bfc7f30 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 4.21 4:870d7801:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c01b980 con 0x55b68bfcc940 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 4.1b 4:d95102f9:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c01e590 con 0x7fd26c00f070 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.264+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 4.1e 4:79fd6c1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c020e00 con 0x55b68bfcc940 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 4.20 4:0604dc28:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c023670 con 0x55b68bfc7f30 2024-09-21T08:52:00.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c026480 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 4.17 4:e9270044:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c029340 con 0x55b68bfcc940 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 4.22 4:45547614:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c02c1c0 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 4.23 4:c4aa99aa:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c02f030 con 0x55b68bfcc940 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 4.32 4:4c77f74f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b68c031ea0 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(68 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(71 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(72 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(74 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(75 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(76 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.265+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.266+0000 7fd12ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.266+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94242521070256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68c02c1c0 con 0x55b68bfc7f30 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.267+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94242521070256] v34'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.267+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94242521046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68c00feb0 con 0x7fd26c00f070 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.268+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94242521046832] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.268+0000 7fd27d340800 20 remove_watcher() i=0 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.268+0000 7fd27d340800 2 removed watcher, disabling cache 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.268+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94242521051168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68c00feb0 con 0x55b68bfc7f30 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.269+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94242521051168] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.269+0000 7fd27d340800 20 remove_watcher() i=1 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.269+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94242521053952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68c00feb0 con 0x55b68bfd1350 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.270+0000 7fd2790ca640 1 -- 172.21.15.196:0/725669552 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94242521053952] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd26c02e070 con 0x55b68bfd1350 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.270+0000 7fd27d340800 20 remove_watcher() i=2 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.270+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94242521056112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7b00 con 0x7fd26c00f070 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.271+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94242521056112] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x7fd26c00f070 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.271+0000 7fd27d340800 20 remove_watcher() i=3 2024-09-21T08:52:00.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.271+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94242521058832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7b00 con 0x55b68bfc7f30 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.272+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94242521058832] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd264057030 con 0x55b68bfc7f30 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.272+0000 7fd27d340800 20 remove_watcher() i=4 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.272+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94242521063216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7b00 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.273+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94242521063216] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.273+0000 7fd27d340800 20 remove_watcher() i=5 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.273+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94242521068448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd9f30 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.274+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94242521068448] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.274+0000 7fd27d340800 20 remove_watcher() i=6 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.274+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94242521061504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b68bfd7b00 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd2798cb640 1 -- 172.21.15.196:0/725669552 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94242521061504] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd27402a070 con 0x55b68bfcc940 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 20 remove_watcher() i=7 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bfcc940 msgr2=0x55b68bfced30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bfcc940 0x55b68bfced30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68bfc7f30 msgr2=0x55b68bfca3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68bfc7f30 0x55b68bfca3f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd26c00f070 msgr2=0x7fd26c019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd26c00f070 0x7fd26c019860 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b68bfd1350 msgr2=0x55b68bfd3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b68bfd1350 0x55b68bfd3810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd144036af0 msgr2=0x7fd144038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd144036af0 0x7fd144038fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd26c001600 tx=0x7fd26c035000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 msgr2=0x55b68bfbc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd2708c9640 1 -- 172.21.15.196:0/725669552 reap_dead start 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2740119b0 tx=0x7fd27404cad0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 shutdown_connections 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 --2- 172.21.15.196:0/725669552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfb4e20 0x55b68bfbc270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 >> 172.21.15.196:0/725669552 conn(0x55b68bfb1180 msgr2=0x55b68bfb64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 shutdown_connections 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.275+0000 7fd27d340800 1 -- 172.21.15.196:0/725669552 wait complete. 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 msgr2=0x7fd150039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 0x7fd150039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0176e0 tx=0x7fd26c04b740 comp rx=0 tx=0).stop 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 msgr2=0x55b68bfa8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b68bf8e570 tx=0x7fd2740188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 shutdown_connections 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd150036b90 0x7fd150039050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/1904848568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68bfa81f0 0x55b68bfa8610 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 >> 172.21.15.196:0/1904848568 conn(0x55b68bf9d180 msgr2=0x55b68bf9fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 shutdown_connections 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/1904848568 wait complete. 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 msgr2=0x55b68bf99200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 0x55b68bf99200 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 msgr2=0x55b68bf94530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 0x55b68bf94530 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 msgr2=0x7fd160039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 0x7fd160039000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd264057000 tx=0x7fd264052000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 msgr2=0x55b68bf8d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 shutdown_connections 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b68bf96e10 0x55b68bf99200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b68be9ad90 0x55b68bf94530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd160036b40 0x7fd160039000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 --2- 172.21.15.196:0/2067387565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b68be08610 0x55b68bf8d4c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 >> 172.21.15.196:0/2067387565 conn(0x55b68be8ede0 msgr2=0x55b68bf7fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 shutdown_connections 2024-09-21T08:52:00.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.276+0000 7fd27d340800 1 -- 172.21.15.196:0/2067387565 wait complete. 2024-09-21T08:52:00.293 INFO:teuthology.orchestra.run.smithi196.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0bf56418-c298-49e5-b663-8247e6a1b700","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T08:51:59.478567Z","creation_time":"2024-09-21T08:51:59.475959Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T08:52:00.293 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:51:59.478567Z', 'creation_time': '2024-09-21T08:51:59.475959Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:52:00.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-21T08:52:00.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-21T08:52:00.294 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-21T08:52:00.339 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.339 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.337+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.337+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.337+0000 7f9b58d30800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559cf03dde10 0x559cf046f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.337+0000 7f9b58d30800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cf0329b30 con 0x559cf046fb40 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.337+0000 7f9b58d30800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x559cf030b360 con 0x559cf03dde10 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b54a5c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559cf03dde10 0x559cf046f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b54a5c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559cf03dde10 0x559cf046f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35342/0 (socket says 172.21.15.196:35342) 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b54a5c640 1 -- 172.21.15.196:0/3836873211 learned_addr learned my addr 172.21.15.196:0/3836873211 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b4ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x559cf046fb40 0x559cf0471f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47044/0 (socket says 172.21.15.196:47044) 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b54a5c640 1 -- 172.21.15.196:0/3836873211 >> v1:172.21.15.29:6789/0 conn(0x559cf046fb40 legacy=0x559cf0471f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.338+0000 7f9b54a5c640 1 -- 172.21.15.196:0/3836873211 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf0331e00 con 0x559cf03dde10 2024-09-21T08:52:00.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/3836873211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf046f600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800a520 tx=0x7f9b48045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1669c7a89bf5231 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b4f7fe640 1 -- 172.21.15.196:0/3836873211 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48055070 con 0x559cf03dde10 2024-09-21T08:52:00.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b4f7fe640 1 -- 172.21.15.196:0/3836873211 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b480515b0 con 0x559cf03dde10 2024-09-21T08:52:00.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b4f7fe640 1 -- 172.21.15.196:0/3836873211 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b480518d0 con 0x559cf03dde10 2024-09-21T08:52:00.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b58d30800 1 -- 172.21.15.196:0/3836873211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 msgr2=0x559cf046f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3836873211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf046f600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800a520 tx=0x7f9b48045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b58d30800 1 -- 172.21.15.196:0/3836873211 shutdown_connections 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3836873211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf046f600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.340+0000 7f9b58d30800 1 -- 172.21.15.196:0/3836873211 >> 172.21.15.196:0/3836873211 conn(0x559cf0464dd0 msgr2=0x559cf04671f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.341+0000 7f9b58d30800 1 -- 172.21.15.196:0/3836873211 shutdown_connections 2024-09-21T08:52:00.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.341+0000 7f9b58d30800 1 -- 172.21.15.196:0/3836873211 wait complete. 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.354+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.354+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.354+0000 7f9b58d30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b58d30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559cf03b6360 con 0x559cf03dde10 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b54a5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b54a5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35348/0 (socket says 172.21.15.196:35348) 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b54a5c640 1 -- 172.21.15.196:0/613138313 learned_addr learned my addr 172.21.15.196:0/613138313 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b54a5c640 1 -- 172.21.15.196:0/613138313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf0303bc0 con 0x559cf03dde10 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/613138313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9b48025da0 tx=0x7f9b48051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4457f8b4c5e58fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9a42e05640 1 -- 172.21.15.196:0/613138313 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48051950 con 0x559cf03dde10 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9a42e05640 1 -- 172.21.15.196:0/613138313 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b48051af0 con 0x559cf03dde10 2024-09-21T08:52:00.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.355+0000 7f9a42e05640 1 -- 172.21.15.196:0/613138313 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48051dd0 con 0x559cf03dde10 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 -- 172.21.15.196:0/613138313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 msgr2=0x559cf055ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 --2- 172.21.15.196:0/613138313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9b48025da0 tx=0x7f9b48051000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 -- 172.21.15.196:0/613138313 shutdown_connections 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 --2- 172.21.15.196:0/613138313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf055ba80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 -- 172.21.15.196:0/613138313 >> 172.21.15.196:0/613138313 conn(0x559cf0464dd0 msgr2=0x559cf0557440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 -- 172.21.15.196:0/613138313 shutdown_connections 2024-09-21T08:52:00.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 -- 172.21.15.196:0/613138313 wait complete. 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.356+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b58d30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b58d30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559cf0473920 con 0x559cf03dde10 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b54a5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b54a5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35364/0 (socket says 172.21.15.196:35364) 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2170788568 learned_addr learned my addr 172.21.15.196:0/2170788568 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf0317fe0 con 0x559cf03dde10 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b48067040 tx=0x7f9b48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9a41602640 1 -- 172.21.15.196:0/2170788568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b48073070 con 0x559cf03dde10 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9a41602640 1 -- 172.21.15.196:0/2170788568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4805a450 con 0x559cf03dde10 2024-09-21T08:52:00.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9a41602640 1 -- 172.21.15.196:0/2170788568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b4805a730 con 0x559cf03dde10 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.357+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf05638f0 con 0x559cf03dde10 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.358+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf0563e70 con 0x559cf03dde10 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.358+0000 7f9a41602640 1 -- 172.21.15.196:0/2170788568 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b48076070 con 0x559cf03dde10 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.358+0000 7f9a41602640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 0x7f9a3c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.358+0000 7f9a41602640 1 -- 172.21.15.196:0/2170788568 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b48062070 con 0x559cf03dde10 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.358+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 0x7f9a3c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 0x559cf056a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf056a9a0 con 0x559cf046fb40 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b5525d640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 0x559cf056a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 0x7f9a3c039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9b40000f60 tx=0x7f9b40001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b5525d640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 0x559cf056a420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b5525d640 1 -- 172.21.15.196:0/2170788568 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b5000a4a0 con 0x559cf046fb40 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05679d0 con 0x559cf046fb40 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.359+0000 7f9b5525d640 1 -- 172.21.15.196:0/2170788568 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b5000a4a0 con 0x559cf046fb40 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 0x559cf056f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf056f760 con 0x559cf056ccd0 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 0x559cf056f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 0x559cf056f0c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2170788568 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b48075030 con 0x559cf056ccd0 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.360+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf056bb70 con 0x559cf046fb40 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b5525d640 1 -- 172.21.15.196:0/2170788568 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b5000a4a0 con 0x559cf046fb40 2024-09-21T08:52:00.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf056c010 con 0x559cf046fb40 2024-09-21T08:52:00.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b5525d640 1 -- 172.21.15.196:0/2170788568 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b5000a4a0 con 0x559cf046fb40 2024-09-21T08:52:00.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b58d30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b58d30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559cf0305580 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.361+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35380/0 (socket says 172.21.15.196:35380) 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9b5525d640 1 -- 172.21.15.196:0/3881153358 learned_addr learned my addr 172.21.15.196:0/3881153358 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9b5525d640 1 -- 172.21.15.196:0/3881153358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf057e9e0 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9b5525d640 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x559cf0564460 tx=0x7f9b500188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9a3a7fc640 1 -- 172.21.15.196:0/3881153358 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50014450 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9a3a7fc640 1 -- 172.21.15.196:0/3881153358 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b500145f0 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf057ec70 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.362+0000 7f9a3a7fc640 1 -- 172.21.15.196:0/3881153358 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b500148d0 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.363+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf0581950 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.363+0000 7f9a3a7fc640 1 -- 172.21.15.196:0/3881153358 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b50011040 con 0x559cf057e080 2024-09-21T08:52:00.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.363+0000 7f9a3a7fc640 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 0x7f9a2c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.363+0000 7f9a3a7fc640 1 -- 172.21.15.196:0/3881153358 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b5001e070 con 0x559cf057e080 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 0x7f9a2c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 0x7f9a2c039050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559cf056ae10 tx=0x7f9b4806f4a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b58d30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b58d30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559cf055c170 con 0x559cf058acd0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35390/0 (socket says 172.21.15.196:35390) 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b5525d640 1 -- 172.21.15.196:0/484999106 learned_addr learned my addr 172.21.15.196:0/484999106 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.364+0000 7f9b5525d640 1 -- 172.21.15.196:0/484999106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf058b6a0 con 0x559cf058acd0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b5525d640 1 --2- 172.21.15.196:0/484999106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004cbb0 tx=0x7f9b5003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34eb8273d008919 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9a2bfff640 1 -- 172.21.15.196:0/484999106 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b500167c0 con 0x559cf058acd0 2024-09-21T08:52:00.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9a2bfff640 1 -- 172.21.15.196:0/484999106 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50013ca0 con 0x559cf058acd0 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9a2bfff640 1 -- 172.21.15.196:0/484999106 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50016960 con 0x559cf058acd0 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 -- 172.21.15.196:0/484999106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 msgr2=0x559cf058b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 --2- 172.21.15.196:0/484999106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b5004cbb0 tx=0x7f9b5003bf60 comp rx=0 tx=0).stop 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 -- 172.21.15.196:0/484999106 shutdown_connections 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 --2- 172.21.15.196:0/484999106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf058b0d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 -- 172.21.15.196:0/484999106 >> 172.21.15.196:0/484999106 conn(0x559cf0587080 msgr2=0x559cf0585180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 -- 172.21.15.196:0/484999106 shutdown_connections 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 -- 172.21.15.196:0/484999106 wait complete. 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.365+0000 7f9b58d30800 1 Processor -- start 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b58d30800 1 -- start start 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b58d30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b58d30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559cf058bc70 con 0x559cf058acd0 2024-09-21T08:52:00.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b5525d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35400/0 (socket says 172.21.15.196:35400) 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 learned_addr learned my addr 172.21.15.196:0/2142818792 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf0596b00 con 0x559cf058acd0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b5525d640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b500119b0 tx=0x7f9b5004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9a2a7fc640 1 -- 172.21.15.196:0/2142818792 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b50044070 con 0x559cf058acd0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9a2a7fc640 1 -- 172.21.15.196:0/2142818792 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b50013e50 con 0x559cf058acd0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf0596d90 con 0x559cf058acd0 2024-09-21T08:52:00.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9a2a7fc640 1 -- 172.21.15.196:0/2142818792 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b5002ba60 con 0x559cf058acd0 2024-09-21T08:52:00.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.366+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf0599a40 con 0x559cf058acd0 2024-09-21T08:52:00.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.367+0000 7f9a2a7fc640 1 -- 172.21.15.196:0/2142818792 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b5002bc00 con 0x559cf058acd0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.367+0000 7f9a2a7fc640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a20036b90 0x7f9a20039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.367+0000 7f9a2a7fc640 1 -- 172.21.15.196:0/2142818792 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b5000e040 con 0x559cf058acd0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.367+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a20036b90 0x7f9a20039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf05a21d0 0x559cf05a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a4de0 con 0x559cf05a21d0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf05a21d0 0x559cf05a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a20036b90 0x7f9a20039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b4808f510 tx=0x7f9b48083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf05a21d0 0x559cf05a4690 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4000f610 con 0x559cf05a21d0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 20 realm 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a1670 con 0x559cf05a21d0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.368+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4000f610 con 0x559cf05a21d0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a58c0 con 0x559cf05a21d0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4000f610 con 0x559cf05a21d0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a6190 con 0x559cf05a21d0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b4000f610 con 0x559cf05a21d0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf05a6a40 0x559cf05a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a95b0 con 0x559cf05a6a40 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b5525d640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf05a6a40 0x559cf05a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.369+0000 7f9b5525d640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf05a6a40 0x559cf05a8e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b58d30800 20 searching for the correct realm 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559cf05ab6b0 0x559cf05adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559cf05ab6b0 0x559cf05adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559cf05ab6b0 0x559cf05adb70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4808f040 con 0x559cf05ab6b0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b54a5c640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9b480a0070 0x7f9b480813a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.370+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9b480a0070 0x7f9b480813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b4ffff640 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9b480a0070 0x7f9b480813a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4000f610 con 0x7f9b480a0070 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.371+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4000f610 con 0x559cf05a21d0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.372+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4808f040 con 0x559cf05ab6b0 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.373+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.374+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.375+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.376+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.377+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05ab6b0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a6a40 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x559cf05a21d0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.378+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae240 con 0x7f9b480a0070 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05aa0b0 con 0x559cf05a21d0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05aa500 con 0x559cf05a21d0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05aa9a0 con 0x559cf05a21d0 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.379+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 zone default found 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 4 Realm: () 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 zonegroup default 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ae6c0 con 0x559cf05a6a40 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.399 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05a9cf0 con 0x559cf05ab6b0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b0a10 con 0x559cf05ab6b0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 started sync module instance, tier type = 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.380+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05afd80 con 0x7f9b480a0070 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.381+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.381+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132535755440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05afd80 con 0x7f9b480a0070 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.381+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b1500 con 0x559cf05a21d0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.382+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132535755440] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.383+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.383+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132535758864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05afd80 con 0x559cf05a21d0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.383+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b1fa0 con 0x559cf05ab6b0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.384+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132535758864] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.384+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.384+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132535752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05afcf0 con 0x559cf05ab6b0 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.384+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b2d60 con 0x7f9b480a0070 2024-09-21T08:52:00.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.385+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132535752912] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.385+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.385+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132535763856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b3150 con 0x7f9b480a0070 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.385+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b3b50 con 0x559cf05a21d0 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.386+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.386+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132535768672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b3a80 con 0x559cf05a21d0 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.386+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b4a80 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.386+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132535763856] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.387+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.387+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132535764912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b4e70 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.387+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b5890 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.388+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132535768672] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.388+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132535764912] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.389+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.389+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132535772560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b3f40 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.389+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b5e70 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132535772560] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132535777728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b5de0 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=0 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=1 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=2 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=3 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=4 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=5 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.390+0000 7f9b58d30800 20 add_watcher() i=6 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132535777728] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b58d30800 20 add_watcher() i=7 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b58d30800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b92c0 con 0x559cf05a21d0 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.391+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132535778784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05b66e0 con 0x559cf05a21d0 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.392+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132535778784] v34'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.392+0000 7f9a0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 5 note: GC not initialized 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9a09fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 Filter name: none 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f997b7fe640 20 reqs_thread_entry: start 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ec080 con 0x559cf05a21d0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.393+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ed5d0 con 0x7f9b480a0070 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ed5d0 con 0x559cf05a21d0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:65 4.3d 4:bcf4508d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05ef080 con 0x559cf05ab6b0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 4.22 4:46bb70b8:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05f1d30 con 0x559cf05a21d0 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 4.21 4:870d7801:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05f4a60 con 0x559cf05a6a40 2024-09-21T08:52:00.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 4.1b 4:d95102f9:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05f76f0 con 0x7f9b480a0070 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 4.1e 4:79fd6c1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05f4a60 con 0x559cf05a6a40 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 4.20 4:0604dc28:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05fc870 con 0x559cf05a21d0 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf05f76f0 con 0x559cf05a21d0 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 4.17 4:e9270044:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf0601a20 con 0x559cf05a6a40 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 4.22 4:45547614:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf06043b0 con 0x559cf05a21d0 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 4.23 4:c4aa99aa:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf0606c60 con 0x559cf05a6a40 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.394+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 4.32 4:4c77f74f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf06095b0 con 0x559cf05a21d0 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(65 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b4002b040 con 0x7f9b480a0070 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(67 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(70 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(71 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(73 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(75 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b4002b040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.395+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x7f9b480a0070 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.396+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(76 foo.buckets [call] v34'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x7f9b480a0070 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.396+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05eeb50 con 0x7f9b480a0070 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(77 foo.buckets [call] v34'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x7f9b480a0070 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b58d30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9b4004d040 con 0x559cf05a21d0 2024-09-21T08:52:00.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b58d30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x7f9b480a0070 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.398+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f9b4004d040 con 0x7f9b480a0070 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.399+0000 7f9a0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.399+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132535778784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x559cf05a21d0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.400+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94132535778784] v34'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x559cf05a21d0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.400+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132535755440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x7f9b480a0070 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.401+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94132535755440] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x7f9b480a0070 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.401+0000 7f9b58d30800 20 remove_watcher() i=0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.401+0000 7f9b58d30800 2 removed watcher, disabling cache 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.401+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132535758864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x559cf05a21d0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.402+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94132535758864] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x559cf05a21d0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.402+0000 7f9b58d30800 20 remove_watcher() i=1 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.402+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132535752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf06013f0 con 0x559cf05ab6b0 2024-09-21T08:52:00.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.403+0000 7f9b54a5c640 1 -- 172.21.15.196:0/2142818792 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94132535752912] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b480af040 con 0x559cf05ab6b0 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.403+0000 7f9b58d30800 20 remove_watcher() i=2 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.403+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132535763856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05e9e90 con 0x7f9b480a0070 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.404+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94132535763856] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x7f9b480a0070 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.404+0000 7f9b58d30800 20 remove_watcher() i=3 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.404+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132535768672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05e9e90 con 0x559cf05a21d0 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.405+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94132535768672] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b4004d040 con 0x559cf05a21d0 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.405+0000 7f9b58d30800 20 remove_watcher() i=4 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.405+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132535764912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05e9e90 con 0x559cf05a6a40 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.406+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94132535764912] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.406+0000 7f9b58d30800 20 remove_watcher() i=5 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.406+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132535772560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05e9e90 con 0x559cf05a6a40 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.407+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94132535772560] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.407+0000 7f9b58d30800 20 remove_watcher() i=6 2024-09-21T08:52:00.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.407+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132535777728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559cf05e9e90 con 0x559cf05a6a40 2024-09-21T08:52:00.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b5525d640 1 -- 172.21.15.196:0/2142818792 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94132535777728] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b50056040 con 0x559cf05a6a40 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 20 remove_watcher() i=7 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf05a6a40 msgr2=0x559cf05a8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf05a6a40 0x559cf05a8e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf05a21d0 msgr2=0x559cf05a4690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf05a21d0 0x559cf05a4690 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9b480a0070 msgr2=0x7f9b480813a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9b480a0070 0x7f9b480813a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559cf05ab6b0 msgr2=0x559cf05adb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559cf05ab6b0 0x559cf05adb70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a20036b90 msgr2=0x7f9a20039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a20036b90 0x7f9a20039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b4808f510 tx=0x7f9b48083000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 msgr2=0x559cf05965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b500119b0 tx=0x7f9b5004cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b4ffff640 1 -- 172.21.15.196:0/2142818792 reap_dead start 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 shutdown_connections 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2142818792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf058acd0 0x559cf05965c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 >> 172.21.15.196:0/2142818792 conn(0x559cf0587080 msgr2=0x559cf058c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 shutdown_connections 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/2142818792 wait complete. 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 msgr2=0x7f9a2c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 0x7f9a2c039050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559cf056ae10 tx=0x7f9b4806f4a0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 msgr2=0x559cf057e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x559cf0564460 tx=0x7f9b500188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 shutdown_connections 2024-09-21T08:52:00.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a2c036b90 0x7f9a2c039050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 --2- 172.21.15.196:0/3881153358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf057e080 0x559cf057e4a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.408+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 >> 172.21.15.196:0/3881153358 conn(0x559cf0573010 msgr2=0x559cf0575b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 shutdown_connections 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/3881153358 wait complete. 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 msgr2=0x559cf056f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 0x559cf056f0c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 msgr2=0x559cf056a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 0x559cf056a420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 msgr2=0x7f9a3c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 0x7f9a3c039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9b40000f60 tx=0x7f9b40001370 comp rx=0 tx=0).stop 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 msgr2=0x559cf05633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b48067040 tx=0x7f9b48002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 shutdown_connections 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559cf056ccd0 0x559cf056f0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559cf046fb40 0x559cf056a420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9a3c036b40 0x7f9a3c039000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 --2- 172.21.15.196:0/2170788568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559cf03dde10 0x559cf05633b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 >> 172.21.15.196:0/2170788568 conn(0x559cf0464dd0 msgr2=0x559cf0555cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 shutdown_connections 2024-09-21T08:52:00.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.409+0000 7f9b58d30800 1 -- 172.21.15.196:0/2170788568 wait complete. 2024-09-21T08:52:00.426 INFO:teuthology.orchestra.run.smithi196.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-21T08:52:00.398729Z","last_stats_update":"2024-09-21T08:52:00.397370Z"} 2024-09-21T08:52:00.426 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-21T08:52:00.398729Z', 'last_stats_update': '2024-09-21T08:52:00.397370Z'} 2024-09-21T08:52:00.431 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:00.431 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-21T08:52:00.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-21T08:52:00.431 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-21T08:52:00.477 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.477 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.475+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.475+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4df6d28800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56099c8e04e0 0x56099c974670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4df6d28800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56099c82ab30 con 0x56099c8e15f0 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4df6d28800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56099c80c360 con 0x56099c8e04e0 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4dea2b2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56099c8e04e0 0x56099c974670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4dea2b2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56099c8e04e0 0x56099c974670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35414/0 (socket says 172.21.15.196:35414) 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4dea2b2640 1 -- 172.21.15.196:0/3905890634 learned_addr learned my addr 172.21.15.196:0/3905890634 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4df2ab3640 1 --1- 172.21.15.196:0/3905890634 >> v1:172.21.15.29:6789/0 conn(0x56099c8e15f0 0x56099c8dfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47056/0 (socket says 172.21.15.196:47056) 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4dea2b2640 1 -- 172.21.15.196:0/3905890634 >> v1:172.21.15.29:6789/0 conn(0x56099c8e15f0 legacy=0x56099c8dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.476+0000 7f4dea2b2640 1 -- 172.21.15.196:0/3905890634 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099c832e00 con 0x56099c8e04e0 2024-09-21T08:52:00.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.478+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/3905890634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099c974670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00a520 tx=0x7f4ddc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2801f533910ae7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.478+0000 7f4df22b2640 1 -- 172.21.15.196:0/3905890634 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ddc055070 con 0x56099c8e04e0 2024-09-21T08:52:00.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.478+0000 7f4df22b2640 1 -- 172.21.15.196:0/3905890634 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0515b0 con 0x56099c8e04e0 2024-09-21T08:52:00.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.478+0000 7f4df22b2640 1 -- 172.21.15.196:0/3905890634 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ddc0518d0 con 0x56099c8e04e0 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 -- 172.21.15.196:0/3905890634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 msgr2=0x56099c974670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 --2- 172.21.15.196:0/3905890634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099c974670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00a520 tx=0x7f4ddc045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 -- 172.21.15.196:0/3905890634 shutdown_connections 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 --2- 172.21.15.196:0/3905890634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099c974670 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 -- 172.21.15.196:0/3905890634 >> 172.21.15.196:0/3905890634 conn(0x56099c966fe0 msgr2=0x56099c969400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 -- 172.21.15.196:0/3905890634 shutdown_connections 2024-09-21T08:52:00.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.479+0000 7f4df6d28800 1 -- 172.21.15.196:0/3905890634 wait complete. 2024-09-21T08:52:00.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df6d28800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df6d28800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56099c8b7360 con 0x56099c8e04e0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df2ab3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df2ab3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35420/0 (socket says 172.21.15.196:35420) 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.493+0000 7f4df2ab3640 1 -- 172.21.15.196:0/4165498339 learned_addr learned my addr 172.21.15.196:0/4165498339 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.494+0000 7f4df2ab3640 1 -- 172.21.15.196:0/4165498339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099c804bc0 con 0x56099c8e04e0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.494+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/4165498339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4de400b230 tx=0x7f4de400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccedf32d803bf659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.494+0000 7f4ce0e09640 1 -- 172.21.15.196:0/4165498339 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de400e5c0 con 0x56099c8e04e0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.494+0000 7f4ce0e09640 1 -- 172.21.15.196:0/4165498339 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de4006070 con 0x56099c8e04e0 2024-09-21T08:52:00.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.494+0000 7f4ce0e09640 1 -- 172.21.15.196:0/4165498339 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de400e890 con 0x56099c8e04e0 2024-09-21T08:52:00.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- 172.21.15.196:0/4165498339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 msgr2=0x56099ca5ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 --2- 172.21.15.196:0/4165498339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4de400b230 tx=0x7f4de400b6f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- 172.21.15.196:0/4165498339 shutdown_connections 2024-09-21T08:52:00.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 --2- 172.21.15.196:0/4165498339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca5ca60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- 172.21.15.196:0/4165498339 >> 172.21.15.196:0/4165498339 conn(0x56099c966fe0 msgr2=0x56099ca58420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- 172.21.15.196:0/4165498339 shutdown_connections 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- 172.21.15.196:0/4165498339 wait complete. 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df6d28800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56099c8e0bd0 con 0x56099c8e04e0 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df2ab3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df2ab3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35434/0 (socket says 172.21.15.196:35434) 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.495+0000 7f4df2ab3640 1 -- 172.21.15.196:0/496739164 learned_addr learned my addr 172.21.15.196:0/496739164 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4df2ab3640 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099c818fe0 con 0x56099c8e04e0 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4de4000c00 tx=0x7f4de4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4cdf606640 1 -- 172.21.15.196:0/496739164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de400f8d0 con 0x56099c8e04e0 2024-09-21T08:52:00.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4cdf606640 1 -- 172.21.15.196:0/496739164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de400fa90 con 0x56099c8e04e0 2024-09-21T08:52:00.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099ca649d0 con 0x56099c8e04e0 2024-09-21T08:52:00.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4cdf606640 1 -- 172.21.15.196:0/496739164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de400fdb0 con 0x56099c8e04e0 2024-09-21T08:52:00.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.496+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099ca64ef0 con 0x56099c8e04e0 2024-09-21T08:52:00.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4cdf606640 1 -- 172.21.15.196:0/496739164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4de4017070 con 0x56099c8e04e0 2024-09-21T08:52:00.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4cdf606640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 0x7f4cd8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4cdf606640 1 -- 172.21.15.196:0/496739164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4de4015020 con 0x56099c8e04e0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 0x7f4cd8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 0x56099ca6b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.497+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099ca6bad0 con 0x56099c8e15f0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df32b4640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 0x56099ca6b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 0x7f4cd8039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc057000 tx=0x7f4ddc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df32b4640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 0x56099ca6b500 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df32b4640 1 -- 172.21.15.196:0/496739164 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dec00a4a0 con 0x56099c8e15f0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099ca68ab0 con 0x56099c8e15f0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df32b4640 1 -- 172.21.15.196:0/496739164 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dec00a4a0 con 0x56099c8e15f0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 0x56099ca701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.498+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099ca70870 con 0x56099ca6dde0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.499+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 0x56099ca701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.499+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 0x56099ca701d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.499+0000 7f4df2ab3640 1 -- 172.21.15.196:0/496739164 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4de402e070 con 0x56099ca6dde0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.499+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099ca6cc80 con 0x56099c8e15f0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df32b4640 1 -- 172.21.15.196:0/496739164 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dec00a4a0 con 0x56099c8e15f0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099ca6d120 con 0x56099c8e15f0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df32b4640 1 -- 172.21.15.196:0/496739164 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dec00a4a0 con 0x56099c8e15f0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df6d28800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.500+0000 7f4df6d28800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56099c806580 con 0x56099ca7f200 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35450/0 (socket says 172.21.15.196:35450) 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4df32b4640 1 -- 172.21.15.196:0/114194569 learned_addr learned my addr 172.21.15.196:0/114194569 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4df32b4640 1 -- 172.21.15.196:0/114194569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099ca7fb60 con 0x56099ca7f200 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4df32b4640 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x56099ca65540 tx=0x7f4dec0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.501+0000 7f4cdce01640 1 -- 172.21.15.196:0/114194569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec014450 con 0x56099ca7f200 2024-09-21T08:52:00.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4cdce01640 1 -- 172.21.15.196:0/114194569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec0145f0 con 0x56099ca7f200 2024-09-21T08:52:00.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099ca7fdf0 con 0x56099ca7f200 2024-09-21T08:52:00.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4cdce01640 1 -- 172.21.15.196:0/114194569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec0148d0 con 0x56099ca7f200 2024-09-21T08:52:00.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099ca82ad0 con 0x56099ca7f200 2024-09-21T08:52:00.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4cdce01640 1 -- 172.21.15.196:0/114194569 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4dec011040 con 0x56099ca7f200 2024-09-21T08:52:00.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4cdce01640 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 0x7f4ccc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.502+0000 7f4cdce01640 1 -- 172.21.15.196:0/114194569 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4dec01e070 con 0x56099ca7f200 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 0x7f4ccc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 0x7f4ccc039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56099ca6bf20 tx=0x7f4de404b7e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df6d28800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df6d28800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56099ca5d210 con 0x56099ca8be30 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35464/0 (socket says 172.21.15.196:35464) 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df32b4640 1 -- 172.21.15.196:0/1220921820 learned_addr learned my addr 172.21.15.196:0/1220921820 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.503+0000 7f4df32b4640 1 -- 172.21.15.196:0/1220921820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099ca8c770 con 0x56099ca8be30 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df32b4640 1 --2- 172.21.15.196:0/1220921820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4dec04cbb0 tx=0x7f4dec011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4878f770d99768f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4cd67fc640 1 -- 172.21.15.196:0/1220921820 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec013dc0 con 0x56099ca8be30 2024-09-21T08:52:00.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4cd67fc640 1 -- 172.21.15.196:0/1220921820 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec014a70 con 0x56099ca8be30 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4cd67fc640 1 -- 172.21.15.196:0/1220921820 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec014d50 con 0x56099ca8be30 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- 172.21.15.196:0/1220921820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 msgr2=0x56099ca8c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1220921820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4dec04cbb0 tx=0x7f4dec011970 comp rx=0 tx=0).stop 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- 172.21.15.196:0/1220921820 shutdown_connections 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1220921820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca8c230 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- 172.21.15.196:0/1220921820 >> 172.21.15.196:0/1220921820 conn(0x56099ca881e0 msgr2=0x56099ca862e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- 172.21.15.196:0/1220921820 shutdown_connections 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- 172.21.15.196:0/1220921820 wait complete. 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 Processor -- start 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.504+0000 7f4df6d28800 1 -- start start 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df6d28800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df6d28800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56099ca8ce10 con 0x56099ca8be30 2024-09-21T08:52:00.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df32b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35466/0 (socket says 172.21.15.196:35466) 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 learned_addr learned my addr 172.21.15.196:0/1283275793 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099ca93890 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df32b4640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4dec011be0 tx=0x7f4dec04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4cd4ff9640 1 -- 172.21.15.196:0/1283275793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec044030 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4cd4ff9640 1 -- 172.21.15.196:0/1283275793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec022a80 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4cd4ff9640 1 -- 172.21.15.196:0/1283275793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dec022d80 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099ca93b20 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.505+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099ca967d0 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.506+0000 7f4cd4ff9640 1 -- 172.21.15.196:0/1283275793 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4dec02b350 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.506+0000 7f4cd4ff9640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cbc036b40 0x7f4cbc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.506+0000 7f4cd4ff9640 1 -- 172.21.15.196:0/1283275793 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4dec045070 con 0x56099ca8be30 2024-09-21T08:52:00.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.506+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cbc036b40 0x7f4cbc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cbc036b40 0x7f4cbc039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4de4019780 tx=0x7f4de4035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099ca9f030 0x56099caa14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa1c40 con 0x56099ca9f030 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099ca9f030 0x56099caa14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.507+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099ca9f030 0x56099caa14f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 realm 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa2070 con 0x56099ca9f030 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa2940 con 0x56099ca9f030 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa2ce0 con 0x56099ca9f030 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099caa3a40 0x56099caa5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.508+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa6480 con 0x56099caa3a40 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df32b4640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099caa3a40 0x56099caa5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df32b4640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099caa3a40 0x56099caa5e30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df6d28800 20 searching for the correct realm 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56099caa8430 0x56099caaa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.509+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56099caa8430 0x56099caaa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56099caa8430 0x56099caaa8f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4df2ab3640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4de400f070 0x7f4de403f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4de400f070 0x7f4de403f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4dea2b2640 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4de400f070 0x7f4de403f400 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.510+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.511+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.512+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.513+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.514+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.515+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.516+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa8430 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x56099ca9f030 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.517+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56099caaafc0 con 0x7f4de400f070 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa6e40 con 0x56099ca9f030 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa6a80 con 0x56099ca9f030 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caa77e0 con 0x56099ca9f030 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 zone default found 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 4 Realm: () 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 zonegroup default 2024-09-21T08:52:00.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.518+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caab480 con 0x56099caa3a40 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caad750 con 0x56099caa8430 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caadaf0 con 0x56099caa8430 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 started sync module instance, tier type = 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.519+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caacb90 con 0x7f4de400f070 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.520+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.520+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599283134608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caacb90 con 0x7f4de400f070 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.520+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caae510 con 0x56099ca9f030 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.521+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599283134608] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.521+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.521+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599283138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caacb90 con 0x56099ca9f030 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.521+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caaef80 con 0x56099caa8430 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.523+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.523+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599283141232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caaf820 con 0x56099caa8430 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.523+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab02c0 con 0x7f4de400f070 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.523+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599283138560] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.524+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599283141232] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.524+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.524+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599283143536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caac6e0 con 0x7f4de400f070 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.524+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab0b60 con 0x56099ca9f030 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.525+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.525+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599283148384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab0a80 con 0x56099ca9f030 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.525+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab1a80 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.525+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599283143536] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.526+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599283148384] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.528+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.528+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599283150672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caafd90 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.528+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab2320 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.529+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599283150672] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.529+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.529+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599283152240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab22d0 con 0x56099caa3a40 2024-09-21T08:52:00.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.529+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab2d30 con 0x56099caa3a40 2024-09-21T08:52:00.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599283152240] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599283157120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab3190 con 0x56099caa3a40 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=0 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=1 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=2 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=3 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=4 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=5 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.530+0000 7f4df6d28800 20 add_watcher() i=6 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599283157120] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4df6d28800 20 add_watcher() i=7 2024-09-21T08:52:00.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4df6d28800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099cab1f10 con 0x56099ca9f030 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.531+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599283158176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab3a60 con 0x56099ca9f030 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.532+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599283158176] v34'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.532+0000 7f4ca97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.532+0000 7f4df6d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.532+0000 7f4df6d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.532+0000 7f4df6d28800 5 note: GC not initialized 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4c23fff640 20 reqs_thread_entry: start 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 20 Filter name: none 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4c21ffb640 20 reqs_thread_entry: start 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:00.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099cae9590 con 0x56099ca9f030 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.533+0000 7f4df6d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caeb670 con 0x7f4de400f070 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:00.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caece50 con 0x56099ca9f030 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.534+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caf05f0 con 0x7f4de400f070 2024-09-21T08:52:00.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 foo.buckets [call] v34'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caef740 con 0x7f4de400f070 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.536+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caf03b0 con 0x7f4de400f070 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4df6d28800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4df6d28800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4df6d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:00.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94599283408272 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099caf1eb0 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== watch-notify(notify (1) cookie 94599283152240 notify 146028888066 ret 0) ==== 380+0+0 (crc 0 0 0) 0x56099ca967d0 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4cd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94599283152240 notifier 4489 bl.length()=338 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4cd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.537+0000 7f4cd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.538+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(68 notify.6 [notify cookie 94599283408272 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.538+0000 7f4cd67fc640 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4cb8003ea0 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.538+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.538+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify_complete (2) cookie 94599283408272 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56099ca93b20 con 0x56099caa3a40 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.539+0000 7f4ca97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.539+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599283158176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cae72e0 con 0x56099ca9f030 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.540+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94599283158176] v34'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.540+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599283134608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cae72e0 con 0x7f4de400f070 2024-09-21T08:52:00.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.541+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94599283134608] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.541+0000 7f4df6d28800 20 remove_watcher() i=0 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.541+0000 7f4df6d28800 2 removed watcher, disabling cache 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.541+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599283138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cae72e0 con 0x56099ca9f030 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.542+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94599283138560] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.542+0000 7f4df6d28800 20 remove_watcher() i=1 2024-09-21T08:52:00.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.542+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599283141232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cae72e0 con 0x56099caa8430 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.543+0000 7f4df2ab3640 1 -- 172.21.15.196:0/1283275793 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94599283141232] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4de403b040 con 0x56099caa8430 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.543+0000 7f4df6d28800 20 remove_watcher() i=2 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.543+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599283143536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099cab2ca0 con 0x7f4de400f070 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.544+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94599283143536] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x7f4de400f070 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.544+0000 7f4df6d28800 20 remove_watcher() i=3 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.544+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599283148384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caad090 con 0x56099ca9f030 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.545+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94599283148384] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ddc057030 con 0x56099ca9f030 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.545+0000 7f4df6d28800 20 remove_watcher() i=4 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.545+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599283150672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caae000 con 0x56099caa3a40 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.546+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94599283150672] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.546+0000 7f4df6d28800 20 remove_watcher() i=5 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.546+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599283152240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caaea70 con 0x56099caa3a40 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.547+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94599283152240] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.547+0000 7f4df6d28800 20 remove_watcher() i=6 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.547+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599283157120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099caaf370 con 0x56099caa3a40 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df32b4640 1 -- 172.21.15.196:0/1283275793 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94599283157120] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dec02a070 con 0x56099caa3a40 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 20 remove_watcher() i=7 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099caa3a40 msgr2=0x56099caa5e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099caa3a40 0x56099caa5e30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099ca9f030 msgr2=0x56099caa14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099ca9f030 0x56099caa14f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4de400f070 msgr2=0x7f4de403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4de400f070 0x7f4de403f400 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56099caa8430 msgr2=0x56099caaa8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56099caa8430 0x56099caaa8f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cbc036b40 msgr2=0x7f4cbc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cbc036b40 0x7f4cbc039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4de4019780 tx=0x7f4de4035000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 msgr2=0x56099ca93350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4dec011be0 tx=0x7f4dec04cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4dea2b2640 1 -- 172.21.15.196:0/1283275793 reap_dead start 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 shutdown_connections 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/1283275793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca8be30 0x56099ca93350 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 >> 172.21.15.196:0/1283275793 conn(0x56099ca881e0 msgr2=0x56099ca862b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 shutdown_connections 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/1283275793 wait complete. 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 msgr2=0x7f4ccc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 0x7f4ccc039050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56099ca6bf20 tx=0x7f4de404b7e0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 msgr2=0x56099ca7f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x56099ca65540 tx=0x7f4dec0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 shutdown_connections 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4ccc036b90 0x7f4ccc039050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 --2- 172.21.15.196:0/114194569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099ca7f200 0x56099ca7f620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 >> 172.21.15.196:0/114194569 conn(0x56099ca74190 msgr2=0x56099ca76d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 shutdown_connections 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.548+0000 7f4df6d28800 1 -- 172.21.15.196:0/114194569 wait complete. 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 msgr2=0x56099ca701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 0x56099ca701d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 msgr2=0x56099ca6b500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 0x56099ca6b500 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 msgr2=0x7f4cd8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 0x7f4cd8039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc057000 tx=0x7f4ddc052000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 msgr2=0x56099ca64490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4de4000c00 tx=0x7f4de4000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 shutdown_connections 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56099ca6dde0 0x56099ca701d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56099c8e15f0 0x56099ca6b500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cd8036b90 0x7f4cd8039050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 --2- 172.21.15.196:0/496739164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56099c8e04e0 0x56099ca64490 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 >> 172.21.15.196:0/496739164 conn(0x56099c966fe0 msgr2=0x56099ca56c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 shutdown_connections 2024-09-21T08:52:00.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.549+0000 7f4df6d28800 1 -- 172.21.15.196:0/496739164 wait complete. 2024-09-21T08:52:00.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T08:52:00.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T08:52:00.560 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-21T08:52:00.612 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.612 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.610+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.610+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.610+0000 7fbedfe87800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606c19df670 0x5606c1a6e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.610+0000 7fbedfe87800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606c192ab30 con 0x5606c1a6e7d0 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.610+0000 7fbedfe87800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5606c190c360 con 0x5606c19df670 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd97b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606c19df670 0x5606c1a6e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd17a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5606c1a6e7d0 0x5606c1a70bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47064/0 (socket says 172.21.15.196:47064) 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd97b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606c19df670 0x5606c1a6e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35468/0 (socket says 172.21.15.196:35468) 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd17a640 1 -- 172.21.15.196:0/3024938188 learned_addr learned my addr 172.21.15.196:0/3024938188 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd97b640 1 -- 172.21.15.196:0/3024938188 >> v1:172.21.15.29:6789/0 conn(0x5606c1a6e7d0 legacy=0x5606c1a70bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.611+0000 7fbedd97b640 1 -- 172.21.15.196:0/3024938188 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1932e00 con 0x5606c19df670 2024-09-21T08:52:00.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.613+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3024938188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1a6e290 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbed000a470 tx=0x7fbed0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7758101d0fb5420b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.613+0000 7fbedc979640 1 -- 172.21.15.196:0/3024938188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0053570 con 0x5606c19df670 2024-09-21T08:52:00.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.613+0000 7fbedc979640 1 -- 172.21.15.196:0/3024938188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0058070 con 0x5606c19df670 2024-09-21T08:52:00.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.613+0000 7fbedc979640 1 -- 172.21.15.196:0/3024938188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0053880 con 0x5606c19df670 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 -- 172.21.15.196:0/3024938188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 msgr2=0x5606c1a6e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3024938188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1a6e290 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbed000a470 tx=0x7fbed0045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 -- 172.21.15.196:0/3024938188 shutdown_connections 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3024938188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1a6e290 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 -- 172.21.15.196:0/3024938188 >> 172.21.15.196:0/3024938188 conn(0x5606c1a65e20 msgr2=0x5606c1a68240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 -- 172.21.15.196:0/3024938188 shutdown_connections 2024-09-21T08:52:00.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.614+0000 7fbedfe87800 1 -- 172.21.15.196:0/3024938188 wait complete. 2024-09-21T08:52:00.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.627+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedfe87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedfe87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606c19b7370 con 0x5606c19df670 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedd97b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedd97b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35474/0 (socket says 172.21.15.196:35474) 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedd97b640 1 -- 172.21.15.196:0/1657480301 learned_addr learned my addr 172.21.15.196:0/1657480301 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.628+0000 7fbedd97b640 1 -- 172.21.15.196:0/1657480301 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1904bc0 con 0x5606c19df670 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedd97b640 1 --2- 172.21.15.196:0/1657480301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbed0025c20 tx=0x7fbed0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2766133f1f5b78ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbdcbe07640 1 -- 172.21.15.196:0/1657480301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed005c580 con 0x5606c19df670 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbdcbe07640 1 -- 172.21.15.196:0/1657480301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0063030 con 0x5606c19df670 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbdcbe07640 1 -- 172.21.15.196:0/1657480301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed005c850 con 0x5606c19df670 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedfe87800 1 -- 172.21.15.196:0/1657480301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 msgr2=0x5606c1b5a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1657480301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbed0025c20 tx=0x7fbed0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedfe87800 1 -- 172.21.15.196:0/1657480301 shutdown_connections 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1657480301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b5a990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.629+0000 7fbedfe87800 1 -- 172.21.15.196:0/1657480301 >> 172.21.15.196:0/1657480301 conn(0x5606c1a65e20 msgr2=0x5606c1b56350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 -- 172.21.15.196:0/1657480301 shutdown_connections 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 -- 172.21.15.196:0/1657480301 wait complete. 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedfe87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606c1a726d0 con 0x5606c19df670 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedd97b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedd97b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35484/0 (socket says 172.21.15.196:35484) 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.630+0000 7fbedd97b640 1 -- 172.21.15.196:0/768401892 learned_addr learned my addr 172.21.15.196:0/768401892 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbedd97b640 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1918fe0 con 0x5606c19df670 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbedd97b640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbed000a330 tx=0x7fbed0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbdca604640 1 -- 172.21.15.196:0/768401892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed006c030 con 0x5606c19df670 2024-09-21T08:52:00.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbdca604640 1 -- 172.21.15.196:0/768401892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed005c580 con 0x5606c19df670 2024-09-21T08:52:00.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606c1b627e0 con 0x5606c19df670 2024-09-21T08:52:00.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbdca604640 1 -- 172.21.15.196:0/768401892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed005c860 con 0x5606c19df670 2024-09-21T08:52:00.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.631+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c1b62d60 con 0x5606c19df670 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbdca604640 1 -- 172.21.15.196:0/768401892 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbed0053440 con 0x5606c19df670 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbdca604640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 0x7fbdc4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbdca604640 1 -- 172.21.15.196:0/768401892 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbed0070020 con 0x5606c19df670 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbedd17a640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 0x7fbdc4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 0x5606c1b69310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b69890 con 0x5606c1a6e7d0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbede17c640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 0x5606c1b69310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.632+0000 7fbedd17a640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 0x7fbdc4039000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000f60 tx=0x7fbed40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbede17c640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 0x5606c1b69310 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbede17c640 1 -- 172.21.15.196:0/768401892 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbed800a4a0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b668e0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbede17c640 1 -- 172.21.15.196:0/768401892 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbed800a4a0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 0x5606c1b6e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b6e6f0 con 0x5606c1b6bc10 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.633+0000 7fbedd97b640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 0x5606c1b6e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.634+0000 7fbedd97b640 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 0x5606c1b6e000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.634+0000 7fbedd97b640 1 -- 172.21.15.196:0/768401892 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbed007b070 con 0x5606c1b6bc10 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.634+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b6aab0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.634+0000 7fbede17c640 1 -- 172.21.15.196:0/768401892 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbed800a4a0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.634+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b6af50 con 0x5606c1a6e7d0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbede17c640 1 -- 172.21.15.196:0/768401892 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbed800a4a0 con 0x5606c1a6e7d0 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbedfe87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbedfe87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606c1906580 con 0x5606c1b7d040 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35494/0 (socket says 172.21.15.196:35494) 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.635+0000 7fbede17c640 1 -- 172.21.15.196:0/1339771891 learned_addr learned my addr 172.21.15.196:0/1339771891 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbede17c640 1 -- 172.21.15.196:0/1339771891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1b7d9a0 con 0x5606c1b7d040 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbede17c640 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5606c1b69c70 tx=0x7fbed8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbdc37fe640 1 -- 172.21.15.196:0/1339771891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8014450 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbdc37fe640 1 -- 172.21.15.196:0/1339771891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8014610 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606c1b7dc30 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbdc37fe640 1 -- 172.21.15.196:0/1339771891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8014930 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.636+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c1b80910 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbdc37fe640 1 -- 172.21.15.196:0/1339771891 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbed8011040 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbdc37fe640 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 0x7fbdb8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbdc37fe640 1 -- 172.21.15.196:0/1339771891 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbed801e070 con 0x5606c1b7d040 2024-09-21T08:52:00.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedd97b640 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 0x7fbdb8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedd97b640 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 0x7fbdb8039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5606c1b69d60 tx=0x7fbed0008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedfe87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.637+0000 7fbedfe87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606c1b5b0e0 con 0x5606c1b89c80 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35496/0 (socket says 172.21.15.196:35496) 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbede17c640 1 -- 172.21.15.196:0/1837587356 learned_addr learned my addr 172.21.15.196:0/1837587356 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbede17c640 1 -- 172.21.15.196:0/1837587356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1b8a650 con 0x5606c1b89c80 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbede17c640 1 --2- 172.21.15.196:0/1837587356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbed804cc70 tx=0x7fbed804ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1926c21e1c3134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbdc17fa640 1 -- 172.21.15.196:0/1837587356 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8042070 con 0x5606c1b89c80 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbdc17fa640 1 -- 172.21.15.196:0/1837587356 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8014c00 con 0x5606c1b89c80 2024-09-21T08:52:00.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbdc17fa640 1 -- 172.21.15.196:0/1837587356 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed802b480 con 0x5606c1b89c80 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbedfe87800 1 -- 172.21.15.196:0/1837587356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 msgr2=0x5606c1b8a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1837587356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbed804cc70 tx=0x7fbed804ce70 comp rx=0 tx=0).stop 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbedfe87800 1 -- 172.21.15.196:0/1837587356 shutdown_connections 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1837587356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b8a080 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.638+0000 7fbedfe87800 1 -- 172.21.15.196:0/1837587356 >> 172.21.15.196:0/1837587356 conn(0x5606c1b86020 msgr2=0x5606c1b84120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 -- 172.21.15.196:0/1837587356 shutdown_connections 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 -- 172.21.15.196:0/1837587356 wait complete. 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 Processor -- start 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 -- start start 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbedfe87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606c1b8ac70 con 0x5606c1b89c80 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbede17c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35510/0 (socket says 172.21.15.196:35510) 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 learned_addr learned my addr 172.21.15.196:0/3609251249 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.639+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c1b916a0 con 0x5606c1b89c80 2024-09-21T08:52:00.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbede17c640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbed804cc70 tx=0x7fbed804cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbdaf7fe640 1 -- 172.21.15.196:0/3609251249 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8011980 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbdaf7fe640 1 -- 172.21.15.196:0/3609251249 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8033070 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbdaf7fe640 1 -- 172.21.15.196:0/3609251249 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed804e100 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606c1b91930 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c1b945e0 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.640+0000 7fbdaf7fe640 1 -- 172.21.15.196:0/3609251249 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbed804e2a0 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbdaf7fe640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbda8036b40 0x7fbda8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbdaf7fe640 1 -- 172.21.15.196:0/3609251249 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fbed800e040 con 0x5606c1b89c80 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbda8036b40 0x7fbda8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbda8036b40 0x7fbda8039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbed005ce90 tx=0x7fbed0086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1b9ce20 0x5606c1b9f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b9fa30 con 0x5606c1b9ce20 2024-09-21T08:52:00.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.641+0000 7fbedd17a640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1b9ce20 0x5606c1b9f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedd17a640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1b9ce20 0x5606c1b9f2e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbed4009050 con 0x5606c1b9ce20 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 realm 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1b9c270 con 0x5606c1b9ce20 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbed4009050 con 0x5606c1b9ce20 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba0520 con 0x5606c1b9ce20 2024-09-21T08:52:00.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbed4009050 con 0x5606c1b9ce20 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.642+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba0df0 con 0x5606c1b9ce20 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbed4009050 con 0x5606c1b9ce20 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedfe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1ba1730 0x5606c1ba3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba42b0 con 0x5606c1ba1730 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbede17c640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1ba1730 0x5606c1ba3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.643+0000 7fbede17c640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1ba1730 0x5606c1ba3b20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedfe87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedfe87800 20 searching for the correct realm 2024-09-21T08:52:00.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5606c1ba6280 0x5606c1ba8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5606c1ba6280 0x5606c1ba8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5606c1ba6280 0x5606c1ba8740 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd97b640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbed005c070 0x7fbed0090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.644+0000 7fbedd17a640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbed005c070 0x7fbed0090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbedd17a640 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbed005c070 0x7fbed0090300 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4009050 con 0x7fbed005c070 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4009050 con 0x5606c1b9ce20 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.645+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x7fbed005c070 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.646+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.647+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbed4029040 con 0x7fbed005c070 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.648+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.649+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x7fbed005c070 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.650+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x7fbed005c070 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba6280 2024-09-21T08:52:00.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.651+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1ba1730 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x5606c1b9ce20 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba8e10 con 0x7fbed005c070 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed4029040 con 0x7fbed005c070 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.652+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba4c70 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba5510 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbed4029040 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba48b0 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 zone default found 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 4 Realm: () 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 zonegroup default 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1ba9290 con 0x5606c1ba1730 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.653+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bab560 con 0x5606c1ba6280 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bab900 con 0x5606c1ba6280 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 20 started sync module instance, tier type = 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.654+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1baa9f0 con 0x7fbed005c070 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.655+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.655+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587020029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1baa9f0 con 0x7fbed005c070 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.655+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bac370 con 0x5606c1b9ce20 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.656+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587020029728] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.656+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.657+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587020033632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1baa9f0 con 0x5606c1b9ce20 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.657+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bacdc0 con 0x5606c1ba6280 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.657+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.658+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587020036304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bad660 con 0x5606c1ba6280 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.658+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bae110 con 0x7fbed005c070 2024-09-21T08:52:00.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.658+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587020033632] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.659+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.659+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587020036304] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.659+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587020027200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bae500 con 0x7fbed005c070 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.659+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bad1b0 con 0x5606c1b9ce20 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.660+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.660+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587020044816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bad1b0 con 0x5606c1b9ce20 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.660+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1baf940 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.660+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587020027200] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.661+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.661+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587020041200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bafd30 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.661+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb06f0 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.661+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587020044816] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.661+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587020041200] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.662+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.662+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587020047440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb0240 con 0x5606c1ba1730 2024-09-21T08:52:00.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.662+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb0c00 con 0x5606c1ba1730 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587020047440] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587020045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb0c00 con 0x5606c1ba1730 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=0 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=1 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=2 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=3 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=4 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=5 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.663+0000 7fbedfe87800 20 add_watcher() i=6 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587020045872] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbedfe87800 20 add_watcher() i=7 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbedfe87800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb4060 con 0x5606c1b9ce20 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.664+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587020052768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1bb1550 con 0x5606c1b9ce20 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.665+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587020052768] v34'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.665+0000 7fbd8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.665+0000 7fbedfe87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.665+0000 7fbedfe87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.665+0000 7fbedfe87800 5 note: GC not initialized 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbd8e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 20 Filter name: none 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbcfffff640 20 reqs_thread_entry: start 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be7520 con 0x5606c1ba1730 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.666+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be5b60 con 0x5606c1ba1730 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:52:00.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.667+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be6430 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbedfe87800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbedfe87800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbedfe87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94587020271488 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1beab10 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify (1) cookie 94587020041200 notify 146028888067 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5606c1be6f70 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbdc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94587020041200 notifier 4496 bl.length()=556 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbdc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbdc17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(65 notify.5 [notify cookie 94587020271488 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.668+0000 7fbdc17fa640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbda0003ea0 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.669+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== watch-notify(notify_complete (2) cookie 94587020271488 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606c1b91930 con 0x5606c1ba1730 2024-09-21T08:52:00.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.669+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.669+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be63e0 con 0x5606c1ba1730 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedfe87800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedfe87800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedfe87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94587020271408 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be63d0 con 0x5606c1ba6280 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 94587020036304 notify 146028888066 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5606c1b62d60 con 0x5606c1ba6280 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbdc0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94587020036304 notifier 4496 bl.length()=177 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbdc0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbdc0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 notify.2 [notify cookie 94587020271408 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbdc0ff9640 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbd08003400 con 0x5606c1ba6280 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== watch-notify(notify_complete (2) cookie 94587020271408 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606c1b627e0 con 0x5606c1ba6280 2024-09-21T08:52:00.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.670+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.685 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T08:52:00.668928Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:52:00.668919Z","tags":[],"group_ids":[]} 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.671+0000 7fbd8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.671+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587020052768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1b9ce20 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.672+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94587020052768] v34'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.672+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587020029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x7fbed005c070 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.673+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94587020029728] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.673+0000 7fbedfe87800 20 remove_watcher() i=0 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.673+0000 7fbedfe87800 2 removed watcher, disabling cache 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.673+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587020033632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1b9ce20 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.674+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94587020033632] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.674+0000 7fbedfe87800 20 remove_watcher() i=1 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.674+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587020036304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1ba6280 2024-09-21T08:52:00.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.675+0000 7fbedd97b640 1 -- 172.21.15.196:0/3609251249 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94587020036304] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed0099070 con 0x5606c1ba6280 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.675+0000 7fbedfe87800 20 remove_watcher() i=2 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.675+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587020027200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x7fbed005c070 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.676+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94587020027200] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x7fbed005c070 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.676+0000 7fbedfe87800 20 remove_watcher() i=3 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.676+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587020044816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1b9ce20 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94587020044816] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed40391c0 con 0x5606c1b9ce20 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbedfe87800 20 remove_watcher() i=4 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587020041200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1ba1730 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94587020041200] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbedfe87800 20 remove_watcher() i=5 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.678+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587020047440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1ba1730 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.679+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94587020047440] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.679+0000 7fbedfe87800 20 remove_watcher() i=6 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.679+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587020045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5606c1be51e0 con 0x5606c1ba1730 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.680+0000 7fbede17c640 1 -- 172.21.15.196:0/3609251249 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94587020045872] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed802a070 con 0x5606c1ba1730 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.680+0000 7fbedfe87800 20 remove_watcher() i=7 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.680+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1ba1730 msgr2=0x5606c1ba3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.680+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1ba1730 0x5606c1ba3b20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.680+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1b9ce20 msgr2=0x5606c1b9f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1b9ce20 0x5606c1b9f2e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbed005c070 msgr2=0x7fbed0090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbed005c070 0x7fbed0090300 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5606c1ba6280 msgr2=0x5606c1ba8740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5606c1ba6280 0x5606c1ba8740 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbda8036b40 msgr2=0x7fbda8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbda8036b40 0x7fbda8039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbed005ce90 tx=0x7fbed0086000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 msgr2=0x5606c1b91160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedd17a640 1 -- 172.21.15.196:0/3609251249 reap_dead start 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbed804cc70 tx=0x7fbed804cc00 comp rx=0 tx=0).stop 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 shutdown_connections 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/3609251249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b89c80 0x5606c1b91160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 >> 172.21.15.196:0/3609251249 conn(0x5606c1b86020 msgr2=0x5606c1b840f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 shutdown_connections 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/3609251249 wait complete. 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 msgr2=0x7fbdb8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 0x7fbdb8039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5606c1b69d60 tx=0x7fbed0008310 comp rx=0 tx=0).stop 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 msgr2=0x5606c1b7d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5606c1b69c70 tx=0x7fbed8018830 comp rx=0 tx=0).stop 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 shutdown_connections 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdb8036b90 0x7fbdb8039050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/1339771891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c1b7d040 0x5606c1b7d460 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 >> 172.21.15.196:0/1339771891 conn(0x5606c1b71fd0 msgr2=0x5606c1b74b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 shutdown_connections 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/1339771891 wait complete. 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 msgr2=0x5606c1b6e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 0x5606c1b6e000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 msgr2=0x5606c1b69310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.681+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 0x5606c1b69310 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 msgr2=0x7fbdc4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 0x7fbdc4039000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000f60 tx=0x7fbed40012b0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 msgr2=0x5606c1b622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbed000a330 tx=0x7fbed0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 shutdown_connections 2024-09-21T08:52:00.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5606c1b6bc10 0x5606c1b6e000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5606c1a6e7d0 0x5606c1b69310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbdc4036b40 0x7fbdc4039000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 --2- 172.21.15.196:0/768401892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606c19df670 0x5606c1b622a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 >> 172.21.15.196:0/768401892 conn(0x5606c1a65e20 msgr2=0x5606c1b54bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 shutdown_connections 2024-09-21T08:52:00.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.682+0000 7fbedfe87800 1 -- 172.21.15.196:0/768401892 wait complete. 2024-09-21T08:52:00.696 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T08:52:00.668928Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:52:00.668919Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:00.701 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T08:52:00.704 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:00.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-21T08:52:00.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-21T08:52:00.705 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-21T08:52:00.748 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.748 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37e3613800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556e279a3f10 0x556e279a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37e3613800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e2785cb30 con 0x556e2799ba70 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37e3613800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556e2783e360 con 0x556e279a3f10 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37d663a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556e279a3f10 0x556e279a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.746+0000 7f37dee3b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556e2799ba70 0x556e2799be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47074/0 (socket says 172.21.15.196:47074) 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.747+0000 7f37d663a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556e279a3f10 0x556e279a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35522/0 (socket says 172.21.15.196:35522) 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.747+0000 7f37dee3b640 1 -- 172.21.15.196:0/3528265781 learned_addr learned my addr 172.21.15.196:0/3528265781 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.747+0000 7f37d663a640 1 -- 172.21.15.196:0/3528265781 >> v1:172.21.15.29:6789/0 conn(0x556e2799ba70 legacy=0x556e2799be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.747+0000 7f37d663a640 1 -- 172.21.15.196:0/3528265781 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e27864e00 con 0x556e279a3f10 2024-09-21T08:52:00.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37d663a640 1 --2- 172.21.15.196:0/3528265781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e279a3f10 0x556e279a6300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f37c800a470 tx=0x7f37c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342c8abc5fdf48ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37de63a640 1 -- 172.21.15.196:0/3528265781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8053570 con 0x556e279a3f10 2024-09-21T08:52:00.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37de63a640 1 -- 172.21.15.196:0/3528265781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8058070 con 0x556e279a3f10 2024-09-21T08:52:00.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37de63a640 1 -- 172.21.15.196:0/3528265781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8053880 con 0x556e279a3f10 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 -- 172.21.15.196:0/3528265781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e279a3f10 msgr2=0x556e279a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 --2- 172.21.15.196:0/3528265781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e279a3f10 0x556e279a6300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f37c800a470 tx=0x7f37c8045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 -- 172.21.15.196:0/3528265781 shutdown_connections 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 --2- 172.21.15.196:0/3528265781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e279a3f10 0x556e279a6300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 -- 172.21.15.196:0/3528265781 >> 172.21.15.196:0/3528265781 conn(0x556e279975c0 msgr2=0x556e279999e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 -- 172.21.15.196:0/3528265781 shutdown_connections 2024-09-21T08:52:00.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.749+0000 7f37e3613800 1 -- 172.21.15.196:0/3528265781 wait complete. 2024-09-21T08:52:00.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37e3613800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37e3613800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e278e9330 con 0x556e2799ba70 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37dee3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37dee3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35534/0 (socket says 172.21.15.196:35534) 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.763+0000 7f37dee3b640 1 -- 172.21.15.196:0/4193988948 learned_addr learned my addr 172.21.15.196:0/4193988948 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.764+0000 7f37dee3b640 1 -- 172.21.15.196:0/4193988948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e27836bc0 con 0x556e2799ba70 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.764+0000 7f37dee3b640 1 --2- 172.21.15.196:0/4193988948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f37d0001d50 tx=0x7f37d000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359c4a7379475a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.764+0000 7f36cce09640 1 -- 172.21.15.196:0/4193988948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0013030 con 0x556e2799ba70 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.764+0000 7f36cce09640 1 -- 172.21.15.196:0/4193988948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d000e470 con 0x556e2799ba70 2024-09-21T08:52:00.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.764+0000 7f36cce09640 1 -- 172.21.15.196:0/4193988948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d000e810 con 0x556e2799ba70 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- 172.21.15.196:0/4193988948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 msgr2=0x556e27a8ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 --2- 172.21.15.196:0/4193988948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f37d0001d50 tx=0x7f37d000b6c0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- 172.21.15.196:0/4193988948 shutdown_connections 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 --2- 172.21.15.196:0/4193988948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a8ea90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- 172.21.15.196:0/4193988948 >> 172.21.15.196:0/4193988948 conn(0x556e279975c0 msgr2=0x556e27a8a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- 172.21.15.196:0/4193988948 shutdown_connections 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- 172.21.15.196:0/4193988948 wait complete. 2024-09-21T08:52:00.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37e3613800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e279a6a50 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37dee3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37dee3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35538/0 (socket says 172.21.15.196:35538) 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.765+0000 7f37dee3b640 1 -- 172.21.15.196:0/3656499407 learned_addr learned my addr 172.21.15.196:0/3656499407 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f37dee3b640 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e2784afe0 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f37dee3b640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37d0004000 tx=0x7f37d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f36cb606640 1 -- 172.21.15.196:0/3656499407 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0027070 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f36cb606640 1 -- 172.21.15.196:0/3656499407 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00013d0 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e27a969d0 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f36cb606640 1 -- 172.21.15.196:0/3656499407 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0019ac0 con 0x556e2799ba70 2024-09-21T08:52:00.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.766+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e27a96ef0 con 0x556e2799ba70 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f36cb606640 1 -- 172.21.15.196:0/3656499407 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d002a070 con 0x556e2799ba70 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f36cb606640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 0x7f36c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f36cb606640 1 -- 172.21.15.196:0/3656499407 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37d001f070 con 0x556e2799ba70 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f37d663a640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 0x7f36c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 0x556e27a9d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27a9da80 con 0x556e279a3f10 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.767+0000 7f37df63c640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 0x556e27a9d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37d663a640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 0x7f36c4039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37c8057000 tx=0x7f37c8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37df63c640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 0x556e27a9d500 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37df63c640 1 -- 172.21.15.196:0/3656499407 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d800a4a0 con 0x556e279a3f10 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27a9aad0 con 0x556e279a3f10 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37df63c640 1 -- 172.21.15.196:0/3656499407 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37d800a4a0 con 0x556e279a3f10 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 0x556e27aa21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.768+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27aa28b0 con 0x556e27a9fdd0 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.769+0000 7f37dee3b640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 0x556e27aa21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.769+0000 7f37dee3b640 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 0x556e27aa21c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.769+0000 7f37dee3b640 1 -- 172.21.15.196:0/3656499407 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37d0029030 con 0x556e27a9fdd0 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.769+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27a9ec70 con 0x556e279a3f10 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37df63c640 1 -- 172.21.15.196:0/3656499407 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37d800a4a0 con 0x556e279a3f10 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27a9f0a0 con 0x556e279a3f10 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37df63c640 1 -- 172.21.15.196:0/3656499407 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37d800a4a0 con 0x556e279a3f10 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37e3613800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.770+0000 7f37e3613800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e27838580 con 0x556e27ab1230 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35546/0 (socket says 172.21.15.196:35546) 2024-09-21T08:52:00.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37df63c640 1 -- 172.21.15.196:0/2717354884 learned_addr learned my addr 172.21.15.196:0/2717354884 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37df63c640 1 -- 172.21.15.196:0/2717354884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e27ab1b90 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37df63c640 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x556e27a97890 tx=0x7f37d8012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f36c8e01640 1 -- 172.21.15.196:0/2717354884 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8014450 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f36c8e01640 1 -- 172.21.15.196:0/2717354884 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8014610 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e27ab1e20 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f36c8e01640 1 -- 172.21.15.196:0/2717354884 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8014930 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.771+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e27ab4b00 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.772+0000 7f36c8e01640 1 -- 172.21.15.196:0/2717354884 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d8011040 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.772+0000 7f36c8e01640 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 0x7f36b8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.772+0000 7f36c8e01640 1 -- 172.21.15.196:0/2717354884 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37d801e070 con 0x556e27ab1230 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.772+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 0x7f36b8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 0x7f36b8039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x556e27a9df20 tx=0x7f37d000dd90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37e3613800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37e3613800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e27a8f240 con 0x556e27abdeb0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35562/0 (socket says 172.21.15.196:35562) 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37df63c640 1 -- 172.21.15.196:0/663545199 learned_addr learned my addr 172.21.15.196:0/663545199 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37df63c640 1 -- 172.21.15.196:0/663545199 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e27abe880 con 0x556e27abdeb0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.773+0000 7f37df63c640 1 --2- 172.21.15.196:0/663545199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37d804cca0 tx=0x7f37d804cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc0d5b77d1b0cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f36c27fc640 1 -- 172.21.15.196:0/663545199 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8013db0 con 0x556e27abdeb0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f36c27fc640 1 -- 172.21.15.196:0/663545199 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8014ad0 con 0x556e27abdeb0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f36c27fc640 1 -- 172.21.15.196:0/663545199 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8014db0 con 0x556e27abdeb0 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- 172.21.15.196:0/663545199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 msgr2=0x556e27abe2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 --2- 172.21.15.196:0/663545199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37d804cca0 tx=0x7f37d804cf70 comp rx=0 tx=0).stop 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- 172.21.15.196:0/663545199 shutdown_connections 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 --2- 172.21.15.196:0/663545199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27abe2b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- 172.21.15.196:0/663545199 >> 172.21.15.196:0/663545199 conn(0x556e27aba210 msgr2=0x556e27ab8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- 172.21.15.196:0/663545199 shutdown_connections 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- 172.21.15.196:0/663545199 wait complete. 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 Processor -- start 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.774+0000 7f37e3613800 1 -- start start 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37e3613800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37e3613800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556e27abeef0 con 0x556e27abdeb0 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37df63c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35570/0 (socket says 172.21.15.196:35570) 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 learned_addr learned my addr 172.21.15.196:0/2321246309 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e27ac57b0 con 0x556e27abdeb0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37df63c640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f37d804cca0 tx=0x7f37d804cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f36c0ff9640 1 -- 172.21.15.196:0/2321246309 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8022c90 con 0x556e27abdeb0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f36c0ff9640 1 -- 172.21.15.196:0/2321246309 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8022e30 con 0x556e27abdeb0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e27ac5a40 con 0x556e27abdeb0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f36c0ff9640 1 -- 172.21.15.196:0/2321246309 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8013520 con 0x556e27abdeb0 2024-09-21T08:52:00.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.775+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e27ac86f0 con 0x556e27abdeb0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.776+0000 7f36c0ff9640 1 -- 172.21.15.196:0/2321246309 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d802b350 con 0x556e27abdeb0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.776+0000 7f36c0ff9640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a8036b40 0x7f36a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.776+0000 7f36c0ff9640 1 -- 172.21.15.196:0/2321246309 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37d8034070 con 0x556e27abdeb0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.776+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a8036b40 0x7f36a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e27ad0db0 0x556e27ad3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad39c0 con 0x556e27ad0db0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a8036b40 0x7f36a8039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37d0019640 tx=0x7f37d004c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37d663a640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e27ad0db0 0x556e27ad3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37d663a640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e27ad0db0 0x556e27ad3270 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 realm 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad3df0 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.777+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad46c0 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad4a60 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27ad57c0 0x556e27ad7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad80f0 con 0x556e27ad57c0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37df63c640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27ad57c0 0x556e27ad7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.778+0000 7f37df63c640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27ad57c0 0x556e27ad7bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37e3613800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37e3613800 20 searching for the correct realm 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e27ada130 0x556e27adc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e27ada130 0x556e27adc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e27ada130 0x556e27adc5f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37dee3b640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37d002c060 0x7f37d0049130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.779+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37d663a640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37d002c060 0x7f37d0049130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37d663a640 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37d002c060 0x7f37d0049130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.780+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.781+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.781+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.781+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.781+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.781+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.782+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.783+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.784+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.785+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.786+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ada130 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad57c0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x556e27ad0db0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.787+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556e27adccc0 con 0x7f37d002c060 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad8b30 con 0x556e27ad0db0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad8fb0 con 0x556e27ad0db0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ad9450 con 0x556e27ad0db0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.788+0000 7f37e3613800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 zone default found 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 4 Realm: () 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 zonegroup default 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27add140 con 0x556e27ad57c0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27adf370 con 0x556e27ada130 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27adf710 con 0x556e27ada130 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 started sync module instance, tier type = 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.789+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ade7b0 con 0x7f37d002c060 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.791+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.791+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931600473040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ade7b0 con 0x7f37d002c060 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.791+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27adffe0 con 0x556e27ad0db0 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.791+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93931600473040] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.792+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.792+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931600476848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ade7b0 con 0x556e27ad0db0 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.792+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae0a50 con 0x556e27ada130 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.793+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.793+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931600479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae1320 con 0x556e27ada130 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.793+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae1e10 con 0x7f37d002c060 2024-09-21T08:52:00.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.793+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93931600476848] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.794+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93931600479552] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.794+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.794+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931600481904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ade300 con 0x7f37d002c060 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.794+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae26f0 con 0x556e27ad0db0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.795+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93931600481904] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.795+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.795+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931600484576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae2660 con 0x556e27ad0db0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.795+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae3100 con 0x556e27ad57c0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.796+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.796+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93931600484576] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.796+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931600489552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae3520 con 0x556e27ad57c0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.796+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae21f0 con 0x556e27ad57c0 2024-09-21T08:52:00.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.797+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93931600489552] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.797+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.797+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931600490608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae3490 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.797+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae44e0 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93931600490608] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931600493328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae44e0 con 0x556e27ad57c0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=0 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=1 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=2 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=3 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=4 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=5 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.798+0000 7f37e3613800 20 add_watcher() i=6 2024-09-21T08:52:00.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.799+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93931600493328] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.799+0000 7f37e3613800 20 add_watcher() i=7 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.799+0000 7f37e3613800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.799+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae7910 con 0x556e27ad0db0 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.800+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.800+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931600494384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae4e00 con 0x556e27ad0db0 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93931600494384] v34'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f36957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 5 note: GC not initialized 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f360ffff640 20 reqs_thread_entry: start 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 20 Filter name: none 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f360dffb640 20 reqs_thread_entry: start 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.801+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556e27b1a7e0 con 0x7f37d002c060 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.802+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.802+0000 7f37e3613800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.803+0000 7f36957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.803+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931600494384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27b18620 con 0x556e27ad0db0 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.804+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93931600494384] v34'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.804+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931600473040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27b18620 con 0x7f37d002c060 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.805+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93931600473040] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.805+0000 7f37e3613800 20 remove_watcher() i=0 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.805+0000 7f37e3613800 2 removed watcher, disabling cache 2024-09-21T08:52:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.805+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931600476848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27b18620 con 0x556e27ad0db0 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.806+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93931600476848] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.806+0000 7f37e3613800 20 remove_watcher() i=1 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.806+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931600479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27b18620 con 0x556e27ada130 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.807+0000 7f37dee3b640 1 -- 172.21.15.196:0/2321246309 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93931600479552] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0029030 con 0x556e27ada130 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.807+0000 7f37e3613800 20 remove_watcher() i=2 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.807+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931600481904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27adebd0 con 0x7f37d002c060 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.808+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93931600481904] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x7f37d002c060 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.808+0000 7f37e3613800 20 remove_watcher() i=3 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.808+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931600484576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae0540 con 0x556e27ad0db0 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.809+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93931600484576] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8051070 con 0x556e27ad0db0 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.809+0000 7f37e3613800 20 remove_watcher() i=4 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.809+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931600489552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae0e70 con 0x556e27ad57c0 2024-09-21T08:52:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.810+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93931600489552] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.810+0000 7f37e3613800 20 remove_watcher() i=5 2024-09-21T08:52:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.810+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931600490608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27adebd0 con 0x556e27ad57c0 2024-09-21T08:52:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.811+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93931600490608] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.811+0000 7f37e3613800 20 remove_watcher() i=6 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.811+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931600493328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556e27ae0540 con 0x556e27ad57c0 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37df63c640 1 -- 172.21.15.196:0/2321246309 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93931600493328] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d802a070 con 0x556e27ad57c0 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 20 remove_watcher() i=7 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27ad57c0 msgr2=0x556e27ad7bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27ad57c0 0x556e27ad7bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e27ad0db0 msgr2=0x556e27ad3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e27ad0db0 0x556e27ad3270 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37d002c060 msgr2=0x7f37d0049130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37d002c060 0x7f37d0049130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e27ada130 msgr2=0x556e27adc5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556e27ada130 0x556e27adc5f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a8036b40 msgr2=0x7f36a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a8036b40 0x7f36a8039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37d0019640 tx=0x7f37d004c000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 msgr2=0x556e27ac5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37d663a640 1 -- 172.21.15.196:0/2321246309 reap_dead start 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f37d804cca0 tx=0x7f37d804cc30 comp rx=0 tx=0).stop 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 shutdown_connections 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 --2- 172.21.15.196:0/2321246309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27abdeb0 0x556e27ac5270 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 >> 172.21.15.196:0/2321246309 conn(0x556e27aba210 msgr2=0x556e27ab82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 shutdown_connections 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.812+0000 7f37e3613800 1 -- 172.21.15.196:0/2321246309 wait complete. 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 msgr2=0x7f36b8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 0x7f36b8039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x556e27a9df20 tx=0x7f37d000dd90 comp rx=0 tx=0).stop 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 msgr2=0x556e27ab1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x556e27a97890 tx=0x7f37d8012fd0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 shutdown_connections 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36b8036b90 0x7f36b8039050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/2717354884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e27ab1230 0x556e27ab1650 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 >> 172.21.15.196:0/2717354884 conn(0x556e27aa61c0 msgr2=0x556e27aa8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 shutdown_connections 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/2717354884 wait complete. 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 msgr2=0x556e27aa21c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 0x556e27aa21c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 msgr2=0x556e27a9d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 0x556e27a9d500 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 msgr2=0x7f36c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 0x7f36c4039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37c8057000 tx=0x7f37c8052000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 msgr2=0x556e27a96490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37d0004000 tx=0x7f37d0000bc0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 shutdown_connections 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556e27a9fdd0 0x556e27aa21c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556e279a3f10 0x556e27a9d500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36c4036b40 0x7f36c4039000 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 --2- 172.21.15.196:0/3656499407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e2799ba70 0x556e27a96490 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 >> 172.21.15.196:0/3656499407 conn(0x556e279975c0 msgr2=0x556e27a88d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 shutdown_connections 2024-09-21T08:52:00.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.813+0000 7f37e3613800 1 -- 172.21.15.196:0/3656499407 wait complete. 2024-09-21T08:52:00.825 INFO:teuthology.orchestra.run.smithi196.stdout:{"key":"bucket:myfoo","ver":{"tag":"_K5a6H5Hx0pwGcfPt2u3thkM","ver":2},"mtime":"2024-09-21T08:52:00.538223Z","data":{"bucket":{"name":"myfoo","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","bucket_id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-21T08:51:59.475959Z","linked":false,"has_bucket_info":false}} 2024-09-21T08:52:00.826 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_K5a6H5Hx0pwGcfPt2u3thkM', 'ver': 2}, 'mtime': '2024-09-21T08:52:00.538223Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'bucket_id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-21T08:51:59.475959Z', 'linked': False, 'has_bucket_info': False}} 2024-09-21T08:52:00.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1'] 2024-09-21T08:52:00.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1'] 2024-09-21T08:52:00.826 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:00.913 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:00.914 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f146cf40800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56103601cbc0 0x56103601cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f146cf40800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561035edcb30 con 0x56103601d500 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f146cf40800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561035ebe360 con 0x56103601cbc0 2024-09-21T08:52:00.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f1468cd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56103601cbc0 0x56103601cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f1468cd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56103601cbc0 0x56103601cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35582/0 (socket says 172.21.15.196:35582) 2024-09-21T08:52:00.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f1468cd1640 1 -- 172.21.15.196:0/3757068511 learned_addr learned my addr 172.21.15.196:0/3757068511 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f14684d0640 1 --1- 172.21.15.196:0/3757068511 >> v1:172.21.15.29:6789/0 conn(0x56103601d500 0x561036021a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47076/0 (socket says 172.21.15.196:47076) 2024-09-21T08:52:00.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.912+0000 7f1468cd1640 1 -- 172.21.15.196:0/3757068511 >> v1:172.21.15.29:6789/0 conn(0x56103601d500 legacy=0x561036021a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.913+0000 7f1468cd1640 1 -- 172.21.15.196:0/3757068511 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561035ee4e00 con 0x56103601cbc0 2024-09-21T08:52:00.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.914+0000 7f1468cd1640 1 --2- 172.21.15.196:0/3757068511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103601cfc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f145800a6b0 tx=0x7f1458047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40b9a1e9b3b81e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.914+0000 7f1467ccf640 1 -- 172.21.15.196:0/3757068511 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145800a200 con 0x56103601cbc0 2024-09-21T08:52:00.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.914+0000 7f1467ccf640 1 -- 172.21.15.196:0/3757068511 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145800a3a0 con 0x56103601cbc0 2024-09-21T08:52:00.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f1467ccf640 1 -- 172.21.15.196:0/3757068511 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1458008700 con 0x56103601cbc0 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 -- 172.21.15.196:0/3757068511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 msgr2=0x56103601cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 --2- 172.21.15.196:0/3757068511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103601cfc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f145800a6b0 tx=0x7f1458047e30 comp rx=0 tx=0).stop 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 -- 172.21.15.196:0/3757068511 shutdown_connections 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 --2- 172.21.15.196:0/3757068511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103601cfc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 -- 172.21.15.196:0/3757068511 >> 172.21.15.196:0/3757068511 conn(0x5610360175e0 msgr2=0x561036019a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 -- 172.21.15.196:0/3757068511 shutdown_connections 2024-09-21T08:52:00.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.915+0000 7f146cf40800 1 -- 172.21.15.196:0/3757068511 wait complete. 2024-09-21T08:52:00.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f146cf40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f146cf40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561035f69350 con 0x56103601cbc0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f1468cd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f1468cd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35596/0 (socket says 172.21.15.196:35596) 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.929+0000 7f1468cd1640 1 -- 172.21.15.196:0/444347691 learned_addr learned my addr 172.21.15.196:0/444347691 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.930+0000 7f1468cd1640 1 -- 172.21.15.196:0/444347691 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561035eb6bc0 con 0x56103601cbc0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.930+0000 7f1468cd1640 1 --2- 172.21.15.196:0/444347691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1458048360 tx=0x7f1458051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f414b00e2415da8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.930+0000 7f1356e0d640 1 -- 172.21.15.196:0/444347691 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145800a200 con 0x56103601cbc0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.930+0000 7f1356e0d640 1 -- 172.21.15.196:0/444347691 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1458008400 con 0x56103601cbc0 2024-09-21T08:52:00.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.930+0000 7f1356e0d640 1 -- 172.21.15.196:0/444347691 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14580088f0 con 0x56103601cbc0 2024-09-21T08:52:00.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- 172.21.15.196:0/444347691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 msgr2=0x56103610eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 --2- 172.21.15.196:0/444347691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1458048360 tx=0x7f1458051000 comp rx=0 tx=0).stop 2024-09-21T08:52:00.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- 172.21.15.196:0/444347691 shutdown_connections 2024-09-21T08:52:00.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 --2- 172.21.15.196:0/444347691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x56103610eb00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- 172.21.15.196:0/444347691 >> 172.21.15.196:0/444347691 conn(0x5610360175e0 msgr2=0x5610361060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- 172.21.15.196:0/444347691 shutdown_connections 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- 172.21.15.196:0/444347691 wait complete. 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.931+0000 7f146cf40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561036023510 con 0x56103601cbc0 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f1468cd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f1468cd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35598/0 (socket says 172.21.15.196:35598) 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f1468cd1640 1 -- 172.21.15.196:0/4204468267 learned_addr learned my addr 172.21.15.196:0/4204468267 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f1468cd1640 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561035ecafe0 con 0x56103601cbc0 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f1468cd1640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1458059040 tx=0x7f1458002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f135560a640 1 -- 172.21.15.196:0/4204468267 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145806f070 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f135560a640 1 -- 172.21.15.196:0/4204468267 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14580088f0 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f135560a640 1 -- 172.21.15.196:0/4204468267 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1458008bd0 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.932+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561036116a00 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.933+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561036116f20 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.933+0000 7f135560a640 1 -- 172.21.15.196:0/4204468267 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1458072070 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.933+0000 7f135560a640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 0x7f1350039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.933+0000 7f135560a640 1 -- 172.21.15.196:0/4204468267 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f1458064020 con 0x56103601cbc0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f14684d0640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 0x7f1350039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 0x56103611d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103611da70 con 0x56103601d500 2024-09-21T08:52:00.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f14694d2640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 0x56103611d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f14684d0640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 0x7f1350039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1450000f60 tx=0x7f1450001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f14694d2640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 0x56103611d530 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f14694d2640 1 -- 172.21.15.196:0/4204468267 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f146000a4a0 con 0x56103601d500 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.934+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103611ab00 con 0x56103601d500 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.935+0000 7f14694d2640 1 -- 172.21.15.196:0/4204468267 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f146000a4a0 con 0x56103601d500 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.935+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 0x561036122190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.935+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036122880 con 0x56103611fda0 2024-09-21T08:52:00.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.935+0000 7f1468cd1640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 0x561036122190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.935+0000 7f1468cd1640 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 0x561036122190 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f1468cd1640 1 -- 172.21.15.196:0/4204468267 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f145807b070 con 0x56103611fda0 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103611ec40 con 0x56103601d500 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f14694d2640 1 -- 172.21.15.196:0/4204468267 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f146000a4a0 con 0x56103601d500 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103611f0e0 con 0x56103601d500 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f14694d2640 1 -- 172.21.15.196:0/4204468267 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f146000a4a0 con 0x56103601d500 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.936+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f146cf40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f146cf40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561035eb8580 con 0x5610361311d0 2024-09-21T08:52:00.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35610/0 (socket says 172.21.15.196:35610) 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f14694d2640 1 -- 172.21.15.196:0/2601135622 learned_addr learned my addr 172.21.15.196:0/2601135622 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f14694d2640 1 -- 172.21.15.196:0/2601135622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561036131b30 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f14694d2640 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x56103611de50 tx=0x7f1460018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f134e7fc640 1 -- 172.21.15.196:0/2601135622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1460014450 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f134e7fc640 1 -- 172.21.15.196:0/2601135622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1460014610 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.937+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561036131dc0 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.938+0000 7f134e7fc640 1 -- 172.21.15.196:0/2601135622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1460014930 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.938+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561036134aa0 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.938+0000 7f134e7fc640 1 -- 172.21.15.196:0/2601135622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1460011040 con 0x5610361311d0 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.938+0000 7f134e7fc640 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 0x7f1340039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f134e7fc640 1 -- 172.21.15.196:0/2601135622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f146001e070 con 0x5610361311d0 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 0x7f1340039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 0x7f1340039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56103611def0 tx=0x7f145808eff0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f146cf40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f146cf40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56103610f250 con 0x56103613de30 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35626/0 (socket says 172.21.15.196:35626) 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f14694d2640 1 -- 172.21.15.196:0/3006924485 learned_addr learned my addr 172.21.15.196:0/3006924485 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.939+0000 7f14694d2640 1 -- 172.21.15.196:0/3006924485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56103613e800 con 0x56103613de30 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f14694d2640 1 --2- 172.21.15.196:0/3006924485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f146004cb90 tx=0x7f1460011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ca4357e0edd97e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f133ffff640 1 -- 172.21.15.196:0/3006924485 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1460044070 con 0x56103613de30 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f133ffff640 1 -- 172.21.15.196:0/3006924485 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14600167c0 con 0x56103613de30 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f133ffff640 1 -- 172.21.15.196:0/3006924485 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1460013ca0 con 0x56103613de30 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- 172.21.15.196:0/3006924485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 msgr2=0x56103613e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 --2- 172.21.15.196:0/3006924485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f146004cb90 tx=0x7f1460011700 comp rx=0 tx=0).stop 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- 172.21.15.196:0/3006924485 shutdown_connections 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 --2- 172.21.15.196:0/3006924485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x56103613e230 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- 172.21.15.196:0/3006924485 >> 172.21.15.196:0/3006924485 conn(0x56103613a190 msgr2=0x561036138290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- 172.21.15.196:0/3006924485 shutdown_connections 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- 172.21.15.196:0/3006924485 wait complete. 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 Processor -- start 2024-09-21T08:52:00.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.940+0000 7f146cf40800 1 -- start start 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f146cf40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f146cf40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56103613ee70 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f14694d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35636/0 (socket says 172.21.15.196:35636) 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 learned_addr learned my addr 172.21.15.196:0/2228536965 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610361457e0 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f14694d2640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f146004bab0 tx=0x7f146004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f133e7fc640 1 -- 172.21.15.196:0/2228536965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1460022c60 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f133e7fc640 1 -- 172.21.15.196:0/2228536965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1460022e00 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f133e7fc640 1 -- 172.21.15.196:0/2228536965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146004e0d0 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561036145a70 con 0x56103613de30 2024-09-21T08:52:00.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.941+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561036148720 con 0x56103613de30 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.942+0000 7f133e7fc640 1 -- 172.21.15.196:0/2228536965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f146003e020 con 0x56103613de30 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.942+0000 7f133e7fc640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1334036b90 0x7f1334039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.942+0000 7f133e7fc640 1 -- 172.21.15.196:0/2228536965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f146003c020 con 0x56103613de30 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1334036b90 0x7f1334039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1334036b90 0x7f1334039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1458005b50 tx=0x7f145807f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561036150f60 0x561036153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036153b70 con 0x561036150f60 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.943+0000 7f14684d0640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561036150f60 0x561036153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f14684d0640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561036150f60 0x561036153420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145000f610 con 0x561036150f60 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 realm 2024-09-21T08:52:00.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610361503b0 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145000f610 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036154660 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145000f610 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036154f30 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f145000f610 con 0x561036150f60 2024-09-21T08:52:00.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.944+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561036155950 0x561036157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f14694d2640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561036155950 0x561036157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f14694d2640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561036155950 0x561036157d40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 20 searching for the correct realm 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56103615a3e0 0x56103615c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.945+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56103615cf70 con 0x56103615a3e0 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56103615a3e0 0x56103615c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56103615a3e0 0x56103615c8a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f1468cd1640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1458074070 0x7f1458051600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56103615cf70 con 0x7f1458074070 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f14684d0640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1458074070 0x7f1458051600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.946+0000 7f14684d0640 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1458074070 0x7f1458051600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145000f610 con 0x7f1458074070 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56103615cf70 con 0x561036155950 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145000f610 con 0x561036150f60 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.947+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.948+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.948+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.948+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.948+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x7f1458074070 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.949+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x7f1458074070 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.950+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.951+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x7f1458074070 2024-09-21T08:52:00.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.952+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.953+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x7f1458074070 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x56103615a3e0 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036155950 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.954+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x561036150f60 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561036158430 con 0x7f1458074070 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036158cf0 con 0x561036150f60 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610361590e0 con 0x561036150f60 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.955+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036159500 con 0x561036150f60 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 zone default found 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 4 Realm: () 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:00.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 zonegroup default 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103615d3f0 con 0x561036155950 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103615f170 con 0x56103615a3e0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103615f650 con 0x56103615a3e0 2024-09-21T08:52:00.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 started sync module instance, tier type = 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.956+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615e610 con 0x7f1458074070 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.958+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.958+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94627626871568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615e610 con 0x7f1458074070 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.958+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036160130 con 0x561036150f60 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.959+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94627626871568] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.959+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.959+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94627626875936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361600f0 con 0x561036150f60 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.959+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036160bf0 con 0x56103615a3e0 2024-09-21T08:52:00.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.960+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94627626875936] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.960+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.960+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94627626878688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036160fe0 con 0x56103615a3e0 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.960+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361619e0 con 0x7f1458074070 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.961+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94627626878688] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.961+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.961+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94627626882288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036161dd0 con 0x7f1458074070 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.961+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036162790 con 0x561036150f60 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.962+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.962+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94627626882288] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.962+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94627626885856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036162700 con 0x561036150f60 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.962+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615e180 con 0x561036155950 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.963+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94627626885856] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.963+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.963+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94627626888064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615e180 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.963+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036163d20 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.964+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94627626888064] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.964+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.964+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94627626889808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036163d20 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.965+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361646e0 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.965+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94627626889808] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94627626891376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361648c0 con 0x561036155950 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=0 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=1 2024-09-21T08:52:00.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=2 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=3 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=4 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=5 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=6 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94627626891376] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 20 add_watcher() i=7 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.966+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561036167ab0 con 0x561036150f60 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.967+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.967+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94627626894448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036164d40 con 0x561036150f60 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94627626894448] v34'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f131efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f146cf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f146cf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f146cf40800 5 note: GC not initialized 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f131dfe3640 20 reqs_thread_entry: start 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f146cf40800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.968+0000 7f146cf40800 20 Filter name: none 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f128f7fe640 20 reqs_thread_entry: start 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:52:00.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103619afa0 con 0x561036155950 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.969+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103619d080 con 0x7f1458074070 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56103619eb00 con 0x561036150f60 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:00.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.970+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361a30e0 con 0x7f1458074070 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.971+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 foo.buckets [call] v34'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.971+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361a8fa0 con 0x561036150f60 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f146cf40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f146cf40800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f146cf40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f146cf40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.972+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94627627131856 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610361a3510 con 0x561036155950 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== watch-notify(notify (1) cookie 94627626888064 notify 146028888068 ret 0) ==== 794+0+0 (crc 0 0 0) 0x561036148720 con 0x561036155950 2024-09-21T08:52:00.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f133ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94627626888064 notifier 4510 bl.length()=752 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f133ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(67 notify.5 [notify cookie 94627627131856 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f133ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f133ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f133ffff640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f132c003ea0 con 0x561036155950 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== watch-notify(notify_complete (2) cookie 94627627131856 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561036145a70 con 0x561036155950 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f146cf40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f146cf40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f146cf40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f146cf40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.973+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103619e3d0 con 0x561036155950 2024-09-21T08:52:00.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.974+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(69 fud.buckets [call] v34'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.974+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361a8810 con 0x7f1458074070 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.975+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.975+0000 7f146cf40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.975+0000 7f146cf40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.975+0000 7f146cf40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.975+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94627627131856 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610361a7cb0 con 0x561036155950 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== watch-notify(notify (1) cookie 94627626889808 notify 146028888069 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5610361457e0 con 0x561036155950 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f133ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94627626889808 notifier 4510 bl.length()=314 2024-09-21T08:52:00.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f133ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f133ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(71 notify.6 [notify cookie 94627627131856 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f133ffff640 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f132c003ea0 con 0x561036155950 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.976+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== watch-notify(notify_complete (2) cookie 94627627131856 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56103613e800 con 0x561036155950 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.977+0000 7f131efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:00.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.977+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94627626894448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036198cf0 con 0x561036150f60 2024-09-21T08:52:00.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.978+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94627626894448] v34'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:00.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.978+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94627626871568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036198cf0 con 0x7f1458074070 2024-09-21T08:52:00.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.979+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94627626871568] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.979+0000 7f146cf40800 20 remove_watcher() i=0 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.979+0000 7f146cf40800 2 removed watcher, disabling cache 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.979+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94627626875936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036198cf0 con 0x561036150f60 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.980+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94627626875936] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.980+0000 7f146cf40800 20 remove_watcher() i=1 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.980+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94627626878688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561036198cf0 con 0x56103615a3e0 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.981+0000 7f1468cd1640 1 -- 172.21.15.196:0/2228536965 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94627626878688] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1458099030 con 0x56103615a3e0 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.981+0000 7f146cf40800 20 remove_watcher() i=2 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.981+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94627626882288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615eb10 con 0x7f1458074070 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.982+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94627626882288] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x7f1458074070 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.982+0000 7f146cf40800 20 remove_watcher() i=3 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.982+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94627626885856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615fc20 con 0x561036150f60 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.983+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94627626885856] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002b040 con 0x561036150f60 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.983+0000 7f146cf40800 20 remove_watcher() i=4 2024-09-21T08:52:01.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.983+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94627626888064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361622e0 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.984+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94627626888064] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.984+0000 7f146cf40800 20 remove_watcher() i=5 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.984+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94627626889808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56103615fc20 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.985+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94627626889808] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.985+0000 7f146cf40800 20 remove_watcher() i=6 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.985+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94627626891376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610361622e0 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f14694d2640 1 -- 172.21.15.196:0/2228536965 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94627626891376] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146002a070 con 0x561036155950 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 20 remove_watcher() i=7 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561036155950 msgr2=0x561036157d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561036155950 0x561036157d40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561036150f60 msgr2=0x561036153420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561036150f60 0x561036153420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1458074070 msgr2=0x7f1458051600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1458074070 0x7f1458051600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56103615a3e0 msgr2=0x56103615c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56103615a3e0 0x56103615c8a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1334036b90 msgr2=0x7f1334039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1334036b90 0x7f1334039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1458005b50 tx=0x7f145807f000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 msgr2=0x5610361452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f14684d0640 1 -- 172.21.15.196:0/2228536965 reap_dead start 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f146004bab0 tx=0x7f146004cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 shutdown_connections 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 --2- 172.21.15.196:0/2228536965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103613de30 0x5610361452a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 >> 172.21.15.196:0/2228536965 conn(0x56103613a190 msgr2=0x561036138260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 shutdown_connections 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.986+0000 7f146cf40800 1 -- 172.21.15.196:0/2228536965 wait complete. 2024-09-21T08:52:01.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 msgr2=0x7f1340039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 0x7f1340039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56103611def0 tx=0x7f145808eff0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 msgr2=0x5610361315f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x56103611de50 tx=0x7f1460018830 comp rx=0 tx=0).stop 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 shutdown_connections 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1340036b90 0x7f1340039050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/2601135622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5610361311d0 0x5610361315f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 >> 172.21.15.196:0/2601135622 conn(0x561036126160 msgr2=0x561036128ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 shutdown_connections 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/2601135622 wait complete. 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 msgr2=0x561036122190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 0x561036122190 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 msgr2=0x56103611d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.003 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 0x56103611d530 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 msgr2=0x7f1350039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 0x7f1350039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1450000f60 tx=0x7f1450001370 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 msgr2=0x5610361164c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1458059040 tx=0x7f1458002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 shutdown_connections 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56103611fda0 0x561036122190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56103601d500 0x56103611d530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1350036b40 0x7f1350039000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 --2- 172.21.15.196:0/4204468267 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56103601cbc0 0x5610361164c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 >> 172.21.15.196:0/4204468267 conn(0x5610360175e0 msgr2=0x561036104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 shutdown_connections 2024-09-21T08:52:01.004 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:00.987+0000 7f146cf40800 1 -- 172.21.15.196:0/4204468267 wait complete. 2024-09-21T08:52:01.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T08:52:01.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T08:52:01.005 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T08:52:01.049 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.049 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.047+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.047+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.047+0000 7f118bd40800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c912469630 0x55c9124f8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.047+0000 7f118bd40800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9123b4b30 con 0x55c9124f8790 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.047+0000 7f118bd40800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c912396360 con 0x55c912469630 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f1187aca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c912469630 0x55c9124f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f1187aca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c912469630 0x55c9124f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35640/0 (socket says 172.21.15.196:35640) 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f1187aca640 1 -- 172.21.15.196:0/3558995162 learned_addr learned my addr 172.21.15.196:0/3558995162 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f117ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c9124f8790 0x55c9124fab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47090/0 (socket says 172.21.15.196:47090) 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f1187aca640 1 -- 172.21.15.196:0/3558995162 >> v1:172.21.15.29:6789/0 conn(0x55c9124f8790 legacy=0x55c9124fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.048+0000 7f1187aca640 1 -- 172.21.15.196:0/3558995162 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9123bce00 con 0x55c912469630 2024-09-21T08:52:01.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.050+0000 7f1187aca640 1 --2- 172.21.15.196:0/3558995162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9124f8250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f117800a520 tx=0x7f1178045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493eb21fc146ed55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.050+0000 7f11872c9640 1 -- 172.21.15.196:0/3558995162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178055070 con 0x55c912469630 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.050+0000 7f11872c9640 1 -- 172.21.15.196:0/3558995162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11780515b0 con 0x55c912469630 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.050+0000 7f11872c9640 1 -- 172.21.15.196:0/3558995162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11780518d0 con 0x55c912469630 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 -- 172.21.15.196:0/3558995162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 msgr2=0x55c9124f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 --2- 172.21.15.196:0/3558995162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9124f8250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f117800a520 tx=0x7f1178045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 -- 172.21.15.196:0/3558995162 shutdown_connections 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 --2- 172.21.15.196:0/3558995162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9124f8250 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 -- 172.21.15.196:0/3558995162 >> 172.21.15.196:0/3558995162 conn(0x55c9124efde0 msgr2=0x55c9124f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 -- 172.21.15.196:0/3558995162 shutdown_connections 2024-09-21T08:52:01.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.051+0000 7f118bd40800 1 -- 172.21.15.196:0/3558995162 wait complete. 2024-09-21T08:52:01.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.064+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.064+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.064+0000 7f118bd40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.064+0000 7f118bd40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c912441330 con 0x55c912469630 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1187aca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1187aca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35656/0 (socket says 172.21.15.196:35656) 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1187aca640 1 -- 172.21.15.196:0/4260369890 learned_addr learned my addr 172.21.15.196:0/4260369890 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1187aca640 1 -- 172.21.15.196:0/4260369890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91238ebc0 con 0x55c912469630 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1187aca640 1 --2- 172.21.15.196:0/4260369890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1178025da0 tx=0x7f1178051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37e543ea7a3ae95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1075e0b640 1 -- 172.21.15.196:0/4260369890 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178051890 con 0x55c912469630 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1075e0b640 1 -- 172.21.15.196:0/4260369890 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1178051ac0 con 0x55c912469630 2024-09-21T08:52:01.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.065+0000 7f1075e0b640 1 -- 172.21.15.196:0/4260369890 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178051da0 con 0x55c912469630 2024-09-21T08:52:01.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- 172.21.15.196:0/4260369890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 msgr2=0x55c9125e4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 --2- 172.21.15.196:0/4260369890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1178025da0 tx=0x7f1178051000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- 172.21.15.196:0/4260369890 shutdown_connections 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 --2- 172.21.15.196:0/4260369890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125e4890 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- 172.21.15.196:0/4260369890 >> 172.21.15.196:0/4260369890 conn(0x55c9124efde0 msgr2=0x55c9125e0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- 172.21.15.196:0/4260369890 shutdown_connections 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- 172.21.15.196:0/4260369890 wait complete. 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.066+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f118bd40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f118bd40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9124fc690 con 0x55c912469630 2024-09-21T08:52:01.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f1187aca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f1187aca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35672/0 (socket says 172.21.15.196:35672) 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f1187aca640 1 -- 172.21.15.196:0/2415943745 learned_addr learned my addr 172.21.15.196:0/2415943745 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f1187aca640 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9123a2fe0 con 0x55c912469630 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.067+0000 7f1187aca640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1178000c00 tx=0x7f1178002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f106ffff640 1 -- 172.21.15.196:0/2415943745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178073070 con 0x55c912469630 2024-09-21T08:52:01.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f106ffff640 1 -- 172.21.15.196:0/2415943745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117805a450 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9125ec640 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f106ffff640 1 -- 172.21.15.196:0/2415943745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117805a730 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9125ecbc0 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.068+0000 7f106ffff640 1 -- 172.21.15.196:0/2415943745 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1178076070 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f106ffff640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 0x7f1070039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f106ffff640 1 -- 172.21.15.196:0/2415943745 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f1178062070 con 0x55c912469630 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f117ffff640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 0x7f1070039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 0x55c9125f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9125f3790 con 0x55c9124f8790 2024-09-21T08:52:01.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f11882cb640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 0x55c9125f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f117ffff640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 0x7f1070039000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1170000f60 tx=0x7f1170001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f11882cb640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 0x55c9125f3170 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f11882cb640 1 -- 172.21.15.196:0/2415943745 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f118000a4a0 con 0x55c9124f8790 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.069+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9125f0740 con 0x55c9124f8790 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.070+0000 7f11882cb640 1 -- 172.21.15.196:0/2415943745 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f118000a4a0 con 0x55c9124f8790 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.070+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 0x55c9125f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.070+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9125f85f0 con 0x55c9125f5b10 2024-09-21T08:52:01.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.070+0000 7f1187aca640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 0x55c9125f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.070+0000 7f1187aca640 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 0x55c9125f7f00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.071+0000 7f1187aca640 1 -- 172.21.15.196:0/2415943745 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f117807f070 con 0x55c9125f5b10 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.071+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9125f49b0 con 0x55c9124f8790 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.071+0000 7f11882cb640 1 -- 172.21.15.196:0/2415943745 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f118000a4a0 con 0x55c9124f8790 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.071+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9125f4e50 con 0x55c9124f8790 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.071+0000 7f11882cb640 1 -- 172.21.15.196:0/2415943745 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f118000a4a0 con 0x55c9124f8790 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f118bd40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f118bd40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c912390580 con 0x55c912606f40 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35686/0 (socket says 172.21.15.196:35686) 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f11882cb640 1 -- 172.21.15.196:0/2721561189 learned_addr learned my addr 172.21.15.196:0/2721561189 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.072+0000 7f11882cb640 1 -- 172.21.15.196:0/2721561189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9126078a0 con 0x55c912606f40 2024-09-21T08:52:01.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f11882cb640 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55c9125f3b70 tx=0x7f1180018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f106d7fa640 1 -- 172.21.15.196:0/2721561189 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1180014450 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f106d7fa640 1 -- 172.21.15.196:0/2721561189 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180014610 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c912607b30 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f106d7fa640 1 -- 172.21.15.196:0/2721561189 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1180014930 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.073+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91260a810 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f106d7fa640 1 -- 172.21.15.196:0/2721561189 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1180011040 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f106d7fa640 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 0x7f1060039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f106d7fa640 1 -- 172.21.15.196:0/2721561189 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f118001e070 con 0x55c912606f40 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f1187aca640 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 0x7f1060039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f1187aca640 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 0x7f1060039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1178050c70 tx=0x7f117806f420 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f118bd40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f118bd40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9125e4f80 con 0x55c9124f5480 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35688/0 (socket says 172.21.15.196:35688) 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.074+0000 7f11882cb640 1 -- 172.21.15.196:0/3337642254 learned_addr learned my addr 172.21.15.196:0/3337642254 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f11882cb640 1 -- 172.21.15.196:0/3337642254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9124f5e50 con 0x55c9124f5480 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f11882cb640 1 --2- 172.21.15.196:0/3337642254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f118004cc70 tx=0x7f118004ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b719f291354de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f1066ffd640 1 -- 172.21.15.196:0/3337642254 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1180042070 con 0x55c9124f5480 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f1066ffd640 1 -- 172.21.15.196:0/3337642254 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180014c00 con 0x55c9124f5480 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f1066ffd640 1 -- 172.21.15.196:0/3337642254 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118002b480 con 0x55c9124f5480 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f118bd40800 1 -- 172.21.15.196:0/3337642254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 msgr2=0x55c9124f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f118bd40800 1 --2- 172.21.15.196:0/3337642254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f118004cc70 tx=0x7f118004ce70 comp rx=0 tx=0).stop 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f118bd40800 1 -- 172.21.15.196:0/3337642254 shutdown_connections 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f118bd40800 1 --2- 172.21.15.196:0/3337642254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c9124f5880 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.075+0000 7f118bd40800 1 -- 172.21.15.196:0/3337642254 >> 172.21.15.196:0/3337642254 conn(0x55c91260ff00 msgr2=0x55c91260e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 -- 172.21.15.196:0/3337642254 shutdown_connections 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 -- 172.21.15.196:0/3337642254 wait complete. 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 Processor -- start 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 -- start start 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f118bd40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9124f41b0 con 0x55c9124f5480 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f11882cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35700/0 (socket says 172.21.15.196:35700) 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 learned_addr learned my addr 172.21.15.196:0/2012411617 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.076+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91261d780 con 0x55c9124f5480 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f11882cb640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f118004cc70 tx=0x7f118004cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f10657fa640 1 -- 172.21.15.196:0/2012411617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1180011980 con 0x55c9124f5480 2024-09-21T08:52:01.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f10657fa640 1 -- 172.21.15.196:0/2012411617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180033070 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c91261da10 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f10657fa640 1 -- 172.21.15.196:0/2012411617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118004e100 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9126206c0 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.077+0000 7f10657fa640 1 -- 172.21.15.196:0/2012411617 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f118004e2a0 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f10657fa640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1050036b90 0x7f1050039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f10657fa640 1 -- 172.21.15.196:0/2012411617 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f118000e040 con 0x55c9124f5480 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f1187aca640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1050036b90 0x7f1050039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f1187aca640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1050036b90 0x7f1050039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1178051780 tx=0x7f1178090f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c912628f00 0x55c91262b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.078+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91262bb10 con 0x55c912628f00 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f117ffff640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c912628f00 0x55c91262b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f117ffff640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c912628f00 0x55c91262b3c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f117000f610 con 0x55c912628f00 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 20 realm 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912628350 con 0x55c912628f00 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f117000f610 con 0x55c912628f00 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91262c600 con 0x55c912628f00 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.079+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f117000f610 con 0x55c912628f00 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91262ced0 con 0x55c912628f00 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f117000f610 con 0x55c912628f00 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c91262d8f0 0x55c91262fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9126303d0 con 0x55c91262d8f0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.080+0000 7f11882cb640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c91262d8f0 0x55c91262fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f11882cb640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c91262d8f0 0x55c91262fce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f118bd40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f118bd40800 20 searching for the correct realm 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c9126323a0 0x55c912634860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f1187aca640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c9126323a0 0x55c912634860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.081+0000 7f1187aca640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c9126323a0 0x55c912634860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f1187aca640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1178078070 0x7f11780670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f117ffff640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1178078070 0x7f11780670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f117ffff640 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1178078070 0x7f11780670d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117000f610 con 0x7f1178078070 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.082+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117000f610 con 0x55c912628f00 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.083+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.084+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.085+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.086+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.087+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.088+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c9126323a0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c91262d8f0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x55c912628f00 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.089+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c912634f30 con 0x7f1178078070 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912630d90 con 0x55c912628f00 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9126309d0 con 0x55c912628f00 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912631730 con 0x55c912628f00 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 zone default found 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 4 Realm: () 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 zonegroup default 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.090+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912635440 con 0x55c91262d8f0 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912637710 con 0x55c9126323a0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912637ab0 con 0x55c9126323a0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 started sync module instance, tier type = 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.091+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912636b50 con 0x7f1178078070 2024-09-21T08:52:01.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.092+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.092+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322085294240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912636b50 con 0x7f1178078070 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.092+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126384b0 con 0x55c912628f00 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.093+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322085294240] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.093+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.093+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322085298112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912636b50 con 0x55c912628f00 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.093+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912638f70 con 0x55c9126323a0 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.094+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.094+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322085300800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912639810 con 0x55c9126323a0 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.094+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263a2d0 con 0x7f1178078070 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.095+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322085298112] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.095+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322085300800] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.096+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.096+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322085303136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126366a0 con 0x7f1178078070 2024-09-21T08:52:01.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.096+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263ab70 con 0x55c912628f00 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.097+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322085303136] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.097+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.097+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322085305760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263aaf0 con 0x55c912628f00 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.097+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263b580 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.098+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322085305760] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.098+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.098+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322085307968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263aa60 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.098+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263c3f0 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.099+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322085307968] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.099+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.099+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322085312800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263c3f0 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.099+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263cdb0 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322085312800] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322085316864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263cd20 con 0x55c91262d8f0 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=0 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=1 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=2 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=3 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=4 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=5 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.100+0000 7f118bd40800 20 add_watcher() i=6 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322085316864] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f118bd40800 20 add_watcher() i=7 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f118bd40800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9126401b0 con 0x55c912628f00 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.101+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322085314368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263d6d0 con 0x55c912628f00 2024-09-21T08:52:01.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.102+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322085314368] v34'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.102+0000 7f103dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.102+0000 7f118bd40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.102+0000 7f118bd40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.103+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912640060 con 0x55c912628f00 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.104+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.104+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912649420 con 0x55c91262d8f0 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.105+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.105+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912649420 con 0x55c9126323a0 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.106+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.106+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912649b00 con 0x55c912628f00 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.107+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.107+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264a090 con 0x7f1178078070 2024-09-21T08:52:01.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.108+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.108+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264a540 con 0x55c9126323a0 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.109+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.109+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264a8e0 con 0x55c912628f00 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.110+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.110+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x55c91262d8f0 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.111+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.111+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x7f1178078070 2024-09-21T08:52:01.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.112+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.113+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x55c9126323a0 2024-09-21T08:52:01.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.113+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.114+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x7f1178078070 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.114+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.114+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x55c91262d8f0 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.115+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.115+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x7f1178078070 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.116+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.116+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad00 con 0x55c91262d8f0 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.118+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.118+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264adc0 con 0x55c912628f00 2024-09-21T08:52:01.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.118+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.119+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264adc0 con 0x55c9126323a0 2024-09-21T08:52:01.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.119+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.119+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x7f1178078070 2024-09-21T08:52:01.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.120+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.121+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.121+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.121+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c912628f00 2024-09-21T08:52:01.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.122+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.122+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c912628f00 2024-09-21T08:52:01.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.123+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.123+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.124+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.124+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x7f1178078070 2024-09-21T08:52:01.127 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.125+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.125+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.126+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.126+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.127+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.127+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.128+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.128+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.129+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.129+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c91262d8f0 2024-09-21T08:52:01.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.130+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.130+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.131+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.131+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c91262d8f0 2024-09-21T08:52:01.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.132+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.133+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c9126323a0 2024-09-21T08:52:01.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.134+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.134+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x55c91262d8f0 2024-09-21T08:52:01.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.135+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.135+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91264ad90 con 0x7f1178078070 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f103cfe1640 20 reqs_thread_entry: start 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f118bd40800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f118bd40800 20 Filter name: none 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f0fb67fc640 20 reqs_thread_entry: start 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f118bd40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f118bd40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.136+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c912676000 con 0x55c91262d8f0 2024-09-21T08:52:01.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f118bd40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f118bd40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f118bd40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f118bd40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9126788c0 con 0x55c91262d8f0 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.137+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.138+0000 7f103dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.138+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322085314368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126228a0 con 0x55c912628f00 2024-09-21T08:52:01.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.139+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94322085314368] v34'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.139+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322085294240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263bf40 con 0x7f1178078070 2024-09-21T08:52:01.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.140+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94322085294240] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.140+0000 7f118bd40800 20 remove_watcher() i=0 2024-09-21T08:52:01.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.140+0000 7f118bd40800 2 removed watcher, disabling cache 2024-09-21T08:52:01.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.140+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322085298112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126370a0 con 0x55c912628f00 2024-09-21T08:52:01.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.141+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94322085298112] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.141+0000 7f118bd40800 20 remove_watcher() i=1 2024-09-21T08:52:01.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.141+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322085300800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126370a0 con 0x55c9126323a0 2024-09-21T08:52:01.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.142+0000 7f1187aca640 1 -- 172.21.15.196:0/2012411617 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94322085300800] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117807f070 con 0x55c9126323a0 2024-09-21T08:52:01.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.142+0000 7f118bd40800 20 remove_watcher() i=2 2024-09-21T08:52:01.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.142+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322085303136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912638a40 con 0x7f1178078070 2024-09-21T08:52:01.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.143+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94322085303136] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x7f1178078070 2024-09-21T08:52:01.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.143+0000 7f118bd40800 20 remove_watcher() i=3 2024-09-21T08:52:01.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.143+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322085305760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126370a0 con 0x55c912628f00 2024-09-21T08:52:01.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.144+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94322085305760] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f117002b040 con 0x55c912628f00 2024-09-21T08:52:01.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.144+0000 7f118bd40800 20 remove_watcher() i=4 2024-09-21T08:52:01.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.144+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322085307968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c912638a40 con 0x55c91262d8f0 2024-09-21T08:52:01.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.145+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94322085307968] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.145+0000 7f118bd40800 20 remove_watcher() i=5 2024-09-21T08:52:01.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.145+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322085312800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9126370a0 con 0x55c91262d8f0 2024-09-21T08:52:01.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.146+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94322085312800] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.146+0000 7f118bd40800 20 remove_watcher() i=6 2024-09-21T08:52:01.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.146+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322085316864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c91263a640 con 0x55c91262d8f0 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f11882cb640 1 -- 172.21.15.196:0/2012411617 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94322085316864] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118002a070 con 0x55c91262d8f0 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 20 remove_watcher() i=7 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c91262d8f0 msgr2=0x55c91262fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c91262d8f0 0x55c91262fce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c912628f00 msgr2=0x55c91262b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c912628f00 0x55c91262b3c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1178078070 msgr2=0x7f11780670d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1178078070 0x7f11780670d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c9126323a0 msgr2=0x55c912634860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c9126323a0 0x55c912634860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1050036b90 msgr2=0x7f1050039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1050036b90 0x7f1050039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1178051780 tx=0x7f1178090f90 comp rx=0 tx=0).stop 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 msgr2=0x55c91261d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f118004cc70 tx=0x7f118004cc00 comp rx=0 tx=0).stop 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f117ffff640 1 -- 172.21.15.196:0/2012411617 reap_dead start 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 shutdown_connections 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 --2- 172.21.15.196:0/2012411617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9124f5480 0x55c91261d240 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.147+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 >> 172.21.15.196:0/2012411617 conn(0x55c91260ff00 msgr2=0x55c91260dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 shutdown_connections 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2012411617 wait complete. 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 msgr2=0x7f1060039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 0x7f1060039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1178050c70 tx=0x7f117806f420 comp rx=0 tx=0).stop 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 msgr2=0x55c912607360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55c9125f3b70 tx=0x7f1180018830 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 shutdown_connections 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1060036b90 0x7f1060039050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2721561189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912606f40 0x55c912607360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 >> 172.21.15.196:0/2721561189 conn(0x55c9125fbed0 msgr2=0x55c9125fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 shutdown_connections 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2721561189 wait complete. 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 msgr2=0x55c9125f7f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 0x55c9125f7f00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 msgr2=0x55c9125f3170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 0x55c9125f3170 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 msgr2=0x7f1070039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 0x7f1070039000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1170000f60 tx=0x7f1170001370 comp rx=0 tx=0).stop 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 msgr2=0x55c9125ec100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1178000c00 tx=0x7f1178002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 shutdown_connections 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c9125f5b10 0x55c9125f7f00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c9124f8790 0x55c9125f3170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1070036b40 0x7f1070039000 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 --2- 172.21.15.196:0/2415943745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c912469630 0x55c9125ec100 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 >> 172.21.15.196:0/2415943745 conn(0x55c9124efde0 msgr2=0x55c9125deac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.148+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 shutdown_connections 2024-09-21T08:52:01.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.149+0000 7f118bd40800 1 -- 172.21.15.196:0/2415943745 wait complete. 2024-09-21T08:52:01.159 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T08:52:01.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-21T08:52:01.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-21T08:52:01.160 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-21T08:52:01.206 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.206 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.204+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.204+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.204+0000 7f4e34615800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ad549b9900 0x55ad549bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.204+0000 7f4e34615800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad54874b30 con 0x55ad54929650 2024-09-21T08:52:01.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.204+0000 7f4e34615800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ad54856360 con 0x55ad549b9900 2024-09-21T08:52:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.205+0000 7f4e2f59b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ad549b9900 0x55ad549bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.205+0000 7f4e2fd9c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ad54929650 0x55ad549b81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:47106/0 (socket says 172.21.15.196:47106) 2024-09-21T08:52:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.205+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/1787392705 learned_addr learned my addr 172.21.15.196:0/1787392705 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.205+0000 7f4e2f59b640 1 -- 172.21.15.196:0/1787392705 >> v1:172.21.15.29:6789/0 conn(0x55ad54929650 legacy=0x55ad549b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.205+0000 7f4e2f59b640 1 -- 172.21.15.196:0/1787392705 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5487ce00 con 0x55ad549b9900 2024-09-21T08:52:01.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.207+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/1787392705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad549b9900 0x55ad549bbcf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400a470 tx=0x7f4e24045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76fe94c8abf0316 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.207+0000 7f4e2ed9a640 1 -- 172.21.15.196:0/1787392705 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e24053570 con 0x55ad549b9900 2024-09-21T08:52:01.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.207+0000 7f4e2ed9a640 1 -- 172.21.15.196:0/1787392705 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e24058070 con 0x55ad549b9900 2024-09-21T08:52:01.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.207+0000 7f4e2ed9a640 1 -- 172.21.15.196:0/1787392705 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e24053880 con 0x55ad549b9900 2024-09-21T08:52:01.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 -- 172.21.15.196:0/1787392705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad549b9900 msgr2=0x55ad549bbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 --2- 172.21.15.196:0/1787392705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad549b9900 0x55ad549bbcf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400a470 tx=0x7f4e24045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:01.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 -- 172.21.15.196:0/1787392705 shutdown_connections 2024-09-21T08:52:01.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 --2- 172.21.15.196:0/1787392705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad549b9900 0x55ad549bbcf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 -- 172.21.15.196:0/1787392705 >> 172.21.15.196:0/1787392705 conn(0x55ad549afdb0 msgr2=0x55ad549b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 -- 172.21.15.196:0/1787392705 shutdown_connections 2024-09-21T08:52:01.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.208+0000 7f4e34615800 1 -- 172.21.15.196:0/1787392705 wait complete. 2024-09-21T08:52:01.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.221+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.221+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.221+0000 7f4e34615800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.221+0000 7f4e34615800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad54901360 con 0x55ad54929650 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4e2fd9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4e2fd9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37084/0 (socket says 172.21.15.196:37084) 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/1176777813 learned_addr learned my addr 172.21.15.196:0/1176777813 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/1176777813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5484ebc0 con 0x55ad54929650 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/1176777813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001e10 tx=0x7f4e2000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd750b2c489021f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4d1de0b640 1 -- 172.21.15.196:0/1176777813 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e20012020 con 0x55ad54929650 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4d1de0b640 1 -- 172.21.15.196:0/1176777813 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2000e5a0 con 0x55ad54929650 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.222+0000 7f4d1de0b640 1 -- 172.21.15.196:0/1176777813 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2000e8e0 con 0x55ad54929650 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- 172.21.15.196:0/1176777813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 msgr2=0x55ad54aa4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 --2- 172.21.15.196:0/1176777813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001e10 tx=0x7f4e2000b780 comp rx=0 tx=0).stop 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- 172.21.15.196:0/1176777813 shutdown_connections 2024-09-21T08:52:01.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 --2- 172.21.15.196:0/1176777813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad54aa4860 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- 172.21.15.196:0/1176777813 >> 172.21.15.196:0/1176777813 conn(0x55ad549afdb0 msgr2=0x55ad54aa0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- 172.21.15.196:0/1176777813 shutdown_connections 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- 172.21.15.196:0/1176777813 wait complete. 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.223+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e34615800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e34615800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad549bc620 con 0x55ad54929650 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e2fd9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e2fd9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37094/0 (socket says 172.21.15.196:37094) 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/2694220757 learned_addr learned my addr 172.21.15.196:0/2694220757 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad54862fe0 con 0x55ad54929650 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001e10 tx=0x7f4e20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4d17fff640 1 -- 172.21.15.196:0/2694220757 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e20012030 con 0x55ad54929650 2024-09-21T08:52:01.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4d17fff640 1 -- 172.21.15.196:0/2694220757 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2001a7a0 con 0x55ad54929650 2024-09-21T08:52:01.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad549b4200 con 0x55ad54929650 2024-09-21T08:52:01.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.224+0000 7f4d17fff640 1 -- 172.21.15.196:0/2694220757 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e2001aac0 con 0x55ad54929650 2024-09-21T08:52:01.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.225+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad549b4720 con 0x55ad54929650 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.225+0000 7f4d17fff640 1 -- 172.21.15.196:0/2694220757 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e20015020 con 0x55ad54929650 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.225+0000 7f4d17fff640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 0x7f4d18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4d17fff640 1 -- 172.21.15.196:0/2694220757 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4e20020030 con 0x55ad54929650 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 0x7f4d18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 0x55ad54ab5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54ab5b70 con 0x55ad549b9900 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e3059d640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 0x55ad54ab5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 0x7f4d18039000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e24057000 tx=0x7f4e24052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e3059d640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 0x55ad54ab5630 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e3059d640 1 -- 172.21.15.196:0/2694220757 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e2800a4a0 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.226+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54ab63c0 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e3059d640 1 -- 172.21.15.196:0/2694220757 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e2800a4a0 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 0x55ad54aba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54aba920 con 0x55ad54ab7cd0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 0x55ad54aba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 0x55ad54aba190 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.227+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/2694220757 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54ab7cd0 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54ab6c10 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e3059d640 1 -- 172.21.15.196:0/2694220757 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e2800a4a0 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54ab6fb0 con 0x55ad549b9900 2024-09-21T08:52:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e3059d640 1 -- 172.21.15.196:0/2694220757 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e2800a4a0 con 0x55ad549b9900 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.228+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e34615800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e34615800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad549b6050 con 0x55ad54ac92a0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37108/0 (socket says 172.21.15.196:37108) 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e3059d640 1 -- 172.21.15.196:0/2334554326 learned_addr learned my addr 172.21.15.196:0/2334554326 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e3059d640 1 -- 172.21.15.196:0/2334554326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad54ac9c00 con 0x55ad54ac92a0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e3059d640 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55ad549b5500 tx=0x7f4e280188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4d157fa640 1 -- 172.21.15.196:0/2334554326 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e28014450 con 0x55ad54ac92a0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4d157fa640 1 -- 172.21.15.196:0/2334554326 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e280145f0 con 0x55ad54ac92a0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad54ac9e90 con 0x55ad54ac92a0 2024-09-21T08:52:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.229+0000 7f4d157fa640 1 -- 172.21.15.196:0/2334554326 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e280148d0 con 0x55ad54ac92a0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.230+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad54accb70 con 0x55ad54ac92a0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.230+0000 7f4d157fa640 1 -- 172.21.15.196:0/2334554326 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e28011040 con 0x55ad54ac92a0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.230+0000 7f4d157fa640 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 0x7f4d08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.230+0000 7f4d157fa640 1 -- 172.21.15.196:0/2334554326 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4e2801e070 con 0x55ad54ac92a0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 0x7f4d08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 0x7f4d08039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ad549b4bc0 tx=0x7f4e2002c4e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e34615800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e34615800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad54850580 con 0x55ad54ad5f40 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37116/0 (socket says 172.21.15.196:37116) 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e3059d640 1 -- 172.21.15.196:0/2888277043 learned_addr learned my addr 172.21.15.196:0/2888277043 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.231+0000 7f4e3059d640 1 -- 172.21.15.196:0/2888277043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad54ad6910 con 0x55ad54ad5f40 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e3059d640 1 --2- 172.21.15.196:0/2888277043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4e2804cbb0 tx=0x7f4e28011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9475e76d3fba2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4d0effd640 1 -- 172.21.15.196:0/2888277043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e28013dc0 con 0x55ad54ad5f40 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4d0effd640 1 -- 172.21.15.196:0/2888277043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e28014a70 con 0x55ad54ad5f40 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4d0effd640 1 -- 172.21.15.196:0/2888277043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e28014d50 con 0x55ad54ad5f40 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 -- 172.21.15.196:0/2888277043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 msgr2=0x55ad54ad6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 --2- 172.21.15.196:0/2888277043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4e2804cbb0 tx=0x7f4e28011970 comp rx=0 tx=0).stop 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 -- 172.21.15.196:0/2888277043 shutdown_connections 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 --2- 172.21.15.196:0/2888277043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54ad6340 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 -- 172.21.15.196:0/2888277043 >> 172.21.15.196:0/2888277043 conn(0x55ad54ad2250 msgr2=0x55ad54ad03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 -- 172.21.15.196:0/2888277043 shutdown_connections 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 -- 172.21.15.196:0/2888277043 wait complete. 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.232+0000 7f4e34615800 1 Processor -- start 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e34615800 1 -- start start 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e34615800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e34615800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad54ad6da0 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e3059d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37122/0 (socket says 172.21.15.196:37122) 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 learned_addr learned my addr 172.21.15.196:0/805941139 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad54add770 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e3059d640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4e28011be0 tx=0x7f4e2804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4d0d7fa640 1 -- 172.21.15.196:0/805941139 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e28044030 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4d0d7fa640 1 -- 172.21.15.196:0/805941139 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e28022a80 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad54adda00 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.233+0000 7f4d0d7fa640 1 -- 172.21.15.196:0/805941139 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e28022d80 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.234+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad54ae06b0 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.234+0000 7f4d0d7fa640 1 -- 172.21.15.196:0/805941139 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e2802b350 con 0x55ad54ad5f40 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.234+0000 7f4d0d7fa640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cf8036b90 0x7f4cf8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.234+0000 7f4d0d7fa640 1 -- 172.21.15.196:0/805941139 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4e28045070 con 0x55ad54ad5f40 2024-09-21T08:52:01.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cf8036b90 0x7f4cf8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cf8036b90 0x7f4cf8039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001750 tx=0x7f4e20034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad54ae8f10 0x55ad54aeb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54aebb20 con 0x55ad54ae8f10 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.235+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad54ae8f10 0x55ad54aeb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad54ae8f10 0x55ad54aeb3d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 realm 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54aebf50 con 0x55ad54ae8f10 2024-09-21T08:52:01.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54aec820 con 0x55ad54ae8f10 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.236+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54aecbc0 con 0x55ad54ae8f10 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54aed920 0x55ad54aefd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af0320 con 0x55ad54aed920 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e3059d640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54aed920 0x55ad54aefd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.237+0000 7f4e3059d640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54aed920 0x55ad54aefd10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e34615800 20 searching for the correct realm 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad54af22b0 0x55ad54af4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad54af22b0 0x55ad54af4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad54af22b0 0x55ad54af4770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2fd9c640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4e20017050 0x7f4e2002c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.238+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4e20017050 0x7f4e2002c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.239+0000 7f4e2f59b640 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4e20017050 0x7f4e2002c5b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.239+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.239+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.239+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.239+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.240+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.241+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.242+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.243+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.244+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.245+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54af22b0 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54aed920 2024-09-21T08:52:01.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x55ad54ae8f10 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.246+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af4e40 con 0x7f4e20017050 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af1800 con 0x55ad54ae8f10 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af07b0 con 0x55ad54ae8f10 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af1130 con 0x55ad54ae8f10 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 zone default found 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 4 Realm: () 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 zonegroup default 2024-09-21T08:52:01.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.247+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af5770 con 0x55ad54aed920 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af79a0 con 0x55ad54af22b0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af7d40 con 0x55ad54af22b0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 started sync module instance, tier type = 2024-09-21T08:52:01.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.248+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af6de0 con 0x7f4e20017050 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.249+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.249+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94202938487600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af6de0 con 0x7f4e20017050 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.249+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af8700 con 0x55ad54ae8f10 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.250+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94202938487600] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.251+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.251+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94202938491952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af6de0 con 0x55ad54ae8f10 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.251+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af9170 con 0x55ad54af22b0 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.252+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94202938491952] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.252+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.252+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94202938485040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af6d50 con 0x55ad54af22b0 2024-09-21T08:52:01.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.252+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afa060 con 0x7f4e20017050 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.253+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94202938485040] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.253+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.253+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94202938497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afa480 con 0x7f4e20017050 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.253+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afad50 con 0x55ad54ae8f10 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.254+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.254+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94202938500224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afa8a0 con 0x55ad54ae8f10 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.254+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afbd00 con 0x55ad54aed920 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.254+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94202938497968] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.255+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94202938500224] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.255+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.255+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94202938503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afb7e0 con 0x55ad54aed920 2024-09-21T08:52:01.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.255+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afc5d0 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.256+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94202938503488] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.256+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.256+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94202938499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afc5d0 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.256+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afcff0 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94202938499024] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94202938510048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afd1d0 con 0x55ad54aed920 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=0 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=1 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=2 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=3 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=4 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=5 2024-09-21T08:52:01.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.257+0000 7f4e34615800 20 add_watcher() i=6 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94202938510048] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e34615800 20 add_watcher() i=7 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e34615800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b005a0 con 0x55ad54ae8f10 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.258+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94202938511552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afd990 con 0x55ad54ae8f10 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.259+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94202938511552] v34'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.259+0000 7f4ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 5 note: GC not initialized 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4ce4fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 20 Filter name: none 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4c5e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.260+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b337f0 con 0x55ad54aed920 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b358d0 con 0x7f4e20017050 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.261+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b372d0 con 0x55ad54ae8f10 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.262+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b387f0 con 0x55ad54aed920 2024-09-21T08:52:01.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(65 fud.buckets [call] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b38bf0 con 0x7f4e20017050 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.263+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b3e7e0 con 0x7f4e20017050 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e34615800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e34615800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e34615800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94202938761968 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b3bd50 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== watch-notify(notify (1) cookie 94202938499024 notify 146028888070 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55ad54ae06b0 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4d0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94202938499024 notifier 4524 bl.length()=338 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4d0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4d0effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4d0effd640 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4cf4003ea0 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(68 notify.6 [notify cookie 94202938761968 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.265+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== watch-notify(notify_complete (2) cookie 94202938761968 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad54adda00 con 0x55ad54aed920 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.266+0000 7f4ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.266+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94202938511552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b31540 con 0x55ad54ae8f10 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.267+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94202938511552] v34'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.267+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94202938487600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b31540 con 0x7f4e20017050 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.268+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94202938487600] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.268+0000 7f4e34615800 20 remove_watcher() i=0 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.268+0000 7f4e34615800 2 removed watcher, disabling cache 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.268+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94202938491952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b31540 con 0x55ad54ae8f10 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.269+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94202938491952] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.269+0000 7f4e34615800 20 remove_watcher() i=1 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.269+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94202938485040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54b31540 con 0x55ad54af22b0 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.270+0000 7f4e2fd9c640 1 -- 172.21.15.196:0/805941139 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94202938485040] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2000dcd0 con 0x55ad54af22b0 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.270+0000 7f4e34615800 20 remove_watcher() i=2 2024-09-21T08:52:01.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.270+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94202938497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af8430 con 0x7f4e20017050 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.271+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94202938497968] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x7f4e20017050 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.271+0000 7f4e34615800 20 remove_watcher() i=3 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.271+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94202938500224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af6930 con 0x55ad54ae8f10 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.272+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94202938500224] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e24051070 con 0x55ad54ae8f10 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.272+0000 7f4e34615800 20 remove_watcher() i=4 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.272+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94202938503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af9bb0 con 0x55ad54aed920 2024-09-21T08:52:01.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.273+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94202938503488] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.273+0000 7f4e34615800 20 remove_watcher() i=5 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.273+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94202938499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54af8430 con 0x55ad54aed920 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.274+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94202938499024] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.274+0000 7f4e34615800 20 remove_watcher() i=6 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.274+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94202938510048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad54afa480 con 0x55ad54aed920 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e3059d640 1 -- 172.21.15.196:0/805941139 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94202938510048] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e2802a070 con 0x55ad54aed920 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 20 remove_watcher() i=7 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54aed920 msgr2=0x55ad54aefd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54aed920 0x55ad54aefd10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad54ae8f10 msgr2=0x55ad54aeb3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad54ae8f10 0x55ad54aeb3d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4e20017050 msgr2=0x7f4e2002c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f4e20017050 0x7f4e2002c5b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad54af22b0 msgr2=0x55ad54af4770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad54af22b0 0x55ad54af4770 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cf8036b90 msgr2=0x7f4cf8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4cf8036b90 0x7f4cf8039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001750 tx=0x7f4e20034000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 msgr2=0x55ad54add230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4e28011be0 tx=0x7f4e2804cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e2f59b640 1 -- 172.21.15.196:0/805941139 reap_dead start 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 shutdown_connections 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 --2- 172.21.15.196:0/805941139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ad5f40 0x55ad54add230 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 >> 172.21.15.196:0/805941139 conn(0x55ad54ad2250 msgr2=0x55ad54ad0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 shutdown_connections 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.275+0000 7f4e34615800 1 -- 172.21.15.196:0/805941139 wait complete. 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 msgr2=0x7f4d08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 0x7f4d08039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ad549b4bc0 tx=0x7f4e2002c4e0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 msgr2=0x55ad54ac96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55ad549b5500 tx=0x7f4e280188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 shutdown_connections 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d08036b90 0x7f4d08039050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2334554326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54ac92a0 0x55ad54ac96c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 >> 172.21.15.196:0/2334554326 conn(0x55ad54abe230 msgr2=0x55ad54ac0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 shutdown_connections 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2334554326 wait complete. 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 msgr2=0x55ad54aba190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 0x55ad54aba190 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 msgr2=0x55ad54ab5630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 0x55ad54ab5630 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 msgr2=0x7f4d18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 0x7f4d18039000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e24057000 tx=0x7f4e24052000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 msgr2=0x55ad549b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4e20001e10 tx=0x7f4e20000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 shutdown_connections 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad54ab7cd0 0x55ad54aba190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad549b9900 0x55ad54ab5630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4d18036b40 0x7f4d18039000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 --2- 172.21.15.196:0/2694220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad54929650 0x55ad549b5b10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 >> 172.21.15.196:0/2694220757 conn(0x55ad549afdb0 msgr2=0x55ad54a9eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 shutdown_connections 2024-09-21T08:52:01.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.276+0000 7f4e34615800 1 -- 172.21.15.196:0/2694220757 wait complete. 2024-09-21T08:52:01.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1'] 2024-09-21T08:52:01.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1'] 2024-09-21T08:52:01.289 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:01.338 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.338 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.336+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.336+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff59ad3f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff59ad3f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7aaff9b30 con 0x55c7ab13d730 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff59ad3f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c7aafdb360 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff596a90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff596a90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37126/0 (socket says 172.21.15.196:37126) 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff596a90640 1 -- 172.21.15.196:0/3024767695 learned_addr learned my addr 172.21.15.196:0/3024767695 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff59628f640 1 --1- 172.21.15.196:0/3024767695 >> v1:172.21.15.29:6789/0 conn(0x55c7ab13d730 0x55c7ab13fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49446/0 (socket says 172.21.15.196:49446) 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff596a90640 1 -- 172.21.15.196:0/3024767695 >> v1:172.21.15.29:6789/0 conn(0x55c7ab13d730 legacy=0x55c7ab13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.337+0000 7ff596a90640 1 -- 172.21.15.196:0/3024767695 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ab001e00 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.339+0000 7ff596a90640 1 --2- 172.21.15.196:0/3024767695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff588005fd0 tx=0x7ff588045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaec33a246cc207 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.339+0000 7ff595a8e640 1 -- 172.21.15.196:0/3024767695 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58804e600 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.339+0000 7ff595a8e640 1 -- 172.21.15.196:0/3024767695 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58804e7a0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.339+0000 7ff595a8e640 1 -- 172.21.15.196:0/3024767695 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58804eaa0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3024767695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 msgr2=0x55c7ab13d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3024767695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff588005fd0 tx=0x7ff588045cf0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3024767695 shutdown_connections 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3024767695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab13d1f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3024767695 >> 172.21.15.196:0/3024767695 conn(0x55c7ab134e00 msgr2=0x55c7ab137220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3024767695 shutdown_connections 2024-09-21T08:52:01.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.340+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3024767695 wait complete. 2024-09-21T08:52:01.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.353+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.353+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff59ad3f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff59ad3f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c7ab086350 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff596a90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff596a90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37130/0 (socket says 172.21.15.196:37130) 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff596a90640 1 -- 172.21.15.196:0/4034702299 learned_addr learned my addr 172.21.15.196:0/4034702299 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff596a90640 1 -- 172.21.15.196:0/4034702299 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7aafd3bc0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.354+0000 7ff596a90640 1 --2- 172.21.15.196:0/4034702299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff58800a4b0 tx=0x7ff588050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3121c8207fd89a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff484e09640 1 -- 172.21.15.196:0/4034702299 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58804ea80 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff484e09640 1 -- 172.21.15.196:0/4034702299 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff588066070 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff484e09640 1 -- 172.21.15.196:0/4034702299 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58804edc0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4034702299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 msgr2=0x55c7ab2299b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/4034702299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff58800a4b0 tx=0x7ff588050000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4034702299 shutdown_connections 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/4034702299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab2299b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4034702299 >> 172.21.15.196:0/4034702299 conn(0x55c7ab134e00 msgr2=0x55c7ab225370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4034702299 shutdown_connections 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.355+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4034702299 wait complete. 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff59ad3f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff59ad3f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c7ab1416a0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff596a90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff596a90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37146/0 (socket says 172.21.15.196:37146) 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff596a90640 1 -- 172.21.15.196:0/2235279366 learned_addr learned my addr 172.21.15.196:0/2235279366 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff596a90640 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7aafe7fe0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.356+0000 7ff596a90640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff588063040 tx=0x7ff588003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.357+0000 7ff483606640 1 -- 172.21.15.196:0/2235279366 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff588076470 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.357+0000 7ff483606640 1 -- 172.21.15.196:0/2235279366 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff588071070 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.357+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7ab2317c0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.357+0000 7ff483606640 1 -- 172.21.15.196:0/2235279366 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff588076740 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.357+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ab231ce0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff483606640 1 -- 172.21.15.196:0/2235279366 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff58806d420 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff483606640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 0x7ff47c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff483606640 1 -- 172.21.15.196:0/2235279366 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff5880915a0 con 0x55c7ab0ae6d0 2024-09-21T08:52:01.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff59628f640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 0x7ff47c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 0x55c7ab2382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2388c0 con 0x55c7ab13d730 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff597291640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 0x55c7ab2382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff59628f640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 0x7ff47c039000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f60 tx=0x7ff58c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.358+0000 7ff597291640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 0x55c7ab2382f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff597291640 1 -- 172.21.15.196:0/2235279366 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5900083e0 con 0x55c7ab13d730 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2358a0 con 0x55c7ab13d730 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff597291640 1 -- 172.21.15.196:0/2235279366 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5900083e0 con 0x55c7ab13d730 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 0x55c7ab23cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab23d6e0 con 0x55c7ab23ac00 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff596a90640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 0x55c7ab23cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.359+0000 7ff596a90640 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 0x55c7ab23cff0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.360+0000 7ff596a90640 1 -- 172.21.15.196:0/2235279366 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab23ac00 2024-09-21T08:52:01.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.360+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab239aa0 con 0x55c7ab13d730 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.360+0000 7ff597291640 1 -- 172.21.15.196:0/2235279366 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5900083e0 con 0x55c7ab13d730 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.360+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab239f20 con 0x55c7ab13d730 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.360+0000 7ff597291640 1 -- 172.21.15.196:0/2235279366 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5900083e0 con 0x55c7ab13d730 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff59ad3f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff59ad3f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c7aafd5580 con 0x55c7ab24c070 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37162/0 (socket says 172.21.15.196:37162) 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff597291640 1 -- 172.21.15.196:0/2297685931 learned_addr learned my addr 172.21.15.196:0/2297685931 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.361+0000 7ff597291640 1 -- 172.21.15.196:0/2297685931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ab24c9d0 con 0x55c7ab24c070 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff597291640 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55c7ab2324a0 tx=0x7ff59000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff480e01640 1 -- 172.21.15.196:0/2297685931 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff590007d00 con 0x55c7ab24c070 2024-09-21T08:52:01.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff480e01640 1 -- 172.21.15.196:0/2297685931 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59001e020 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7ab24cc60 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff480e01640 1 -- 172.21.15.196:0/2297685931 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff590019590 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ab24f940 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.362+0000 7ff480e01640 1 -- 172.21.15.196:0/2297685931 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff590016040 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff480e01640 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 0x7ff470039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff480e01640 1 -- 172.21.15.196:0/2297685931 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff59001f030 con 0x55c7ab24c070 2024-09-21T08:52:01.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff596a90640 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 0x7ff470039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff596a90640 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 0x7ff470039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55c7ab238d70 tx=0x7ff58807f810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff59ad3f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff59ad3f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c7ab22a0a0 con 0x55c7ab258d30 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37172/0 (socket says 172.21.15.196:37172) 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.363+0000 7ff597291640 1 -- 172.21.15.196:0/4047129096 learned_addr learned my addr 172.21.15.196:0/4047129096 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff597291640 1 -- 172.21.15.196:0/4047129096 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ab259700 con 0x55c7ab258d30 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff597291640 1 --2- 172.21.15.196:0/4047129096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff590018fd0 tx=0x7ff590014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7974b355d3b9c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff47a7fc640 1 -- 172.21.15.196:0/4047129096 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff59001d040 con 0x55c7ab258d30 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff47a7fc640 1 -- 172.21.15.196:0/4047129096 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5900184e0 con 0x55c7ab258d30 2024-09-21T08:52:01.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff47a7fc640 1 -- 172.21.15.196:0/4047129096 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff590015bd0 con 0x55c7ab258d30 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4047129096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 msgr2=0x55c7ab259130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/4047129096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff590018fd0 tx=0x7ff590014f30 comp rx=0 tx=0).stop 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4047129096 shutdown_connections 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/4047129096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab259130 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4047129096 >> 172.21.15.196:0/4047129096 conn(0x55c7ab2550d0 msgr2=0x55c7ab2531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4047129096 shutdown_connections 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.364+0000 7ff59ad3f800 1 -- 172.21.15.196:0/4047129096 wait complete. 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff59ad3f800 1 Processor -- start 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff59ad3f800 1 -- start start 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff59ad3f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff59ad3f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c7ab259c90 con 0x55c7ab258d30 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff597291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37186/0 (socket says 172.21.15.196:37186) 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 learned_addr learned my addr 172.21.15.196:0/3179799869 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ab2606d0 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.365+0000 7ff597291640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff5900148c0 tx=0x7ff59004c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff478ff9640 1 -- 172.21.15.196:0/3179799869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff590030070 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff478ff9640 1 -- 172.21.15.196:0/3179799869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59004e280 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff478ff9640 1 -- 172.21.15.196:0/3179799869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff59001d050 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7ab260960 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ab263610 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff478ff9640 1 -- 172.21.15.196:0/3179799869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff590033070 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.366+0000 7ff478ff9640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff460036b90 0x7ff460039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff478ff9640 1 -- 172.21.15.196:0/3179799869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff590036c90 con 0x55c7ab258d30 2024-09-21T08:52:01.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff596a90640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff460036b90 0x7ff460039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff596a90640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff460036b90 0x7ff460039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff58806c730 tx=0x7ff588086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab26bce0 0x55c7ab26e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab26e8f0 con 0x55c7ab26bce0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.367+0000 7ff59628f640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab26bce0 0x55c7ab26e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59628f640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab26bce0 0x55c7ab26e1a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff58c00f5c0 con 0x55c7ab26bce0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 realm 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab26b130 con 0x55c7ab26bce0 2024-09-21T08:52:01.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff58c00f5c0 con 0x55c7ab26bce0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab26f3e0 con 0x55c7ab26bce0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff58c00f5c0 con 0x55c7ab26bce0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.368+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab26fcb0 con 0x55c7ab26bce0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff58c00f5c0 con 0x55c7ab26bce0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab2706d0 0x55c7ab272ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2731b0 con 0x55c7ab2706d0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff597291640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab2706d0 0x55c7ab272ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff597291640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab2706d0 0x55c7ab272ac0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 20 searching for the correct realm 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c7ab275180 0x55c7ab277640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab275180 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.369+0000 7ff596a90640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c7ab275180 0x55c7ab277640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff596a90640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c7ab275180 0x55c7ab277640 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff596a90640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff58806d040 0x7ff58806aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x7ff58806d040 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff59628f640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff58806d040 0x7ff58806aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.370+0000 7ff59628f640 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff58806d040 0x7ff58806aab0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c00f5c0 con 0x7ff58806d040 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab2706d0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab26bce0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c00f5c0 con 0x55c7ab26bce0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab26bce0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.371+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab2706d0 2024-09-21T08:52:01.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab2706d0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x7ff58806d040 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab275180 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab26bce0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.372+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab2706d0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab26bce0 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x7ff58806d040 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.373+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab277d10 con 0x55c7ab275180 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab2706d0 2024-09-21T08:52:01.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.374+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab26bce0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab26bce0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab2706d0 2024-09-21T08:52:01.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.375+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x7ff58806d040 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab26bce0 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab2706d0 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.393 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.376+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab2706d0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x7ff58806d040 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab275180 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab2706d0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.377+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x55c7ab26bce0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff5880ab040 con 0x7ff58806d040 2024-09-21T08:52:01.394 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab273b70 con 0x55c7ab26bce0 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab273780 con 0x55c7ab26bce0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.378+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2744a0 con 0x55c7ab26bce0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 zone default found 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 4 Realm: () 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.396 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 zonegroup default 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab278190 con 0x55c7ab2706d0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27a440 con 0x55c7ab275180 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27a7e0 con 0x55c7ab275180 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.397 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 started sync module instance, tier type = 2024-09-21T08:52:01.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.379+0000 7ff59ad3f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.398 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.380+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab279880 con 0x7ff58806d040 2024-09-21T08:52:01.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.380+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.381+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94316058353104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab279880 con 0x7ff58806d040 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.381+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27b220 con 0x55c7ab26bce0 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.381+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94316058353104] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.382+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.382+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94316058356976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab279880 con 0x55c7ab26bce0 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.382+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27bcb0 con 0x55c7ab275180 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.383+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.383+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94316058359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27c550 con 0x55c7ab275180 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.383+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27d000 con 0x7ff58806d040 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.383+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94316058356976] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.384+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94316058359680] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.384+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.384+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94316058350544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27c0a0 con 0x7ff58806d040 2024-09-21T08:52:01.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.384+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27d8a0 con 0x55c7ab26bce0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.385+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.385+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94316058366880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27dc70 con 0x55c7ab26bce0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.385+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27e4c0 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.385+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94316058350544] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.386+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.386+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94316058369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27e8b0 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.386+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27f100 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.386+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94316058366880] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.387+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94316058369136] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.387+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.387+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94316058367936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27ec30 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.387+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27f480 con 0x55c7ab2706d0 2024-09-21T08:52:01.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94316058373648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27f820 con 0x55c7ab2706d0 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=0 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=1 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=2 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=3 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=4 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=5 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94316058367936] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.388+0000 7ff59ad3f800 20 add_watcher() i=6 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94316058373648] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff59ad3f800 20 add_watcher() i=7 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff59ad3f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27e780 con 0x55c7ab26bce0 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.389+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94316058374832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab27e780 con 0x55c7ab26bce0 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.390+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94316058374832] v34'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.390+0000 7ff44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.390+0000 7ff59ad3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.390+0000 7ff59ad3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.390+0000 7ff59ad3f800 5 note: GC not initialized 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff3c7fff640 20 reqs_thread_entry: start 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 20 Filter name: none 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff3c5ffb640 20 reqs_thread_entry: start 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:01.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b5cb0 con 0x55c7ab26bce0 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.391+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b7d90 con 0x7ff58806d040 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:01.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b9580 con 0x55c7ab26bce0 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.392+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2bddd0 con 0x55c7ab2706d0 2024-09-21T08:52:01.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.393+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(65 fud.buckets [call] v34'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.393+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2c3d10 con 0x55c7ab26bce0 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94316058614848 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2be200 con 0x55c7ab2706d0 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== watch-notify(notify (1) cookie 94316058369136 notify 146028888071 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55c7ab260960 con 0x55c7ab2706d0 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff47a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94316058369136 notifier 4531 bl.length()=752 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff47a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff47a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff47a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:01.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(67 notify.5 [notify cookie 94316058614848 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff47a7fc640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff45c003ea0 con 0x55c7ab2706d0 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== watch-notify(notify_complete (2) cookie 94316058614848 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7ab2606d0 con 0x55c7ab2706d0 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.395+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2c24f0 con 0x7ff58806d040 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.396+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(69 foo.buckets [call] v34'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.396+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2c3500 con 0x7ff58806d040 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.397+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.397+0000 7ff59ad3f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.397+0000 7ff59ad3f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.397+0000 7ff59ad3f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.397+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94316058614816 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2c29a0 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== watch-notify(notify (1) cookie 94316058367936 notify 146028888072 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55c7ab259700 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff479ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94316058367936 notifier 4531 bl.length()=314 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff479ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff479ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff479ffb640 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff3cc003400 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(71 notify.6 [notify cookie 94316058614816 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.398+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== watch-notify(notify_complete (2) cookie 94316058614816 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7ab24f940 con 0x55c7ab2706d0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.399+0000 7ff44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.399+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94316058374832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab26bce0 2024-09-21T08:52:01.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.400+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94316058374832] v34'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.400+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94316058353104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x7ff58806d040 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.401+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94316058353104] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.401+0000 7ff59ad3f800 20 remove_watcher() i=0 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.401+0000 7ff59ad3f800 2 removed watcher, disabling cache 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.401+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94316058356976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab26bce0 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.402+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94316058356976] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.402+0000 7ff59ad3f800 20 remove_watcher() i=1 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.402+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94316058359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab275180 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.403+0000 7ff596a90640 1 -- 172.21.15.196:0/3179799869 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94316058359680] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58806c480 con 0x55c7ab275180 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.403+0000 7ff59ad3f800 20 remove_watcher() i=2 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.403+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94316058350544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x7ff58806d040 2024-09-21T08:52:01.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.404+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94316058350544] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x7ff58806d040 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.404+0000 7ff59ad3f800 20 remove_watcher() i=3 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.404+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94316058366880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab26bce0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.405+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94316058366880] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff58c02b040 con 0x55c7ab26bce0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.405+0000 7ff59ad3f800 20 remove_watcher() i=4 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.405+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94316058369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.406+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94316058369136] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.406+0000 7ff59ad3f800 20 remove_watcher() i=5 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.406+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94316058367936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.407+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94316058367936] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.407+0000 7ff59ad3f800 20 remove_watcher() i=6 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.407+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94316058373648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7ab2b3a00 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff597291640 1 -- 172.21.15.196:0/3179799869 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94316058373648] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff590032030 con 0x55c7ab2706d0 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 20 remove_watcher() i=7 2024-09-21T08:52:01.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab2706d0 msgr2=0x55c7ab272ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab2706d0 0x55c7ab272ac0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab26bce0 msgr2=0x55c7ab26e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab26bce0 0x55c7ab26e1a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff58806d040 msgr2=0x7ff58806aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff58806d040 0x7ff58806aab0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c7ab275180 msgr2=0x55c7ab277640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c7ab275180 0x55c7ab277640 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff460036b90 msgr2=0x7ff460039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff460036b90 0x7ff460039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff58806c730 tx=0x7ff588086000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 msgr2=0x55c7ab260190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff5900148c0 tx=0x7ff59004c9f0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59628f640 1 -- 172.21.15.196:0/3179799869 reap_dead start 2024-09-21T08:52:01.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 shutdown_connections 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/3179799869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab258d30 0x55c7ab260190 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 >> 172.21.15.196:0/3179799869 conn(0x55c7ab2550d0 msgr2=0x55c7ab25a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 shutdown_connections 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.408+0000 7ff59ad3f800 1 -- 172.21.15.196:0/3179799869 wait complete. 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 msgr2=0x7ff470039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 0x7ff470039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55c7ab238d70 tx=0x7ff58807f810 comp rx=0 tx=0).stop 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 msgr2=0x55c7ab24c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55c7ab2324a0 tx=0x7ff59000aea0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 shutdown_connections 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff470036b90 0x7ff470039050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2297685931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab24c070 0x55c7ab24c490 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 >> 172.21.15.196:0/2297685931 conn(0x55c7ab241000 msgr2=0x55c7ab243b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 shutdown_connections 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2297685931 wait complete. 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 msgr2=0x55c7ab23cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 0x55c7ab23cff0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 msgr2=0x55c7ab2382f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 0x55c7ab2382f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 msgr2=0x7ff47c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 0x7ff47c039000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f60 tx=0x7ff58c001370 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 msgr2=0x55c7ab231280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff588063040 tx=0x7ff588003330 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 shutdown_connections 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c7ab23ac00 0x55c7ab23cff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c7ab13d730 0x55c7ab2382f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff47c036b40 0x7ff47c039000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 --2- 172.21.15.196:0/2235279366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c7ab0ae6d0 0x55c7ab231280 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 >> 172.21.15.196:0/2235279366 conn(0x55c7ab134e00 msgr2=0x55c7ab223be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 shutdown_connections 2024-09-21T08:52:01.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.409+0000 7ff59ad3f800 1 -- 172.21.15.196:0/2235279366 wait complete. 2024-09-21T08:52:01.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-21T08:52:01.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-21T08:52:01.429 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-21T08:52:01.473 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.473 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.471+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.471+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.471+0000 7fa76cf39800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a1a4193990 0x55a1a4195d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.471+0000 7fa76cf39800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1a404fb30 con 0x55a1a418f550 2024-09-21T08:52:01.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.471+0000 7fa76cf39800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a1a4031360 con 0x55a1a4193990 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa7604c4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a1a4193990 0x55a1a4195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa7604c4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a1a4193990 0x55a1a4195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37194/0 (socket says 172.21.15.196:37194) 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa768cc5640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55a1a418f550 0x55a1a418f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49456/0 (socket says 172.21.15.196:49456) 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa7604c4640 1 -- 172.21.15.196:0/12995081 learned_addr learned my addr 172.21.15.196:0/12995081 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa7604c4640 1 -- 172.21.15.196:0/12995081 >> v1:172.21.15.29:6789/0 conn(0x55a1a418f550 legacy=0x55a1a418f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.472+0000 7fa7604c4640 1 -- 172.21.15.196:0/12995081 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a4057e00 con 0x55a1a4193990 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.474+0000 7fa7604c4640 1 --2- 172.21.15.196:0/12995081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4193990 0x55a1a4195d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa75000a520 tx=0x7fa750045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8931542b6656ef58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.474+0000 7fa763fff640 1 -- 172.21.15.196:0/12995081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa750055070 con 0x55a1a4193990 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.474+0000 7fa763fff640 1 -- 172.21.15.196:0/12995081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7500515b0 con 0x55a1a4193990 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.474+0000 7fa763fff640 1 -- 172.21.15.196:0/12995081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7500518d0 con 0x55a1a4193990 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 -- 172.21.15.196:0/12995081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4193990 msgr2=0x55a1a4195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 --2- 172.21.15.196:0/12995081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4193990 0x55a1a4195d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa75000a520 tx=0x7fa750045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 -- 172.21.15.196:0/12995081 shutdown_connections 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 --2- 172.21.15.196:0/12995081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4193990 0x55a1a4195d80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 -- 172.21.15.196:0/12995081 >> 172.21.15.196:0/12995081 conn(0x55a1a418ade0 msgr2=0x55a1a418d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 -- 172.21.15.196:0/12995081 shutdown_connections 2024-09-21T08:52:01.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.475+0000 7fa76cf39800 1 -- 172.21.15.196:0/12995081 wait complete. 2024-09-21T08:52:01.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.488+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.488+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa76cf39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa76cf39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a1a40dc330 con 0x55a1a418f550 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa768cc5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa768cc5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37206/0 (socket says 172.21.15.196:37206) 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa768cc5640 1 -- 172.21.15.196:0/1027234384 learned_addr learned my addr 172.21.15.196:0/1027234384 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa768cc5640 1 -- 172.21.15.196:0/1027234384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a4029bc0 con 0x55a1a418f550 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.489+0000 7fa768cc5640 1 --2- 172.21.15.196:0/1027234384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa758001e40 tx=0x7fa758001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23273eacbe6b0ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa656e0d640 1 -- 172.21.15.196:0/1027234384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75800e5c0 con 0x55a1a418f550 2024-09-21T08:52:01.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa656e0d640 1 -- 172.21.15.196:0/1027234384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758006070 con 0x55a1a418f550 2024-09-21T08:52:01.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa656e0d640 1 -- 172.21.15.196:0/1027234384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75800e910 con 0x55a1a418f550 2024-09-21T08:52:01.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 -- 172.21.15.196:0/1027234384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 msgr2=0x55a1a427e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 --2- 172.21.15.196:0/1027234384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa758001e40 tx=0x7fa758001e70 comp rx=0 tx=0).stop 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 -- 172.21.15.196:0/1027234384 shutdown_connections 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 --2- 172.21.15.196:0/1027234384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a427e780 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 -- 172.21.15.196:0/1027234384 >> 172.21.15.196:0/1027234384 conn(0x55a1a418ade0 msgr2=0x55a1a427a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 -- 172.21.15.196:0/1027234384 shutdown_connections 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.490+0000 7fa76cf39800 1 -- 172.21.15.196:0/1027234384 wait complete. 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa76cf39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa76cf39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a1a41965c0 con 0x55a1a418f550 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa768cc5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa768cc5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37216/0 (socket says 172.21.15.196:37216) 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa768cc5640 1 -- 172.21.15.196:0/2487869582 learned_addr learned my addr 172.21.15.196:0/2487869582 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa768cc5640 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a403dfe0 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.491+0000 7fa768cc5640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa758004000 tx=0x7fa758000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa65560a640 1 -- 172.21.15.196:0/2487869582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75801a7c0 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa65560a640 1 -- 172.21.15.196:0/2487869582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75801a960 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1a4289ee0 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa65560a640 1 -- 172.21.15.196:0/2487869582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75801acc0 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a428a400 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.492+0000 7fa65560a640 1 -- 172.21.15.196:0/2487869582 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa758017070 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa65560a640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 0x7fa650039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa65560a640 1 -- 172.21.15.196:0/2487869582 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa758015020 con 0x55a1a418f550 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa7604c4640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 0x7fa650039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 0x55a1a428e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a428e8e0 con 0x55a1a4193990 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa7694c6640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 0x55a1a428e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa7604c4640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 0x7fa650039000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa750057000 tx=0x7fa750052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa7694c6640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 0x55a1a428e2a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.493+0000 7fa7694c6640 1 -- 172.21.15.196:0/2487869582 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76400a4a0 con 0x55a1a4193990 2024-09-21T08:52:01.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.494+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a428b7d0 con 0x55a1a4193990 2024-09-21T08:52:01.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.494+0000 7fa7694c6640 1 -- 172.21.15.196:0/2487869582 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa76400a4a0 con 0x55a1a4193990 2024-09-21T08:52:01.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.494+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 0x55a1a4293020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.494+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4293710 con 0x55a1a4290c30 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.494+0000 7fa768cc5640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 0x55a1a4293020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa768cc5640 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 0x55a1a4293020 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa768cc5640 1 -- 172.21.15.196:0/2487869582 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a4290c30 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a428fad0 con 0x55a1a4193990 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa7694c6640 1 -- 172.21.15.196:0/2487869582 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa76400a4a0 con 0x55a1a4193990 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a428ff70 con 0x55a1a4193990 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.495+0000 7fa7694c6640 1 -- 172.21.15.196:0/2487869582 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa76400a4a0 con 0x55a1a4193990 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa76cf39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa76cf39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a1a402b580 con 0x55a1a4287890 2024-09-21T08:52:01.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37222/0 (socket says 172.21.15.196:37222) 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa7694c6640 1 -- 172.21.15.196:0/3382548737 learned_addr learned my addr 172.21.15.196:0/3382548737 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.496+0000 7fa7694c6640 1 -- 172.21.15.196:0/3382548737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a4287cb0 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa7694c6640 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x55a1a4103fd0 tx=0x7fa764018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa64e7fc640 1 -- 172.21.15.196:0/3382548737 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa764014450 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa64e7fc640 1 -- 172.21.15.196:0/3382548737 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa764014610 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1a42864e0 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa64e7fc640 1 -- 172.21.15.196:0/3382548737 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa764014930 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.497+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a42869e0 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa64e7fc640 1 -- 172.21.15.196:0/3382548737 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa764011040 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa64e7fc640 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 0x7fa640039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa64e7fc640 1 -- 172.21.15.196:0/3382548737 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa76401e070 con 0x55a1a4287890 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa768cc5640 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 0x7fa640039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa768cc5640 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 0x7fa640039050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55a1a428eda0 tx=0x7fa75804b730 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa76cf39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.498+0000 7fa76cf39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a1a427ef30 con 0x55a1a42b0f10 2024-09-21T08:52:01.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37236/0 (socket says 172.21.15.196:37236) 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa7694c6640 1 -- 172.21.15.196:0/1991163761 learned_addr learned my addr 172.21.15.196:0/1991163761 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa7694c6640 1 -- 172.21.15.196:0/1991163761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a42b18e0 con 0x55a1a42b0f10 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa7694c6640 1 --2- 172.21.15.196:0/1991163761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa76404ccb0 tx=0x7fa764011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45b8a2afa2cb79f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa63ffff640 1 -- 172.21.15.196:0/1991163761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7640167c0 con 0x55a1a42b0f10 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa63ffff640 1 -- 172.21.15.196:0/1991163761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76402bc50 con 0x55a1a42b0f10 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa63ffff640 1 -- 172.21.15.196:0/1991163761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa764016960 con 0x55a1a42b0f10 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa76cf39800 1 -- 172.21.15.196:0/1991163761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 msgr2=0x55a1a42b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.499+0000 7fa76cf39800 1 --2- 172.21.15.196:0/1991163761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa76404ccb0 tx=0x7fa764011ef0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- 172.21.15.196:0/1991163761 shutdown_connections 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 --2- 172.21.15.196:0/1991163761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b1310 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- 172.21.15.196:0/1991163761 >> 172.21.15.196:0/1991163761 conn(0x55a1a42ad270 msgr2=0x55a1a42ab370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- 172.21.15.196:0/1991163761 shutdown_connections 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- 172.21.15.196:0/1991163761 wait complete. 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 Processor -- start 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- start start 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa76cf39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a1a42b1e30 con 0x55a1a42b0f10 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa7694c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37242/0 (socket says 172.21.15.196:37242) 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 learned_addr learned my addr 172.21.15.196:0/4046378634 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.500+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a42b8890 con 0x55a1a42b0f10 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa7694c6640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b8350 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7640114a0 tx=0x7fa76404cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa63e7fc640 1 -- 172.21.15.196:0/4046378634 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76402be00 con 0x55a1a42b0f10 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa63e7fc640 1 -- 172.21.15.196:0/4046378634 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76404e0d0 con 0x55a1a42b0f10 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa63e7fc640 1 -- 172.21.15.196:0/4046378634 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76404e3b0 con 0x55a1a42b0f10 2024-09-21T08:52:01.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1a42b8b20 con 0x55a1a42b0f10 2024-09-21T08:52:01.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a42bb7d0 con 0x55a1a42b0f10 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.501+0000 7fa63e7fc640 1 -- 172.21.15.196:0/4046378634 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa76404e550 con 0x55a1a42b0f10 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa63e7fc640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa634036b90 0x7fa634039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa63e7fc640 1 -- 172.21.15.196:0/4046378634 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa764033070 con 0x55a1a42b0f10 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa768cc5640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa634036b90 0x7fa634039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa768cc5640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa634036b90 0x7fa634039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa75801d8a0 tx=0x7fa758044000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a42c4090 0x55a1a42c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.502+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42c6ca0 con 0x55a1a42c4090 2024-09-21T08:52:01.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa7604c4640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a42c4090 0x55a1a42c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa7604c4640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a42c4090 0x55a1a42c6550 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 realm 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42c70d0 con 0x55a1a42c4090 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42c79a0 con 0x55a1a42c4090 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.503+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42c7d40 con 0x55a1a42c4090 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a42c8aa0 0x55a1a42cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42cb4e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa7694c6640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a42c8aa0 0x55a1a42cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa7694c6640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a42c8aa0 0x55a1a42cae90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.504+0000 7fa76cf39800 20 searching for the correct realm 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a1a42cd470 0x55a1a42cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42cd470 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa768cc5640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a1a42cd470 0x55a1a42cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa768cc5640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a1a42cd470 0x55a1a42cf930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa768cc5640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa75800f070 0x7fa75801b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x7fa75800f070 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.505+0000 7fa7604c4640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa75800f070 0x7fa75801b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7604c4640 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa75800f070 0x7fa75801b3d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c8aa0 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c4090 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.506+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c4090 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x7fa75800f070 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.507+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42cd470 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c4090 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42c4090 2024-09-21T08:52:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.508+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x7fa75800f070 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d0000 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c8aa0 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.509+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c4090 2024-09-21T08:52:01.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c4090 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.510+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c8aa0 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42cd470 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x7fa75800f070 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c4090 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c8aa0 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.511+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42cd470 2024-09-21T08:52:01.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c8aa0 2024-09-21T08:52:01.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x7fa75800f070 2024-09-21T08:52:01.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42cd470 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.512+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c8aa0 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x55a1a42c4090 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa75805b040 con 0x7fa75800f070 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42cbea0 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.513+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42cbae0 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42cc840 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 zone default found 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 4 Realm: () 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 zonegroup default 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d04f0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.514+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d27c0 con 0x55a1a42cd470 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d2b60 con 0x55a1a42cd470 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 20 started sync module instance, tier type = 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.515+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d1c50 con 0x7fa75800f070 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.516+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.516+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94152732516768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d1c50 con 0x7fa75800f070 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.516+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d3570 con 0x55a1a42c4090 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.517+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94152732516768] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.517+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.517+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94152732521120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d1c50 con 0x55a1a42c4090 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.517+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d3fc0 con 0x55a1a42cd470 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.518+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.518+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94152732523216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d4890 con 0x55a1a42cd470 2024-09-21T08:52:01.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.518+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d5300 con 0x7fa75800f070 2024-09-21T08:52:01.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.518+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94152732521120] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.519+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94152732523216] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.519+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.519+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94152732525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d17a0 con 0x7fa75800f070 2024-09-21T08:52:01.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.519+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d5ba0 con 0x55a1a42c4090 2024-09-21T08:52:01.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.520+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.520+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94152732530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d6000 con 0x55a1a42c4090 2024-09-21T08:52:01.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.520+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94152732525536] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.520+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d6b00 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.521+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94152732530256] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.521+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.521+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94152732531312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d4dd0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.521+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d70e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.522+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94152732531312] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.522+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94152732534256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d70e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d7aa0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94152732534256] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94152732536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d7aa0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.523+0000 7fa76cf39800 20 add_watcher() i=0 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=1 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=2 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=3 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=4 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=5 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=6 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94152732536336] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 20 add_watcher() i=7 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.524+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42dada0 con 0x55a1a42c4090 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.525+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.525+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94152732538720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42d8030 con 0x55a1a42c4090 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.526+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94152732538720] v34'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.526+0000 7fa61efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.526+0000 7fa76cf39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.526+0000 7fa76cf39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.526+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42da6b0 con 0x55a1a42c4090 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.527+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.527+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e3fa0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.528+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.528+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e3fa0 con 0x55a1a42cd470 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.529+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.529+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e47f0 con 0x55a1a42c4090 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.530+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.530+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e4be0 con 0x7fa75800f070 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.531+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.531+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e5150 con 0x55a1a42cd470 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.532+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.532+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e51e0 con 0x55a1a42c4090 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.533+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.533+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.534+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.534+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x7fa75800f070 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.535+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.535+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.536+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.536+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x7fa75800f070 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.537+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.537+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e4db0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.538+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.538+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e59b0 con 0x7fa75800f070 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.539+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.539+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e59b0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.540+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.540+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e59b0 con 0x55a1a42c4090 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.541+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.541+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.543+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.543+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x7fa75800f070 2024-09-21T08:52:01.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.544+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.544+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.544+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.544+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c4090 2024-09-21T08:52:01.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.546+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.546+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c4090 2024-09-21T08:52:01.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.547+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.547+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.548+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.548+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x7fa75800f070 2024-09-21T08:52:01.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.549+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.549+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.549+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.550+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.550+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.551+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.551+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.551+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.552+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.552+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.553+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.554+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.554+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.554+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.555+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.556+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42cd470 2024-09-21T08:52:01.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.557+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.557+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.558+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.558+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a42e55c0 con 0x7fa75800f070 2024-09-21T08:52:01.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa61dfe3640 20 reqs_thread_entry: start 2024-09-21T08:52:01.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa76cf39800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa76cf39800 20 Filter name: none 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa58f7fe640 20 reqs_thread_entry: start 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa76cf39800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa76cf39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.559+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4310710 con 0x55a1a42c8aa0 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4312d10 con 0x55a1a42c8aa0 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T08:52:01.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.560+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4310cb0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa76cf39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94152732772352 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4310c60 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== watch-notify(notify (1) cookie 94152732523216 notify 146028888067 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a1a42da670 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa63ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94152732523216 notifier 4538 bl.length()=170 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(97 notify.2 [notify cookie 94152732772352 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa63ffff640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa62c003d60 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.561+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.562+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== watch-notify(notify_complete (2) cookie 94152732772352 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa758044e30 con 0x55a1a42cd470 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.562+0000 7fa76cf39800 10 removing email index: 2024-09-21T08:52:01.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.562+0000 7fa76cf39800 10 removing user buckets index 2024-09-21T08:52:01.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.562+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43110c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(99 fud.buckets [delete] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa76cf39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94152732772352 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a4310c60 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== watch-notify(notify (1) cookie 94152732534256 notify 146028888073 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a1a42bb7d0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa63ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94152732534256 notifier 4538 bl.length()=160 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa63ffff640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa62c003d60 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(100 notify.6 [notify cookie 94152732772352 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.563+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.564+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== watch-notify(notify_complete (2) cookie 94152732772352 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1a42b8b20 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.564+0000 7fa76cf39800 10 removing user index: fud 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.564+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.564+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(102 fud [call,call,delete] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa76cf39800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa76cf39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94152732779984 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== watch-notify(notify (1) cookie 94152732531312 notify 146028888074 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a1a42b8b20 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa63f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94152732531312 notifier 4538 bl.length()=152 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(103 notify.5 [notify cookie 94152732779984 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa63f7fe640 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa59c0032c0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== watch-notify(notify_complete (2) cookie 94152732779984 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a1a42b8890 con 0x55a1a42c8aa0 2024-09-21T08:52:01.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.565+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.566+0000 7fa61efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.566+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94152732538720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c4090 2024-09-21T08:52:01.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.567+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94152732538720] v34'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.567+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94152732516768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x7fa75800f070 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.568+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94152732516768] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.568+0000 7fa76cf39800 20 remove_watcher() i=0 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.568+0000 7fa76cf39800 2 removed watcher, disabling cache 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.568+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94152732521120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c4090 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.569+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94152732521120] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.569+0000 7fa76cf39800 20 remove_watcher() i=1 2024-09-21T08:52:01.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.569+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94152732523216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42cd470 2024-09-21T08:52:01.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.570+0000 7fa768cc5640 1 -- 172.21.15.196:0/4046378634 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94152732523216] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75802e070 con 0x55a1a42cd470 2024-09-21T08:52:01.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.570+0000 7fa76cf39800 20 remove_watcher() i=2 2024-09-21T08:52:01.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.570+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94152732525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x7fa75800f070 2024-09-21T08:52:01.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.571+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94152732525536] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x7fa75800f070 2024-09-21T08:52:01.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.571+0000 7fa76cf39800 20 remove_watcher() i=3 2024-09-21T08:52:01.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.571+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94152732530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c4090 2024-09-21T08:52:01.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.572+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94152732530256] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa750057030 con 0x55a1a42c4090 2024-09-21T08:52:01.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.572+0000 7fa76cf39800 20 remove_watcher() i=4 2024-09-21T08:52:01.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.572+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94152732531312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.573+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94152732531312] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.573+0000 7fa76cf39800 20 remove_watcher() i=5 2024-09-21T08:52:01.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.573+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94152732534256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.574+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94152732534256] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.574+0000 7fa76cf39800 20 remove_watcher() i=6 2024-09-21T08:52:01.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.574+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94152732536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a1a43121e0 con 0x55a1a42c8aa0 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa7694c6640 1 -- 172.21.15.196:0/4046378634 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94152732536336] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76402a070 con 0x55a1a42c8aa0 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 20 remove_watcher() i=7 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a42c8aa0 msgr2=0x55a1a42cae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a42c8aa0 0x55a1a42cae90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a42c4090 msgr2=0x55a1a42c6550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a42c4090 0x55a1a42c6550 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa75800f070 msgr2=0x7fa75801b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa75800f070 0x7fa75801b3d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a1a42cd470 msgr2=0x55a1a42cf930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55a1a42cd470 0x55a1a42cf930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa634036b90 msgr2=0x7fa634039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa634036b90 0x7fa634039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa75801d8a0 tx=0x7fa758044000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 msgr2=0x55a1a42b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 --2- 172.21.15.196:0/4046378634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a42b0f10 0x55a1a42b8350 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7640114a0 tx=0x7fa76404cc40 comp rx=0 tx=0).stop 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 reap_dead start 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa7604c4640 1 -- 172.21.15.196:0/4046378634 reap_dead start 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 shutdown_connections 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.575+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 >> 172.21.15.196:0/4046378634 conn(0x55a1a42ad270 msgr2=0x55a1a42ab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 shutdown_connections 2024-09-21T08:52:01.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/4046378634 wait complete. 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 msgr2=0x7fa640039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 0x7fa640039050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55a1a428eda0 tx=0x7fa75804b730 comp rx=0 tx=0).stop 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 msgr2=0x55a1a4285ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x55a1a4103fd0 tx=0x7fa764018830 comp rx=0 tx=0).stop 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 shutdown_connections 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa640036b90 0x7fa640039050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/3382548737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a4287890 0x55a1a4285ee0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 >> 172.21.15.196:0/3382548737 conn(0x55a1a4296ff0 msgr2=0x55a1a4299b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 shutdown_connections 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/3382548737 wait complete. 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 msgr2=0x55a1a4293020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 0x55a1a4293020 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 msgr2=0x55a1a428e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 0x55a1a428e2a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 msgr2=0x7fa650039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 0x7fa650039000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa750057000 tx=0x7fa750052000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 msgr2=0x55a1a41045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa758004000 tx=0x7fa758000bc0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 shutdown_connections 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55a1a4290c30 0x55a1a4293020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55a1a4193990 0x55a1a428e2a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa650036b40 0x7fa650039000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 --2- 172.21.15.196:0/2487869582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a1a418f550 0x55a1a41045e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.576+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 >> 172.21.15.196:0/2487869582 conn(0x55a1a418ade0 msgr2=0x55a1a42789d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.577+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 shutdown_connections 2024-09-21T08:52:01.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.577+0000 7fa76cf39800 1 -- 172.21.15.196:0/2487869582 wait complete. 2024-09-21T08:52:01.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T08:52:01.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-21T08:52:01.588 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-21T08:52:01.642 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.642 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab73f26800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560af9e2660 0x5560afa73630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab73f26800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560af92db30 con 0x5560afa73b70 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab73f26800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5560af90f360 con 0x5560af9e2660 2024-09-21T08:52:01.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab6fbe3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560af9e2660 0x5560afa73630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab6f3e2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5560afa73b70 0x5560afa75f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49470/0 (socket says 172.21.15.196:49470) 2024-09-21T08:52:01.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab6fbe3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560af9e2660 0x5560afa73630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37244/0 (socket says 172.21.15.196:37244) 2024-09-21T08:52:01.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.640+0000 7fab6f3e2640 1 -- 172.21.15.196:0/491427679 learned_addr learned my addr 172.21.15.196:0/491427679 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:01.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.641+0000 7fab6fbe3640 1 -- 172.21.15.196:0/491427679 >> v1:172.21.15.29:6789/0 conn(0x5560afa73b70 legacy=0x5560afa75f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.641+0000 7fab6fbe3640 1 -- 172.21.15.196:0/491427679 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560af935e00 con 0x5560af9e2660 2024-09-21T08:52:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.642+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/491427679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afa73630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fab6000a470 tx=0x7fab60045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70c6bcb84c3b866 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab6ebe1640 1 -- 172.21.15.196:0/491427679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60053570 con 0x5560af9e2660 2024-09-21T08:52:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab6ebe1640 1 -- 172.21.15.196:0/491427679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60058070 con 0x5560af9e2660 2024-09-21T08:52:01.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab6ebe1640 1 -- 172.21.15.196:0/491427679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60053880 con 0x5560af9e2660 2024-09-21T08:52:01.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 -- 172.21.15.196:0/491427679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 msgr2=0x5560afa73630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 --2- 172.21.15.196:0/491427679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afa73630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fab6000a470 tx=0x7fab60045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:01.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 -- 172.21.15.196:0/491427679 shutdown_connections 2024-09-21T08:52:01.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 --2- 172.21.15.196:0/491427679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afa73630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 -- 172.21.15.196:0/491427679 >> 172.21.15.196:0/491427679 conn(0x5560afa68de0 msgr2=0x5560afa6b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 -- 172.21.15.196:0/491427679 shutdown_connections 2024-09-21T08:52:01.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.643+0000 7fab73f26800 1 -- 172.21.15.196:0/491427679 wait complete. 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab73f26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab73f26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560af9ba450 con 0x5560af9e2660 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab6fbe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab6fbe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37252/0 (socket says 172.21.15.196:37252) 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab6fbe3640 1 -- 172.21.15.196:0/4183997697 learned_addr learned my addr 172.21.15.196:0/4183997697 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.657+0000 7fab6fbe3640 1 -- 172.21.15.196:0/4183997697 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560af907bc0 con 0x5560af9e2660 2024-09-21T08:52:01.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.658+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/4183997697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fab60025c20 tx=0x7fab60051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d039d56fe066b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.658+0000 7faa5de0b640 1 -- 172.21.15.196:0/4183997697 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60053ba0 con 0x5560af9e2660 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.658+0000 7faa5de0b640 1 -- 172.21.15.196:0/4183997697 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60063030 con 0x5560af9e2660 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.658+0000 7faa5de0b640 1 -- 172.21.15.196:0/4183997697 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60053440 con 0x5560af9e2660 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- 172.21.15.196:0/4183997697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 msgr2=0x5560afb5fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 --2- 172.21.15.196:0/4183997697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fab60025c20 tx=0x7fab60051000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- 172.21.15.196:0/4183997697 shutdown_connections 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 --2- 172.21.15.196:0/4183997697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb5fb60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- 172.21.15.196:0/4183997697 >> 172.21.15.196:0/4183997697 conn(0x5560afa68de0 msgr2=0x5560afb5b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- 172.21.15.196:0/4183997697 shutdown_connections 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- 172.21.15.196:0/4183997697 wait complete. 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab73f26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560afa77950 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab6fbe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab6fbe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37260/0 (socket says 172.21.15.196:37260) 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.659+0000 7fab6fbe3640 1 -- 172.21.15.196:0/1370408189 learned_addr learned my addr 172.21.15.196:0/1370408189 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7fab6fbe3640 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560af91bfe0 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5560afb609c0 tx=0x7fab60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7faa57fff640 1 -- 172.21.15.196:0/1370408189 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60078070 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7faa57fff640 1 -- 172.21.15.196:0/1370408189 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60053570 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560afb67a00 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7faa57fff640 1 -- 172.21.15.196:0/1370408189 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab60053850 con 0x5560af9e2660 2024-09-21T08:52:01.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.660+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560afb67f80 con 0x5560af9e2660 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7faa57fff640 1 -- 172.21.15.196:0/1370408189 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab6007b070 con 0x5560af9e2660 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7faa57fff640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 0x7faa58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7faa57fff640 1 -- 172.21.15.196:0/1370408189 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fab60070070 con 0x5560af9e2660 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 0x7faa58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 0x5560afb6e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afb6eb80 con 0x5560afa73b70 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.661+0000 7fab703e4640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 0x5560afb6e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab703e4640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 0x5560afb6e530 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 0x7faa58039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab64000f60 tx=0x7fab640012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab703e4640 1 -- 172.21.15.196:0/1370408189 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6800a4a0 con 0x5560afa73b70 2024-09-21T08:52:01.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afb6bae0 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab703e4640 1 -- 172.21.15.196:0/1370408189 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab6800a4a0 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 0x5560afb732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.662+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afb739c0 con 0x5560afb70ee0 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.663+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 0x5560afb732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.663+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 0x5560afb732d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.663+0000 7fab6fbe3640 1 -- 172.21.15.196:0/1370408189 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab6007a030 con 0x5560afb70ee0 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.663+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afb6fcc0 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab703e4640 1 -- 172.21.15.196:0/1370408189 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab6800a4a0 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afb70160 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab703e4640 1 -- 172.21.15.196:0/1370408189 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab6800a4a0 con 0x5560afa73b70 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab73f26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.664+0000 7fab73f26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560af909580 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37270/0 (socket says 172.21.15.196:37270) 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab703e4640 1 -- 172.21.15.196:0/2608343809 learned_addr learned my addr 172.21.15.196:0/2608343809 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab703e4640 1 -- 172.21.15.196:0/2608343809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560afb82b40 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab703e4640 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5560afb6ef60 tx=0x7fab68018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7faa557fa640 1 -- 172.21.15.196:0/2608343809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68014450 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7faa557fa640 1 -- 172.21.15.196:0/2608343809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68014610 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560afb82dd0 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7faa557fa640 1 -- 172.21.15.196:0/2608343809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68014930 con 0x5560afb821e0 2024-09-21T08:52:01.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.665+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560afb85ab0 con 0x5560afb821e0 2024-09-21T08:52:01.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.666+0000 7faa557fa640 1 -- 172.21.15.196:0/2608343809 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab68011040 con 0x5560afb821e0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.666+0000 7faa557fa640 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 0x7faa48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.666+0000 7faa557fa640 1 -- 172.21.15.196:0/2608343809 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fab6801e070 con 0x5560afb821e0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.666+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 0x7faa48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 0x7faa48039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5560afb6f050 tx=0x7fab6008ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab73f26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab73f26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560afb602b0 con 0x5560afb8edb0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37280/0 (socket says 172.21.15.196:37280) 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab703e4640 1 -- 172.21.15.196:0/1992970572 learned_addr learned my addr 172.21.15.196:0/1992970572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab703e4640 1 -- 172.21.15.196:0/1992970572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560afb8f780 con 0x5560afb8edb0 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7fab703e4640 1 --2- 172.21.15.196:0/1992970572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab6804ccb0 tx=0x7fab68011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8912af0e2efd1c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7faa4effd640 1 -- 172.21.15.196:0/1992970572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68016940 con 0x5560afb8edb0 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7faa4effd640 1 -- 172.21.15.196:0/1992970572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68014ad0 con 0x5560afb8edb0 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.667+0000 7faa4effd640 1 -- 172.21.15.196:0/1992970572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68046aa0 con 0x5560afb8edb0 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- 172.21.15.196:0/1992970572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 msgr2=0x5560afb8f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 --2- 172.21.15.196:0/1992970572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab6804ccb0 tx=0x7fab68011970 comp rx=0 tx=0).stop 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- 172.21.15.196:0/1992970572 shutdown_connections 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 --2- 172.21.15.196:0/1992970572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb8f1b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- 172.21.15.196:0/1992970572 >> 172.21.15.196:0/1992970572 conn(0x5560afb8b1a0 msgr2=0x5560afb892a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- 172.21.15.196:0/1992970572 shutdown_connections 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- 172.21.15.196:0/1992970572 wait complete. 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 Processor -- start 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- start start 2024-09-21T08:52:01.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb96320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.668+0000 7fab73f26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560afb8fdc0 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb96320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab703e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb96320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37284/0 (socket says 172.21.15.196:37284) 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 learned_addr learned my addr 172.21.15.196:0/914128706 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560afb96860 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab703e4640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb96320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fab6804bbd0 tx=0x7fab6804cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7faa4d7fa640 1 -- 172.21.15.196:0/914128706 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab68016940 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7faa4d7fa640 1 -- 172.21.15.196:0/914128706 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68014c80 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560afb96af0 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7faa4d7fa640 1 -- 172.21.15.196:0/914128706 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab680136f0 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.669+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560afb997a0 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.670+0000 7faa4d7fa640 1 -- 172.21.15.196:0/914128706 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab6802b350 con 0x5560afb8edb0 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.670+0000 7faa4d7fa640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa38036af0 0x7faa38038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.670+0000 7faa4d7fa640 1 -- 172.21.15.196:0/914128706 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fab68034070 con 0x5560afb8edb0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.670+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa38036af0 0x7faa38038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa38036af0 0x7faa38038fb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab6000a470 tx=0x7fab60093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afba1f60 0x5560afba4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba4b70 con 0x5560afba1f60 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afba1f60 0x5560afba4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afba1f60 0x5560afba4420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab64009050 con 0x5560afba1f60 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.671+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 realm 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba13b0 con 0x5560afba1f60 2024-09-21T08:52:01.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab64009050 con 0x5560afba1f60 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba5660 con 0x5560afba1f60 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab64009050 con 0x5560afba1f60 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba5f30 con 0x5560afba1f60 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab64009050 con 0x5560afba1f60 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afba6870 0x5560afba8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba93f0 con 0x5560afba6870 2024-09-21T08:52:01.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.672+0000 7fab703e4640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afba6870 0x5560afba8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab703e4640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afba6870 0x5560afba8c60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab73f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab73f26800 20 searching for the correct realm 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5560afbab3c0 0x5560afbad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5560afbab3c0 0x5560afbad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.673+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5560afbab3c0 0x5560afbad880 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6fbe3640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fab6007d060 0x7fab600908f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fab6007d060 0x7fab600908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6f3e2640 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fab6007d060 0x7fab600908f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64009050 con 0x7fab6007d060 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.674+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64009050 con 0x5560afba1f60 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.675+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x7fab6007d060 2024-09-21T08:52:01.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.676+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab64029040 con 0x7fab6007d060 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.677+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.678+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.679+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x7fab6007d060 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.680+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x7fab6007d060 2024-09-21T08:52:01.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.681+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afbab3c0 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba6870 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x5560afba1f60 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560afbadf50 con 0x7fab6007d060 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64029040 con 0x7fab6007d060 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.682+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba9db0 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbaa650 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab64029040 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afba99f0 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 zone default found 2024-09-21T08:52:01.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 4 Realm: () 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 zonegroup default 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbae3d0 con 0x5560afba6870 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.683+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb06a0 con 0x5560afbab3c0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb0a40 con 0x5560afbab3c0 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 20 started sync module instance, tier type = 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.684+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbafb30 con 0x7fab6007d060 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.685+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.685+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93873753489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbafb30 con 0x7fab6007d060 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.685+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb1450 con 0x5560afba1f60 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.686+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93873753489504] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.686+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.686+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93873753493888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbafb30 con 0x5560afba1f60 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.686+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb1ed0 con 0x5560afbab3c0 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.687+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93873753493888] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.700 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.687+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.687+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93873753486976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbafaa0 con 0x5560afbab3c0 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.687+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb2d90 con 0x7fab6007d060 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.688+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93873753486976] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.688+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.688+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93873753499872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb31b0 con 0x7fab6007d060 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.688+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb3b70 con 0x5560afba1f60 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.689+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93873753499872] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.689+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.689+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93873753501408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb3b70 con 0x5560afba1f60 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.689+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb4530 con 0x5560afba6870 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.691+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93873753501408] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.691+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.691+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93873753506400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb3b70 con 0x5560afba6870 2024-09-21T08:52:01.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.691+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb4f40 con 0x5560afba6870 2024-09-21T08:52:01.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.692+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93873753506400] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.692+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.692+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93873753503424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb5140 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.692+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb5990 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93873753503424] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93873753510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb5dd0 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=0 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=1 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=2 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=3 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=4 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=5 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.693+0000 7fab73f26800 20 add_watcher() i=6 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93873753510720] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab73f26800 20 add_watcher() i=7 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab73f26800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb4d20 con 0x5560afba1f60 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.694+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93873753512032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbb4d20 con 0x5560afba1f60 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.695+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93873753512032] v34'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.695+0000 7faa25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.695+0000 7fab73f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.695+0000 7fab73f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.695+0000 7fab73f26800 5 note: GC not initialized 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7faa24fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 20 Filter name: none 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fa99e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:01.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbec570 con 0x5560afba6870 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.696+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbeab00 con 0x5560afba6870 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:01.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.697+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbef220 con 0x5560afba6870 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v34'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab73f26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab73f26800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab73f26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93873753746400 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbefcf0 con 0x7fab6007d060 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== watch-notify(notify (1) cookie 93873753499872 notify 146028888082 ret 0) ==== 652+0+0 (crc 0 0 0) 0x5560af92db30 con 0x7fab6007d060 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7faa4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 93873753499872 notifier 4545 bl.length()=610 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7faa4effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7faa4effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7faa4effd640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faa34003ea0 con 0x7fab6007d060 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 notify.3 [notify cookie 93873753746400 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify_complete (2) cookie 93873753746400 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab6402fa80 con 0x7fab6007d060 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.698+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbeebb0 con 0x5560afba6870 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v34'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab73f26800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab73f26800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab73f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93873753746304 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560afbefcf0 con 0x5560afbab3c0 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 93873753486976 notify 146028888068 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7fab60098040 con 0x5560afbab3c0 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7faa4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 93873753486976 notifier 4545 bl.length()=192 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 notify.2 [notify cookie 93873753746304 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7faa4e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7faa4e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:52:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7faa4e7fc640 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa9a4003400 con 0x5560afbab3c0 2024-09-21T08:52:01.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.700+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== watch-notify(notify_complete (2) cookie 93873753746304 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560afb67f80 con 0x5560afbab3c0 2024-09-21T08:52:01.712 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T08:52:01.698806Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:52:01.698796Z","tags":[],"group_ids":[]} 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.701+0000 7faa25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.701+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93873753512032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba1f60 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.702+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93873753512032] v34'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.702+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93873753489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x7fab6007d060 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.703+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93873753489504] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.703+0000 7fab73f26800 20 remove_watcher() i=0 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.703+0000 7fab73f26800 2 removed watcher, disabling cache 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.703+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93873753493888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba1f60 2024-09-21T08:52:01.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.704+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93873753493888] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.704+0000 7fab73f26800 20 remove_watcher() i=1 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.704+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93873753486976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afbab3c0 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.705+0000 7fab6fbe3640 1 -- 172.21.15.196:0/914128706 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93873753486976] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6007a030 con 0x5560afbab3c0 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.705+0000 7fab73f26800 20 remove_watcher() i=2 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.705+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93873753499872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x7fab6007d060 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.706+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93873753499872] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x7fab6007d060 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.706+0000 7fab73f26800 20 remove_watcher() i=3 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.706+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93873753501408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba1f60 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.707+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93873753501408] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab640391c0 con 0x5560afba1f60 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.707+0000 7fab73f26800 20 remove_watcher() i=4 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.707+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93873753506400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba6870 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.708+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93873753506400] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.708+0000 7fab73f26800 20 remove_watcher() i=5 2024-09-21T08:52:01.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.708+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93873753503424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba6870 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.710+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93873753503424] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.710+0000 7fab73f26800 20 remove_watcher() i=6 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.710+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93873753510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560afbea0b0 con 0x5560afba6870 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab703e4640 1 -- 172.21.15.196:0/914128706 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93873753510720] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6802a070 con 0x5560afba6870 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 20 remove_watcher() i=7 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afba6870 msgr2=0x5560afba8c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afba6870 0x5560afba8c60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afba1f60 msgr2=0x5560afba4420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afba1f60 0x5560afba4420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fab6007d060 msgr2=0x7fab600908f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fab6007d060 0x7fab600908f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5560afbab3c0 msgr2=0x5560afbad880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5560afbab3c0 0x5560afbad880 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa38036af0 msgr2=0x7faa38038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa38036af0 0x7faa38038fb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab6000a470 tx=0x7fab60093000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 msgr2=0x5560afb96320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/914128706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb8edb0 0x5560afb96320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fab6804bbd0 tx=0x7fab6804cc40 comp rx=0 tx=0).stop 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab6f3e2640 1 -- 172.21.15.196:0/914128706 reap_dead start 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 shutdown_connections 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 >> 172.21.15.196:0/914128706 conn(0x5560afb8b1a0 msgr2=0x5560afb89270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 shutdown_connections 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/914128706 wait complete. 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 msgr2=0x7faa48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 0x7faa48039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5560afb6f050 tx=0x7fab6008ec10 comp rx=0 tx=0).stop 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 msgr2=0x5560afb82600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5560afb6ef60 tx=0x7fab68018830 comp rx=0 tx=0).stop 2024-09-21T08:52:01.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 shutdown_connections 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa48036b90 0x7faa48039050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 --2- 172.21.15.196:0/2608343809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560afb821e0 0x5560afb82600 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 >> 172.21.15.196:0/2608343809 conn(0x5560afb77170 msgr2=0x5560afb79cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 shutdown_connections 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.711+0000 7fab73f26800 1 -- 172.21.15.196:0/2608343809 wait complete. 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 msgr2=0x5560afb732d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 0x5560afb732d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 msgr2=0x5560afb6e530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 0x5560afb6e530 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 msgr2=0x7faa58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 0x7faa58039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab64000f60 tx=0x7fab640012b0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 msgr2=0x5560afb674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5560afb609c0 tx=0x7fab60002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 shutdown_connections 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5560afb70ee0 0x5560afb732d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5560afa73b70 0x5560afb6e530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7faa58036b40 0x7faa58039000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 --2- 172.21.15.196:0/1370408189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560af9e2660 0x5560afb674c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 >> 172.21.15.196:0/1370408189 conn(0x5560afa68de0 msgr2=0x5560afb59d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 shutdown_connections 2024-09-21T08:52:01.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.712+0000 7fab73f26800 1 -- 172.21.15.196:0/1370408189 wait complete. 2024-09-21T08:52:01.723 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T08:52:01.698806Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:52:01.698796Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:01.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T08:52:01.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T08:52:01.723 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-21T08:52:01.771 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.771 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.769+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.769+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd1a1a0f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564fb081d650 0x564fb08ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd1a1a0f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fb0768b30 con 0x564fb08ac7b0 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd1a1a0f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564fb074a360 con 0x564fb081d650 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd19f503640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564fb081d650 0x564fb08ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd19f503640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564fb081d650 0x564fb08ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37296/0 (socket says 172.21.15.196:37296) 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd19f503640 1 -- 172.21.15.196:0/2493608179 learned_addr learned my addr 172.21.15.196:0/2493608179 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd196d02640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564fb08ac7b0 0x564fb08aeba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49474/0 (socket says 172.21.15.196:49474) 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd19f503640 1 -- 172.21.15.196:0/2493608179 >> v1:172.21.15.29:6789/0 conn(0x564fb08ac7b0 legacy=0x564fb08aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.770+0000 7fd19f503640 1 -- 172.21.15.196:0/2493608179 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb0770e00 con 0x564fb081d650 2024-09-21T08:52:01.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.772+0000 7fd19f503640 1 --2- 172.21.15.196:0/2493608179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb08ac270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd19000a520 tx=0x7fd190045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf4771c37a1d958 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.772+0000 7fd19ed02640 1 -- 172.21.15.196:0/2493608179 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd190055070 con 0x564fb081d650 2024-09-21T08:52:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.772+0000 7fd19ed02640 1 -- 172.21.15.196:0/2493608179 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1900515b0 con 0x564fb081d650 2024-09-21T08:52:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.772+0000 7fd19ed02640 1 -- 172.21.15.196:0/2493608179 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1900518d0 con 0x564fb081d650 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/2493608179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 msgr2=0x564fb08ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/2493608179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb08ac270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd19000a520 tx=0x7fd190045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/2493608179 shutdown_connections 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/2493608179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb08ac270 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/2493608179 >> 172.21.15.196:0/2493608179 conn(0x564fb08a3e00 msgr2=0x564fb08a6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/2493608179 shutdown_connections 2024-09-21T08:52:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.773+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/2493608179 wait complete. 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.786+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.786+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd1a1a0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd1a1a0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fb07f5350 con 0x564fb081d650 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd19f503640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd19f503640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37302/0 (socket says 172.21.15.196:37302) 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd19f503640 1 -- 172.21.15.196:0/3259056701 learned_addr learned my addr 172.21.15.196:0/3259056701 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd19f503640 1 -- 172.21.15.196:0/3259056701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb0742bc0 con 0x564fb081d650 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.787+0000 7fd19f503640 1 --2- 172.21.15.196:0/3259056701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd190025da0 tx=0x7fd190051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469f0c6ecd57727a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd08d60a640 1 -- 172.21.15.196:0/3259056701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd190051950 con 0x564fb081d650 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd08d60a640 1 -- 172.21.15.196:0/3259056701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd190051af0 con 0x564fb081d650 2024-09-21T08:52:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd08d60a640 1 -- 172.21.15.196:0/3259056701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd190051dd0 con 0x564fb081d650 2024-09-21T08:52:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/3259056701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 msgr2=0x564fb09988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/3259056701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd190025da0 tx=0x7fd190051000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/3259056701 shutdown_connections 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/3259056701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09988b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/3259056701 >> 172.21.15.196:0/3259056701 conn(0x564fb08a3e00 msgr2=0x564fb0994270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/3259056701 shutdown_connections 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.788+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/3259056701 wait complete. 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd1a1a0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd1a1a0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fb08b06b0 con 0x564fb081d650 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd19f503640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd19f503640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37312/0 (socket says 172.21.15.196:37312) 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.789+0000 7fd19f503640 1 -- 172.21.15.196:0/739101819 learned_addr learned my addr 172.21.15.196:0/739101819 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd19f503640 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb0756fe0 con 0x564fb081d650 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd19f503640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd190067040 tx=0x7fd190002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd08be07640 1 -- 172.21.15.196:0/739101819 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd190073070 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd08be07640 1 -- 172.21.15.196:0/739101819 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19005a450 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fb09a0660 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd08be07640 1 -- 172.21.15.196:0/739101819 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd19005a730 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.790+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb09a0be0 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd08be07640 1 -- 172.21.15.196:0/739101819 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd190076070 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd08be07640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 0x7fd084039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd08be07640 1 -- 172.21.15.196:0/739101819 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd190062070 con 0x564fb081d650 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd196d02640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 0x7fd084039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 0x564fb09a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09a7710 con 0x564fb08ac7b0 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd19fd04640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 0x564fb09a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd196d02640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 0x7fd084039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd188000f60 tx=0x7fd188001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.791+0000 7fd19fd04640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 0x564fb09a7190 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd19fd04640 1 -- 172.21.15.196:0/739101819 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd19800a4a0 con 0x564fb08ac7b0 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09a4760 con 0x564fb08ac7b0 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd19fd04640 1 -- 172.21.15.196:0/739101819 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd19800a4a0 con 0x564fb08ac7b0 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 0x564fb09abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ac520 con 0x564fb09a9a40 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.792+0000 7fd19f503640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 0x564fb09abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd19f503640 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 0x564fb09abe30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd19f503640 1 -- 172.21.15.196:0/739101819 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09a9a40 2024-09-21T08:52:01.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09a88e0 con 0x564fb08ac7b0 2024-09-21T08:52:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd19fd04640 1 -- 172.21.15.196:0/739101819 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd19800a4a0 con 0x564fb08ac7b0 2024-09-21T08:52:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09a8d80 con 0x564fb08ac7b0 2024-09-21T08:52:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.793+0000 7fd19fd04640 1 -- 172.21.15.196:0/739101819 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd19800a4a0 con 0x564fb08ac7b0 2024-09-21T08:52:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd1a1a0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd1a1a0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fb0744580 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37328/0 (socket says 172.21.15.196:37328) 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd19fd04640 1 -- 172.21.15.196:0/1699073765 learned_addr learned my addr 172.21.15.196:0/1699073765 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.794+0000 7fd19fd04640 1 -- 172.21.15.196:0/1699073765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb09bb7d0 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd19fd04640 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x564fb09a7af0 tx=0x7fd198018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd089602640 1 -- 172.21.15.196:0/1699073765 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd198014450 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd089602640 1 -- 172.21.15.196:0/1699073765 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd198014610 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fb09bba60 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd089602640 1 -- 172.21.15.196:0/1699073765 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd198014930 con 0x564fb09bae70 2024-09-21T08:52:01.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.795+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb09be740 con 0x564fb09bae70 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd089602640 1 -- 172.21.15.196:0/1699073765 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd198011040 con 0x564fb09bae70 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd089602640 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 0x7fd078039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd089602640 1 -- 172.21.15.196:0/1699073765 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd19801e070 con 0x564fb09bae70 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd19f503640 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 0x7fd078039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd19f503640 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 0x7fd078039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564fb09a7b90 tx=0x7fd19008f220 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd1a1a0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd1a1a0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fb0998fa0 con 0x564fb09c7a80 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37336/0 (socket says 172.21.15.196:37336) 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.796+0000 7fd19fd04640 1 -- 172.21.15.196:0/792716112 learned_addr learned my addr 172.21.15.196:0/792716112 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.797+0000 7fd19fd04640 1 -- 172.21.15.196:0/792716112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb09c83c0 con 0x564fb09c7a80 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.797+0000 7fd19fd04640 1 --2- 172.21.15.196:0/792716112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd19804cbc0 tx=0x7fd198011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c636c003d018a751 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.797+0000 7fd082ffd640 1 -- 172.21.15.196:0/792716112 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd198040150 con 0x564fb09c7a80 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.797+0000 7fd082ffd640 1 -- 172.21.15.196:0/792716112 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1980167e0 con 0x564fb09c7a80 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.797+0000 7fd082ffd640 1 -- 172.21.15.196:0/792716112 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd198014ad0 con 0x564fb09c7a80 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/792716112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 msgr2=0x564fb09c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/792716112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd19804cbc0 tx=0x7fd198011b10 comp rx=0 tx=0).stop 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/792716112 shutdown_connections 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/792716112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09c7e80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/792716112 >> 172.21.15.196:0/792716112 conn(0x564fb09c3e30 msgr2=0x564fb09c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/792716112 shutdown_connections 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/792716112 wait complete. 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 Processor -- start 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- start start 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd1a1a0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fb09c8a60 con 0x564fb09c7a80 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd19fd04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37338/0 (socket says 172.21.15.196:37338) 2024-09-21T08:52:01.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.798+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 learned_addr learned my addr 172.21.15.196:0/942589490 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb09cf4a0 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd19fd04640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd198011fd0 tx=0x7fd19804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd0817fa640 1 -- 172.21.15.196:0/942589490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd198011510 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd0817fa640 1 -- 172.21.15.196:0/942589490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1980116b0 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fb09cf730 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd0817fa640 1 -- 172.21.15.196:0/942589490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1980133b0 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.799+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb09d23e0 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.800+0000 7fd0817fa640 1 -- 172.21.15.196:0/942589490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd198013550 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.800+0000 7fd0817fa640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd068036b90 0x7fd068039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.800+0000 7fd0817fa640 1 -- 172.21.15.196:0/942589490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd198033030 con 0x564fb09c7a80 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.800+0000 7fd19f503640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd068036b90 0x7fd068039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.800+0000 7fd19f503640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd068036b90 0x7fd068039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd19005ab80 tx=0x7fd190094070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb09dabe0 0x564fb09dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09dd7f0 con 0x564fb09dabe0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd196d02640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb09dabe0 0x564fb09dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd196d02640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb09dabe0 0x564fb09dd0a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd18800f610 con 0x564fb09dabe0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 20 realm 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09da030 con 0x564fb09dabe0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.801+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd18800f610 con 0x564fb09dabe0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09de2e0 con 0x564fb09dabe0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd18800f610 con 0x564fb09dabe0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09debb0 con 0x564fb09dabe0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd18800f610 con 0x564fb09dabe0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09df5d0 0x564fb09e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e20b0 con 0x564fb09df5d0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.802+0000 7fd19fd04640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09df5d0 0x564fb09e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd19fd04640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09df5d0 0x564fb09e19c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd1a1a0f800 20 searching for the correct realm 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564fb09e4080 0x564fb09e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09e4080 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd19f503640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564fb09e4080 0x564fb09e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.803+0000 7fd19f503640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564fb09e4080 0x564fb09e6540 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd19f503640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd19009f070 0x7fd19006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x7fd19009f070 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd196d02640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd19009f070 0x7fd19006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd196d02640 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd19009f070 0x7fd19006e3c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18800f610 con 0x7fd19009f070 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.804+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09df5d0 2024-09-21T08:52:01.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09dabe0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18800f610 con 0x564fb09dabe0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09dabe0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09df5d0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09df5d0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.805+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x7fd19009f070 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09e4080 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09dabe0 2024-09-21T08:52:01.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09df5d0 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.806+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09dabe0 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x7fd19009f070 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e6c10 con 0x564fb09e4080 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.807+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09df5d0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09dabe0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09dabe0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.808+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09df5d0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x7fd19009f070 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09dabe0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.809+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09df5d0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09df5d0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x7fd19009f070 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.810+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09e4080 2024-09-21T08:52:01.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09df5d0 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x564fb09dabe0 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd1900ac040 con 0x7fd19009f070 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.811+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e2a70 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e2680 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e33a0 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 zone default found 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 4 Realm: () 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 zonegroup default 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.812+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e7090 con 0x564fb09df5d0 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e9340 con 0x564fb09e4080 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e96e0 con 0x564fb09e4080 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 started sync module instance, tier type = 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.813+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e87d0 con 0x7fd19009f070 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.814+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.814+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94900265585904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09e87d0 con 0x7fd19009f070 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.814+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ea150 con 0x564fb09dabe0 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.815+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94900265585904] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.816+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.816+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94900265583392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ea110 con 0x564fb09dabe0 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.816+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09eab90 con 0x564fb09e4080 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.817+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94900265583392] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.817+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.817+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94900265589856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ea080 con 0x564fb09e4080 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.817+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09eb950 con 0x7fd19009f070 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.818+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94900265589856] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.818+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.818+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94900265594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ebd40 con 0x7fd19009f070 2024-09-21T08:52:01.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.818+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ec7a0 con 0x564fb09dabe0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.819+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.819+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94900265599568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ec760 con 0x564fb09dabe0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.819+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ed700 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.819+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94900265594800] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.820+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.820+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94900265603600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ed700 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.820+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ee150 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.820+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94900265599568] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.821+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94900265603600] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.821+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.821+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94900265595856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09edc60 con 0x564fb09df5d0 2024-09-21T08:52:01.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.821+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ee620 con 0x564fb09df5d0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94900265595856] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94900265601936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09ee620 con 0x564fb09df5d0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=1 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=2 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=3 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=4 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=5 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.822+0000 7fd1a1a0f800 20 add_watcher() i=6 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94900265601936] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd1a1a0f800 20 add_watcher() i=7 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd1a1a0f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb09f1a50 con 0x564fb09dabe0 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.823+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94900265608000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb09eef10 con 0x564fb09dabe0 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94900265608000] v34'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd1a1a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd1a1a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd1a1a0f800 5 note: GC not initialized 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd054fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd1a1a0f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.824+0000 7fd1a1a0f800 20 Filter name: none 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fcfce7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a25030 con 0x564fb09df5d0 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.825+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a24a80 con 0x7fd19009f070 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:01.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a28800 con 0x564fb09dabe0 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.826+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a2cf00 con 0x7fd19009f070 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.828+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 foo.buckets [call] v34'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.828+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 8.b 8:d2ecee2c:root::.bucket.meta.testx%3amyfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a30810 con 0x564fb09e4080 2024-09-21T08:52:01.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [create,call,writefull 0~412,setxattr (203)] v34'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd1a1a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x7 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd1a1a0f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd1a1a0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd1a1a0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94900265870480 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301f0 con 0x564fb09dabe0 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== watch-notify(notify (1) cookie 94900265599568 notify 146028888075 ret 0) ==== 889+0+0 (crc 0 0 0) 0x564fb0a28bf0 con 0x564fb09dabe0 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd082ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94900265599568 notifier 4552 bl.length()=847 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 notify.4 [notify cookie 94900265870480 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd082ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x7 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd082ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:01.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd082ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd082ffd640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd064003ea0 con 0x564fb09dabe0 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.829+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== watch-notify(notify_complete (2) cookie 94900265870480 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fb0a27dd0 con 0x564fb09dabe0 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd1a1a0f800 20 handle_bi_update(): bucket=testx:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd1a1a0f800 20 handle_bi_update(): bucket=testx:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd1a1a0f800 20 handle_bi_update(): bucket=testx:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd1a1a0f800 20 handle_bi_update(): bucket=testx:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.830+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301d0 con 0x564fb09dabe0 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.831+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v34'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.831+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301d0 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd1a1a0f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd1a1a0f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd1a1a0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94900265876768 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a30140 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== watch-notify(notify (1) cookie 94900265599568 notify 146028888076 ret 0) ==== 390+0+0 (crc 0 0 0) 0x564fb0a30570 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd082ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94900265599568 notifier 4552 bl.length()=348 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd082ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd082ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd082ffd640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd064003ea0 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.4 [notify cookie 94900265876768 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== watch-notify(notify_complete (2) cookie 94900265876768 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fb0a2f4a0 con 0x564fb09dabe0 2024-09-21T08:52:01.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.832+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301d0 con 0x7fd19009f070 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(73 myfoo [call,delete] v34'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd1a1a0f800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd1a1a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94900265876768 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a30140 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== watch-notify(notify (1) cookie 94900265595856 notify 146028888075 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564fb09d23e0 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd0827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94900265595856 notifier 4552 bl.length()=149 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 notify.6 [notify cookie 94900265876768 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.834+0000 7fd0827fc640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcfd40032c0 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.835+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.835+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== watch-notify(notify_complete (2) cookie 94900265876768 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fb09cf730 con 0x564fb09df5d0 2024-09-21T08:52:01.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.835+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301d0 con 0x564fb09dabe0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(76 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call,delete] v34'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd1a1a0f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 from cache 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd1a1a0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94900265848480 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a301d0 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== watch-notify(notify (1) cookie 94900265603600 notify 146028888076 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564fb09cf730 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd082ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94900265603600 notifier 4552 bl.length()=206 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd082ffd640 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd064003ea0 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.836+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(77 notify.5 [notify cookie 94900265848480 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.837+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== watch-notify(notify_complete (2) cookie 94900265848480 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fb09cf4a0 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.837+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.837+0000 7fd055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.837+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94900265608000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09dabe0 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.838+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94900265608000] v34'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.838+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94900265585904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x7fd19009f070 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.839+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94900265585904] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.839+0000 7fd1a1a0f800 20 remove_watcher() i=0 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.839+0000 7fd1a1a0f800 2 removed watcher, disabling cache 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.839+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94900265583392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09dabe0 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.840+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94900265583392] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.840+0000 7fd1a1a0f800 20 remove_watcher() i=1 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.840+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94900265589856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09e4080 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.841+0000 7fd19f503640 1 -- 172.21.15.196:0/942589490 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94900265589856] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19007f070 con 0x564fb09e4080 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.841+0000 7fd1a1a0f800 20 remove_watcher() i=2 2024-09-21T08:52:01.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.841+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94900265594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x7fd19009f070 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.842+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94900265594800] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x7fd19009f070 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.842+0000 7fd1a1a0f800 20 remove_watcher() i=3 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.842+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94900265599568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09dabe0 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.843+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94900265599568] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd18802b040 con 0x564fb09dabe0 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.843+0000 7fd1a1a0f800 20 remove_watcher() i=4 2024-09-21T08:52:01.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.843+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94900265603600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.844+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94900265603600] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.844+0000 7fd1a1a0f800 20 remove_watcher() i=5 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.844+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94900265595856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.845+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94900265595856] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.845+0000 7fd1a1a0f800 20 remove_watcher() i=6 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.845+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94900265601936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564fb0a22be0 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd19fd04640 1 -- 172.21.15.196:0/942589490 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94900265601936] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd19802a070 con 0x564fb09df5d0 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 20 remove_watcher() i=7 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09df5d0 msgr2=0x564fb09e19c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09df5d0 0x564fb09e19c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb09dabe0 msgr2=0x564fb09dd0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb09dabe0 0x564fb09dd0a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd19009f070 msgr2=0x7fd19006e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd19009f070 0x7fd19006e3c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564fb09e4080 msgr2=0x564fb09e6540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564fb09e4080 0x564fb09e6540 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd068036b90 msgr2=0x7fd068039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.846+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd068036b90 0x7fd068039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd19005ab80 tx=0x7fd190094070 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 msgr2=0x564fb09cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd196d02640 1 -- 172.21.15.196:0/942589490 reap_dead start 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd198011fd0 tx=0x7fd19804cb50 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 shutdown_connections 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/942589490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09c7a80 0x564fb09cef60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 >> 172.21.15.196:0/942589490 conn(0x564fb09c3e30 msgr2=0x564fb09c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 shutdown_connections 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/942589490 wait complete. 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 msgr2=0x7fd078039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 0x7fd078039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564fb09a7b90 tx=0x7fd19008f220 comp rx=0 tx=0).stop 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 msgr2=0x564fb09bb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x564fb09a7af0 tx=0x7fd198018830 comp rx=0 tx=0).stop 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 shutdown_connections 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd078036b90 0x7fd078039050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/1699073765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb09bae70 0x564fb09bb290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 >> 172.21.15.196:0/1699073765 conn(0x564fb09afe00 msgr2=0x564fb09b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 shutdown_connections 2024-09-21T08:52:01.866 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/1699073765 wait complete. 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 msgr2=0x564fb09abe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 0x564fb09abe30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 msgr2=0x564fb09a7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 0x564fb09a7190 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 msgr2=0x7fd084039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 0x7fd084039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd188000f60 tx=0x7fd188001370 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 msgr2=0x564fb09a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.847+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd190067040 tx=0x7fd190002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 shutdown_connections 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564fb09a9a40 0x564fb09abe30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564fb08ac7b0 0x564fb09a7190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd084036b40 0x7fd084039000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 --2- 172.21.15.196:0/739101819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fb081d650 0x564fb09a0120 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 >> 172.21.15.196:0/739101819 conn(0x564fb08a3e00 msgr2=0x564fb0992ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 shutdown_connections 2024-09-21T08:52:01.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.848+0000 7fd1a1a0f800 1 -- 172.21.15.196:0/739101819 wait complete. 2024-09-21T08:52:01.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-21T08:52:01.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-21T08:52:01.868 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-21T08:52:01.911 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:01.911 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:01.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.909+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.909+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.909+0000 7ff100f32800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e3b4553630 0x55e3b45e2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff100f32800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e3b449eb30 con 0x55e3b45e2790 2024-09-21T08:52:01.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff100f32800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e3b4480360 con 0x55e3b4553630 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0fcc5c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e3b4553630 0x55e3b45e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0fcc5c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e3b4553630 0x55e3b45e2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37352/0 (socket says 172.21.15.196:37352) 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0f7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55e3b45e2790 0x55e3b45e4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49490/0 (socket says 172.21.15.196:49490) 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/3148694653 learned_addr learned my addr 172.21.15.196:0/3148694653 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/3148694653 >> v1:172.21.15.29:6789/0 conn(0x55e3b45e2790 legacy=0x55e3b45e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.910+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/3148694653 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b44a6e00 con 0x55e3b4553630 2024-09-21T08:52:01.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.912+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/3148694653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45e2250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a520 tx=0x7ff0f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582f43e72d6a7879 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.912+0000 7ff0f77fe640 1 -- 172.21.15.196:0/3148694653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0055070 con 0x55e3b4553630 2024-09-21T08:52:01.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.912+0000 7ff0f77fe640 1 -- 172.21.15.196:0/3148694653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f00515b0 con 0x55e3b4553630 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.912+0000 7ff0f77fe640 1 -- 172.21.15.196:0/3148694653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f00518d0 con 0x55e3b4553630 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 -- 172.21.15.196:0/3148694653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 msgr2=0x55e3b45e2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 --2- 172.21.15.196:0/3148694653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45e2250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000a520 tx=0x7ff0f0045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 -- 172.21.15.196:0/3148694653 shutdown_connections 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 --2- 172.21.15.196:0/3148694653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45e2250 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 -- 172.21.15.196:0/3148694653 >> 172.21.15.196:0/3148694653 conn(0x55e3b45d9de0 msgr2=0x55e3b45dc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 -- 172.21.15.196:0/3148694653 shutdown_connections 2024-09-21T08:52:01.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.913+0000 7ff100f32800 1 -- 172.21.15.196:0/3148694653 wait complete. 2024-09-21T08:52:01.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.926+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.926+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff100f32800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff100f32800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e3b452b330 con 0x55e3b4553630 2024-09-21T08:52:01.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff0fcc5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff0fcc5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37366/0 (socket says 172.21.15.196:37366) 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/3140017961 learned_addr learned my addr 172.21.15.196:0/3140017961 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/3140017961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b4478bc0 con 0x55e3b4553630 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.927+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/3140017961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0025da0 tx=0x7ff0f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1989f537fa5ce609 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7fefeae05640 1 -- 172.21.15.196:0/3140017961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0051890 con 0x55e3b4553630 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7fefeae05640 1 -- 172.21.15.196:0/3140017961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f0051ac0 con 0x55e3b4553630 2024-09-21T08:52:01.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7fefeae05640 1 -- 172.21.15.196:0/3140017961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0051da0 con 0x55e3b4553630 2024-09-21T08:52:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 -- 172.21.15.196:0/3140017961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 msgr2=0x55e3b46ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 --2- 172.21.15.196:0/3140017961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0025da0 tx=0x7ff0f0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 -- 172.21.15.196:0/3140017961 shutdown_connections 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 --2- 172.21.15.196:0/3140017961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b46ce910 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 -- 172.21.15.196:0/3140017961 >> 172.21.15.196:0/3140017961 conn(0x55e3b45d9de0 msgr2=0x55e3b46ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 -- 172.21.15.196:0/3140017961 shutdown_connections 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.928+0000 7ff100f32800 1 -- 172.21.15.196:0/3140017961 wait complete. 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff100f32800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff100f32800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e3b45e6690 con 0x55e3b4553630 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff0fcc5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff0fcc5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37378/0 (socket says 172.21.15.196:37378) 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1735033074 learned_addr learned my addr 172.21.15.196:0/1735033074 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b448cfe0 con 0x55e3b4553630 2024-09-21T08:52:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.929+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0025da0 tx=0x7ff0f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7fefe9602640 1 -- 172.21.15.196:0/1735033074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0073070 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7fefe9602640 1 -- 172.21.15.196:0/1735033074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f005a580 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3b45de270 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7fefe9602640 1 -- 172.21.15.196:0/1735033074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f005a860 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b45de7f0 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.930+0000 7fefe9602640 1 -- 172.21.15.196:0/1735033074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0f0076070 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7fefe9602640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 0x7fefe4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7fefe9602640 1 -- 172.21.15.196:0/1735033074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff0f0062070 con 0x55e3b4553630 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 0x7fefe4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 0x55e3b46df5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b46dfb20 con 0x55e3b45e2790 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 0x55e3b46df5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 0x7fefe4039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000f60 tx=0x7ff0e8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 0x55e3b46df5e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.931+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1735033074 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f800a4a0 con 0x55e3b45e2790 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b46e03a0 con 0x55e3b45e2790 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1735033074 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0f800a4a0 con 0x55e3b45e2790 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 0x55e3b46e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b46e49f0 con 0x55e3b46e1dd0 2024-09-21T08:52:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 0x55e3b46e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.932+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 0x55e3b46e4260 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.933+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1735033074 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b46e1dd0 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.933+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b46e0bf0 con 0x55e3b45e2790 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.933+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1735033074 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0f800a4a0 con 0x55e3b45e2790 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.933+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b46e0f90 con 0x55e3b45e2790 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.933+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1735033074 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0f800a4a0 con 0x55e3b45e2790 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff100f32800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff100f32800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e3b45e00c0 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37380/0 (socket says 172.21.15.196:37380) 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff0fd45d640 1 -- 172.21.15.196:0/2979844626 learned_addr learned my addr 172.21.15.196:0/2979844626 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff0fd45d640 1 -- 172.21.15.196:0/2979844626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b46f3cd0 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.934+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55e3b45df6e0 tx=0x7ff0f80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7fefe27fc640 1 -- 172.21.15.196:0/2979844626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8014450 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7fefe27fc640 1 -- 172.21.15.196:0/2979844626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f80145f0 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3b46f3f60 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7fefe27fc640 1 -- 172.21.15.196:0/2979844626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80148d0 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b46f6c40 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.935+0000 7fefe27fc640 1 -- 172.21.15.196:0/2979844626 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0f8011040 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7fefe27fc640 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 0x7fefd4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7fefe27fc640 1 -- 172.21.15.196:0/2979844626 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff0f801e070 con 0x55e3b46f3370 2024-09-21T08:52:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 0x7fefd4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 0x7fefd4039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55e3b45dedb0 tx=0x7ff0f008f3d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff100f32800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff100f32800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e3b447a580 con 0x55e3b46ffff0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37386/0 (socket says 172.21.15.196:37386) 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.936+0000 7ff0fd45d640 1 -- 172.21.15.196:0/3645239672 learned_addr learned my addr 172.21.15.196:0/3645239672 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff0fd45d640 1 -- 172.21.15.196:0/3645239672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b47009c0 con 0x55e3b46ffff0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/3645239672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff0f804cbb0 tx=0x7ff0f8011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d17cfccd84a2a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7fefd3fff640 1 -- 172.21.15.196:0/3645239672 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8013dc0 con 0x55e3b46ffff0 2024-09-21T08:52:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7fefd3fff640 1 -- 172.21.15.196:0/3645239672 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8014a70 con 0x55e3b46ffff0 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7fefd3fff640 1 -- 172.21.15.196:0/3645239672 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8014d50 con 0x55e3b46ffff0 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 -- 172.21.15.196:0/3645239672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 msgr2=0x55e3b47003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 --2- 172.21.15.196:0/3645239672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff0f804cbb0 tx=0x7ff0f8011970 comp rx=0 tx=0).stop 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 -- 172.21.15.196:0/3645239672 shutdown_connections 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 --2- 172.21.15.196:0/3645239672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b47003f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 -- 172.21.15.196:0/3645239672 >> 172.21.15.196:0/3645239672 conn(0x55e3b46fc350 msgr2=0x55e3b46fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 -- 172.21.15.196:0/3645239672 shutdown_connections 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.937+0000 7ff100f32800 1 -- 172.21.15.196:0/3645239672 wait complete. 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff100f32800 1 Processor -- start 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff100f32800 1 -- start start 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff100f32800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff100f32800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e3b4700eb0 con 0x55e3b46ffff0 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff0fd45d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37390/0 (socket says 172.21.15.196:37390) 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 learned_addr learned my addr 172.21.15.196:0/1755043803 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b4707880 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8011be0 tx=0x7ff0f804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.938+0000 7fefd27fc640 1 -- 172.21.15.196:0/1755043803 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8044030 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7fefd27fc640 1 -- 172.21.15.196:0/1755043803 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8022a80 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3b4707b10 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7fefd27fc640 1 -- 172.21.15.196:0/1755043803 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8022d80 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b470a7c0 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7fefd27fc640 1 -- 172.21.15.196:0/1755043803 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0f802b350 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.939+0000 7fefd27fc640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefc8036b90 0x7fefc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7fefd27fc640 1 -- 172.21.15.196:0/1755043803 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff0f8045070 con 0x55e3b46ffff0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefc8036b90 0x7fefc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b4712fd0 0x55e3b4715490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4715be0 con 0x55e3b4712fd0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b4712fd0 0x55e3b4715490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefc8036b90 0x7fefc8039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff0f005cfd0 tx=0x7ff0f0089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b4712fd0 0x55e3b4715490 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e800f610 con 0x55e3b4712fd0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 20 realm 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.940+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4712420 con 0x55e3b4712fd0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e800f610 con 0x55e3b4712fd0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b47166c0 con 0x55e3b4712fd0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e800f610 con 0x55e3b4712fd0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4716f90 con 0x55e3b4712fd0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0e800f610 con 0x55e3b4712fd0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b4717840 0x55e3b4719c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.941+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471a3b0 con 0x55e3b4717840 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b4717840 0x55e3b4719c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff0fd45d640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b4717840 0x55e3b4719c50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff100f32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff100f32800 20 searching for the correct realm 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e3b471c4b0 0x55e3b471e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.942+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e3b471c4b0 0x55e3b471e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e3b471c4b0 0x55e3b471e970 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0fcc5c640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0f0078070 0x7ff0f00643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0f0078070 0x7ff0f00643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0f7fff640 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0f0078070 0x7ff0f00643b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e800f610 con 0x7ff0f0078070 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.943+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e800f610 con 0x55e3b4712fd0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.944+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.945+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.946+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.947+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.948+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.949+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b471c4b0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4717840 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x55e3b4712fd0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.950+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f040 con 0x7ff0f0078070 2024-09-21T08:52:01.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471aeb0 con 0x55e3b4712fd0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471b300 con 0x55e3b4712fd0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:01.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471b7a0 con 0x55e3b4712fd0 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 zone default found 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 4 Realm: () 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 zonegroup default 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.951+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471f4c0 con 0x55e3b4717840 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b471aac0 con 0x55e3b471c4b0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4721810 con 0x55e3b471c4b0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 started sync module instance, tier type = 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.952+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4720b80 con 0x7ff0f0078070 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.953+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.953+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94436473311392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4720b80 con 0x7ff0f0078070 2024-09-21T08:52:01.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.953+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b47223c0 con 0x55e3b4712fd0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.954+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.954+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94436473311392] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.954+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94436473314960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4722380 con 0x55e3b4712fd0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.954+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b47206d0 con 0x55e3b471c4b0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.955+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.955+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94436473319088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4723780 con 0x55e3b471c4b0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.955+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4724140 con 0x7ff0f0078070 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.956+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94436473314960] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.956+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94436473319088] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.957+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.957+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94436473317152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4724140 con 0x7ff0f0078070 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.957+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b47249e0 con 0x55e3b4712fd0 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.958+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94436473317152] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.958+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.958+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94436473323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4724880 con 0x55e3b4712fd0 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.958+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4725340 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.959+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94436473323120] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.959+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.959+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94436473327120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4725730 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.959+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4725730 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.960+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94436473327120] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.960+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.960+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94436473324240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4726180 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.960+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4726b80 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94436473324240] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94436473330752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4726b40 con 0x55e3b4717840 2024-09-21T08:52:01.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=0 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=1 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=2 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=3 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=4 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=5 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.961+0000 7ff100f32800 20 add_watcher() i=6 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.962+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94436473330752] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.962+0000 7ff100f32800 20 add_watcher() i=7 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.962+0000 7ff100f32800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.962+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4729fd0 con 0x55e3b4712fd0 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.962+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.963+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94436473333856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4727490 con 0x55e3b4712fd0 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.963+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94436473333856] v34'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7fefb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 5 note: GC not initialized 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7fefb1fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 20 Filter name: none 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7fef237fe640 20 reqs_thread_entry: start 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 20 rados->read ofs=0 len=0 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.964+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3b475cec0 con 0x55e3b4712fd0 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.965+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.965+0000 7ff100f32800 20 rados_obj.operate() r=0 bl.length=193 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.966+0000 7fefb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:01.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.966+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94436473333856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b475ad20 con 0x55e3b4712fd0 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.967+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94436473333856] v34'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.967+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94436473311392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b475ad20 con 0x7ff0f0078070 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.969+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94436473311392] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.969+0000 7ff100f32800 20 remove_watcher() i=0 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.969+0000 7ff100f32800 2 removed watcher, disabling cache 2024-09-21T08:52:01.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.969+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94436473314960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b475ad20 con 0x55e3b4712fd0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.970+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94436473314960] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.970+0000 7ff100f32800 20 remove_watcher() i=1 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.970+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94436473319088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b475ad20 con 0x55e3b471c4b0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.971+0000 7ff0fcc5c640 1 -- 172.21.15.196:0/1755043803 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94436473319088] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f007f070 con 0x55e3b471c4b0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.971+0000 7ff100f32800 20 remove_watcher() i=2 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.971+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94436473317152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4722eb0 con 0x7ff0f0078070 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.972+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94436473317152] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x7ff0f0078070 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.972+0000 7ff100f32800 20 remove_watcher() i=3 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.972+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94436473323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4722720 con 0x55e3b4712fd0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.973+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94436473323120] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0e802b040 con 0x55e3b4712fd0 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.973+0000 7ff100f32800 20 remove_watcher() i=4 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.973+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94436473327120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4722eb0 con 0x55e3b4717840 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.974+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94436473327120] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.974+0000 7ff100f32800 20 remove_watcher() i=5 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.974+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94436473324240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4722720 con 0x55e3b4717840 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.975+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94436473324240] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.975+0000 7ff100f32800 20 remove_watcher() i=6 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.975+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94436473330752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3b4724320 con 0x55e3b4717840 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff0fd45d640 1 -- 172.21.15.196:0/1755043803 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94436473330752] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f802a070 con 0x55e3b4717840 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 20 remove_watcher() i=7 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b4717840 msgr2=0x55e3b4719c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b4717840 0x55e3b4719c50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b4712fd0 msgr2=0x55e3b4715490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b4712fd0 0x55e3b4715490 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0f0078070 msgr2=0x7ff0f00643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0f0078070 0x7ff0f00643b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e3b471c4b0 msgr2=0x55e3b471e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e3b471c4b0 0x55e3b471e970 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefc8036b90 msgr2=0x7fefc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefc8036b90 0x7fefc8039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff0f005cfd0 tx=0x7ff0f0089000 comp rx=0 tx=0).stop 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 msgr2=0x55e3b4707340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff0f7fff640 1 -- 172.21.15.196:0/1755043803 reap_dead start 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8011be0 tx=0x7ff0f804cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 shutdown_connections 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 --2- 172.21.15.196:0/1755043803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46ffff0 0x55e3b4707340 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 >> 172.21.15.196:0/1755043803 conn(0x55e3b46fc350 msgr2=0x55e3b46fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 shutdown_connections 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.976+0000 7ff100f32800 1 -- 172.21.15.196:0/1755043803 wait complete. 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 msgr2=0x7fefd4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 0x7fefd4039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55e3b45dedb0 tx=0x7ff0f008f3d0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 msgr2=0x55e3b46f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55e3b45df6e0 tx=0x7ff0f80188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 shutdown_connections 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefd4036b90 0x7fefd4039050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/2979844626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b46f3370 0x55e3b46f3790 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 >> 172.21.15.196:0/2979844626 conn(0x55e3b46e8300 msgr2=0x55e3b46eae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 shutdown_connections 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/2979844626 wait complete. 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 msgr2=0x55e3b46e4260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 0x55e3b46e4260 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 msgr2=0x55e3b46df5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 0x55e3b46df5e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 msgr2=0x7fefe4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 0x7fefe4039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000f60 tx=0x7ff0e8001370 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 msgr2=0x55e3b45dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0025da0 tx=0x7ff0f0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 shutdown_connections 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e3b46e1dd0 0x55e3b46e4260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e3b45e2790 0x55e3b46df5e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefe4036b40 0x7fefe4039000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 --2- 172.21.15.196:0/1735033074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e3b4553630 0x55e3b45dfb80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 >> 172.21.15.196:0/1735033074 conn(0x55e3b45d9de0 msgr2=0x55e3b46c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 shutdown_connections 2024-09-21T08:52:01.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:01.977+0000 7ff100f32800 1 -- 172.21.15.196:0/1735033074 wait complete. 2024-09-21T08:52:01.988 INFO:teuthology.orchestra.run.smithi196.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"bMciPWHBfzeNWxCSTh7EQU7/","ver":2},"mtime":"2024-09-21T08:52:01.832875Z","data":{"bucket":{"name":"myfoo","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","bucket_id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-21T08:51:59.475959Z","linked":true,"has_bucket_info":false}} 2024-09-21T08:52:01.988 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'bMciPWHBfzeNWxCSTh7EQU7/', 'ver': 2}, 'mtime': '2024-09-21T08:52:01.832875Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'bucket_id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-21T08:51:59.475959Z', 'linked': True, 'has_bucket_info': False}} 2024-09-21T08:52:01.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-21T08:52:01.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-21T08:52:01.989 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-21T08:52:02.076 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.076 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bfa40800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c83f823650 0x55c83f8b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bfa40800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c83f76eb30 con 0x55c83f8b2720 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bfa40800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c83f750360 con 0x55c83f823650 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bd534640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c83f823650 0x55c83f8b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bd534640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c83f823650 0x55c83f8b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37396/0 (socket says 172.21.15.196:37396) 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bd534640 1 -- 172.21.15.196:0/651650517 learned_addr learned my addr 172.21.15.196:0/651650517 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bcd33640 1 --1- 172.21.15.196:0/651650517 >> v1:172.21.15.29:6789/0 conn(0x55c83f8b2720 0x55c83f8b4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49492/0 (socket says 172.21.15.196:49492) 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bd534640 1 -- 172.21.15.196:0/651650517 >> v1:172.21.15.29:6789/0 conn(0x55c83f8b2720 legacy=0x55c83f8b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.075+0000 7f37bd534640 1 -- 172.21.15.196:0/651650517 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f776e00 con 0x55c83f823650 2024-09-21T08:52:02.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.077+0000 7f37bd534640 1 --2- 172.21.15.196:0/651650517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f8b21e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f37b000a520 tx=0x7f37b0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2115190cdbeb4858 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.077+0000 7f37affff640 1 -- 172.21.15.196:0/651650517 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0055070 con 0x55c83f823650 2024-09-21T08:52:02.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.077+0000 7f37affff640 1 -- 172.21.15.196:0/651650517 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b00515b0 con 0x55c83f823650 2024-09-21T08:52:02.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.077+0000 7f37affff640 1 -- 172.21.15.196:0/651650517 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b00518d0 con 0x55c83f823650 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 -- 172.21.15.196:0/651650517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 msgr2=0x55c83f8b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 --2- 172.21.15.196:0/651650517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f8b21e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f37b000a520 tx=0x7f37b0045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 -- 172.21.15.196:0/651650517 shutdown_connections 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 --2- 172.21.15.196:0/651650517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f8b21e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 -- 172.21.15.196:0/651650517 >> 172.21.15.196:0/651650517 conn(0x55c83f8a9db0 msgr2=0x55c83f8ac1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 -- 172.21.15.196:0/651650517 shutdown_connections 2024-09-21T08:52:02.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.078+0000 7f37bfa40800 1 -- 172.21.15.196:0/651650517 wait complete. 2024-09-21T08:52:02.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.091+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.091+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.091+0000 7f37bfa40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.091+0000 7f37bfa40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c83f7fb360 con 0x55c83f823650 2024-09-21T08:52:02.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.092+0000 7f37bd534640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.092+0000 7f37bd534640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37400/0 (socket says 172.21.15.196:37400) 2024-09-21T08:52:02.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.092+0000 7f37bd534640 1 -- 172.21.15.196:0/216336775 learned_addr learned my addr 172.21.15.196:0/216336775 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.092+0000 7f37bd534640 1 -- 172.21.15.196:0/216336775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f748bc0 con 0x55c83f823650 2024-09-21T08:52:02.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.092+0000 7f37bd534640 1 --2- 172.21.15.196:0/216336775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f37b0025da0 tx=0x7f37b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cec07782449b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f36ab606640 1 -- 172.21.15.196:0/216336775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0051890 con 0x55c83f823650 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f36ab606640 1 -- 172.21.15.196:0/216336775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0051ac0 con 0x55c83f823650 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f36ab606640 1 -- 172.21.15.196:0/216336775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0051da0 con 0x55c83f823650 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 -- 172.21.15.196:0/216336775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 msgr2=0x55c83f99e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 --2- 172.21.15.196:0/216336775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f37b0025da0 tx=0x7f37b0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 -- 172.21.15.196:0/216336775 shutdown_connections 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 --2- 172.21.15.196:0/216336775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f99e880 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 -- 172.21.15.196:0/216336775 >> 172.21.15.196:0/216336775 conn(0x55c83f8a9db0 msgr2=0x55c83f99a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 -- 172.21.15.196:0/216336775 shutdown_connections 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.093+0000 7f37bfa40800 1 -- 172.21.15.196:0/216336775 wait complete. 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bfa40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bfa40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c83f8b6620 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bd534640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bd534640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37404/0 (socket says 172.21.15.196:37404) 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bd534640 1 -- 172.21.15.196:0/3765913713 learned_addr learned my addr 172.21.15.196:0/3765913713 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bd534640 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f75cfe0 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.094+0000 7f37bd534640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f37b0025da0 tx=0x7f37b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f36a9e03640 1 -- 172.21.15.196:0/3765913713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b0073070 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f36a9e03640 1 -- 172.21.15.196:0/3765913713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b005a580 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f36a9e03640 1 -- 172.21.15.196:0/3765913713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b005a860 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c83f9a6660 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83f9a6be0 con 0x55c83f823650 2024-09-21T08:52:02.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f36a9e03640 1 -- 172.21.15.196:0/3765913713 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b0076070 con 0x55c83f823650 2024-09-21T08:52:02.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.095+0000 7f36a9e03640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f36a9e03640 1 -- 172.21.15.196:0/3765913713 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b0062070 con 0x55c83f823650 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bcd33640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 0x55c83f9ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ad800 con 0x55c83f8b2720 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bdd35640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 0x55c83f9ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bcd33640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f60 tx=0x7f37b4001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bdd35640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 0x55c83f9ad190 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bdd35640 1 -- 172.21.15.196:0/3765913713 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b800a4a0 con 0x55c83f8b2720 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.096+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9aa740 con 0x55c83f8b2720 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bdd35640 1 -- 172.21.15.196:0/3765913713 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b800a4a0 con 0x55c83f8b2720 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 0x55c83f9b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9b2610 con 0x55c83f9afb30 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bd534640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 0x55c83f9b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bd534640 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 0x55c83f9b1f20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bd534640 1 -- 172.21.15.196:0/3765913713 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9afb30 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.097+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ae9d0 con 0x55c83f8b2720 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.098+0000 7f37bdd35640 1 -- 172.21.15.196:0/3765913713 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b800a4a0 con 0x55c83f8b2720 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.098+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9aee70 con 0x55c83f8b2720 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.098+0000 7f37bdd35640 1 -- 172.21.15.196:0/3765913713 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37b800a4a0 con 0x55c83f8b2720 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.098+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.098+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bfa40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bfa40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c83f74a580 con 0x55c83f9c0f60 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37414/0 (socket says 172.21.15.196:37414) 2024-09-21T08:52:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bdd35640 1 -- 172.21.15.196:0/2964330034 learned_addr learned my addr 172.21.15.196:0/2964330034 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bdd35640 1 -- 172.21.15.196:0/2964330034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f9c18c0 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bdd35640 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55c83f9adc00 tx=0x7f37b8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f36a2ffd640 1 -- 172.21.15.196:0/2964330034 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8014450 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f36a2ffd640 1 -- 172.21.15.196:0/2964330034 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8014610 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c83f9c1b50 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.099+0000 7f36a2ffd640 1 -- 172.21.15.196:0/2964330034 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8014930 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.100+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83f9c4830 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f36a2ffd640 1 -- 172.21.15.196:0/2964330034 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b8011040 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f36a2ffd640 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f36a2ffd640 1 -- 172.21.15.196:0/2964330034 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b801e070 con 0x55c83f9c0f60 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bd534640 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bd534640 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c83f9adca0 tx=0x7f37b008f3d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bfa40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.101+0000 7f37bfa40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c83f99ef70 con 0x55c83f9cdbc0 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37420/0 (socket says 172.21.15.196:37420) 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f37bdd35640 1 -- 172.21.15.196:0/670355169 learned_addr learned my addr 172.21.15.196:0/670355169 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f37bdd35640 1 -- 172.21.15.196:0/670355169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f9ce590 con 0x55c83f9cdbc0 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f37bdd35640 1 --2- 172.21.15.196:0/670355169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37b804cbc0 tx=0x7f37b8011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d3f9aaf20c08de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f36a0ff9640 1 -- 172.21.15.196:0/670355169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8040150 con 0x55c83f9cdbc0 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f36a0ff9640 1 -- 172.21.15.196:0/670355169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b80167e0 con 0x55c83f9cdbc0 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.102+0000 7f36a0ff9640 1 -- 172.21.15.196:0/670355169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8014ad0 con 0x55c83f9cdbc0 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- 172.21.15.196:0/670355169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 msgr2=0x55c83f9cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 --2- 172.21.15.196:0/670355169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37b804cbc0 tx=0x7f37b8011b10 comp rx=0 tx=0).stop 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- 172.21.15.196:0/670355169 shutdown_connections 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 --2- 172.21.15.196:0/670355169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9cdfc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- 172.21.15.196:0/670355169 >> 172.21.15.196:0/670355169 conn(0x55c83f9c9f20 msgr2=0x55c83f9c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- 172.21.15.196:0/670355169 shutdown_connections 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- 172.21.15.196:0/670355169 wait complete. 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 Processor -- start 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- start start 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bfa40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c83f9cec00 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bdd35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37424/0 (socket says 172.21.15.196:37424) 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 learned_addr learned my addr 172.21.15.196:0/1410688572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.103+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83f9d5540 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f37bdd35640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9d5000 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f37b8011fd0 tx=0x7f37b804cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f368effd640 1 -- 172.21.15.196:0/1410688572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8013cf0 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f368effd640 1 -- 172.21.15.196:0/1410688572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8011720 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c83f9d57d0 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f368effd640 1 -- 172.21.15.196:0/1410688572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b80134e0 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.104+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83f9d8480 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.105+0000 7f368effd640 1 -- 172.21.15.196:0/1410688572 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37b8013680 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.105+0000 7f368effd640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.105+0000 7f368effd640 1 -- 172.21.15.196:0/1410688572 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f37b8033030 con 0x55c83f9cdbc0 2024-09-21T08:52:02.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.105+0000 7f37bd534640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.105+0000 7f37bd534640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37b005cfd0 tx=0x7f37b0089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f9e0c70 0x55c83f9e3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e3880 con 0x55c83f9e0c70 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bcd33640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f9e0c70 0x55c83f9e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bcd33640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f9e0c70 0x55c83f9e3130 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f610 con 0x55c83f9e0c70 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 realm 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e00c0 con 0x55c83f9e0c70 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f610 con 0x55c83f9e0c70 2024-09-21T08:52:02.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.106+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e4370 con 0x55c83f9e0c70 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b400f610 con 0x55c83f9e0c70 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e4c40 con 0x55c83f9e0c70 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b400f610 con 0x55c83f9e0c70 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9e5660 0x55c83f9e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e8140 con 0x55c83f9e5660 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.107+0000 7f37bdd35640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9e5660 0x55c83f9e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bdd35640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9e5660 0x55c83f9e7a50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bfa40800 20 searching for the correct realm 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c83f9ea110 0x55c83f9ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bd534640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c83f9ea110 0x55c83f9ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bd534640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c83f9ea110 0x55c83f9ec5d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.108+0000 7f37bd534640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0078070 0x7f37b00643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bcd33640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0078070 0x7f37b00643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bcd33640 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0078070 0x7f37b00643b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b400f610 con 0x7f37b0078070 2024-09-21T08:52:02.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.109+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b400f610 con 0x55c83f9e0c70 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.110+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.111+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.112+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.113+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.114+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.115+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9ea110 2024-09-21T08:52:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e5660 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x55c83f9e0c70 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.116+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ecca0 con 0x7f37b0078070 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e8b00 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e8740 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9e94a0 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 zone default found 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 4 Realm: () 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 zonegroup default 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.117+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ed1b0 con 0x55c83f9e5660 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ef480 con 0x55c83f9ea110 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ef820 con 0x55c83f9ea110 2024-09-21T08:52:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 started sync module instance, tier type = 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.118+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ee8c0 con 0x7f37b0078070 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.119+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.119+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94318549200352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9ee8c0 con 0x7f37b0078070 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.119+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f0240 con 0x55c83f9e0c70 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.120+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.120+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94318549204272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f0240 con 0x55c83f9e0c70 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.120+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f1220 con 0x55c83f9ea110 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.120+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94318549200352] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.121+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94318549204272] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.122+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.122+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94318549206624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f0d30 con 0x55c83f9ea110 2024-09-21T08:52:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.122+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f1c60 con 0x7f37b0078070 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.123+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94318549206624] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.123+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.123+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94318549211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f2080 con 0x7f37b0078070 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.123+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f28d0 con 0x55c83f9e0c70 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.124+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94318549211056] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.124+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.124+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94318549212592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f2720 con 0x55c83f9e0c70 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.124+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f32e0 con 0x55c83f9e5660 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.125+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94318549212592] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.125+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.125+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94318549216816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f3680 con 0x55c83f9e5660 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.125+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f4040 con 0x55c83f9e5660 2024-09-21T08:52:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.126+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94318549216816] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.126+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.126+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94318549213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f4040 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.126+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f4ab0 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94318549213648] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94318549222816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f4c90 con 0x55c83f9e5660 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=0 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=1 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=2 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=3 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=4 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=5 2024-09-21T08:52:02.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.127+0000 7f37bfa40800 20 add_watcher() i=6 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.128+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94318549222816] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.128+0000 7f37bfa40800 20 add_watcher() i=7 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.128+0000 7f37bfa40800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.128+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f8060 con 0x55c83f9e0c70 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.129+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.129+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94318549224320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83f9f5480 con 0x55c83f9e0c70 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94318549224320] v34'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f36737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f37bfa40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f37bfa40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f37bfa40800 5 note: GC not initialized 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f36727e4640 20 reqs_thread_entry: start 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.130+0000 7f37bfa40800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 20 Filter name: none 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f35e3fff640 20 reqs_thread_entry: start 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa2b3c0 con 0x55c83f9e0c70 2024-09-21T08:52:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.131+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa2aee0 con 0x55c83f9e0c70 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 8.b 8:d2ecee2c:root::.bucket.meta.testx%3amyfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa2eca0 con 0x55c83f9ea110 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.132+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa33560 con 0x55c83f9e0c70 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.133+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v34'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.133+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa36e70 con 0x55c83f9e0c70 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.134+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [create,call,writefull 0~379,setxattr (123)] v34'6 uv6 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bfa40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x7 2024-09-21T08:52:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bfa40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bfa40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bfa40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94318549486608 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa368b0 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== watch-notify(notify (1) cookie 94318549216816 notify 146028888077 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55c83f9d8480 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f36a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94318549216816 notifier 4566 bl.length()=728 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f36a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x7 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f36a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f36a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f36a0ff9640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3680003ea0 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(67 notify.5 [notify cookie 94318549486608 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.135+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify_complete (2) cookie 94318549486608 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c83f9d57d0 con 0x55c83f9e5660 2024-09-21T08:52:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bfa40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bfa40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bfa40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bfa40800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.136+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa369b0 con 0x7f37b0078070 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.137+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(69 foo.buckets [call] v34'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.137+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa369b0 con 0x7f37b0078070 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bfa40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bfa40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bfa40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94318549492992 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa36920 con 0x55c83f9e5660 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== watch-notify(notify (1) cookie 94318549213648 notify 146028888078 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55c83f9d5540 con 0x55c83f9e5660 2024-09-21T08:52:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f368ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94318549213648 notifier 4566 bl.length()=314 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f368ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f368ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f368ffff640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f35f0003400 con 0x55c83f9e5660 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.138+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(71 notify.6 [notify cookie 94318549492992 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.139+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== watch-notify(notify_complete (2) cookie 94318549492992 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c83f9ce590 con 0x55c83f9e5660 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.139+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.139+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa369b0 con 0x55c83f9e0c70 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bfa40800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bfa40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94318549492992 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa36920 con 0x55c83f9e0c70 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify (1) cookie 94318549212592 notify 146028888077 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55c83fa36d50 con 0x55c83f9e0c70 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f36a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94318549212592 notifier 4566 bl.length()=155 2024-09-21T08:52:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f36a0ff9640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3680003ea0 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(74 notify.4 [notify cookie 94318549492992 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== watch-notify(notify_complete (2) cookie 94318549492992 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c83fa35c20 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.140+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:76 8.b 8:d2ecee2c:root::.bucket.meta.testx%3amyfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa369b0 con 0x55c83f9ea110 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.141+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call,delete] v34'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.141+0000 7f37bfa40800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 from cache 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.141+0000 7f37bfa40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.141+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94318549492992 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa31f10 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== watch-notify(notify (1) cookie 94318549212592 notify 146028888078 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55c83fa35c20 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f368ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94318549212592 notifier 4566 bl.length()=212 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f368ffff640 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f35f0003470 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(77 notify.4 [notify cookie 94318549492992 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== watch-notify(notify_complete (2) cookie 94318549492992 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c83fa37210 con 0x55c83f9e0c70 2024-09-21T08:52:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.142+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.143+0000 7f36737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.143+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94318549224320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e0c70 2024-09-21T08:52:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.144+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94318549224320] v34'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.144+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94318549200352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x7f37b0078070 2024-09-21T08:52:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.145+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94318549200352] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.145+0000 7f37bfa40800 20 remove_watcher() i=0 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.145+0000 7f37bfa40800 2 removed watcher, disabling cache 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.145+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94318549204272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e0c70 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.146+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94318549204272] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.146+0000 7f37bfa40800 20 remove_watcher() i=1 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.146+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94318549206624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9ea110 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.147+0000 7f37bd534640 1 -- 172.21.15.196:0/1410688572 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94318549206624] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b007f070 con 0x55c83f9ea110 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.147+0000 7f37bfa40800 20 remove_watcher() i=2 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.147+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94318549211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x7f37b0078070 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.148+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94318549211056] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x7f37b0078070 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.148+0000 7f37bfa40800 20 remove_watcher() i=3 2024-09-21T08:52:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.148+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94318549212592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e0c70 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.149+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94318549212592] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b402b040 con 0x55c83f9e0c70 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.149+0000 7f37bfa40800 20 remove_watcher() i=4 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.149+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94318549216816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.150+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94318549216816] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.150+0000 7f37bfa40800 20 remove_watcher() i=5 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.150+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94318549213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.151+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94318549213648] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.151+0000 7f37bfa40800 20 remove_watcher() i=6 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.151+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94318549222816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c83fa29110 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bdd35640 1 -- 172.21.15.196:0/1410688572 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94318549222816] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802a070 con 0x55c83f9e5660 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 20 remove_watcher() i=7 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9e5660 msgr2=0x55c83f9e7a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9e5660 0x55c83f9e7a50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f9e0c70 msgr2=0x55c83f9e3130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f9e0c70 0x55c83f9e3130 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0078070 msgr2=0x7f37b00643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f37b0078070 0x7f37b00643b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c83f9ea110 msgr2=0x55c83f9ec5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c83f9ea110 0x55c83f9ec5d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 msgr2=0x7f3688039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3688036b90 0x7f3688039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37b005cfd0 tx=0x7f37b0089000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 msgr2=0x55c83f9d5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/1410688572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9cdbc0 0x55c83f9d5000 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f37b8011fd0 tx=0x7f37b804cb50 comp rx=0 tx=0).stop 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 reap_dead start 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bcd33640 1 -- 172.21.15.196:0/1410688572 reap_dead start 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 shutdown_connections 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 >> 172.21.15.196:0/1410688572 conn(0x55c83f9c9f20 msgr2=0x55c83f9c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 shutdown_connections 2024-09-21T08:52:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/1410688572 wait complete. 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 msgr2=0x7f3698039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c83f9adca0 tx=0x7f37b008f3d0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 msgr2=0x55c83f9c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55c83f9adc00 tx=0x7f37b8018830 comp rx=0 tx=0).stop 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 shutdown_connections 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3698036b90 0x7f3698039050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 --2- 172.21.15.196:0/2964330034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f9c0f60 0x55c83f9c1380 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.153+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 >> 172.21.15.196:0/2964330034 conn(0x55c83f9b5ef0 msgr2=0x55c83f9b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 shutdown_connections 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/2964330034 wait complete. 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 msgr2=0x55c83f9b1f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 0x55c83f9b1f20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 msgr2=0x55c83f9ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 0x55c83f9ad190 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 msgr2=0x7f36a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f60 tx=0x7f37b4001370 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 msgr2=0x55c83f9a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f37b0025da0 tx=0x7f37b0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 shutdown_connections 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c83f9afb30 0x55c83f9b1f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c83f8b2720 0x55c83f9ad190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f36a4036b40 0x7f36a4039000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 --2- 172.21.15.196:0/3765913713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c83f823650 0x55c83f9a6120 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f37b0025da0 tx=0x7f37b0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 >> 172.21.15.196:0/3765913713 conn(0x55c83f8a9db0 msgr2=0x55c83f998ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 shutdown_connections 2024-09-21T08:52:02.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.154+0000 7f37bfa40800 1 -- 172.21.15.196:0/3765913713 wait complete. 2024-09-21T08:52:02.166 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T08:52:02.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-21T08:52:02.166 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-21T08:52:02.212 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.213 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72653c800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e54cde2900 0x55e54cde4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72653c800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e54cc9db30 con 0x55e54cd52650 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72653c800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e54cc7f360 con 0x55e54cde2900 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc71bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e54cde2900 0x55e54cde4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72222f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55e54cd52650 0x55e54cde11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49498/0 (socket says 172.21.15.196:49498) 2024-09-21T08:52:02.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc71bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e54cde2900 0x55e54cde4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37430/0 (socket says 172.21.15.196:37430) 2024-09-21T08:52:02.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.211+0000 7fc72222f640 1 -- 172.21.15.196:0/2528156799 learned_addr learned my addr 172.21.15.196:0/2528156799 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:02.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.212+0000 7fc71bfff640 1 -- 172.21.15.196:0/2528156799 >> v1:172.21.15.29:6789/0 conn(0x55e54cd52650 legacy=0x55e54cde11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.212+0000 7fc71bfff640 1 -- 172.21.15.196:0/2528156799 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cca5e00 con 0x55e54cde2900 2024-09-21T08:52:02.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.213+0000 7fc71bfff640 1 --2- 172.21.15.196:0/2528156799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cde2900 0x55e54cde4cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00a470 tx=0x7fc70c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b5dc9274727de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc721a2e640 1 -- 172.21.15.196:0/2528156799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70c053570 con 0x55e54cde2900 2024-09-21T08:52:02.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc721a2e640 1 -- 172.21.15.196:0/2528156799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c058070 con 0x55e54cde2900 2024-09-21T08:52:02.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc721a2e640 1 -- 172.21.15.196:0/2528156799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70c053880 con 0x55e54cde2900 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 -- 172.21.15.196:0/2528156799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cde2900 msgr2=0x55e54cde4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 --2- 172.21.15.196:0/2528156799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cde2900 0x55e54cde4cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00a470 tx=0x7fc70c045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 -- 172.21.15.196:0/2528156799 shutdown_connections 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 --2- 172.21.15.196:0/2528156799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cde2900 0x55e54cde4cf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 -- 172.21.15.196:0/2528156799 >> 172.21.15.196:0/2528156799 conn(0x55e54cdd8db0 msgr2=0x55e54cddb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 -- 172.21.15.196:0/2528156799 shutdown_connections 2024-09-21T08:52:02.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.214+0000 7fc72653c800 1 -- 172.21.15.196:0/2528156799 wait complete. 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72653c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72653c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e54cd2a360 con 0x55e54cd52650 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72222f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72222f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37440/0 (socket says 172.21.15.196:37440) 2024-09-21T08:52:02.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.228+0000 7fc72222f640 1 -- 172.21.15.196:0/813298452 learned_addr learned my addr 172.21.15.196:0/813298452 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.229+0000 7fc72222f640 1 -- 172.21.15.196:0/813298452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cc77bc0 con 0x55e54cd52650 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.229+0000 7fc72222f640 1 --2- 172.21.15.196:0/813298452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc714001e10 tx=0x7fc71400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b0d6d3ed0de464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.229+0000 7fc610608640 1 -- 172.21.15.196:0/813298452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714012020 con 0x55e54cd52650 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.229+0000 7fc610608640 1 -- 172.21.15.196:0/813298452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71400e5a0 con 0x55e54cd52650 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.229+0000 7fc610608640 1 -- 172.21.15.196:0/813298452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71400e8e0 con 0x55e54cd52650 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- 172.21.15.196:0/813298452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 msgr2=0x55e54cecd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 --2- 172.21.15.196:0/813298452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc714001e10 tx=0x7fc71400b780 comp rx=0 tx=0).stop 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- 172.21.15.196:0/813298452 shutdown_connections 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 --2- 172.21.15.196:0/813298452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54cecd860 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- 172.21.15.196:0/813298452 >> 172.21.15.196:0/813298452 conn(0x55e54cdd8db0 msgr2=0x55e54cec9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- 172.21.15.196:0/813298452 shutdown_connections 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- 172.21.15.196:0/813298452 wait complete. 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72653c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e54cde5620 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72222f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72222f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37448/0 (socket says 172.21.15.196:37448) 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.230+0000 7fc72222f640 1 -- 172.21.15.196:0/2332500435 learned_addr learned my addr 172.21.15.196:0/2332500435 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc72222f640 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cc8bfe0 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc72222f640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc71400b7c0 tx=0x7fc714000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc60ee05640 1 -- 172.21.15.196:0/2332500435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc714012030 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc60ee05640 1 -- 172.21.15.196:0/2332500435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714001470 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e54ced5780 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc60ee05640 1 -- 172.21.15.196:0/2332500435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71401a8d0 con 0x55e54cd52650 2024-09-21T08:52:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.231+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54ced5ca0 con 0x55e54cd52650 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc60ee05640 1 -- 172.21.15.196:0/2332500435 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc714015020 con 0x55e54cd52650 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc60ee05640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc60ee05640 1 -- 172.21.15.196:0/2332500435 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc714020030 con 0x55e54cd52650 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc71bfff640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 0x55e54cedc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cedc880 con 0x55e54cde2900 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.232+0000 7fc722a30640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 0x55e54cedc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc71bfff640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc70c057000 tx=0x7fc70c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc722a30640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 0x55e54cedc2b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc722a30640 1 -- 172.21.15.196:0/2332500435 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71c00a4a0 con 0x55e54cde2900 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54ced9860 con 0x55e54cde2900 2024-09-21T08:52:02.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc722a30640 1 -- 172.21.15.196:0/2332500435 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc71c00a4a0 con 0x55e54cde2900 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 0x55e54cee0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cee1620 con 0x55e54cedeb90 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.233+0000 7fc72222f640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 0x55e54cee0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.234+0000 7fc72222f640 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 0x55e54cee0f80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.234+0000 7fc72222f640 1 -- 172.21.15.196:0/2332500435 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cedeb90 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.234+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cedda30 con 0x55e54cde2900 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc722a30640 1 -- 172.21.15.196:0/2332500435 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc71c00a4a0 con 0x55e54cde2900 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cedded0 con 0x55e54cde2900 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc722a30640 1 -- 172.21.15.196:0/2332500435 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc71c00a4a0 con 0x55e54cde2900 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc72653c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc72653c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e54cc79580 con 0x55e54ceeffb0 2024-09-21T08:52:02.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.235+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37454/0 (socket says 172.21.15.196:37454) 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc722a30640 1 -- 172.21.15.196:0/2570579843 learned_addr learned my addr 172.21.15.196:0/2570579843 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc722a30640 1 -- 172.21.15.196:0/2570579843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cef0910 con 0x55e54ceeffb0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc722a30640 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55e54ced62f0 tx=0x7fc71c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc607fff640 1 -- 172.21.15.196:0/2570579843 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c014450 con 0x55e54ceeffb0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc607fff640 1 -- 172.21.15.196:0/2570579843 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c0145f0 con 0x55e54ceeffb0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e54cef0ba0 con 0x55e54ceeffb0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc607fff640 1 -- 172.21.15.196:0/2570579843 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c0148d0 con 0x55e54ceeffb0 2024-09-21T08:52:02.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.236+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54cef3880 con 0x55e54ceeffb0 2024-09-21T08:52:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc607fff640 1 -- 172.21.15.196:0/2570579843 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc71c011040 con 0x55e54ceeffb0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc607fff640 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 0x7fc5fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc607fff640 1 -- 172.21.15.196:0/2570579843 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc71c01e070 con 0x55e54ceeffb0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc72222f640 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 0x7fc5fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.237+0000 7fc72222f640 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 0x7fc5fc039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55e54cedccd0 tx=0x7fc71404b080 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc72653c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc72653c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e54cece010 con 0x55e54cefcc30 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37468/0 (socket says 172.21.15.196:37468) 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc722a30640 1 -- 172.21.15.196:0/1974822570 learned_addr learned my addr 172.21.15.196:0/1974822570 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc722a30640 1 -- 172.21.15.196:0/1974822570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cefd600 con 0x55e54cefcc30 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc722a30640 1 --2- 172.21.15.196:0/1974822570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc71c04cbb0 tx=0x7fc71c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bff281ec954aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc605ffb640 1 -- 172.21.15.196:0/1974822570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c013dc0 con 0x55e54cefcc30 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc605ffb640 1 -- 172.21.15.196:0/1974822570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c014a70 con 0x55e54cefcc30 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.238+0000 7fc605ffb640 1 -- 172.21.15.196:0/1974822570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c014d50 con 0x55e54cefcc30 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- 172.21.15.196:0/1974822570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 msgr2=0x55e54cefd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 --2- 172.21.15.196:0/1974822570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc71c04cbb0 tx=0x7fc71c011970 comp rx=0 tx=0).stop 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- 172.21.15.196:0/1974822570 shutdown_connections 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 --2- 172.21.15.196:0/1974822570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cefd030 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- 172.21.15.196:0/1974822570 >> 172.21.15.196:0/1974822570 conn(0x55e54cef8f90 msgr2=0x55e54cef7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- 172.21.15.196:0/1974822570 shutdown_connections 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- 172.21.15.196:0/1974822570 wait complete. 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 Processor -- start 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- start start 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc72653c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e54cefdc70 con 0x55e54cefcc30 2024-09-21T08:52:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc722a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37476/0 (socket says 172.21.15.196:37476) 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.239+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 learned_addr learned my addr 172.21.15.196:0/3756467794 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54cf04630 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc722a30640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011be0 tx=0x7fc71c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc5f3fff640 1 -- 172.21.15.196:0/3756467794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c044030 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc5f3fff640 1 -- 172.21.15.196:0/3756467794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71c022a80 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc5f3fff640 1 -- 172.21.15.196:0/3756467794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc71c022d80 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e54cf048c0 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.240+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54cf07570 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.241+0000 7fc5f3fff640 1 -- 172.21.15.196:0/3756467794 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc71c04e0d0 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.241+0000 7fc5f3fff640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5ec036b90 0x7fc5ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.241+0000 7fc5f3fff640 1 -- 172.21.15.196:0/3756467794 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc71c045070 con 0x55e54cefcc30 2024-09-21T08:52:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.241+0000 7fc72222f640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5ec036b90 0x7fc5ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc72222f640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5ec036b90 0x7fc5ec039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc71401a6a0 tx=0x7fc714036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cf0fdd0 0x55e54cf12290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf129e0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc71bfff640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cf0fdd0 0x55e54cf12290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.242+0000 7fc71bfff640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cf0fdd0 0x55e54cf12290 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 realm 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf12e10 con 0x55e54cf0fdd0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf136e0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf13a80 con 0x55e54cf0fdd0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cf147e0 0x55e54cf16bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf171e0 con 0x55e54cf147e0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.243+0000 7fc722a30640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cf147e0 0x55e54cf16bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc722a30640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cf147e0 0x55e54cf16bd0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc72653c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc72653c800 20 searching for the correct realm 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e54cf19150 0x55e54cf1b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.244+0000 7fc72222f640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e54cf19150 0x55e54cf1b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc72222f640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e54cf19150 0x55e54cf1b610 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc72222f640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc71403a040 0x7fc71403f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc71bfff640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc71403a040 0x7fc71403f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc71bfff640 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc71403a040 0x7fc71403f5f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.245+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.246+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.247+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.248+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.249+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.250+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.251+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf19150 2024-09-21T08:52:02.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf147e0 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.252+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1bce0 con 0x7fc71403a040 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf186c0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf17f30 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.253+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf17670 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 zone default found 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 4 Realm: () 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 zonegroup default 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1c610 con 0x55e54cf147e0 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1e8c0 con 0x55e54cf19150 2024-09-21T08:52:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1ec60 con 0x55e54cf19150 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 started sync module instance, tier type = 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.254+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1dd50 con 0x7fc71403a040 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.255+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.255+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443326792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1dd50 con 0x7fc71403a040 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.255+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1f660 con 0x55e54cf0fdd0 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.256+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443326792352] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.257+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.257+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443326796144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1dd50 con 0x55e54cf0fdd0 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.257+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf200d0 con 0x55e54cf19150 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.258+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443326796144] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.258+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.258+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443326789792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1dcc0 con 0x55e54cf19150 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.258+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf20fc0 con 0x7fc71403a040 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.259+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443326789792] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.259+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.259+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443326802704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf213e0 con 0x7fc71403a040 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.259+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf21cb0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.260+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.260+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443326802704] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.260+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443326804960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf21800 con 0x55e54cf0fdd0 2024-09-21T08:52:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.260+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf20f30 con 0x55e54cf147e0 2024-09-21T08:52:02.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.261+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443326804960] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.261+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.261+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443326808272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf22bd0 con 0x55e54cf147e0 2024-09-21T08:52:02.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.261+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf23590 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.262+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443326808272] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.262+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.262+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443326809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf23770 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.262+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf23fc0 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.263+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.263+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443326809888] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.263+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443326814576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf24400 con 0x55e54cf147e0 2024-09-21T08:52:02.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.263+0000 7fc72653c800 20 add_watcher() i=0 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=1 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=2 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=3 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=4 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=5 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=6 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443326814576] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 20 add_watcher() i=7 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.264+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf233b0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.265+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.265+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443326815888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf24d00 con 0x55e54cf0fdd0 2024-09-21T08:52:02.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.266+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443326815888] v34'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.266+0000 7fc5d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.266+0000 7fc72653c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.266+0000 7fc72653c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.266+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf2fec0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.267+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.267+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf30590 con 0x55e54cf147e0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.268+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.268+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf30590 con 0x55e54cf19150 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.269+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.269+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf30ee0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.270+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.270+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf2bbe0 con 0x7fc71403a040 2024-09-21T08:52:02.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.271+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.271+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf2bbe0 con 0x55e54cf19150 2024-09-21T08:52:02.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.272+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.272+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf319d0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.273+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.273+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf319d0 con 0x55e54cf147e0 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.274+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.274+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31a60 con 0x7fc71403a040 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.275+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.275+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31a60 con 0x55e54cf19150 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.276+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.276+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x7fc71403a040 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.277+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.277+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x55e54cf147e0 2024-09-21T08:52:02.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.278+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.278+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x7fc71403a040 2024-09-21T08:52:02.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.279+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.279+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x55e54cf147e0 2024-09-21T08:52:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.280+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.280+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.281+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.281+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x55e54cf19150 2024-09-21T08:52:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.282+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.282+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x7fc71403a040 2024-09-21T08:52:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.283+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.283+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf320a0 con 0x55e54cf19150 2024-09-21T08:52:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.284+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.284+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32060 con 0x55e54cf0fdd0 2024-09-21T08:52:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.286+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.286+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32060 con 0x55e54cf0fdd0 2024-09-21T08:52:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.287+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.287+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x55e54cf19150 2024-09-21T08:52:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.288+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.288+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf31fd0 con 0x7fc71403a040 2024-09-21T08:52:02.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.289+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.289+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32030 con 0x55e54cf19150 2024-09-21T08:52:02.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.289+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.289+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf2b770 con 0x55e54cf19150 2024-09-21T08:52:02.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.290+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.290+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf19150 2024-09-21T08:52:02.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.291+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.291+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf19150 2024-09-21T08:52:02.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.292+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.292+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf147e0 2024-09-21T08:52:02.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.293+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.293+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf19150 2024-09-21T08:52:02.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.294+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.294+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf147e0 2024-09-21T08:52:02.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.295+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.295+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32010 con 0x55e54cf19150 2024-09-21T08:52:02.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.296+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.296+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x55e54cf147e0 2024-09-21T08:52:02.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.297+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.297+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf32050 con 0x7fc71403a040 2024-09-21T08:52:02.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.298+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc5537fe640 20 reqs_thread_entry: start 2024-09-21T08:52:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc72653c800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc72653c800 20 Filter name: none 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc5517fa640 20 reqs_thread_entry: start 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc72653c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc72653c800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.299+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5d1a0 con 0x55e54cf147e0 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5d160 con 0x55e54cf0fdd0 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T08:52:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.300+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5d160 con 0x55e54cf147e0 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc72653c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94443327055696 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf60110 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== watch-notify(notify (1) cookie 94443326789792 notify 146028888069 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e54cf07570 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc605ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94443326789792 notifier 4573 bl.length()=170 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(97 notify.2 [notify cookie 94443327055696 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc605ffb640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc5e8003d60 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.301+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.302+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== watch-notify(notify_complete (2) cookie 94443327055696 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc714033070 con 0x55e54cf19150 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.302+0000 7fc72653c800 10 removing email index: 2024-09-21T08:52:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.302+0000 7fc72653c800 10 removing user buckets index 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.302+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5dbf0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v34'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc72653c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94443327051584 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5db60 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== watch-notify(notify (1) cookie 94443326804960 notify 146028888079 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55e54cf2bf80 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc605ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94443326804960 notifier 4573 bl.length()=175 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc605ffb640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc5e8003d60 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(100 notify.4 [notify cookie 94443327051584 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== watch-notify(notify_complete (2) cookie 94443327051584 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e54cf2b560 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc72653c800 10 removing user index: testx$tenanteduser 2024-09-21T08:52:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.303+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5ef90 con 0x55e54cf147e0 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.304+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v34'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.304+0000 7fc72653c800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.304+0000 7fc72653c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.304+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94443327059088 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5ef90 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== watch-notify(notify (1) cookie 94443326802704 notify 146028888083 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55e54cf2b560 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc6057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94443326802704 notifier 4573 bl.length()=167 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(103 notify.3 [notify cookie 94443327059088 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc6057fa640 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc5580032c0 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== watch-notify(notify_complete (2) cookie 94443327059088 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e54cf2faa0 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.305+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.306+0000 7fc5d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.306+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443326815888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf309c0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.307+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94443326815888] v34'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.307+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443326792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf5d6d0 con 0x7fc71403a040 2024-09-21T08:52:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.308+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94443326792352] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.308+0000 7fc72653c800 20 remove_watcher() i=0 2024-09-21T08:52:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.308+0000 7fc72653c800 2 removed watcher, disabling cache 2024-09-21T08:52:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.308+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443326796144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1e2a0 con 0x55e54cf0fdd0 2024-09-21T08:52:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.309+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94443326796144] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.309+0000 7fc72653c800 20 remove_watcher() i=1 2024-09-21T08:52:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.309+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443326789792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1e2a0 con 0x55e54cf19150 2024-09-21T08:52:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.310+0000 7fc72222f640 1 -- 172.21.15.196:0/3756467794 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94443326789792] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71402dcf0 con 0x55e54cf19150 2024-09-21T08:52:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.310+0000 7fc72653c800 20 remove_watcher() i=2 2024-09-21T08:52:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.310+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443326802704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1d8a0 con 0x7fc71403a040 2024-09-21T08:52:02.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.311+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94443326802704] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x7fc71403a040 2024-09-21T08:52:02.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.311+0000 7fc72653c800 20 remove_watcher() i=3 2024-09-21T08:52:02.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.311+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443326804960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf20b10 con 0x55e54cf0fdd0 2024-09-21T08:52:02.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.312+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94443326804960] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc70c051070 con 0x55e54cf0fdd0 2024-09-21T08:52:02.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.312+0000 7fc72653c800 20 remove_watcher() i=4 2024-09-21T08:52:02.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.312+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443326808272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf1d8a0 con 0x55e54cf147e0 2024-09-21T08:52:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.313+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94443326808272] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.313+0000 7fc72653c800 20 remove_watcher() i=5 2024-09-21T08:52:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.313+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443326809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf213e0 con 0x55e54cf147e0 2024-09-21T08:52:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.314+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94443326809888] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.314+0000 7fc72653c800 20 remove_watcher() i=6 2024-09-21T08:52:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.314+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443326814576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e54cf20b10 con 0x55e54cf147e0 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc722a30640 1 -- 172.21.15.196:0/3756467794 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94443326814576] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c02a070 con 0x55e54cf147e0 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 20 remove_watcher() i=7 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cf147e0 msgr2=0x55e54cf16bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cf147e0 0x55e54cf16bd0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cf0fdd0 msgr2=0x55e54cf12290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cf0fdd0 0x55e54cf12290 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc71403a040 msgr2=0x7fc71403f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc71403a040 0x7fc71403f5f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e54cf19150 msgr2=0x55e54cf1b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e54cf19150 0x55e54cf1b610 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5ec036b90 msgr2=0x7fc5ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5ec036b90 0x7fc5ec039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc71401a6a0 tx=0x7fc714036000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 msgr2=0x55e54cf040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc71bfff640 1 -- 172.21.15.196:0/3756467794 reap_dead start 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011be0 tx=0x7fc71c04cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 shutdown_connections 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 --2- 172.21.15.196:0/3756467794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cefcc30 0x55e54cf040f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 >> 172.21.15.196:0/3756467794 conn(0x55e54cef8f90 msgr2=0x55e54cef7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 shutdown_connections 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.315+0000 7fc72653c800 1 -- 172.21.15.196:0/3756467794 wait complete. 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 msgr2=0x7fc5fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 0x7fc5fc039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55e54cedccd0 tx=0x7fc71404b080 comp rx=0 tx=0).stop 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 msgr2=0x55e54cef03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x55e54ced62f0 tx=0x7fc71c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 shutdown_connections 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc5fc036b90 0x7fc5fc039050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2570579843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54ceeffb0 0x55e54cef03d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 >> 172.21.15.196:0/2570579843 conn(0x55e54cee4f40 msgr2=0x55e54cee7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 shutdown_connections 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2570579843 wait complete. 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 msgr2=0x55e54cee0f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 0x55e54cee0f80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 msgr2=0x55e54cedc2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 0x55e54cedc2b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 msgr2=0x7fc608039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc70c057000 tx=0x7fc70c052000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 msgr2=0x55e54ced5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc71400b7c0 tx=0x7fc714000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 shutdown_connections 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e54cedeb90 0x55e54cee0f80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e54cde2900 0x55e54cedc2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 --2- 172.21.15.196:0/2332500435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e54cd52650 0x55e54ced5240 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 >> 172.21.15.196:0/2332500435 conn(0x55e54cdd8db0 msgr2=0x55e54cec7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 shutdown_connections 2024-09-21T08:52:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.316+0000 7fc72653c800 1 -- 172.21.15.196:0/2332500435 wait complete. 2024-09-21T08:52:02.333 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-21T08:52:02.337 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-21T08:52:02.383 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:02.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-21T08:52:02.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-21T08:52:02.384 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-21T08:52:02.431 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.431 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.429+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.429+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.429+0000 7f62e320f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5634cbebb900 0x5634cbebdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.429+0000 7f62e320f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634cbd76b30 con 0x5634cbe2b650 2024-09-21T08:52:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.429+0000 7f62e320f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5634cbd58360 con 0x5634cbebb900 2024-09-21T08:52:02.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62d8502640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5634cbebb900 0x5634cbebdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62e0d03640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5634cbe2b650 0x5634cbeba1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49504/0 (socket says 172.21.15.196:49504) 2024-09-21T08:52:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62e0d03640 1 -- 172.21.15.196:0/498243086 learned_addr learned my addr 172.21.15.196:0/498243086 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62d8502640 1 -- 172.21.15.196:0/498243086 >> v1:172.21.15.29:6789/0 conn(0x5634cbe2b650 legacy=0x5634cbeba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62dbfff640 1 -- 172.21.15.196:0/498243086 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305109353 0 0) 0x5634cbd76b30 con 0x5634cbe2b650 2024-09-21T08:52:02.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.430+0000 7f62d8502640 1 -- 172.21.15.196:0/498243086 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbd7ee00 con 0x5634cbebb900 2024-09-21T08:52:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62d8502640 1 --2- 172.21.15.196:0/498243086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbebb900 0x5634cbebdcf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62c800a470 tx=0x7f62c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c039744bf72195fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62dbfff640 1 -- 172.21.15.196:0/498243086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c8053570 con 0x5634cbebb900 2024-09-21T08:52:02.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62dbfff640 1 -- 172.21.15.196:0/498243086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c8058070 con 0x5634cbebb900 2024-09-21T08:52:02.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62dbfff640 1 -- 172.21.15.196:0/498243086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c8053880 con 0x5634cbebb900 2024-09-21T08:52:02.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62e320f800 1 -- 172.21.15.196:0/498243086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbebb900 msgr2=0x5634cbebdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62e320f800 1 --2- 172.21.15.196:0/498243086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbebb900 0x5634cbebdcf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62c800a470 tx=0x7f62c8045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:02.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62e320f800 1 -- 172.21.15.196:0/498243086 shutdown_connections 2024-09-21T08:52:02.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62e320f800 1 --2- 172.21.15.196:0/498243086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbebb900 0x5634cbebdcf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.432+0000 7f62e320f800 1 -- 172.21.15.196:0/498243086 >> 172.21.15.196:0/498243086 conn(0x5634cbeb1db0 msgr2=0x5634cbeb41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.433+0000 7f62e320f800 1 -- 172.21.15.196:0/498243086 shutdown_connections 2024-09-21T08:52:02.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.433+0000 7f62e320f800 1 -- 172.21.15.196:0/498243086 wait complete. 2024-09-21T08:52:02.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.446+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.446+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.446+0000 7f62e320f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.446+0000 7f62e320f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634cbe03360 con 0x5634cbe2b650 2024-09-21T08:52:02.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f62e0d03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f62e0d03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37494/0 (socket says 172.21.15.196:37494) 2024-09-21T08:52:02.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f62e0d03640 1 -- 172.21.15.196:0/1611581338 learned_addr learned my addr 172.21.15.196:0/1611581338 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f62e0d03640 1 -- 172.21.15.196:0/1611581338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbd50bc0 con 0x5634cbe2b650 2024-09-21T08:52:02.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f62e0d03640 1 --2- 172.21.15.196:0/1611581338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b240 tx=0x7f62d000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e3c9c7b81a6871 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f61cee0d640 1 -- 172.21.15.196:0/1611581338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d0008070 con 0x5634cbe2b650 2024-09-21T08:52:02.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f61cee0d640 1 -- 172.21.15.196:0/1611581338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d000d500 con 0x5634cbe2b650 2024-09-21T08:52:02.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.447+0000 7f61cee0d640 1 -- 172.21.15.196:0/1611581338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d000d860 con 0x5634cbe2b650 2024-09-21T08:52:02.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- 172.21.15.196:0/1611581338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 msgr2=0x5634cbeb7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 --2- 172.21.15.196:0/1611581338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b240 tx=0x7f62d000b700 comp rx=0 tx=0).stop 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- 172.21.15.196:0/1611581338 shutdown_connections 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 --2- 172.21.15.196:0/1611581338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbeb7b10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- 172.21.15.196:0/1611581338 >> 172.21.15.196:0/1611581338 conn(0x5634cbeb1db0 msgr2=0x5634cbfa2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- 172.21.15.196:0/1611581338 shutdown_connections 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- 172.21.15.196:0/1611581338 wait complete. 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.448+0000 7f62e320f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e320f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634cbebe620 con 0x5634cbe2b650 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e0d03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e0d03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37510/0 (socket says 172.21.15.196:37510) 2024-09-21T08:52:02.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e0d03640 1 -- 172.21.15.196:0/246238864 learned_addr learned my addr 172.21.15.196:0/246238864 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e0d03640 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbd64fe0 con 0x5634cbe2b650 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e0d03640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5634cbeb7210 tx=0x7f62d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f61cd60a640 1 -- 172.21.15.196:0/246238864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d0019870 con 0x5634cbe2b650 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f61cd60a640 1 -- 172.21.15.196:0/246238864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d0019a10 con 0x5634cbe2b650 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634cbfb07f0 con 0x5634cbe2b650 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f61cd60a640 1 -- 172.21.15.196:0/246238864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d0019d30 con 0x5634cbe2b650 2024-09-21T08:52:02.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.449+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cbfb0d10 con 0x5634cbe2b650 2024-09-21T08:52:02.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.450+0000 7f61cd60a640 1 -- 172.21.15.196:0/246238864 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62d0017040 con 0x5634cbe2b650 2024-09-21T08:52:02.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.450+0000 7f61cd60a640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 0x7f61c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.450+0000 7f61cd60a640 1 -- 172.21.15.196:0/246238864 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f62d0015020 con 0x5634cbe2b650 2024-09-21T08:52:02.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.450+0000 7f62d8502640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 0x7f61c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 0x5634cbfb7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfb7860 con 0x5634cbebb900 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e1504640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 0x5634cbfb7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62d8502640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 0x7f61c8039000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62c8057000 tx=0x7f62c8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e1504640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 0x5634cbfb7320 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e1504640 1 -- 172.21.15.196:0/246238864 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5634cbebb900 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.451+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfb48f0 con 0x5634cbebb900 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e1504640 1 -- 172.21.15.196:0/246238864 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5634cbebb900 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 0x5634cbfbbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfbc600 con 0x5634cbfb9b70 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e0d03640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 0x5634cbfbbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e0d03640 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 0x5634cbfbbf60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e0d03640 1 -- 172.21.15.196:0/246238864 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62d002d070 con 0x5634cbfb9b70 2024-09-21T08:52:02.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.452+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfb8a10 con 0x5634cbebb900 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.453+0000 7f62e1504640 1 -- 172.21.15.196:0/246238864 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5634cbebb900 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.453+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfb8eb0 con 0x5634cbebb900 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.453+0000 7f62e1504640 1 -- 172.21.15.196:0/246238864 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5634cbebb900 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.453+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e320f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e320f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634cbd52580 con 0x5634cbfcaf90 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37522/0 (socket says 172.21.15.196:37522) 2024-09-21T08:52:02.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e1504640 1 -- 172.21.15.196:0/3561490658 learned_addr learned my addr 172.21.15.196:0/3561490658 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e1504640 1 -- 172.21.15.196:0/3561490658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbfcb8f0 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e1504640 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5634cbfb1360 tx=0x7f62dc0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f61c67fc640 1 -- 172.21.15.196:0/3561490658 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc014450 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f61c67fc640 1 -- 172.21.15.196:0/3561490658 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0145f0 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.454+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634cbfcbb80 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.455+0000 7f61c67fc640 1 -- 172.21.15.196:0/3561490658 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc0148d0 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.455+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cbfce860 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.455+0000 7f61c67fc640 1 -- 172.21.15.196:0/3561490658 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62dc011040 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.455+0000 7f61c67fc640 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 0x7f61b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.455+0000 7f61c67fc640 1 -- 172.21.15.196:0/3561490658 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f62dc01e070 con 0x5634cbfcaf90 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e0d03640 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 0x7f61b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e0d03640 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 0x7f61b8039000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5634cbfb7c90 tx=0x7f62d001b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e320f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e320f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634cbeb61e0 con 0x5634cbfd7bd0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37528/0 (socket says 172.21.15.196:37528) 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e1504640 1 -- 172.21.15.196:0/1859452246 learned_addr learned my addr 172.21.15.196:0/1859452246 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.456+0000 7f62e1504640 1 -- 172.21.15.196:0/1859452246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbfd85a0 con 0x5634cbfd7bd0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e1504640 1 --2- 172.21.15.196:0/1859452246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04cb90 tx=0x7f62dc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa95ce3f17e3a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f61b7fff640 1 -- 172.21.15.196:0/1859452246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc044070 con 0x5634cbfd7bd0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f61b7fff640 1 -- 172.21.15.196:0/1859452246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc013c90 con 0x5634cbfd7bd0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f61b7fff640 1 -- 172.21.15.196:0/1859452246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc02ba60 con 0x5634cbfd7bd0 2024-09-21T08:52:02.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 -- 172.21.15.196:0/1859452246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 msgr2=0x5634cbfd7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 --2- 172.21.15.196:0/1859452246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04cb90 tx=0x7f62dc011700 comp rx=0 tx=0).stop 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 -- 172.21.15.196:0/1859452246 shutdown_connections 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 --2- 172.21.15.196:0/1859452246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfd7fd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 -- 172.21.15.196:0/1859452246 >> 172.21.15.196:0/1859452246 conn(0x5634cbfd3fc0 msgr2=0x5634cbfd20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 -- 172.21.15.196:0/1859452246 shutdown_connections 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 -- 172.21.15.196:0/1859452246 wait complete. 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.457+0000 7f62e320f800 1 Processor -- start 2024-09-21T08:52:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e320f800 1 -- start start 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e320f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e320f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5634cbfd8bb0 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e1504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37534/0 (socket says 172.21.15.196:37534) 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 learned_addr learned my addr 172.21.15.196:0/4153013345 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.458+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cbfdf570 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f62e1504640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04ba60 tx=0x7f62dc04cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f61b67fc640 1 -- 172.21.15.196:0/4153013345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc03a020 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f61b67fc640 1 -- 172.21.15.196:0/4153013345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc02b560 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f61b67fc640 1 -- 172.21.15.196:0/4153013345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc02b880 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634cbfdf800 con 0x5634cbfd7bd0 2024-09-21T08:52:02.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cbfe24b0 con 0x5634cbfd7bd0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.459+0000 7f61b67fc640 1 -- 172.21.15.196:0/4153013345 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62dc03d020 con 0x5634cbfd7bd0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f61b67fc640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61ac036b40 0x7f61ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f61b67fc640 1 -- 172.21.15.196:0/4153013345 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f62dc033040 con 0x5634cbfd7bd0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62e0d03640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61ac036b40 0x7f61ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62e0d03640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61ac036b40 0x7f61ac039000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62d0040fd0 tx=0x7f62d0035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbfead40 0x5634cbfed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfed950 con 0x5634cbfead40 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.460+0000 7f62d8502640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbfead40 0x5634cbfed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62d8502640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbfead40 0x5634cbfed200 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 realm 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfedd80 con 0x5634cbfead40 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfee650 con 0x5634cbfead40 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.461+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfee9f0 con 0x5634cbfead40 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfef750 0x5634cbff1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff2150 con 0x5634cbfef750 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e1504640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfef750 0x5634cbff1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.462+0000 7f62e1504640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfef750 0x5634cbff1b40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e320f800 20 searching for the correct realm 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5634cbff40e0 0x5634cbff65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbff40e0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e0d03640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5634cbff40e0 0x5634cbff65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e0d03640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5634cbff40e0 0x5634cbff65a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e0d03640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f62d003d070 0x7f62d00187f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x7f62d003d070 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.463+0000 7f62d8502640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f62d003d070 0x7f62d00187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62d8502640 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f62d003d070 0x7f62d00187f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfef750 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfead40 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.464+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfead40 2024-09-21T08:52:02.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x7f62d003d070 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.465+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbff40e0 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfead40 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbfead40 2024-09-21T08:52:02.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.466+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x7f62d003d070 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff6c70 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfef750 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.467+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.468+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfef750 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x7f62d003d070 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.469+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfef750 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfef750 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x7f62d003d070 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.470+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbff40e0 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfef750 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x5634cbfead40 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f62d005a040 con 0x7f62d003d070 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.471+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff3630 con 0x5634cbfead40 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff25e0 con 0x5634cbfead40 2024-09-21T08:52:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff2fa0 con 0x5634cbfead40 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 zone default found 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 4 Realm: () 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 zonegroup default 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.472+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff75a0 con 0x5634cbfef750 2024-09-21T08:52:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff9820 con 0x5634cbff40e0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff9bc0 con 0x5634cbff40e0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 started sync module instance, tier type = 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.473+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff8c60 con 0x7f62d003d070 2024-09-21T08:52:02.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.474+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.474+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94784760811840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbff8c60 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.474+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffa5c0 con 0x5634cbfead40 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.475+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94784760811840] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.476+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.476+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94784760809392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffa580 con 0x5634cbfead40 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.476+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffb000 con 0x5634cbff40e0 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.477+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94784760809392] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.477+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.477+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94784760818448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffb3a0 con 0x5634cbff40e0 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.477+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffbdd0 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.478+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94784760818448] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.478+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.478+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94784760815824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffc1f0 con 0x7f62d003d070 2024-09-21T08:52:02.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.478+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffcbf0 con 0x5634cbfead40 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.479+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.479+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94784760825600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffcb20 con 0x5634cbfead40 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.479+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffdb20 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.479+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94784760815824] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.480+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94784760825600] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.480+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.480+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94784760827872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffd630 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.480+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffe3c0 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.481+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94784760827872] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.481+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.481+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94784760821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffe370 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.481+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffeda0 con 0x5634cbfef750 2024-09-21T08:52:02.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94784760821984] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94784760831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbffed60 con 0x5634cbfef750 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=0 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=1 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=2 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=3 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=4 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=5 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.482+0000 7f62e320f800 20 add_watcher() i=6 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.483+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94784760831680] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.483+0000 7f62e320f800 20 add_watcher() i=7 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.483+0000 7f62e320f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.483+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cc002220 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.483+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.484+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94784760834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cbfff6e0 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.485+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94784760834688] v34'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.485+0000 7f6196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.485+0000 7f62e320f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.485+0000 7f62e320f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.485+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc002010 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.486+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.486+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00b370 con 0x5634cbfef750 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.487+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.487+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00b370 con 0x5634cbff40e0 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.488+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.488+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00bd90 con 0x5634cbfead40 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.489+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.489+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00a9b0 con 0x7f62d003d070 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.490+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.490+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00a9b0 con 0x5634cbff40e0 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.491+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.491+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00c720 con 0x5634cbfead40 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.492+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.492+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00c720 con 0x5634cbfef750 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.493+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.493+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00c720 con 0x7f62d003d070 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.494+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.494+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00c7b0 con 0x5634cbff40e0 2024-09-21T08:52:02.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.495+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.495+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cc60 con 0x7f62d003d070 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.496+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.496+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cc60 con 0x5634cbfef750 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.497+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.497+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cc60 con 0x7f62d003d070 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.499+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.499+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfef750 2024-09-21T08:52:02.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.500+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.500+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfead40 2024-09-21T08:52:02.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.501+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.501+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.502+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.502+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x7f62d003d070 2024-09-21T08:52:02.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.503+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.503+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.504+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.504+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfead40 2024-09-21T08:52:02.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.505+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.505+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfead40 2024-09-21T08:52:02.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.506+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.506+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.507+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.507+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x7f62d003d070 2024-09-21T08:52:02.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.508+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.508+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.509+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.509+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.510+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.510+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.511+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.511+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.512+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.512+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfef750 2024-09-21T08:52:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.513+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.513+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.514+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.514+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfef750 2024-09-21T08:52:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.515+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.515+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbff40e0 2024-09-21T08:52:02.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.516+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.516+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x5634cbfef750 2024-09-21T08:52:02.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.517+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.518+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc00cbd0 con 0x7f62d003d070 2024-09-21T08:52:02.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f6195fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62e320f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62e320f800 20 Filter name: none 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f61077fe640 20 reqs_thread_entry: start 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62e320f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cc037bd0 con 0x7f62d003d070 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.519+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cc0395b0 con 0x5634cbfead40 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 get_obj_state: octx=0x7f62dc0368b0 obj=myfoo:four state=0x5634cc03a328 s->prefetch_data=0 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 3.34s0 3:2f7c0a92:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b5a0 con 0x5634cbfead40 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(96 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 10 manifest: total_size = 4 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.16849872044028172893 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 get_obj_state: octx=0x7f62dc0368b0 obj=myfoo:four state=0x5634cc03a328 s->prefetch_data=0 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 prepare_atomic_modification: state is not atomic. state=0x5634cc03a328 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 2024-09-21T08:52:02.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.520+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc040000 con 0x5634cbfead40 2024-09-21T08:52:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.521+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(97 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.521+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 3.34s0 3:2f7c0a92:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc040000 con 0x5634cbfead40 2024-09-21T08:52:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.523+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(98 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1_four [call] v34'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.523+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc040a90 con 0x5634cbfead40 2024-09-21T08:52:02.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.524+0000 7f6196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.524+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94784760834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc040a90 con 0x5634cbfead40 2024-09-21T08:52:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.524+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(99 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.524+0000 7f61b7fff640 20 handle_completion(): completion ok for obj=four 2024-09-21T08:52:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.525+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94784760834688] v34'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.525+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94784760811840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x7f62d003d070 2024-09-21T08:52:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.526+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94784760811840] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.526+0000 7f62e320f800 20 remove_watcher() i=0 2024-09-21T08:52:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.526+0000 7f62e320f800 2 removed watcher, disabling cache 2024-09-21T08:52:02.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.526+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94784760809392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbfead40 2024-09-21T08:52:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.527+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94784760809392] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.527+0000 7f62e320f800 20 remove_watcher() i=1 2024-09-21T08:52:02.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.527+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94784760818448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbff40e0 2024-09-21T08:52:02.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.528+0000 7f62e0d03640 1 -- 172.21.15.196:0/4153013345 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94784760818448] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d0044d70 con 0x5634cbff40e0 2024-09-21T08:52:02.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.528+0000 7f62e320f800 20 remove_watcher() i=2 2024-09-21T08:52:02.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.528+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94784760815824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x7f62d003d070 2024-09-21T08:52:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.529+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94784760815824] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x7f62d003d070 2024-09-21T08:52:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.529+0000 7f62e320f800 20 remove_watcher() i=3 2024-09-21T08:52:02.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.529+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94784760825600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbfead40 2024-09-21T08:52:02.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.530+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94784760825600] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62c8051070 con 0x5634cbfead40 2024-09-21T08:52:02.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.530+0000 7f62e320f800 20 remove_watcher() i=4 2024-09-21T08:52:02.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.530+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94784760827872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbfef750 2024-09-21T08:52:02.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.531+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94784760827872] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.531+0000 7f62e320f800 20 remove_watcher() i=5 2024-09-21T08:52:02.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.531+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94784760821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbfef750 2024-09-21T08:52:02.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.532+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94784760821984] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.532+0000 7f62e320f800 20 remove_watcher() i=6 2024-09-21T08:52:02.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.532+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94784760831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634cc03b450 con 0x5634cbfef750 2024-09-21T08:52:02.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e1504640 1 -- 172.21.15.196:0/4153013345 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94784760831680] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc02a070 con 0x5634cbfef750 2024-09-21T08:52:02.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 20 remove_watcher() i=7 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfef750 msgr2=0x5634cbff1b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfef750 0x5634cbff1b40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbfead40 msgr2=0x5634cbfed200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbfead40 0x5634cbfed200 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f62d003d070 msgr2=0x7f62d00187f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f62d003d070 0x7f62d00187f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5634cbff40e0 msgr2=0x5634cbff65a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5634cbff40e0 0x5634cbff65a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61ac036b40 msgr2=0x7f61ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61ac036b40 0x7f61ac039000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62d0040fd0 tx=0x7f62d0035000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 msgr2=0x5634cbfdf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62d8502640 1 -- 172.21.15.196:0/4153013345 reap_dead start 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f62dc04ba60 tx=0x7f62dc04cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 shutdown_connections 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/4153013345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfd7bd0 0x5634cbfdf030 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 >> 172.21.15.196:0/4153013345 conn(0x5634cbfd3fc0 msgr2=0x5634cbfd2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 shutdown_connections 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/4153013345 wait complete. 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 msgr2=0x7f61b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 0x7f61b8039000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5634cbfb7c90 tx=0x7f62d001b540 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 msgr2=0x5634cbfcb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.533+0000 7f62e320f800 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5634cbfb1360 tx=0x7f62dc0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 shutdown_connections 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61b8036b40 0x7f61b8039000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/3561490658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbfcaf90 0x5634cbfcb3b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 >> 172.21.15.196:0/3561490658 conn(0x5634cbfbff20 msgr2=0x5634cbfc2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 shutdown_connections 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/3561490658 wait complete. 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 msgr2=0x5634cbfbbf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 0x5634cbfbbf60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 msgr2=0x5634cbfb7320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 0x5634cbfb7320 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 msgr2=0x7f61c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 0x7f61c8039000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62c8057000 tx=0x7f62c8052000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 msgr2=0x5634cbfb02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5634cbeb7210 tx=0x7f62d0000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 shutdown_connections 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5634cbfb9b70 0x5634cbfbbf60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5634cbebb900 0x5634cbfb7320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f61c8036b40 0x7f61c8039000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 --2- 172.21.15.196:0/246238864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5634cbe2b650 0x5634cbfb02b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 >> 172.21.15.196:0/246238864 conn(0x5634cbeb1db0 msgr2=0x5634cbfa1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 shutdown_connections 2024-09-21T08:52:02.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.534+0000 7f62e320f800 1 -- 172.21.15.196:0/246238864 wait complete. 2024-09-21T08:52:02.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:52:02.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-21T08:52:02.546 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-21T08:52:02.589 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.590 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf8d39800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5572b512a610 0x5572b51b9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf8d39800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572b5075b30 con 0x5572b51b97b0 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf8d39800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5572b5057360 con 0x5572b512a610 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf49d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5572b512a610 0x5572b51b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf49d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5572b512a610 0x5572b51b9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37544/0 (socket says 172.21.15.196:37544) 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.588+0000 7ffbf49d1640 1 -- 172.21.15.196:0/2933985940 learned_addr learned my addr 172.21.15.196:0/2933985940 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.589+0000 7ffbf49d1640 1 -- 172.21.15.196:0/2933985940 >> v1:172.21.15.29:6789/0 conn(0x5572b51b97b0 legacy=0x5572b51bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.589+0000 7ffbf49d1640 1 -- 172.21.15.196:0/2933985940 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b507de00 con 0x5572b512a610 2024-09-21T08:52:02.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.590+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/2933985940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b9270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000a520 tx=0x7ffbe0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771584ddef37c491 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.590+0000 7ffbef7fe640 1 -- 172.21.15.196:0/2933985940 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe0055070 con 0x5572b512a610 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.590+0000 7ffbef7fe640 1 -- 172.21.15.196:0/2933985940 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe00515b0 con 0x5572b512a610 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.590+0000 7ffbef7fe640 1 -- 172.21.15.196:0/2933985940 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe00518d0 con 0x5572b512a610 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 -- 172.21.15.196:0/2933985940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 msgr2=0x5572b51b9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/2933985940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b9270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000a520 tx=0x7ffbe0045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 -- 172.21.15.196:0/2933985940 shutdown_connections 2024-09-21T08:52:02.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/2933985940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b9270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 -- 172.21.15.196:0/2933985940 >> 172.21.15.196:0/2933985940 conn(0x5572b51b0de0 msgr2=0x5572b51b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 -- 172.21.15.196:0/2933985940 shutdown_connections 2024-09-21T08:52:02.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.591+0000 7ffbf8d39800 1 -- 172.21.15.196:0/2933985940 wait complete. 2024-09-21T08:52:02.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf8d39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf8d39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5572b5102330 con 0x5572b512a610 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf49d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf49d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37548/0 (socket says 172.21.15.196:37548) 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf49d1640 1 -- 172.21.15.196:0/4291073442 learned_addr learned my addr 172.21.15.196:0/4291073442 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.605+0000 7ffbf49d1640 1 -- 172.21.15.196:0/4291073442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b504fbc0 con 0x5572b512a610 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/4291073442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0025da0 tx=0x7ffbe0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14d11fb107e5ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffae1e13640 1 -- 172.21.15.196:0/4291073442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe0051950 con 0x5572b512a610 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffae1e13640 1 -- 172.21.15.196:0/4291073442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe0051af0 con 0x5572b512a610 2024-09-21T08:52:02.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffae1e13640 1 -- 172.21.15.196:0/4291073442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe0051dd0 con 0x5572b512a610 2024-09-21T08:52:02.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffbf8d39800 1 -- 172.21.15.196:0/4291073442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 msgr2=0x5572b51b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.606+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/4291073442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0025da0 tx=0x7ffbe0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- 172.21.15.196:0/4291073442 shutdown_connections 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/4291073442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b51b6ba0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- 172.21.15.196:0/4291073442 >> 172.21.15.196:0/4291073442 conn(0x5572b51b0de0 msgr2=0x5572b52a1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- 172.21.15.196:0/4291073442 shutdown_connections 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- 172.21.15.196:0/4291073442 wait complete. 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf8d39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5572b51bd680 con 0x5572b512a610 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf49d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf49d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37562/0 (socket says 172.21.15.196:37562) 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.607+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3613224859 learned_addr learned my addr 172.21.15.196:0/3613224859 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b5063fe0 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0067040 tx=0x7ffbe0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffadbfff640 1 -- 172.21.15.196:0/3613224859 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe0073070 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffadbfff640 1 -- 172.21.15.196:0/3613224859 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe005a450 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffadbfff640 1 -- 172.21.15.196:0/3613224859 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe005a730 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b52af870 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.608+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b52afdf0 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffadbfff640 1 -- 172.21.15.196:0/3613224859 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbe0076070 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffadbfff640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 0x7ffadc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffadbfff640 1 -- 172.21.15.196:0/3613224859 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbe0062070 con 0x5572b512a610 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 0x7ffadc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 0x5572b52b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52b6920 con 0x5572b51b97b0 2024-09-21T08:52:02.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 0x5572b52b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 0x7ffadc039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001e10 tx=0x7ffbe8001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.609+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 0x5572b52b63a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3613224859 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbf000a4a0 con 0x5572b51b97b0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52b71e0 con 0x5572b51b97b0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3613224859 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbf000a4a0 con 0x5572b51b97b0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 0x5572b52baf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52bb710 con 0x5572b52b8af0 2024-09-21T08:52:02.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.610+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 0x5572b52baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 0x5572b52baf80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3613224859 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffbe0075030 con 0x5572b52b8af0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52b7a30 con 0x5572b51b97b0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3613224859 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbf000a4a0 con 0x5572b51b97b0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52b7dd0 con 0x5572b51b97b0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.611+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3613224859 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbf000a4a0 con 0x5572b51b97b0 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf8d39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf8d39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5572b5051580 con 0x5572b52ca090 2024-09-21T08:52:02.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37572/0 (socket says 172.21.15.196:37572) 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3132236430 learned_addr learned my addr 172.21.15.196:0/3132236430 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.612+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3132236430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b52ca9f0 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5572b52b03e0 tx=0x7ffbf00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffad97fa640 1 -- 172.21.15.196:0/3132236430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf0014450 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffad97fa640 1 -- 172.21.15.196:0/3132236430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbf00145f0 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffad97fa640 1 -- 172.21.15.196:0/3132236430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf00148d0 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b52cac80 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b52cd960 con 0x5572b52ca090 2024-09-21T08:52:02.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.613+0000 7ffad97fa640 1 -- 172.21.15.196:0/3132236430 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbf0011040 con 0x5572b52ca090 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffad97fa640 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 0x7ffacc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffad97fa640 1 -- 172.21.15.196:0/3132236430 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbf001e070 con 0x5572b52ca090 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 0x7ffacc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 0x7ffacc039000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5572b52b3a70 tx=0x7ffbe00643b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf8d39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf8d39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5572b51b5180 con 0x5572b52d6d30 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37584/0 (socket says 172.21.15.196:37584) 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.614+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3466800264 learned_addr learned my addr 172.21.15.196:0/3466800264 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3466800264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b52d7700 con 0x5572b52d6d30 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3466800264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffbf004cb90 tx=0x7ffbf0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f1ff7f4fb37509 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffad2ffd640 1 -- 172.21.15.196:0/3466800264 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf0044070 con 0x5572b52d6d30 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffad2ffd640 1 -- 172.21.15.196:0/3466800264 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbf0013c90 con 0x5572b52d6d30 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffad2ffd640 1 -- 172.21.15.196:0/3466800264 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf002ba60 con 0x5572b52d6d30 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3466800264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 msgr2=0x5572b52d7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3466800264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffbf004cb90 tx=0x7ffbf0011700 comp rx=0 tx=0).stop 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3466800264 shutdown_connections 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3466800264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52d7130 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3466800264 >> 172.21.15.196:0/3466800264 conn(0x5572b52d30e0 msgr2=0x5572b52d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3466800264 shutdown_connections 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.615+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3466800264 wait complete. 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf8d39800 1 Processor -- start 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf8d39800 1 -- start start 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf8d39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf8d39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5572b52d7cd0 con 0x5572b52d6d30 2024-09-21T08:52:02.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf51d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37596/0 (socket says 172.21.15.196:37596) 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 learned_addr learned my addr 172.21.15.196:0/3099087266 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.616+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b52de6c0 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffbf004ba60 tx=0x7ffbf004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffad17fa640 1 -- 172.21.15.196:0/3099087266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf003a020 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffad17fa640 1 -- 172.21.15.196:0/3099087266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbf002b560 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b52de950 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffad17fa640 1 -- 172.21.15.196:0/3099087266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbf002b880 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b52e1600 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.617+0000 7ffad17fa640 1 -- 172.21.15.196:0/3099087266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbf003d020 con 0x5572b52d6d30 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffad17fa640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffabc036af0 0x7ffabc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffad17fa640 1 -- 172.21.15.196:0/3099087266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ffbf0033040 con 0x5572b52d6d30 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffabc036af0 0x7ffabc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b52e9dd0 0x5572b52ec290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52ec9e0 con 0x5572b52e9dd0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b52e9dd0 0x5572b52ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.618+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffabc036af0 0x7ffabc038fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5572b52bbb10 tx=0x7ffbe0084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b52e9dd0 0x5572b52ec290 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe800bdb0 con 0x5572b52e9dd0 2024-09-21T08:52:02.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 realm 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52e9220 con 0x5572b52e9dd0 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe800bdb0 con 0x5572b52e9dd0 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52ed4c0 con 0x5572b52e9dd0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe800bdb0 con 0x5572b52e9dd0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.619+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52edd90 con 0x5572b52e9dd0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbe800bdb0 con 0x5572b52e9dd0 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52ee640 0x5572b52f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f11b0 con 0x5572b52ee640 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52ee640 0x5572b52f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf51d2640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52ee640 0x5572b52f0a50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.620+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf8d39800 20 searching for the correct realm 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5572b52f3260 0x5572b52f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5572b52f3260 0x5572b52f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5572b52f3260 0x5572b52f5720 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe0093070 con 0x5572b52f3260 2024-09-21T08:52:02.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf49d1640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbe00a4040 0x7ffbe004f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.621+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbe00a4040 0x7ffbe004f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbeffff640 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbe00a4040 0x7ffbe004f360 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe800bdb0 con 0x7ffbe00a4040 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe800bdb0 con 0x5572b52e9dd0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.622+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.623+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe0093070 con 0x5572b52f3260 2024-09-21T08:52:02.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.624+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe0093070 con 0x5572b52f3260 2024-09-21T08:52:02.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe0093070 con 0x5572b52f3260 2024-09-21T08:52:02.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe0093070 con 0x5572b52f3260 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.625+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.626+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.627+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52f3260 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.628+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52ee640 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x5572b52e9dd0 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f5df0 con 0x7ffbe00a4040 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f1c60 con 0x5572b52e9dd0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.629+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f20e0 con 0x5572b52e9dd0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f2580 con 0x5572b52e9dd0 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 zone default found 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 4 Realm: () 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 zonegroup default 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f6270 con 0x5572b52ee640 2024-09-21T08:52:02.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f84a0 con 0x5572b52f3260 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.630+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f8840 con 0x5572b52f3260 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 20 started sync module instance, tier type = 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.631+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f78e0 con 0x7ffbe00a4040 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.632+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.673 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.632+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951154420944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f78e0 con 0x7ffbe00a4040 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.632+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f9110 con 0x5572b52e9dd0 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.633+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951154420944] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.633+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.633+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951154424800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f78e0 con 0x5572b52e9dd0 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.633+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f9b80 con 0x5572b52f3260 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.634+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951154424800] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.634+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.634+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951154418736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52f7850 con 0x5572b52f3260 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.634+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52faa40 con 0x7ffbe00a4040 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.635+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951154418736] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.674 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.635+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.635+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951154431376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fa9b0 con 0x7ffbe00a4040 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.635+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fb7e0 con 0x5572b52e9dd0 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.636+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951154431376] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.636+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.636+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951154433440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fb7e0 con 0x5572b52e9dd0 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.636+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fc220 con 0x5572b52ee640 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.637+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951154433440] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.638+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.675 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.638+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951154437488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fc610 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.638+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fd010 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.639+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951154437488] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.639+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.639+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951154434496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fcfd0 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.639+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fda40 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.676 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951154443664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fdec0 con 0x5572b52ee640 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=0 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=1 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=2 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=3 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=4 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=5 2024-09-21T08:52:02.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951154434496] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.640+0000 7ffbf8d39800 20 add_watcher() i=6 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951154443664] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbf8d39800 20 add_watcher() i=7 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbf8d39800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fcb20 con 0x5572b52e9dd0 2024-09-21T08:52:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.641+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951154444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b52fcb20 con 0x5572b52e9dd0 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.642+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951154444720] v34'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.642+0000 7ffaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 5 note: GC not initialized 2024-09-21T08:52:02.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffaa8fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 Filter name: none 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffa227fc640 20 reqs_thread_entry: start 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5334230 con 0x7ffbe00a4040 2024-09-21T08:52:02.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.643+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5334b60 con 0x5572b52e9dd0 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:02.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5334ba0 con 0x7ffbe00a4040 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b53362f0 con 0x5572b52e9dd0 2024-09-21T08:52:02.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.644+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 4.3d 4:bcf4508d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5335940 con 0x5572b52f3260 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 4.22 4:46bb70b8:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b533ae60 con 0x5572b52e9dd0 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 4.21 4:870d7801:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b533d750 con 0x5572b52ee640 2024-09-21T08:52:02.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 4.1b 4:d95102f9:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5340020 con 0x7ffbe00a4040 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 4.1e 4:79fd6c1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5342b40 con 0x5572b52ee640 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 4.20 4:0604dc28:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5345880 con 0x5572b52e9dd0 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 4.3c 4:3e42c0c5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5342b40 con 0x5572b52e9dd0 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 4.17 4:e9270044:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b534ac70 con 0x5572b52ee640 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 4.22 4:45547614:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b534daf0 con 0x5572b52e9dd0 2024-09-21T08:52:02.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 4.23 4:c4aa99aa:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b5350520 con 0x5572b52ee640 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 4.32 4:4c77f74f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572b534ac70 con 0x5572b52e9dd0 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(71 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(72 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(74 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.8 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(68 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(75 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(76 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.645+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.646+0000 7ffaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.646+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951154444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b534ac70 con 0x5572b52e9dd0 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.647+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93951154444720] v34'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.647+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951154420944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b5345880 con 0x7ffbe00a4040 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.648+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93951154420944] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.648+0000 7ffbf8d39800 20 remove_watcher() i=0 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.648+0000 7ffbf8d39800 2 removed watcher, disabling cache 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.648+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951154424800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b5331c10 con 0x5572b52e9dd0 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.650+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93951154424800] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.650+0000 7ffbf8d39800 20 remove_watcher() i=1 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.650+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951154418736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b5331c10 con 0x5572b52f3260 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbf49d1640 1 -- 172.21.15.196:0/3099087266 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93951154418736] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe00b4040 con 0x5572b52f3260 2024-09-21T08:52:02.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbf8d39800 20 remove_watcher() i=2 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951154431376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b531c990 con 0x7ffbe00a4040 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93951154431376] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x7ffbe00a4040 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbf8d39800 20 remove_watcher() i=3 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.651+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951154433440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b531c990 con 0x5572b52e9dd0 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.652+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93951154433440] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe802a040 con 0x5572b52e9dd0 2024-09-21T08:52:02.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.652+0000 7ffbf8d39800 20 remove_watcher() i=4 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.653+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951154437488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b531c990 con 0x5572b52ee640 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.653+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93951154437488] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.653+0000 7ffbf8d39800 20 remove_watcher() i=5 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.653+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951154434496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b531c990 con 0x5572b52ee640 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.655+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93951154434496] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.655+0000 7ffbf8d39800 20 remove_watcher() i=6 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.655+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951154443664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572b531c990 con 0x5572b52ee640 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.655+0000 7ffbf51d2640 1 -- 172.21.15.196:0/3099087266 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93951154443664] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbf002a070 con 0x5572b52ee640 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 20 remove_watcher() i=7 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52ee640 msgr2=0x5572b52f0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52ee640 0x5572b52f0a50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b52e9dd0 msgr2=0x5572b52ec290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b52e9dd0 0x5572b52ec290 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbe00a4040 msgr2=0x7ffbe004f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ffbe00a4040 0x7ffbe004f360 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5572b52f3260 msgr2=0x5572b52f5720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5572b52f3260 0x5572b52f5720 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffabc036af0 msgr2=0x7ffabc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffabc036af0 0x7ffabc038fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5572b52bbb10 tx=0x7ffbe0084000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 msgr2=0x5572b52de180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbeffff640 1 -- 172.21.15.196:0/3099087266 reap_dead start 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffbf004ba60 tx=0x7ffbf004cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 shutdown_connections 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3099087266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52d6d30 0x5572b52de180 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 >> 172.21.15.196:0/3099087266 conn(0x5572b52d30e0 msgr2=0x5572b52d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 shutdown_connections 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3099087266 wait complete. 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 msgr2=0x7ffacc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 0x7ffacc039000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5572b52b3a70 tx=0x7ffbe00643b0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 msgr2=0x5572b52ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5572b52b03e0 tx=0x7ffbf00188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 shutdown_connections 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffacc036b40 0x7ffacc039000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3132236430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b52ca090 0x5572b52ca4b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 >> 172.21.15.196:0/3132236430 conn(0x5572b52bf020 msgr2=0x5572b52c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 shutdown_connections 2024-09-21T08:52:02.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.656+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3132236430 wait complete. 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 msgr2=0x5572b52baf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 0x5572b52baf80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 msgr2=0x5572b52b63a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 0x5572b52b63a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 msgr2=0x7ffadc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 0x7ffadc039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8001e10 tx=0x7ffbe8001390 comp rx=0 tx=0).stop 2024-09-21T08:52:02.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 msgr2=0x5572b52af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0067040 tx=0x7ffbe0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 shutdown_connections 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5572b52b8af0 0x5572b52baf80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5572b51b97b0 0x5572b52b63a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ffadc036b90 0x7ffadc039050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 --2- 172.21.15.196:0/3613224859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5572b512a610 0x5572b52af330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 >> 172.21.15.196:0/3613224859 conn(0x5572b51b0de0 msgr2=0x5572b51b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 shutdown_connections 2024-09-21T08:52:02.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.657+0000 7ffbf8d39800 1 -- 172.21.15.196:0/3613224859 wait complete. 2024-09-21T08:52:02.699 INFO:teuthology.orchestra.run.smithi196.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0bf56418-c298-49e5-b663-8247e6a1b700","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","marker":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-21T08:52:02.135607Z","creation_time":"2024-09-21T08:51:59.475959Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-21T08:52:02.700 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:52:02.135607Z', 'creation_time': '2024-09-21T08:51:59.475959Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:52:02.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-21T08:52:02.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-21T08:52:02.700 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-21T08:52:02.742 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.742 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.740+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.740+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.740+0000 7fe382a0e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559e677c2930 0x559e677c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.740+0000 7fe382a0e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e6767db30 con 0x559e67731da0 2024-09-21T08:52:02.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.740+0000 7fe382a0e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x559e6765f360 con 0x559e677c2930 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d919640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559e677c2930 0x559e677c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d919640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559e677c2930 0x559e677c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37604/0 (socket says 172.21.15.196:37604) 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d919640 1 -- 172.21.15.196:0/1910264986 learned_addr learned my addr 172.21.15.196:0/1910264986 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37e11a640 1 --1- 172.21.15.196:0/1910264986 >> v1:172.21.15.29:6789/0 conn(0x559e67731da0 0x559e677c1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49524/0 (socket says 172.21.15.196:49524) 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d919640 1 -- 172.21.15.196:0/1910264986 >> v1:172.21.15.29:6789/0 conn(0x559e67731da0 legacy=0x559e677c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d919640 1 -- 172.21.15.196:0/1910264986 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e67685e00 con 0x559e677c2930 2024-09-21T08:52:02.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.741+0000 7fe37d118640 1 -- 172.21.15.196:0/1910264986 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498930564 0 0) 0x559e6767db30 con 0x559e67731da0 2024-09-21T08:52:02.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.743+0000 7fe37d919640 1 --2- 172.21.15.196:0/1910264986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e677c2930 0x559e677c4d20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe37400a520 tx=0x7fe374045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98066591b7d579b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.743+0000 7fe37d118640 1 -- 172.21.15.196:0/1910264986 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe374055070 con 0x559e677c2930 2024-09-21T08:52:02.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.743+0000 7fe37d118640 1 -- 172.21.15.196:0/1910264986 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3740515b0 con 0x559e677c2930 2024-09-21T08:52:02.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.743+0000 7fe37d118640 1 -- 172.21.15.196:0/1910264986 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3740518d0 con 0x559e677c2930 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 -- 172.21.15.196:0/1910264986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e677c2930 msgr2=0x559e677c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1910264986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e677c2930 0x559e677c4d20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe37400a520 tx=0x7fe374045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 -- 172.21.15.196:0/1910264986 shutdown_connections 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1910264986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e677c2930 0x559e677c4d20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 -- 172.21.15.196:0/1910264986 >> 172.21.15.196:0/1910264986 conn(0x559e677b8de0 msgr2=0x559e677bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 -- 172.21.15.196:0/1910264986 shutdown_connections 2024-09-21T08:52:02.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.744+0000 7fe382a0e800 1 -- 172.21.15.196:0/1910264986 wait complete. 2024-09-21T08:52:02.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.757+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.757+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe382a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe382a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559e6770a320 con 0x559e67731da0 2024-09-21T08:52:02.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe37e11a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe37e11a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37610/0 (socket says 172.21.15.196:37610) 2024-09-21T08:52:02.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe37e11a640 1 -- 172.21.15.196:0/3689622589 learned_addr learned my addr 172.21.15.196:0/3689622589 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.758+0000 7fe37e11a640 1 -- 172.21.15.196:0/3689622589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e67657bc0 con 0x559e67731da0 2024-09-21T08:52:02.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3689622589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b240 tx=0x7fe37000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6aaee9c65866b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe26c608640 1 -- 172.21.15.196:0/3689622589 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe370008070 con 0x559e67731da0 2024-09-21T08:52:02.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe26c608640 1 -- 172.21.15.196:0/3689622589 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37000d500 con 0x559e67731da0 2024-09-21T08:52:02.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe26c608640 1 -- 172.21.15.196:0/3689622589 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe37000d860 con 0x559e67731da0 2024-09-21T08:52:02.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe382a0e800 1 -- 172.21.15.196:0/3689622589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 msgr2=0x559e678ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3689622589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b240 tx=0x7fe37000b700 comp rx=0 tx=0).stop 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe382a0e800 1 -- 172.21.15.196:0/3689622589 shutdown_connections 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3689622589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678ad650 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.759+0000 7fe382a0e800 1 -- 172.21.15.196:0/3689622589 >> 172.21.15.196:0/3689622589 conn(0x559e677b8de0 msgr2=0x559e678a9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 -- 172.21.15.196:0/3689622589 shutdown_connections 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 -- 172.21.15.196:0/3689622589 wait complete. 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe382a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559e677c55f0 con 0x559e67731da0 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe37e11a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe37e11a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37626/0 (socket says 172.21.15.196:37626) 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.760+0000 7fe37e11a640 1 -- 172.21.15.196:0/1777599176 learned_addr learned my addr 172.21.15.196:0/1777599176 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe37e11a640 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6766bfe0 con 0x559e67731da0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe37e11a640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x559e678ae4b0 tx=0x7fe370000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe26ae05640 1 -- 172.21.15.196:0/1777599176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe370019870 con 0x559e67731da0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe26ae05640 1 -- 172.21.15.196:0/1777599176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe370019a10 con 0x559e67731da0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe26ae05640 1 -- 172.21.15.196:0/1777599176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe370019d30 con 0x559e67731da0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e678b55c0 con 0x559e67731da0 2024-09-21T08:52:02.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.761+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e678b5ae0 con 0x559e67731da0 2024-09-21T08:52:02.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe26ae05640 1 -- 172.21.15.196:0/1777599176 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe370017040 con 0x559e67731da0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe26ae05640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 0x7fe264039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe26ae05640 1 -- 172.21.15.196:0/1777599176 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe370015020 con 0x559e67731da0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe37d919640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 0x7fe264039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 0x559e678bc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678bc670 con 0x559e677c2930 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe37e91b640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 0x559e678bc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.762+0000 7fe37d919640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 0x7fe264039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe374057000 tx=0x7fe374052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe37e91b640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 0x559e678bc0f0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe37e91b640 1 -- 172.21.15.196:0/1777599176 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe37800a4a0 con 0x559e677c2930 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678b96c0 con 0x559e677c2930 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe37e91b640 1 -- 172.21.15.196:0/1777599176 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe37800a4a0 con 0x559e677c2930 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 0x559e678c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678c1430 con 0x559e678be9a0 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.763+0000 7fe37e11a640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 0x559e678c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.764+0000 7fe37e11a640 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 0x559e678c0d90 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.764+0000 7fe37e11a640 1 -- 172.21.15.196:0/1777599176 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe37002d070 con 0x559e678be9a0 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.764+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678bd840 con 0x559e677c2930 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.764+0000 7fe37e91b640 1 -- 172.21.15.196:0/1777599176 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe37800a4a0 con 0x559e677c2930 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.764+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678bdce0 con 0x559e677c2930 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe37e91b640 1 -- 172.21.15.196:0/1777599176 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe37800a4a0 con 0x559e677c2930 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe382a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe382a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559e67659580 con 0x559e678cfdc0 2024-09-21T08:52:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37630/0 (socket says 172.21.15.196:37630) 2024-09-21T08:52:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.765+0000 7fe37e91b640 1 -- 172.21.15.196:0/1152406446 learned_addr learned my addr 172.21.15.196:0/1152406446 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe37e91b640 1 -- 172.21.15.196:0/1152406446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e678d0720 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe37e91b640 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x559e678b6130 tx=0x7fe3780188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe263fff640 1 -- 172.21.15.196:0/1152406446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe378014450 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe263fff640 1 -- 172.21.15.196:0/1152406446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3780145f0 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e678d09b0 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe263fff640 1 -- 172.21.15.196:0/1152406446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3780148d0 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.766+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e678d3690 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.767+0000 7fe263fff640 1 -- 172.21.15.196:0/1152406446 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe378011040 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.767+0000 7fe263fff640 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 0x7fe258039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.767+0000 7fe263fff640 1 -- 172.21.15.196:0/1152406446 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe37801e070 con 0x559e678cfdc0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.767+0000 7fe37e11a640 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 0x7fe258039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe37e11a640 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 0x7fe258039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559e678bcac0 tx=0x7fe37001b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe382a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe382a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559e678ade00 con 0x559e678dca40 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37644/0 (socket says 172.21.15.196:37644) 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.768+0000 7fe37e91b640 1 -- 172.21.15.196:0/1753401141 learned_addr learned my addr 172.21.15.196:0/1753401141 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe37e91b640 1 -- 172.21.15.196:0/1753401141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e678dd410 con 0x559e678dca40 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe37e91b640 1 --2- 172.21.15.196:0/1753401141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe37804cbb0 tx=0x7fe378011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6092e71d1a7373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe261ffb640 1 -- 172.21.15.196:0/1753401141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe378013dc0 con 0x559e678dca40 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe261ffb640 1 -- 172.21.15.196:0/1753401141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378014a70 con 0x559e678dca40 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe261ffb640 1 -- 172.21.15.196:0/1753401141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe378014d50 con 0x559e678dca40 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 -- 172.21.15.196:0/1753401141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 msgr2=0x559e678dce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1753401141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe37804cbb0 tx=0x7fe378011970 comp rx=0 tx=0).stop 2024-09-21T08:52:02.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 -- 172.21.15.196:0/1753401141 shutdown_connections 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1753401141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678dce40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 -- 172.21.15.196:0/1753401141 >> 172.21.15.196:0/1753401141 conn(0x559e678d8da0 msgr2=0x559e678d6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 -- 172.21.15.196:0/1753401141 shutdown_connections 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.769+0000 7fe382a0e800 1 -- 172.21.15.196:0/1753401141 wait complete. 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe382a0e800 1 Processor -- start 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe382a0e800 1 -- start start 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe382a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe382a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559e678dda80 con 0x559e678dca40 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe37e91b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678e3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37652/0 (socket says 172.21.15.196:37652) 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 learned_addr learned my addr 172.21.15.196:0/3374197698 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.770+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e678e4400 con 0x559e678dca40 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe37e91b640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678e3ec0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe378011be0 tx=0x7fe37804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe24ffff640 1 -- 172.21.15.196:0/3374197698 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe378044030 con 0x559e678dca40 2024-09-21T08:52:02.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe24ffff640 1 -- 172.21.15.196:0/3374197698 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378022a80 con 0x559e678dca40 2024-09-21T08:52:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe24ffff640 1 -- 172.21.15.196:0/3374197698 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe378022da0 con 0x559e678dca40 2024-09-21T08:52:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e678e4690 con 0x559e678dca40 2024-09-21T08:52:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.771+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e678e7340 con 0x559e678dca40 2024-09-21T08:52:02.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe24ffff640 1 -- 172.21.15.196:0/3374197698 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe37802b350 con 0x559e678dca40 2024-09-21T08:52:02.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe24ffff640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe248036b90 0x7fe248039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe24ffff640 1 -- 172.21.15.196:0/3374197698 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe378045070 con 0x559e678dca40 2024-09-21T08:52:02.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe248036b90 0x7fe248039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e678efb70 0x559e678f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f2780 con 0x559e678efb70 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe37d919640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e678efb70 0x559e678f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.772+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe248036b90 0x7fe248039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bc50 tx=0x7fe370040f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe37d919640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e678efb70 0x559e678f2030 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 realm 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f2bb0 con 0x559e678efb70 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f3480 con 0x559e678efb70 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.773+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f3820 con 0x559e678efb70 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe382a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678f4580 0x559e678f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f6eb0 con 0x559e678f4580 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.774+0000 7fe37e91b640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678f4580 0x559e678f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe37e91b640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678f4580 0x559e678f6970 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe382a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe382a0e800 20 searching for the correct realm 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559e678f8ef0 0x559e678fb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f8ef0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559e678f8ef0 0x559e678fb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559e678f8ef0 0x559e678fb3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.775+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37e11a640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe37003d070 0x7fe370018810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x7fe37003d070 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37d919640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe37003d070 0x7fe370018810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37d919640 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe37003d070 0x7fe370018810 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.776+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678efb70 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678efb70 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.777+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x7fe37003d070 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f8ef0 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678efb70 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f4580 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.778+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678efb70 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x7fe37003d070 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678fba80 con 0x559e678f8ef0 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.779+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f4580 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678efb70 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.780+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678efb70 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f4580 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.781+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x7fe37003d070 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678efb70 2024-09-21T08:52:02.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f4580 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.782+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f4580 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x7fe37003d070 2024-09-21T08:52:02.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f8ef0 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.783+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678f4580 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x559e678efb70 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe37005a040 con 0x7fe37003d070 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f78f0 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.784+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f8210 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 zone default found 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 4 Realm: () 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 zonegroup default 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678fbf00 con 0x559e678f4580 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.785+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7530 con 0x559e678f8ef0 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e678fe250 con 0x559e678f8ef0 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 20 started sync module instance, tier type = 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.786+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fd5c0 con 0x7fe37003d070 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.787+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.787+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138830674704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fd5c0 con 0x7fe37003d070 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.787+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fed70 con 0x559e678efb70 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.788+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138830674704] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.788+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.788+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138830678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fd5c0 con 0x559e678efb70 2024-09-21T08:52:02.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.788+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678ff840 con 0x559e678f8ef0 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.789+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.789+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138830680880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e679000e0 con 0x559e678f8ef0 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.789+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138830678144] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.789+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67900650 con 0x7fe37003d070 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.790+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138830680880] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.790+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.790+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138830672144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67900a40 con 0x7fe37003d070 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.790+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67901400 con 0x559e678efb70 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.791+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138830672144] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.791+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.791+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138830683184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67901400 con 0x559e678efb70 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.792+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67901e10 con 0x559e678f4580 2024-09-21T08:52:02.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.792+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138830683184] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.793+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.793+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138830688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67901370 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.793+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67902cd0 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.794+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138830688080] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.794+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.794+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138830692864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67902cd0 con 0x559e678f4580 2024-09-21T08:52:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.794+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67903690 con 0x559e678f4580 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138830692864] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138830694432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67903870 con 0x559e678f4580 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=0 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=1 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=2 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=3 2024-09-21T08:52:02.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=4 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=5 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.795+0000 7fe382a0e800 20 add_watcher() i=6 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.796+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138830694432] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.796+0000 7fe382a0e800 20 add_watcher() i=7 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.796+0000 7fe382a0e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.796+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e67906a60 con 0x559e678efb70 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.797+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.797+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138830697504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67903cf0 con 0x559e678efb70 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138830697504] v34'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 5 note: GC not initialized 2024-09-21T08:52:02.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe1af7fe640 20 reqs_thread_entry: start 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 20 Filter name: none 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe1ad7fa640 20 reqs_thread_entry: start 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.798+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e67939340 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.799+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 [pgnls start_epoch 34 out=254b] v34'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.799+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e67901e10 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.799+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 [pgnls start_epoch 34 out=131b] v34'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.799+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e67901e10 con 0x559e678f8ef0 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e67901e10 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(65 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e67901e10 con 0x559e678efb70 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(66 [pgnls start_epoch 34 out=335b] v34'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.800+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 [pgnls start_epoch 34 out=213b] v34'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 [pgnls start_epoch 34 out=254b] v34'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(69 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.801+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(70 [pgnls start_epoch 34 out=213b] v34'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(71 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 [pgnls start_epoch 34 out=336b] v34'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 [pgnls start_epoch 34 out=131b] v34'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.802+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(74 [pgnls start_epoch 34 out=254b] v34'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(75 [pgnls start_epoch 34 out=90b] v34'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(76 [pgnls start_epoch 34 out=213b] v34'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.803+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(77 [pgnls start_epoch 34 out=254b] v34'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(78 [pgnls start_epoch 34 out=254b] v34'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(79 [pgnls start_epoch 34 out=213b] v34'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(80 [pgnls start_epoch 34 out=172b] v34'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.804+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(81 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(82 [pgnls start_epoch 34 out=276b] v34'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(83 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.805+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(84 [pgnls start_epoch 34 out=295b] v34'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f4580 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(85 [pgnls start_epoch 34 out=172b] v34'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(86 [pgnls start_epoch 34 out=213b] v34'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.806+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f4580 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(87 [pgnls start_epoch 34 out=172b] v34'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe37802a070 con 0x559e678f4580 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(88 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(89 [pgnls start_epoch 34 out=90b] v34'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.807+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(90 [pgnls start_epoch 34 out=90b] v34'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678efb70 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(91 [pgnls start_epoch 34 out=131b] v34'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x7fe37003d070 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(92 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe374057030 con 0x7fe37003d070 2024-09-21T08:52:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.808+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e678f7d70 con 0x559e678f4580 2024-09-21T08:52:02.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.809+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(93 [pgnls start_epoch 34 out=213b] v34'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe378069040 con 0x559e678f4580 2024-09-21T08:52:02.818 INFO:teuthology.orchestra.run.smithi196.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-21T08:52:02.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.811+0000 7fe234fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.811+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138830697504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e67937d70 con 0x559e678efb70 2024-09-21T08:52:02.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.812+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94138830697504] v34'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe374057030 con 0x559e678efb70 2024-09-21T08:52:02.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.812+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138830674704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e679377d0 con 0x7fe37003d070 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.813+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94138830674704] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374095040 con 0x7fe37003d070 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.813+0000 7fe382a0e800 20 remove_watcher() i=0 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.813+0000 7fe382a0e800 2 removed watcher, disabling cache 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.813+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138830678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e679377d0 con 0x559e678efb70 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.814+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94138830678144] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374095040 con 0x559e678efb70 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.814+0000 7fe382a0e800 20 remove_watcher() i=1 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.814+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138830680880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e679377d0 con 0x559e678f8ef0 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.815+0000 7fe37e11a640 1 -- 172.21.15.196:0/3374197698 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94138830680880] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe37002d070 con 0x559e678f8ef0 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.815+0000 7fe382a0e800 20 remove_watcher() i=2 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.815+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138830672144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fe880 con 0x7fe37003d070 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.816+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94138830672144] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374095040 con 0x7fe37003d070 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.816+0000 7fe382a0e800 20 remove_watcher() i=3 2024-09-21T08:52:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.816+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138830683184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678ff330 con 0x559e678efb70 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.817+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94138830683184] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe374095040 con 0x559e678efb70 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.817+0000 7fe382a0e800 20 remove_watcher() i=4 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.817+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138830688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678fe880 con 0x559e678f4580 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.818+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94138830688080] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe378069040 con 0x559e678f4580 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.818+0000 7fe382a0e800 20 remove_watcher() i=5 2024-09-21T08:52:02.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.818+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138830692864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678ffc30 con 0x559e678f4580 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.819+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94138830692864] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe378069040 con 0x559e678f4580 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.819+0000 7fe382a0e800 20 remove_watcher() i=6 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.819+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138830694432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e678ff330 con 0x559e678f4580 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe37e91b640 1 -- 172.21.15.196:0/3374197698 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94138830694432] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe378069040 con 0x559e678f4580 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 20 remove_watcher() i=7 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678f4580 msgr2=0x559e678f6970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678f4580 0x559e678f6970 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e678efb70 msgr2=0x559e678f2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e678efb70 0x559e678f2030 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe37003d070 msgr2=0x7fe370018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe37003d070 0x7fe370018810 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559e678f8ef0 msgr2=0x559e678fb3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x559e678f8ef0 0x559e678fb3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe248036b90 msgr2=0x7fe248039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe248036b90 0x7fe248039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe37000bc50 tx=0x7fe370040f90 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 msgr2=0x559e678e3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe382a0e800 1 --2- 172.21.15.196:0/3374197698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678dca40 0x559e678e3ec0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe378011be0 tx=0x7fe37804cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 reap_dead start 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.820+0000 7fe37d919640 1 -- 172.21.15.196:0/3374197698 reap_dead start 2024-09-21T08:52:02.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 shutdown_connections 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 >> 172.21.15.196:0/3374197698 conn(0x559e678d8da0 msgr2=0x559e678d6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 shutdown_connections 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/3374197698 wait complete. 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 msgr2=0x7fe258039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 0x7fe258039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559e678bcac0 tx=0x7fe37001b520 comp rx=0 tx=0).stop 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 msgr2=0x559e678d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x559e678b6130 tx=0x7fe3780188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 shutdown_connections 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe258036b90 0x7fe258039050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1152406446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e678cfdc0 0x559e678d01e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 >> 172.21.15.196:0/1152406446 conn(0x559e678c4d50 msgr2=0x559e678c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 shutdown_connections 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1152406446 wait complete. 2024-09-21T08:52:02.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 msgr2=0x559e678c0d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 0x559e678c0d90 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 msgr2=0x559e678bc0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 0x559e678bc0f0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 msgr2=0x7fe264039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 0x7fe264039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe374057000 tx=0x7fe374052000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 msgr2=0x559e678b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.821+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x559e678ae4b0 tx=0x7fe370000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 shutdown_connections 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559e678be9a0 0x559e678c0d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559e677c2930 0x559e678bc0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe264036b90 0x7fe264039050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 --2- 172.21.15.196:0/1777599176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559e67731da0 0x559e678b5080 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 >> 172.21.15.196:0/1777599176 conn(0x559e677b8de0 msgr2=0x559e678a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 shutdown_connections 2024-09-21T08:52:02.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.822+0000 7fe382a0e800 1 -- 172.21.15.196:0/1777599176 wait complete. 2024-09-21T08:52:02.833 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-21T08:52:02.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-21T08:52:02.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-21T08:52:02.833 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-21T08:52:02.917 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:02.918 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e48a63800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ba6f42dd0 0x556ba6fd4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e48a63800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ba6e8eb30 con 0x556ba6fd4b40 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e48a63800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556ba6e70360 con 0x556ba6f42dd0 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e4655e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ba6f42dd0 0x556ba6fd4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e4655e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ba6f42dd0 0x556ba6fd4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37664/0 (socket says 172.21.15.196:37664) 2024-09-21T08:52:02.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e4655e640 1 -- 172.21.15.196:0/2779336918 learned_addr learned my addr 172.21.15.196:0/2779336918 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.916+0000 7f5e3dd5d640 1 --1- 172.21.15.196:0/2779336918 >> v1:172.21.15.29:6789/0 conn(0x556ba6fd4b40 0x556ba6fd6f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49534/0 (socket says 172.21.15.196:49534) 2024-09-21T08:52:02.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.917+0000 7f5e4655e640 1 -- 172.21.15.196:0/2779336918 >> v1:172.21.15.29:6789/0 conn(0x556ba6fd4b40 legacy=0x556ba6fd6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.917+0000 7f5e4655e640 1 -- 172.21.15.196:0/2779336918 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba6e96e00 con 0x556ba6f42dd0 2024-09-21T08:52:02.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.918+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2779336918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba6fd4600 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a520 tx=0x7f5e380459e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874e9b9ed65d6da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.918+0000 7f5e45d5d640 1 -- 172.21.15.196:0/2779336918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38053400 con 0x556ba6f42dd0 2024-09-21T08:52:02.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e45d5d640 1 -- 172.21.15.196:0/2779336918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38058070 con 0x556ba6f42dd0 2024-09-21T08:52:02.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e45d5d640 1 -- 172.21.15.196:0/2779336918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38053710 con 0x556ba6f42dd0 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 -- 172.21.15.196:0/2779336918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 msgr2=0x556ba6fd4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2779336918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba6fd4600 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a520 tx=0x7f5e380459e0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 -- 172.21.15.196:0/2779336918 shutdown_connections 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2779336918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba6fd4600 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 -- 172.21.15.196:0/2779336918 >> 172.21.15.196:0/2779336918 conn(0x556ba6fc9df0 msgr2=0x556ba6fcc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 -- 172.21.15.196:0/2779336918 shutdown_connections 2024-09-21T08:52:02.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.919+0000 7f5e48a63800 1 -- 172.21.15.196:0/2779336918 wait complete. 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e48a63800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e48a63800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ba6f1b330 con 0x556ba6f42dd0 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e4655e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e4655e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37672/0 (socket says 172.21.15.196:37672) 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e4655e640 1 -- 172.21.15.196:0/219649144 learned_addr learned my addr 172.21.15.196:0/219649144 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e4655e640 1 -- 172.21.15.196:0/219649144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba6e68bc0 con 0x556ba6f42dd0 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.933+0000 7f5e4655e640 1 --2- 172.21.15.196:0/219649144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5e38045a20 tx=0x7f5e38051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833c0a7ba8ba8c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5d34608640 1 -- 172.21.15.196:0/219649144 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e380539a0 con 0x556ba6f42dd0 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5d34608640 1 -- 172.21.15.196:0/219649144 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38063030 con 0x556ba6f42dd0 2024-09-21T08:52:02.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5d34608640 1 -- 172.21.15.196:0/219649144 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38053cb0 con 0x556ba6f42dd0 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 -- 172.21.15.196:0/219649144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 msgr2=0x556ba70c0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 --2- 172.21.15.196:0/219649144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5e38045a20 tx=0x7f5e38051000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 -- 172.21.15.196:0/219649144 shutdown_connections 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 --2- 172.21.15.196:0/219649144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c0a70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 -- 172.21.15.196:0/219649144 >> 172.21.15.196:0/219649144 conn(0x556ba6fc9df0 msgr2=0x556ba70bc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 -- 172.21.15.196:0/219649144 shutdown_connections 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.934+0000 7f5e48a63800 1 -- 172.21.15.196:0/219649144 wait complete. 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e48a63800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e48a63800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ba6fd88f0 con 0x556ba6f42dd0 2024-09-21T08:52:02.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e4655e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e4655e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37684/0 (socket says 172.21.15.196:37684) 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e4655e640 1 -- 172.21.15.196:0/1478223205 learned_addr learned my addr 172.21.15.196:0/1478223205 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.935+0000 7f5e4655e640 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba6e7cfe0 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5e4655e640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025be0 tx=0x7f5e38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5d32e05640 1 -- 172.21.15.196:0/1478223205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38053bf0 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5d32e05640 1 -- 172.21.15.196:0/1478223205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38068420 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba70c88c0 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5d32e05640 1 -- 172.21.15.196:0/1478223205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38068740 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba70c8de0 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.936+0000 7f5d32e05640 1 -- 172.21.15.196:0/1478223205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e38052070 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5d32e05640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 0x7f5d2c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5d32e05640 1 -- 172.21.15.196:0/1478223205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5e38070030 con 0x556ba6f42dd0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 0x7f5d2c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 0x556ba70cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba70cf970 con 0x556ba6fd4b40 2024-09-21T08:52:02.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 0x556ba70cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 0x7f5d2c039000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000b340 tx=0x7f5e30001520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.937+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 0x556ba70cf3f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1478223205 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4000a4a0 con 0x556ba6fd4b40 2024-09-21T08:52:02.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba70cc9a0 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1478223205 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e4000a4a0 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 0x556ba70d4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba70d46f0 con 0x556ba70d1c60 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e4655e640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 0x556ba70d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.938+0000 7f5e4655e640 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 0x556ba70d4050 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.939+0000 7f5e4655e640 1 -- 172.21.15.196:0/1478223205 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba70d1c60 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.939+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba70d0b00 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.939+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1478223205 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e4000a4a0 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.939+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba70d0fa0 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.939+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1478223205 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e4000a4a0 con 0x556ba6fd4b40 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e48a63800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e48a63800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ba6e6a580 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37692/0 (socket says 172.21.15.196:37692) 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e46d5f640 1 -- 172.21.15.196:0/4034564111 learned_addr learned my addr 172.21.15.196:0/4034564111 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e46d5f640 1 -- 172.21.15.196:0/4034564111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba70e39e0 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.940+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x556ba70c9430 tx=0x7f5e400188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5d2bfff640 1 -- 172.21.15.196:0/4034564111 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40014450 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5d2bfff640 1 -- 172.21.15.196:0/4034564111 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e400145f0 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5d2bfff640 1 -- 172.21.15.196:0/4034564111 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e400148d0 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba70e3c70 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba70e6950 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5d2bfff640 1 -- 172.21.15.196:0/4034564111 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e40011040 con 0x556ba70e3080 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.941+0000 7f5d2bfff640 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5d2bfff640 1 -- 172.21.15.196:0/4034564111 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5e4001e070 con 0x556ba70e3080 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e4655e640 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e4655e640 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x556ba70cfda0 tx=0x7f5e38067f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e48a63800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e48a63800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ba70c11c0 con 0x556ba70efd00 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37696/0 (socket says 172.21.15.196:37696) 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.942+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1593125434 learned_addr learned my addr 172.21.15.196:0/1593125434 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e46d5f640 1 -- 172.21.15.196:0/1593125434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba70f0640 con 0x556ba70efd00 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/1593125434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004cb90 tx=0x7f5e40011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d1fddf779e73d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5d29ffb640 1 -- 172.21.15.196:0/1593125434 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40044070 con 0x556ba70efd00 2024-09-21T08:52:02.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5d29ffb640 1 -- 172.21.15.196:0/1593125434 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40013c90 con 0x556ba70efd00 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5d29ffb640 1 -- 172.21.15.196:0/1593125434 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4002ba60 con 0x556ba70efd00 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 -- 172.21.15.196:0/1593125434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 msgr2=0x556ba70f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1593125434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004cb90 tx=0x7f5e40011700 comp rx=0 tx=0).stop 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 -- 172.21.15.196:0/1593125434 shutdown_connections 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1593125434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f0100 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 -- 172.21.15.196:0/1593125434 >> 172.21.15.196:0/1593125434 conn(0x556ba70ec0b0 msgr2=0x556ba70ea1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 -- 172.21.15.196:0/1593125434 shutdown_connections 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.943+0000 7f5e48a63800 1 -- 172.21.15.196:0/1593125434 wait complete. 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e48a63800 1 Processor -- start 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e48a63800 1 -- start start 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e48a63800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e48a63800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ba70f0ce0 con 0x556ba70efd00 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e46d5f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37702/0 (socket says 172.21.15.196:37702) 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 learned_addr learned my addr 172.21.15.196:0/2740613560 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba70f7680 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f7140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004ba60 tx=0x7f5e4004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.944+0000 7f5d17fff640 1 -- 172.21.15.196:0/2740613560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4003a020 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5d17fff640 1 -- 172.21.15.196:0/2740613560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4002b560 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba70f7910 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5d17fff640 1 -- 172.21.15.196:0/2740613560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4002b880 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba70fa5c0 con 0x556ba70efd00 2024-09-21T08:52:02.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5d17fff640 1 -- 172.21.15.196:0/2740613560 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e4003d020 con 0x556ba70efd00 2024-09-21T08:52:02.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.945+0000 7f5d17fff640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b40 0x7f5d10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5d17fff640 1 -- 172.21.15.196:0/2740613560 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5e40033040 con 0x556ba70efd00 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b40 0x7f5d10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b40 0x7f5d10039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e3808eba0 tx=0x7f5e38093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba7102e50 0x556ba7105310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7105a60 con 0x556ba7102e50 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.946+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba7102e50 0x556ba7105310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba7102e50 0x556ba7105310 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f7f0 con 0x556ba7102e50 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 realm 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba71022a0 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f7f0 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7106550 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f7f0 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.947+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7106e20 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e3000f7f0 con 0x556ba7102e50 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba7107840 0x556ba7109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.965 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba710a320 con 0x556ba7107840 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba7107840 0x556ba7109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e46d5f640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba7107840 0x556ba7109c30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 20 searching for the correct realm 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556ba710c2f0 0x556ba710e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.948+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556ba710c2f0 0x556ba710e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556ba710c2f0 0x556ba710e7b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e4655e640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e3805f040 0x7f5e3805faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e3805f040 0x7f5e3805faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:02.966 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.949+0000 7f5e3dd5d640 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e3805f040 0x7f5e3805faa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3000f7f0 con 0x7f5e3805f040 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3000f7f0 con 0x556ba7102e50 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.950+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.967 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.951+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.952+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.968 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.953+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.954+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.955+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba710c2f0 2024-09-21T08:52:02.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7107840 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.956+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x556ba7102e50 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ee80 con 0x7f5e3805f040 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba710ace0 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba710b580 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.957+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba710a920 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 zone default found 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 4 Realm: () 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:02.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 zonegroup default 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba710f320 con 0x556ba7107840 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba71115f0 con 0x556ba710c2f0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.958+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7111990 con 0x556ba710c2f0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.959+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.959+0000 7f5e48a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:02.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.959+0000 7f5e48a63800 20 started sync module instance, tier type = 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.959+0000 7f5e48a63800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.959+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7110a80 con 0x7f5e3805f040 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.960+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.960+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920852774816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7110a80 con 0x7f5e3805f040 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.960+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7112400 con 0x556ba7102e50 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.961+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920852774816] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.961+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.961+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920852778768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7110a80 con 0x556ba7102e50 2024-09-21T08:52:02.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.961+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7112e70 con 0x556ba710c2f0 2024-09-21T08:52:02.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.962+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920852778768] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.962+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.962+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920852772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71109f0 con 0x556ba710c2f0 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.962+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7113d30 con 0x7f5e3805f040 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.963+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.963+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920852772304] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.963+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920852785488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7114220 con 0x7f5e3805f040 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.963+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7114ab0 con 0x556ba7102e50 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.964+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920852785488] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.964+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.964+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920852786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7114640 con 0x556ba7102e50 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.964+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71154c0 con 0x556ba7107840 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.965+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920852786544] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.965+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.965+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920852787600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71145b0 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.965+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7116380 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.966+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920852787600] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.966+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.966+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920852793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7116380 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.966+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7116d40 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920852793440] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920852795568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7116d40 con 0x556ba7107840 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=0 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=1 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=2 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=3 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=4 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=5 2024-09-21T08:52:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.967+0000 7f5e48a63800 20 add_watcher() i=6 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.968+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920852795568] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.968+0000 7f5e48a63800 20 add_watcher() i=7 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.968+0000 7f5e48a63800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.968+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba711a170 con 0x556ba7102e50 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.969+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.969+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920852798048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7117690 con 0x556ba7102e50 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920852798048] v34'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5cfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 5 note: GC not initialized 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5c777fe640 20 reqs_thread_entry: start 2024-09-21T08:52:02.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 20 Filter name: none 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5c757fa640 20 reqs_thread_entry: start 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.970+0000 7f5e48a63800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba714d580 con 0x556ba7102e50 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7150010 con 0x7f5e3805f040 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 20 disabling bucket name=myfoo 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:02.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.971+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba714dff0 con 0x7f5e3805f040 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 20 rados->read ofs=0 len=0 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba71508e0 con 0x556ba7102e50 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.972+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7158510 con 0x556ba7102e50 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e48a63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e48a63800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e48a63800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e48a63800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 93920853036960 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7153bc0 con 0x556ba7107840 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.973+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== watch-notify(notify (1) cookie 93920852787600 notify 146028888079 ret 0) ==== 794+0+0 (crc 0 0 0) 0x556ba70fa5c0 con 0x556ba7107840 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5d29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 93920852787600 notifier 4601 bl.length()=752 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5d29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5d29ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:02.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(67 notify.5 [notify cookie 93920853036960 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5d29ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5d29ffb640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5d0c003ea0 con 0x556ba7107840 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify_complete (2) cookie 93920853036960 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ba70f7910 con 0x556ba7107840 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e48a63800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e48a63800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e48a63800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e48a63800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.974+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba7155df0 con 0x556ba7102e50 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e48a63800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e48a63800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e48a63800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93920853058512 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ba7155df0 con 0x556ba7102e50 2024-09-21T08:52:02.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== watch-notify(notify (1) cookie 93920852786544 notify 146028888080 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556ba7150cd0 con 0x556ba7102e50 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5d29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 93920852786544 notifier 4601 bl.length()=567 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5d29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5d29ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5d29ffb640 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5d0c003ea0 con 0x556ba7102e50 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.975+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(70 notify.4 [notify cookie 93920853058512 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.976+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.976+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== watch-notify(notify_complete (2) cookie 93920853058512 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ba714fe10 con 0x556ba7102e50 2024-09-21T08:52:02.989 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.977+0000 7f5cfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.977+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920852798048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba714b2f0 con 0x556ba7102e50 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.978+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93920852798048] v34'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.978+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920852774816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba714b2f0 con 0x7f5e3805f040 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.979+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93920852774816] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.979+0000 7f5e48a63800 20 remove_watcher() i=0 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.979+0000 7f5e48a63800 2 removed watcher, disabling cache 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.979+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920852778768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba714b2f0 con 0x556ba7102e50 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.980+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93920852778768] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.980+0000 7f5e48a63800 20 remove_watcher() i=1 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.980+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920852772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba714b2f0 con 0x556ba710c2f0 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.981+0000 7f5e4655e640 1 -- 172.21.15.196:0/2740613560 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93920852772304] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3805ed60 con 0x556ba710c2f0 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.981+0000 7f5e48a63800 20 remove_watcher() i=2 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.981+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920852785488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71105d0 con 0x7f5e3805f040 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.982+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93920852785488] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e3805f040 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.982+0000 7f5e48a63800 20 remove_watcher() i=3 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.982+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920852786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71105d0 con 0x556ba7102e50 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.983+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93920852786544] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x556ba7102e50 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.983+0000 7f5e48a63800 20 remove_watcher() i=4 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.983+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920852787600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71105d0 con 0x556ba7107840 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.984+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93920852787600] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.984+0000 7f5e48a63800 20 remove_watcher() i=5 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.984+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920852793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71105d0 con 0x556ba7107840 2024-09-21T08:52:02.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.985+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93920852793440] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.985+0000 7f5e48a63800 20 remove_watcher() i=6 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.985+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920852795568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ba71105d0 con 0x556ba7107840 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e46d5f640 1 -- 172.21.15.196:0/2740613560 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93920852795568] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x556ba7107840 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 20 remove_watcher() i=7 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba7107840 msgr2=0x556ba7109c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba7107840 0x556ba7109c30 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba7102e50 msgr2=0x556ba7105310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba7102e50 0x556ba7105310 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e3805f040 msgr2=0x7f5e3805faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e3805f040 0x7f5e3805faa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556ba710c2f0 msgr2=0x556ba710e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556ba710c2f0 0x556ba710e7b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b40 msgr2=0x7f5d10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b40 0x7f5d10039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5e3808eba0 tx=0x7f5e38093000 comp rx=0 tx=0).stop 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 msgr2=0x556ba70f7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/2740613560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70efd00 0x556ba70f7140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004ba60 tx=0x7f5e4004cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 reap_dead start 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e3dd5d640 1 -- 172.21.15.196:0/2740613560 reap_dead start 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 shutdown_connections 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 >> 172.21.15.196:0/2740613560 conn(0x556ba70ec0b0 msgr2=0x556ba70f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 shutdown_connections 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/2740613560 wait complete. 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 msgr2=0x7f5d20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x556ba70cfda0 tx=0x7f5e38067f70 comp rx=0 tx=0).stop 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 msgr2=0x556ba70e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x556ba70c9430 tx=0x7f5e400188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 shutdown_connections 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 --2- 172.21.15.196:0/4034564111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba70e3080 0x556ba70e34a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 >> 172.21.15.196:0/4034564111 conn(0x556ba70d8010 msgr2=0x556ba70dab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 shutdown_connections 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.986+0000 7f5e48a63800 1 -- 172.21.15.196:0/4034564111 wait complete. 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 msgr2=0x556ba70d4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 0x556ba70d4050 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 msgr2=0x556ba70cf3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 0x556ba70cf3f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 msgr2=0x7f5d2c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 0x7f5d2c039000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000b340 tx=0x7f5e30001520 comp rx=0 tx=0).stop 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 msgr2=0x556ba70c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025be0 tx=0x7f5e38002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 shutdown_connections 2024-09-21T08:52:02.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556ba70d1c60 0x556ba70d4050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556ba6fd4b40 0x556ba70cf3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d2c036b40 0x7f5d2c039000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 --2- 172.21.15.196:0/1478223205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ba6f42dd0 0x556ba70c8380 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 >> 172.21.15.196:0/1478223205 conn(0x556ba6fc9df0 msgr2=0x556ba70bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 shutdown_connections 2024-09-21T08:52:02.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:02.987+0000 7f5e48a63800 1 -- 172.21.15.196:0/1478223205 wait complete. 2024-09-21T08:52:03.000 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:03.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-21T08:52:03.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-21T08:52:03.002 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-21T08:52:03.046 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:03.046 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.044+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.044+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.044+0000 7fe195430800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560bd961d990 0x560bd961fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.044+0000 7fe195430800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560bd94d9b30 con 0x560bd9619550 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.044+0000 7fe195430800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x560bd94bb360 con 0x560bd961d990 2024-09-21T08:52:03.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe187f5f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560bd961d990 0x560bd961fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe190760640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x560bd9619550 0x560bd9619950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:49540/0 (socket says 172.21.15.196:49540) 2024-09-21T08:52:03.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe187f5f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560bd961d990 0x560bd961fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37710/0 (socket says 172.21.15.196:37710) 2024-09-21T08:52:03.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe190760640 1 -- 172.21.15.196:0/2753067201 learned_addr learned my addr 172.21.15.196:0/2753067201 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:03.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe187f5f640 1 -- 172.21.15.196:0/2753067201 >> v1:172.21.15.29:6789/0 conn(0x560bd9619550 legacy=0x560bd9619950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.045+0000 7fe187f5f640 1 -- 172.21.15.196:0/2753067201 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd94e1e00 con 0x560bd961d990 2024-09-21T08:52:03.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe187f5f640 1 --2- 172.21.15.196:0/2753067201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd961d990 0x560bd961fd80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe17800a470 tx=0x7fe178045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ab74a0343e423d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe18ff5f640 1 -- 172.21.15.196:0/2753067201 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe178053570 con 0x560bd961d990 2024-09-21T08:52:03.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe18ff5f640 1 -- 172.21.15.196:0/2753067201 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178058070 con 0x560bd961d990 2024-09-21T08:52:03.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe18ff5f640 1 -- 172.21.15.196:0/2753067201 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe178053880 con 0x560bd961d990 2024-09-21T08:52:03.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 -- 172.21.15.196:0/2753067201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd961d990 msgr2=0x560bd961fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 --2- 172.21.15.196:0/2753067201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd961d990 0x560bd961fd80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe17800a470 tx=0x7fe178045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:03.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 -- 172.21.15.196:0/2753067201 shutdown_connections 2024-09-21T08:52:03.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 --2- 172.21.15.196:0/2753067201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd961d990 0x560bd961fd80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 -- 172.21.15.196:0/2753067201 >> 172.21.15.196:0/2753067201 conn(0x560bd9614de0 msgr2=0x560bd9617200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 -- 172.21.15.196:0/2753067201 shutdown_connections 2024-09-21T08:52:03.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.047+0000 7fe195430800 1 -- 172.21.15.196:0/2753067201 wait complete. 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.061+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.061+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.061+0000 7fe195430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.061+0000 7fe195430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560bd9566330 con 0x560bd9619550 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe190760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe190760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37720/0 (socket says 172.21.15.196:37720) 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe190760640 1 -- 172.21.15.196:0/2366749194 learned_addr learned my addr 172.21.15.196:0/2366749194 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe190760640 1 -- 172.21.15.196:0/2366749194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd94b3bc0 con 0x560bd9619550 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe190760640 1 --2- 172.21.15.196:0/2366749194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe180001e10 tx=0x7fe18000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e8d661870284d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe07e60c640 1 -- 172.21.15.196:0/2366749194 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180012020 con 0x560bd9619550 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe07e60c640 1 -- 172.21.15.196:0/2366749194 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18000e5a0 con 0x560bd9619550 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.062+0000 7fe07e60c640 1 -- 172.21.15.196:0/2366749194 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18000e8e0 con 0x560bd9619550 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- 172.21.15.196:0/2366749194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 msgr2=0x560bd9708780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 --2- 172.21.15.196:0/2366749194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe180001e10 tx=0x7fe18000b780 comp rx=0 tx=0).stop 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- 172.21.15.196:0/2366749194 shutdown_connections 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 --2- 172.21.15.196:0/2366749194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd9708780 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- 172.21.15.196:0/2366749194 >> 172.21.15.196:0/2366749194 conn(0x560bd9614de0 msgr2=0x560bd9704140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- 172.21.15.196:0/2366749194 shutdown_connections 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- 172.21.15.196:0/2366749194 wait complete. 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.063+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe195430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe195430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560bd96205c0 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe190760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe190760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37724/0 (socket says 172.21.15.196:37724) 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe190760640 1 -- 172.21.15.196:0/4194304805 learned_addr learned my addr 172.21.15.196:0/4194304805 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe190760640 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd94c7fe0 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe190760640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe18000b7c0 tx=0x7fe180000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe07ce09640 1 -- 172.21.15.196:0/4194304805 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180012030 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe07ce09640 1 -- 172.21.15.196:0/4194304805 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe180001470 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bd9713eb0 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.064+0000 7fe07ce09640 1 -- 172.21.15.196:0/4194304805 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18001a8d0 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.065+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bd97143d0 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.065+0000 7fe07ce09640 1 -- 172.21.15.196:0/4194304805 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe180015020 con 0x560bd9619550 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.065+0000 7fe07ce09640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 0x7fe078039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.065+0000 7fe07ce09640 1 -- 172.21.15.196:0/4194304805 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe180020030 con 0x560bd9619550 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe187f5f640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 0x7fe078039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 0x560bd97181f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9718840 con 0x560bd961d990 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe190f61640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 0x560bd97181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe187f5f640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 0x7fe078039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe178057000 tx=0x7fe178052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe190f61640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 0x560bd97181f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe190f61640 1 -- 172.21.15.196:0/4194304805 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18800a4a0 con 0x560bd961d990 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.066+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97157a0 con 0x560bd961d990 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe190f61640 1 -- 172.21.15.196:0/4194304805 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe18800a4a0 con 0x560bd961d990 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 0x560bd971cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd971d5e0 con 0x560bd971ab50 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe190760640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 0x560bd971cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe190760640 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 0x560bd971cf40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe190760640 1 -- 172.21.15.196:0/4194304805 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd971ab50 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.067+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97199f0 con 0x560bd961d990 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.068+0000 7fe190f61640 1 -- 172.21.15.196:0/4194304805 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe18800a4a0 con 0x560bd961d990 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.068+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9719e90 con 0x560bd961d990 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.068+0000 7fe190f61640 1 -- 172.21.15.196:0/4194304805 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe18800a4a0 con 0x560bd961d990 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.068+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.068+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe195430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe195430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560bd94b5580 con 0x560bd972bf70 2024-09-21T08:52:03.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37728/0 (socket says 172.21.15.196:37728) 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe190f61640 1 -- 172.21.15.196:0/1023310023 learned_addr learned my addr 172.21.15.196:0/1023310023 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe190f61640 1 -- 172.21.15.196:0/1023310023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd972c8d0 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe190f61640 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x560bd958dfd0 tx=0x7fe1880188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe075ffb640 1 -- 172.21.15.196:0/1023310023 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188014450 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe075ffb640 1 -- 172.21.15.196:0/1023310023 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1880145f0 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe075ffb640 1 -- 172.21.15.196:0/1023310023 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1880148d0 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bd972cb60 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.069+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bd972f840 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.070+0000 7fe075ffb640 1 -- 172.21.15.196:0/1023310023 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe188011040 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.070+0000 7fe075ffb640 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 0x7fe068039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.070+0000 7fe075ffb640 1 -- 172.21.15.196:0/1023310023 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe18801e070 con 0x560bd972bf70 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.070+0000 7fe190760640 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 0x7fe068039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190760640 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 0x7fe068039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560bd9718c90 tx=0x7fe18004b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe195430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe195430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560bd9708f30 con 0x560bd9738c10 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37744/0 (socket says 172.21.15.196:37744) 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190f61640 1 -- 172.21.15.196:0/3890065010 learned_addr learned my addr 172.21.15.196:0/3890065010 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190f61640 1 -- 172.21.15.196:0/3890065010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd97395e0 con 0x560bd9738c10 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.071+0000 7fe190f61640 1 --2- 172.21.15.196:0/3890065010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe18804cb90 tx=0x7fe188011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65fab3f8c4cbd4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe0677fe640 1 -- 172.21.15.196:0/3890065010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188044070 con 0x560bd9738c10 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe0677fe640 1 -- 172.21.15.196:0/3890065010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188013c90 con 0x560bd9738c10 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe0677fe640 1 -- 172.21.15.196:0/3890065010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18802ba60 con 0x560bd9738c10 2024-09-21T08:52:03.084 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- 172.21.15.196:0/3890065010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 msgr2=0x560bd9739010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 --2- 172.21.15.196:0/3890065010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe18804cb90 tx=0x7fe188011700 comp rx=0 tx=0).stop 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- 172.21.15.196:0/3890065010 shutdown_connections 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 --2- 172.21.15.196:0/3890065010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9739010 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- 172.21.15.196:0/3890065010 >> 172.21.15.196:0/3890065010 conn(0x560bd9734fc0 msgr2=0x560bd97330c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- 172.21.15.196:0/3890065010 shutdown_connections 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- 172.21.15.196:0/3890065010 wait complete. 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 Processor -- start 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.072+0000 7fe195430800 1 -- start start 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe195430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe195430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560bd9739bb0 con 0x560bd9738c10 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe190f61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:37754/0 (socket says 172.21.15.196:37754) 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 learned_addr learned my addr 172.21.15.196:0/2471732205 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:03.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd97405a0 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe190f61640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe18804ba60 tx=0x7fe18804cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe065ffb640 1 -- 172.21.15.196:0/2471732205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18803a020 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe065ffb640 1 -- 172.21.15.196:0/2471732205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18802b560 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe065ffb640 1 -- 172.21.15.196:0/2471732205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18802b880 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bd9740830 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.073+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bd97434e0 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.074+0000 7fe065ffb640 1 -- 172.21.15.196:0/2471732205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe18803d020 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.074+0000 7fe065ffb640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe058036b40 0x7fe058039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.074+0000 7fe065ffb640 1 -- 172.21.15.196:0/2471732205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe188033040 con 0x560bd9738c10 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.074+0000 7fe190760640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe058036b40 0x7fe058039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe190760640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe058036b40 0x7fe058039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe180000fd0 tx=0x7fe180033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd974bd00 0x560bd974e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd974e910 con 0x560bd974bd00 2024-09-21T08:52:03.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe187f5f640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd974bd00 0x560bd974e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.075+0000 7fe187f5f640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd974bd00 0x560bd974e1c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 realm 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd974ed40 con 0x560bd974bd00 2024-09-21T08:52:03.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd974f610 con 0x560bd974bd00 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd974f9b0 con 0x560bd974bd00 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.102 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd9750710 0x560bd9752b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.076+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9753110 con 0x560bd9750710 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe190f61640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd9750710 0x560bd9752b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe190f61640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd9750710 0x560bd9752b00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe195430800 20 searching for the correct realm 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560bd97550a0 0x560bd9757560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.077+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe190760640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560bd97550a0 0x560bd9757560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe190760640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560bd97550a0 0x560bd9757560 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe190760640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe180017050 0x7fe1800405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.078+0000 7fe187f5f640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe180017050 0x7fe1800405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe187f5f640 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe180017050 0x7fe1800405b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.079+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.080+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.081+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.082+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.083+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.084+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd97550a0 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.085+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd9750710 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x560bd974bd00 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560bd9757c30 con 0x7fe180017050 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:03.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97545f0 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.086+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9753e60 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97535a0 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:03.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 zone default found 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 4 Realm: () 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 zonegroup default 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9758560 con 0x560bd9750710 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd975a790 con 0x560bd97550a0 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.087+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd975ab30 con 0x560bd97550a0 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 20 started sync module instance, tier type = 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.088+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759c20 con 0x7fe180017050 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.089+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.089+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94608892993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759c20 con 0x7fe180017050 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.089+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975b540 con 0x560bd974bd00 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.090+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94608892993872] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.090+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.090+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94608892998256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759c20 con 0x560bd974bd00 2024-09-21T08:52:03.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.090+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975bfe0 con 0x560bd97550a0 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.091+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94608892998256] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.091+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.092+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94608892991344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759b90 con 0x560bd97550a0 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.092+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975cd70 con 0x7fe180017050 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.092+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94608892991344] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.093+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.093+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94608893002704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975d190 con 0x7fe180017050 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.093+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975db90 con 0x560bd974bd00 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.094+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.094+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94608893007520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975dac0 con 0x560bd974bd00 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.094+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975eac0 con 0x560bd9750710 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.094+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94608893002704] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.095+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.095+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94608893003760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975eeb0 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.095+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975f8b0 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.095+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94608893007520] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.096+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94608893003760] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.096+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.096+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94608893011408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975f3c0 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.096+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975fd80 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94608893011408] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94608893009792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975fd80 con 0x560bd9750710 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=0 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=1 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=2 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=3 2024-09-21T08:52:03.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=4 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=5 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.097+0000 7fe195430800 20 add_watcher() i=6 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94608893009792] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe195430800 20 add_watcher() i=7 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe195430800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97631e0 con 0x560bd974bd00 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.098+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94608893016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9760730 con 0x560bd974bd00 2024-09-21T08:52:03.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.099+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94608893016736] v34'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.099+0000 7fe046fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:03.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.099+0000 7fe195430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:03.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.099+0000 7fe195430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:03.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.099+0000 7fe195430800 5 note: GC not initialized 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe045fdb640 20 reqs_thread_entry: start 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 20 Filter name: none 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fdfb77fe640 20 reqs_thread_entry: start 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97965d0 con 0x560bd974bd00 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.100+0000 7fe195430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97960f0 con 0x7fe180017050 2024-09-21T08:52:03.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 20 enabling bucket name=myfoo 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9797040 con 0x7fe180017050 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 : miss 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 20 rados->read ofs=0 len=0 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.101+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd9798920 con 0x560bd974bd00 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:03.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.102+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.3 8:c7507662:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd97a1560 con 0x560bd974bd00 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe195430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe195430800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe195430800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe195430800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1, ofs0, ns] 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.103+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94608893265680 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd979cfe0 con 0x560bd9750710 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== watch-notify(notify (1) cookie 94608893003760 notify 146028888080 ret 0) ==== 794+0+0 (crc 0 0 0) 0x560bd97434e0 con 0x560bd9750710 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe0677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94608893003760 notifier 4608 bl.length()=752 2024-09-21T08:52:03.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(67 notify.5 [notify cookie 94608893265680 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe0677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 info.flags=0x17 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe0677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1 to cache LRU end 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe0677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe0677fe640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe05c003ea0 con 0x560bd9750710 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify_complete (2) cookie 94608893265680 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bd9740830 con 0x560bd9750710 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe195430800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_sources= new_sources= 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe195430800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential sources added=[] removed=[] 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe195430800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): orig_dests= new_dests= 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe195430800 20 handle_bi_update(): bucket=:myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1]): potential dests added=[] removed=[] 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.104+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9799540 con 0x560bd974bd00 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe195430800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:03.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe195430800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe195430800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94608893251728 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560bd97994b0 con 0x560bd974bd00 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== watch-notify(notify (1) cookie 94608893007520 notify 146028888081 ret 0) ==== 609+0+0 (crc 0 0 0) 0x560bd9798d10 con 0x560bd974bd00 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe0677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94608893007520 notifier 4608 bl.length()=567 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe0677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe0677fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(70 notify.4 [notify cookie 94608893251728 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.105+0000 7fe0677fe640 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe05c003ea0 con 0x560bd974bd00 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.106+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.106+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== watch-notify(notify_complete (2) cookie 94608893251728 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560bd9796d30 con 0x560bd974bd00 2024-09-21T08:52:03.125 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.106+0000 7fe046fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.107+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94608893016736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9794320 con 0x560bd974bd00 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.107+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94608893016736] v34'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.107+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94608892993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9794320 con 0x7fe180017050 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.108+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94608892993872] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.108+0000 7fe195430800 20 remove_watcher() i=0 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.108+0000 7fe195430800 2 removed watcher, disabling cache 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.108+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94608892998256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9794320 con 0x560bd974bd00 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.110+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94608892998256] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.110+0000 7fe195430800 20 remove_watcher() i=1 2024-09-21T08:52:03.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.110+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94608892991344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9794320 con 0x560bd97550a0 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.111+0000 7fe190760640 1 -- 172.21.15.196:0/2471732205 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94608892991344] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18002dcf0 con 0x560bd97550a0 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.111+0000 7fe195430800 20 remove_watcher() i=2 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.111+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94608893002704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759770 con 0x7fe180017050 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.111+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94608893002704] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x7fe180017050 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.112+0000 7fe195430800 20 remove_watcher() i=3 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.112+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94608893007520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd975c3d0 con 0x560bd974bd00 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.113+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94608893007520] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe178051070 con 0x560bd974bd00 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.113+0000 7fe195430800 20 remove_watcher() i=4 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.113+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94608893003760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759770 con 0x560bd9750710 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.114+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94608893003760] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.114+0000 7fe195430800 20 remove_watcher() i=5 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.114+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94608893011408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759770 con 0x560bd9750710 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.115+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94608893011408] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.115+0000 7fe195430800 20 remove_watcher() i=6 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.115+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94608893009792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560bd9759770 con 0x560bd9750710 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe190f61640 1 -- 172.21.15.196:0/2471732205 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94608893009792] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x560bd9750710 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 20 remove_watcher() i=7 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd9750710 msgr2=0x560bd9752b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd9750710 0x560bd9752b00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd974bd00 msgr2=0x560bd974e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd974bd00 0x560bd974e1c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe180017050 msgr2=0x7fe1800405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe180017050 0x7fe1800405b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560bd97550a0 msgr2=0x560bd9757560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560bd97550a0 0x560bd9757560 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe058036b40 msgr2=0x7fe058039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe058036b40 0x7fe058039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe180000fd0 tx=0x7fe180033000 comp rx=0 tx=0).stop 2024-09-21T08:52:03.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe187f5f640 1 -- 172.21.15.196:0/2471732205 reap_dead start 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 msgr2=0x560bd9740060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe18804ba60 tx=0x7fe18804cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 shutdown_connections 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/2471732205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9738c10 0x560bd9740060 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 >> 172.21.15.196:0/2471732205 conn(0x560bd9734fc0 msgr2=0x560bd9733090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 shutdown_connections 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/2471732205 wait complete. 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 msgr2=0x7fe068039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 0x7fe068039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560bd9718c90 tx=0x7fe18004b030 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 msgr2=0x560bd972c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x560bd958dfd0 tx=0x7fe1880188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 shutdown_connections 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe068036b40 0x7fe068039000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 --2- 172.21.15.196:0/1023310023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd972bf70 0x560bd972c390 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 >> 172.21.15.196:0/1023310023 conn(0x560bd9720f00 msgr2=0x560bd9723a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 shutdown_connections 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.116+0000 7fe195430800 1 -- 172.21.15.196:0/1023310023 wait complete. 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 msgr2=0x560bd971cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 0x560bd971cf40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 msgr2=0x560bd97181f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 0x560bd97181f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 msgr2=0x7fe078039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 0x7fe078039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe178057000 tx=0x7fe178052000 comp rx=0 tx=0).stop 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 msgr2=0x560bd958e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe18000b7c0 tx=0x7fe180000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 shutdown_connections 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560bd971ab50 0x560bd971cf40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560bd961d990 0x560bd97181f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe078036b90 0x7fe078039050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 --2- 172.21.15.196:0/4194304805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560bd9619550 0x560bd958e5e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:03.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 >> 172.21.15.196:0/4194304805 conn(0x560bd9614de0 msgr2=0x560bd97029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:03.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 shutdown_connections 2024-09-21T08:52:03.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:03.117+0000 7fe195430800 1 -- 172.21.15.196:0/4194304805 wait complete. 2024-09-21T08:52:03.135 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:03.142 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T08:52:03.383 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-21T08:52:03.389 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:18.389 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-21T08:52:18.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-21T08:52:18.390 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-21T08:52:18.443 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:18.443 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:18.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.442+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e4c720800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559591f734c0 0x559591f738c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e4c720800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559591e33b30 con 0x559591f73e00 2024-09-21T08:52:18.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e4c720800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x559591e15360 con 0x559591f734c0 2024-09-21T08:52:18.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e48416640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559591f734c0 0x559591f738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e48416640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559591f734c0 0x559591f738c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34962/0 (socket says 172.21.15.196:34962) 2024-09-21T08:52:18.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e3ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x559591f73e00 0x559591f78980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57948/0 (socket says 172.21.15.196:57948) 2024-09-21T08:52:18.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.443+0000 7f5e48416640 1 -- 172.21.15.196:0/955373437 learned_addr learned my addr 172.21.15.196:0/955373437 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.444+0000 7f5e48416640 1 -- 172.21.15.196:0/955373437 >> v1:172.21.15.29:6789/0 conn(0x559591f73e00 legacy=0x559591f78980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.444+0000 7f5e48416640 1 -- 172.21.15.196:0/955373437 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559591e3be00 con 0x559591f734c0 2024-09-21T08:52:18.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e48416640 1 --2- 172.21.15.196:0/955373437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x559591f738c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a520 tx=0x7f5e38045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aad18242965c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e47c15640 1 -- 172.21.15.196:0/955373437 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38055070 con 0x559591f734c0 2024-09-21T08:52:18.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e47c15640 1 -- 172.21.15.196:0/955373437 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e380515b0 con 0x559591f734c0 2024-09-21T08:52:18.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e47c15640 1 -- 172.21.15.196:0/955373437 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e380518d0 con 0x559591f734c0 2024-09-21T08:52:18.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 -- 172.21.15.196:0/955373437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 msgr2=0x559591f738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 --2- 172.21.15.196:0/955373437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x559591f738c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a520 tx=0x7f5e38045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 -- 172.21.15.196:0/955373437 shutdown_connections 2024-09-21T08:52:18.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 --2- 172.21.15.196:0/955373437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x559591f738c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 -- 172.21.15.196:0/955373437 >> 172.21.15.196:0/955373437 conn(0x559591f6edf0 msgr2=0x559591f71210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.446+0000 7f5e4c720800 1 -- 172.21.15.196:0/955373437 shutdown_connections 2024-09-21T08:52:18.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.447+0000 7f5e4c720800 1 -- 172.21.15.196:0/955373437 wait complete. 2024-09-21T08:52:18.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.462+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.462+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.462+0000 7f5e4c720800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e4c720800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559591ec0330 con 0x559591f734c0 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e48416640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e48416640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34970/0 (socket says 172.21.15.196:34970) 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e48416640 1 -- 172.21.15.196:0/3036853943 learned_addr learned my addr 172.21.15.196:0/3036853943 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e48416640 1 -- 172.21.15.196:0/3036853943 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559591e0dbc0 con 0x559591f734c0 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.463+0000 7f5e48416640 1 --2- 172.21.15.196:0/3036853943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025da0 tx=0x7f5e38051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf16cc3fe720a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.464+0000 7f5d3660c640 1 -- 172.21.15.196:0/3036853943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38051890 con 0x559591f734c0 2024-09-21T08:52:18.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.464+0000 7f5d3660c640 1 -- 172.21.15.196:0/3036853943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38051ac0 con 0x559591f734c0 2024-09-21T08:52:18.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.464+0000 7f5d3660c640 1 -- 172.21.15.196:0/3036853943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38051da0 con 0x559591f734c0 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.464+0000 7f5e4c720800 1 -- 172.21.15.196:0/3036853943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 msgr2=0x55959205f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.464+0000 7f5e4c720800 1 --2- 172.21.15.196:0/3036853943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025da0 tx=0x7f5e38051000 comp rx=0 tx=0).stop 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- 172.21.15.196:0/3036853943 shutdown_connections 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 --2- 172.21.15.196:0/3036853943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959205f630 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- 172.21.15.196:0/3036853943 >> 172.21.15.196:0/3036853943 conn(0x559591f6edf0 msgr2=0x559592061ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- 172.21.15.196:0/3036853943 shutdown_connections 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- 172.21.15.196:0/3036853943 wait complete. 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e4c720800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559591f7a4e0 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e48416640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e48416640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34976/0 (socket says 172.21.15.196:34976) 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.465+0000 7f5e48416640 1 -- 172.21.15.196:0/1606561572 learned_addr learned my addr 172.21.15.196:0/1606561572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5e48416640 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559591e21fe0 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5e48416640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025da0 tx=0x7f5e38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5d34e09640 1 -- 172.21.15.196:0/1606561572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e38073070 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5d34e09640 1 -- 172.21.15.196:0/1606561572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3805a580 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55959206d860 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5d34e09640 1 -- 172.21.15.196:0/1606561572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3805a860 con 0x559591f734c0 2024-09-21T08:52:18.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.466+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959206dde0 con 0x559591f734c0 2024-09-21T08:52:18.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.467+0000 7f5d34e09640 1 -- 172.21.15.196:0/1606561572 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e38076070 con 0x559591f734c0 2024-09-21T08:52:18.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.467+0000 7f5d34e09640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 0x7f5d30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.467+0000 7f5d34e09640 1 -- 172.21.15.196:0/1606561572 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5e38062070 con 0x559591f734c0 2024-09-21T08:52:18.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 0x7f5d30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 0x559592074390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559592074a00 con 0x559591f73e00 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e48c17640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 0x559592074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 0x7f5d30039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000f60 tx=0x7f5e30001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e48c17640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 0x559592074390 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e48c17640 1 -- 172.21.15.196:0/1606561572 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e4000a4a0 con 0x559591f73e00 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.468+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559592071940 con 0x559591f73e00 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.469+0000 7f5e48c17640 1 -- 172.21.15.196:0/1606561572 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e4000a4a0 con 0x559591f73e00 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.469+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 0x559592079120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.469+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559592079810 con 0x559592076d30 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.469+0000 7f5e48416640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 0x559592079120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.469+0000 7f5e48416640 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 0x559592079120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.470+0000 7f5e48416640 1 -- 172.21.15.196:0/1606561572 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e3807f070 con 0x559592076d30 2024-09-21T08:52:18.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.470+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559592075bd0 con 0x559591f73e00 2024-09-21T08:52:18.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.470+0000 7f5e48c17640 1 -- 172.21.15.196:0/1606561572 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e4000a4a0 con 0x559591f73e00 2024-09-21T08:52:18.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.470+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559592076000 con 0x559591f73e00 2024-09-21T08:52:18.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e48c17640 1 -- 172.21.15.196:0/1606561572 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e4000a4a0 con 0x559591f73e00 2024-09-21T08:52:18.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e4c720800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e4c720800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559591e0f580 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34988/0 (socket says 172.21.15.196:34988) 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.471+0000 7f5e48c17640 1 -- 172.21.15.196:0/4183259104 learned_addr learned my addr 172.21.15.196:0/4183259104 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5e48c17640 1 -- 172.21.15.196:0/4183259104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559592088af0 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5e48c17640 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55959206e540 tx=0x7f5e40012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5d2dffb640 1 -- 172.21.15.196:0/4183259104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40014450 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5d2dffb640 1 -- 172.21.15.196:0/4183259104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40014610 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5d2dffb640 1 -- 172.21.15.196:0/4183259104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40014930 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559592088d80 con 0x559592088190 2024-09-21T08:52:18.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.472+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959208ba60 con 0x559592088190 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.473+0000 7f5d2dffb640 1 -- 172.21.15.196:0/4183259104 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e40011040 con 0x559592088190 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.473+0000 7f5d2dffb640 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.473+0000 7f5d2dffb640 1 -- 172.21.15.196:0/4183259104 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5e4001e070 con 0x559592088190 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.473+0000 7f5e48416640 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e48416640 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x559592074ea0 tx=0x7f5e3808f320 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e4c720800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e4c720800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55959205dc40 con 0x559592094e60 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:34990/0 (socket says 172.21.15.196:34990) 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e48c17640 1 -- 172.21.15.196:0/3644447640 learned_addr learned my addr 172.21.15.196:0/3644447640 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.474+0000 7f5e48c17640 1 -- 172.21.15.196:0/3644447640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559592095830 con 0x559592094e60 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e48c17640 1 --2- 172.21.15.196:0/3644447640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004cd40 tx=0x7f5e40011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f08de58425cf0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5d1f7fe640 1 -- 172.21.15.196:0/3644447640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40014ad0 con 0x559592094e60 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5d1f7fe640 1 -- 172.21.15.196:0/3644447640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40014c70 con 0x559592094e60 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5d1f7fe640 1 -- 172.21.15.196:0/3644447640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40011d80 con 0x559592094e60 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 -- 172.21.15.196:0/3644447640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 msgr2=0x559592095260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 --2- 172.21.15.196:0/3644447640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5e4004cd40 tx=0x7f5e40011700 comp rx=0 tx=0).stop 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 -- 172.21.15.196:0/3644447640 shutdown_connections 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 --2- 172.21.15.196:0/3644447640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x559592095260 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 -- 172.21.15.196:0/3644447640 >> 172.21.15.196:0/3644447640 conn(0x5595920911c0 msgr2=0x55959208f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 -- 172.21.15.196:0/3644447640 shutdown_connections 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.475+0000 7f5e4c720800 1 -- 172.21.15.196:0/3644447640 wait complete. 2024-09-21T08:52:18.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e4c720800 1 Processor -- start 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e4c720800 1 -- start start 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e4c720800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e4c720800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559592095ea0 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e48c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35000/0 (socket says 172.21.15.196:35000) 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 learned_addr learned my addr 172.21.15.196:0/138708692 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.476+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959209c7d0 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5e48c17640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5e4003d040 tx=0x7f5e4004ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5d1dffb640 1 -- 172.21.15.196:0/138708692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4002b650 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5d1dffb640 1 -- 172.21.15.196:0/138708692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40022a80 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55959209ca60 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5d1dffb640 1 -- 172.21.15.196:0/138708692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e40022d60 con 0x559592094e60 2024-09-21T08:52:18.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.477+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959209f710 con 0x559592094e60 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5d1dffb640 1 -- 172.21.15.196:0/138708692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e400133b0 con 0x559592094e60 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5d1dffb640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b90 0x7f5d10039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5d1dffb640 1 -- 172.21.15.196:0/138708692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5e4000e040 con 0x559592094e60 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5e48416640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b90 0x7f5d10039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5595920a7f30 0x5595920aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920aab40 con 0x5595920a7f30 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.478+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5595920a7f30 0x5595920aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e48416640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b90 0x7f5d10039050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x559592079c10 tx=0x7f5e38093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5595920a7f30 0x5595920aa3f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f610 con 0x5595920a7f30 2024-09-21T08:52:18.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 20 realm 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920a7380 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f610 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.479+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920ab620 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3000f610 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920abef0 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e3000f610 con 0x5595920a7f30 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5595920ac7a0 0x5595920aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920af310 con 0x5595920ac7a0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e48c17640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5595920ac7a0 0x5595920aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.480+0000 7f5e48c17640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5595920ac7a0 0x5595920aebb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e4c720800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e4c720800 20 searching for the correct realm 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5595920b1410 0x5595920b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e48416640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5595920b1410 0x5595920b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e48416640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5595920b1410 0x5595920b38d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.481+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e48416640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e38078070 0x7f5e3806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e38078070 0x7f5e3806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e3ffff640 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e38078070 0x7f5e3806e3c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3000f610 con 0x7f5e38078070 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.482+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3000f610 con 0x5595920a7f30 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.483+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.484+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.485+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.486+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.487+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.488+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.489+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920b1410 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920ac7a0 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x5595920a7f30 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.490+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5595920b3fa0 con 0x7f5e38078070 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:18.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920afe10 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920b0260 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.491+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920b0700 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 zone default found 2024-09-21T08:52:18.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 4 Realm: () 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 zonegroup default 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920b4420 con 0x5595920ac7a0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920afa70 con 0x5595920b1410 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.492+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920b6760 con 0x5595920b1410 2024-09-21T08:52:18.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.493+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.493+0000 7f5e4c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.493+0000 7f5e4c720800 20 started sync module instance, tier type = 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.493+0000 7f5e4c720800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.493+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b5ae0 con 0x7f5e38078070 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.494+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.494+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94100888707072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b5ae0 con 0x7f5e38078070 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.494+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b7310 con 0x5595920a7f30 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.495+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94100888707072] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.495+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.495+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94100888710624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b5ae0 con 0x5595920a7f30 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.495+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b7da0 con 0x5595920b1410 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.497+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94100888710624] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.497+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.497+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94100888704560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b5a50 con 0x5595920b1410 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.497+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b8c60 con 0x7f5e38078070 2024-09-21T08:52:18.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.498+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.498+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94100888717712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b9380 con 0x7f5e38078070 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.498+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94100888704560] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.498+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b9ea0 con 0x5595920a7f30 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.499+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94100888717712] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.499+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.499+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94100888721776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b9e60 con 0x5595920a7f30 2024-09-21T08:52:18.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.499+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920ba740 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.500+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.500+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94100888721776] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.500+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94100888724112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b9e60 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.501+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b9e60 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.502+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94100888724112] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.502+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.502+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94100888715664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920bb130 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.502+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920bbb50 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94100888715664] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94100888729152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920bbb10 con 0x5595920ac7a0 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=0 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=1 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=2 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=3 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=4 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=5 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.504+0000 7f5e4c720800 20 add_watcher() i=6 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.505+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94100888729152] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.505+0000 7f5e4c720800 20 add_watcher() i=7 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.505+0000 7f5e4c720800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.505+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920befa0 con 0x5595920a7f30 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.506+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.506+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94100888726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920bc460 con 0x5595920a7f30 2024-09-21T08:52:18.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.507+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94100888726240] v36'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.507+0000 7f5cfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:18.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.507+0000 7f5e4c720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:18.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.507+0000 7f5e4c720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:18.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.507+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c7640 con 0x5595920a7f30 2024-09-21T08:52:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.509+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.509+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c7d10 con 0x5595920ac7a0 2024-09-21T08:52:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.510+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.510+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c8130 con 0x5595920b1410 2024-09-21T08:52:18.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.511+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.511+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c84d0 con 0x5595920a7f30 2024-09-21T08:52:18.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.512+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.512+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c8a40 con 0x7f5e38078070 2024-09-21T08:52:18.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.513+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.513+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c8c80 con 0x5595920b1410 2024-09-21T08:52:18.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.514+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.514+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9020 con 0x5595920a7f30 2024-09-21T08:52:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.515+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.515+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9020 con 0x5595920ac7a0 2024-09-21T08:52:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.516+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.516+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c90b0 con 0x7f5e38078070 2024-09-21T08:52:18.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.517+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.517+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c90b0 con 0x5595920b1410 2024-09-21T08:52:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.518+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.518+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c8820 con 0x7f5e38078070 2024-09-21T08:52:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.519+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.520+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c8820 con 0x5595920ac7a0 2024-09-21T08:52:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.521+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.521+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x7f5e38078070 2024-09-21T08:52:18.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.522+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.522+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920ac7a0 2024-09-21T08:52:18.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.523+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.523+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920a7f30 2024-09-21T08:52:18.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.524+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.524+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.525+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.525+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x7f5e38078070 2024-09-21T08:52:18.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.526+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.526+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.527+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'19 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.527+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920a7f30 2024-09-21T08:52:18.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.529+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.529+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920a7f30 2024-09-21T08:52:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.530+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.530+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.531+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.531+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x7f5e38078070 2024-09-21T08:52:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.532+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.532+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.533+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.533+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.534+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.534+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.535+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.535+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.536+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.536+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920ac7a0 2024-09-21T08:52:18.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.537+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.537+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.538+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.538+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920ac7a0 2024-09-21T08:52:18.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.539+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.539+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920b1410 2024-09-21T08:52:18.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.541+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.541+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x5595920ac7a0 2024-09-21T08:52:18.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.542+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.542+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c9660 con 0x7f5e38078070 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5cfd7e2640 20 reqs_thread_entry: start 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5e4c720800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5e4c720800 20 Filter name: none 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5c6effd640 20 reqs_thread_entry: start 2024-09-21T08:52:18.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.543+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c57d0 con 0x5595920a7f30 2024-09-21T08:52:18.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920a7f30 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.544+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920ac7a0 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920ac7a0 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920ac7a0 2024-09-21T08:52:18.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.545+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.546+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5bb0 con 0x5595920a7f30 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.547+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.551 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.548+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.549+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.550+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.550+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.550+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.550+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.551+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.552+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.553+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.553+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.553+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.553+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.553+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.554+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.555+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.556+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920a7f30 2024-09-21T08:52:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.557+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.558+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920c5790 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(147 gc.17 [call out=1702b] v0'0 uv18 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.559+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920a7f30 2024-09-21T08:52:18.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.560+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.561+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.562+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.563+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.564+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.565+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.566+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.567+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920ac7a0 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.568+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.569+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.569+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920b1410 2024-09-21T08:52:18.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.569+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.569+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920b1410 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.570+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x7f5e38078070 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f4790 con 0x7f5e38078070 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5595920f57a0 con 0x7f5e38078070 2024-09-21T08:52:18.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.571+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.572+0000 7f5cfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.572+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94100888726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920c4e60 con 0x5595920a7f30 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.573+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94100888726240] v36'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.573+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94100888707072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x7f5e38078070 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.574+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94100888707072] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.574+0000 7f5e4c720800 20 remove_watcher() i=0 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.574+0000 7f5e4c720800 2 removed watcher, disabling cache 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.574+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94100888710624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x5595920a7f30 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.575+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94100888710624] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.575+0000 7f5e4c720800 20 remove_watcher() i=1 2024-09-21T08:52:18.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.575+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94100888704560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x5595920b1410 2024-09-21T08:52:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.576+0000 7f5e48416640 1 -- 172.21.15.196:0/138708692 <== osd.3 v2:172.21.15.196:6800/127179937 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94100888704560] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3807f070 con 0x5595920b1410 2024-09-21T08:52:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.576+0000 7f5e4c720800 20 remove_watcher() i=2 2024-09-21T08:52:18.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.576+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94100888717712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x7f5e38078070 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.577+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94100888717712] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x7f5e38078070 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.578+0000 7f5e4c720800 20 remove_watcher() i=3 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.578+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94100888721776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b8990 con 0x5595920a7f30 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.578+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94100888721776] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3002b040 con 0x5595920a7f30 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.579+0000 7f5e4c720800 20 remove_watcher() i=4 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.579+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94100888724112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x5595920ac7a0 2024-09-21T08:52:18.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.580+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94100888724112] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.580+0000 7f5e4c720800 20 remove_watcher() i=5 2024-09-21T08:52:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.580+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94100888715664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920baae0 con 0x5595920ac7a0 2024-09-21T08:52:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.581+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94100888715664] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.581+0000 7f5e4c720800 20 remove_watcher() i=6 2024-09-21T08:52:18.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.581+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94100888729152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5595920b8190 con 0x5595920ac7a0 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e48c17640 1 -- 172.21.15.196:0/138708692 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94100888729152] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4002a070 con 0x5595920ac7a0 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 20 remove_watcher() i=7 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5595920ac7a0 msgr2=0x5595920aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5595920ac7a0 0x5595920aebb0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5595920a7f30 msgr2=0x5595920aa3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5595920a7f30 0x5595920aa3f0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e38078070 msgr2=0x7f5e3806e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5e38078070 0x7f5e3806e3c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5595920b1410 msgr2=0x5595920b38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5595920b1410 0x5595920b38d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b90 msgr2=0x7f5d10039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d10036b90 0x7f5d10039050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x559592079c10 tx=0x7f5e38093000 comp rx=0 tx=0).stop 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 msgr2=0x55959209c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5e4003d040 tx=0x7f5e4004ccd0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e3ffff640 1 -- 172.21.15.196:0/138708692 reap_dead start 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 shutdown_connections 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/138708692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592094e60 0x55959209c290 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 >> 172.21.15.196:0/138708692 conn(0x5595920911c0 msgr2=0x55959208f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 shutdown_connections 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/138708692 wait complete. 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 msgr2=0x7f5d20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x559592074ea0 tx=0x7f5e3808f320 comp rx=0 tx=0).stop 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 msgr2=0x5595920885b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55959206e540 tx=0x7f5e40012fd0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 shutdown_connections 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d20036b40 0x7f5d20039000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 --2- 172.21.15.196:0/4183259104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559592088190 0x5595920885b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.582+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 >> 172.21.15.196:0/4183259104 conn(0x55959207d120 msgr2=0x55959207fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 shutdown_connections 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/4183259104 wait complete. 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 msgr2=0x559592079120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 0x559592079120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 msgr2=0x559592074390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 0x559592074390 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 msgr2=0x7f5d30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 0x7f5d30039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000f60 tx=0x7f5e30001370 comp rx=0 tx=0).stop 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 msgr2=0x55959206d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5e38025da0 tx=0x7f5e38002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 shutdown_connections 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x559592076d30 0x559592079120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559591f73e00 0x559592074390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5d30036b90 0x7f5d30039050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 --2- 172.21.15.196:0/1606561572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559591f734c0 0x55959206d320 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 >> 172.21.15.196:0/1606561572 conn(0x559591f6edf0 msgr2=0x55959205c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 shutdown_connections 2024-09-21T08:52:18.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.583+0000 7f5e4c720800 1 -- 172.21.15.196:0/1606561572 wait complete. 2024-09-21T08:52:18.593 INFO:teuthology.orchestra.run.smithi196.stdout:[{"tag":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.15649714258504884811\u0000","time":"2024-09-21T08:52:18.387309+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_7","key":"","instance":""}]}] 2024-09-21T08:52:18.593 DEBUG:tasks.util.rgw: json result: [{'tag': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.15649714258504884811\x00', 'time': '2024-09-21T08:52:18.387309+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_7', 'key': '', 'instance': ''}]}] 2024-09-21T08:52:18.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-21T08:52:18.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-21T08:52:18.594 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-21T08:52:18.635 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:18.635 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:18.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a10326800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55719d57ca50 0x55719d57ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a10326800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55719d437b30 con 0x55719d578750 2024-09-21T08:52:18.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a10326800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55719d419360 con 0x55719d57ca50 2024-09-21T08:52:18.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a037e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55719d57ca50 0x55719d57ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a037e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55719d57ca50 0x55719d57ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35014/0 (socket says 172.21.15.196:35014) 2024-09-21T08:52:18.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.635+0000 7f4a037e2640 1 -- 172.21.15.196:0/2453502269 learned_addr learned my addr 172.21.15.196:0/2453502269 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.636+0000 7f4a037e2640 1 -- 172.21.15.196:0/2453502269 >> v1:172.21.15.29:6789/0 conn(0x55719d578750 legacy=0x55719d578b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.636+0000 7f4a037e2640 1 -- 172.21.15.196:0/2453502269 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d43fe00 con 0x55719d57ca50 2024-09-21T08:52:18.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.637+0000 7f4a037e2640 1 --2- 172.21.15.196:0/2453502269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d57ca50 0x55719d57ee40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a520 tx=0x7f49f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ce77bd7ef75dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a0b7e2640 1 -- 172.21.15.196:0/2453502269 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f4055070 con 0x55719d57ca50 2024-09-21T08:52:18.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a0b7e2640 1 -- 172.21.15.196:0/2453502269 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f40515b0 con 0x55719d57ca50 2024-09-21T08:52:18.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a0b7e2640 1 -- 172.21.15.196:0/2453502269 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f40518d0 con 0x55719d57ca50 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 -- 172.21.15.196:0/2453502269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d57ca50 msgr2=0x55719d57ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 --2- 172.21.15.196:0/2453502269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d57ca50 0x55719d57ee40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a520 tx=0x7f49f4045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 -- 172.21.15.196:0/2453502269 shutdown_connections 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 --2- 172.21.15.196:0/2453502269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d57ca50 0x55719d57ee40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 -- 172.21.15.196:0/2453502269 >> 172.21.15.196:0/2453502269 conn(0x55719d573fe0 msgr2=0x55719d576400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 -- 172.21.15.196:0/2453502269 shutdown_connections 2024-09-21T08:52:18.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.638+0000 7f4a10326800 1 -- 172.21.15.196:0/2453502269 wait complete. 2024-09-21T08:52:18.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a10326800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a10326800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55719d4c4320 con 0x55719d578750 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a0bfe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a0bfe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35018/0 (socket says 172.21.15.196:35018) 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.652+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/2447938628 learned_addr learned my addr 172.21.15.196:0/2447938628 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.653+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/2447938628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d411bc0 con 0x55719d578750 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.653+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/2447938628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f49fc001d50 tx=0x7f49fc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3284a7567c26b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.653+0000 7f48f9e0b640 1 -- 172.21.15.196:0/2447938628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc00f400 con 0x55719d578750 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.653+0000 7f48f9e0b640 1 -- 172.21.15.196:0/2447938628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc00f5a0 con 0x55719d578750 2024-09-21T08:52:18.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.653+0000 7f48f9e0b640 1 -- 172.21.15.196:0/2447938628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc00f7d0 con 0x55719d578750 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- 172.21.15.196:0/2447938628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 msgr2=0x55719d667850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 --2- 172.21.15.196:0/2447938628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f49fc001d50 tx=0x7f49fc00b5b0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- 172.21.15.196:0/2447938628 shutdown_connections 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 --2- 172.21.15.196:0/2447938628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d667850 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- 172.21.15.196:0/2447938628 >> 172.21.15.196:0/2447938628 conn(0x55719d573fe0 msgr2=0x55719d663210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- 172.21.15.196:0/2447938628 shutdown_connections 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- 172.21.15.196:0/2447938628 wait complete. 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.654+0000 7f4a10326800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55719d57f680 con 0x55719d578750 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a0bfe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a0bfe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35026/0 (socket says 172.21.15.196:35026) 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/407969622 learned_addr learned my addr 172.21.15.196:0/407969622 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d425fe0 con 0x55719d578750 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00b5f0 tx=0x7f49fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f48f3fff640 1 -- 172.21.15.196:0/407969622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc01a7c0 con 0x55719d578750 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f48f3fff640 1 -- 172.21.15.196:0/407969622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc01a960 con 0x55719d578750 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55719d6719d0 con 0x55719d578750 2024-09-21T08:52:18.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f48f3fff640 1 -- 172.21.15.196:0/407969622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc01ac40 con 0x55719d578750 2024-09-21T08:52:18.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.655+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719d671f50 con 0x55719d578750 2024-09-21T08:52:18.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.656+0000 7f48f3fff640 1 -- 172.21.15.196:0/407969622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f49fc017070 con 0x55719d578750 2024-09-21T08:52:18.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.656+0000 7f48f3fff640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 0x7f48f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.656+0000 7f48f3fff640 1 -- 172.21.15.196:0/407969622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f49fc015020 con 0x55719d578750 2024-09-21T08:52:18.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.656+0000 7f4a037e2640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 0x7f48f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 0x55719d678500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d678a80 con 0x55719d57ca50 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 0x55719d678500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a037e2640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 0x7f48f4039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f49f4057000 tx=0x7f49f4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 0x55719d678500 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/407969622 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a0400a4a0 con 0x55719d57ca50 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.657+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d675ab0 con 0x55719d57ca50 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.658+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/407969622 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a0400a4a0 con 0x55719d57ca50 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.658+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 0x55719d67d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.658+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d67d840 con 0x55719d67adb0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.658+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 0x55719d67d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.658+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 0x55719d67d1a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/407969622 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49fc02e070 con 0x55719d67adb0 2024-09-21T08:52:18.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d679c50 con 0x55719d57ca50 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/407969622 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a0400a4a0 con 0x55719d57ca50 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d67a0f0 con 0x55719d57ca50 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/407969622 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a0400a4a0 con 0x55719d57ca50 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.659+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a10326800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a10326800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55719d413580 con 0x55719d68c1b0 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35040/0 (socket says 172.21.15.196:35040) 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/1834437935 learned_addr learned my addr 172.21.15.196:0/1834437935 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.663 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/1834437935 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d68cb10 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.660+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55719d678e80 tx=0x7f4a04018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f48f17fa640 1 -- 172.21.15.196:0/1834437935 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04014450 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f48f17fa640 1 -- 172.21.15.196:0/1834437935 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a040145f0 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55719d68cda0 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f48f17fa640 1 -- 172.21.15.196:0/1834437935 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04014910 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719d68fa80 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.661+0000 7f48f17fa640 1 -- 172.21.15.196:0/1834437935 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a04011040 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f48f17fa640 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 0x7f48e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f48f17fa640 1 -- 172.21.15.196:0/1834437935 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4a0401e070 con 0x55719d68c1b0 2024-09-21T08:52:18.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 0x7f48e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 0x7f48e4039050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55719d678ef0 tx=0x7f49fc01ae70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a10326800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a10326800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55719d668000 con 0x55719d698e10 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35046/0 (socket says 172.21.15.196:35046) 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.662+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/1359849283 learned_addr learned my addr 172.21.15.196:0/1359849283 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/1359849283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d6997e0 con 0x55719d698e10 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/1359849283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4a0404ccc0 tx=0x7f4a0404cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba688fe563e8524 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f48eaffd640 1 -- 172.21.15.196:0/1359849283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04028040 con 0x55719d698e10 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f48eaffd640 1 -- 172.21.15.196:0/1359849283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04046df0 con 0x55719d698e10 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f48eaffd640 1 -- 172.21.15.196:0/1359849283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04014c00 con 0x55719d698e10 2024-09-21T08:52:18.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 -- 172.21.15.196:0/1359849283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 msgr2=0x55719d699210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 --2- 172.21.15.196:0/1359849283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4a0404ccc0 tx=0x7f4a0404cf90 comp rx=0 tx=0).stop 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 -- 172.21.15.196:0/1359849283 shutdown_connections 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 --2- 172.21.15.196:0/1359849283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d699210 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 -- 172.21.15.196:0/1359849283 >> 172.21.15.196:0/1359849283 conn(0x55719d695170 msgr2=0x55719d693270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 -- 172.21.15.196:0/1359849283 shutdown_connections 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.663+0000 7f4a10326800 1 -- 172.21.15.196:0/1359849283 wait complete. 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a10326800 1 Processor -- start 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a10326800 1 -- start start 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a10326800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d6a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a10326800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55719d699e90 con 0x55719d698e10 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d6a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a0c7e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d6a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35050/0 (socket says 172.21.15.196:35050) 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 learned_addr learned my addr 172.21.15.196:0/180964138 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.664+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719d6a0830 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d6a02f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4a04018430 tx=0x7f4a0404cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f48e97fa640 1 -- 172.21.15.196:0/180964138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04028070 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f48e97fa640 1 -- 172.21.15.196:0/180964138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0404a030 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f48e97fa640 1 -- 172.21.15.196:0/180964138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a04046640 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55719d6a0ac0 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719d6a3770 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.665+0000 7f48e97fa640 1 -- 172.21.15.196:0/180964138 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a04044020 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f48e97fa640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48d4036b40 0x7f48d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f48e97fa640 1 -- 172.21.15.196:0/180964138 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4a0400e040 con 0x55719d698e10 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48d4036b40 0x7f48d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48d4036b40 0x7f48d4039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49fc01cfd0 tx=0x7f49fc032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d6abfe0 0x55719d6ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6aebf0 con 0x55719d6abfe0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.666+0000 7f4a037e2640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d6abfe0 0x55719d6ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a037e2640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d6abfe0 0x55719d6ae4a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 realm 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6af020 con 0x55719d6abfe0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6af8f0 con 0x55719d6abfe0 2024-09-21T08:52:18.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.667+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6afc90 con 0x55719d6abfe0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a10326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d6b09f0 0x55719d6b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b3430 con 0x55719d6b09f0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.668+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d6b09f0 0x55719d6b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a0c7e4640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d6b09f0 0x55719d6b2de0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a10326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:18.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a10326800 20 searching for the correct realm 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55719d6b53e0 0x55719d6b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55719d6b53e0 0x55719d6b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.669+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55719d6b53e0 0x55719d6b78a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc02e070 con 0x55719d6b53e0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a0bfe3640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f49fc0448a0 0x7f49fc01b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a037e2640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f49fc0448a0 0x7f49fc01b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a037e2640 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f49fc0448a0 0x7f49fc01b830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.688 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.670+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.671+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc02e070 con 0x55719d6b53e0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.672+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc02e070 con 0x55719d6b53e0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.673+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.674+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.691 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.675+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.692 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.676+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b53e0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6b09f0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.677+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x55719d6abfe0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b7f70 con 0x7f49fc0448a0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:18.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b3df0 con 0x55719d6abfe0 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b3a30 con 0x55719d6abfe0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.678+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b4790 con 0x55719d6abfe0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:18.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 zone default found 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 4 Realm: () 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 zonegroup default 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b83f0 con 0x55719d6b09f0 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ba6c0 con 0x55719d6b53e0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6baa60 con 0x55719d6b53e0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 started sync module instance, tier type = 2024-09-21T08:52:18.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.679+0000 7f4a10326800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:18.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.680+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b9b50 con 0x7f49fc0448a0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.681+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.681+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93946460741744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b9b50 con 0x7f49fc0448a0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.681+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bb480 con 0x55719d6abfe0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.682+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93946460741744] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.682+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.682+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93946460745584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b9b50 con 0x55719d6abfe0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.682+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bbf10 con 0x55719d6b53e0 2024-09-21T08:52:18.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.683+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93946460745584] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.683+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.683+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93946460739232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b9ac0 con 0x55719d6b53e0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.683+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bcdd0 con 0x7f49fc0448a0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.684+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93946460739232] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.684+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.684+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93946460752160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bd1f0 con 0x7f49fc0448a0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.684+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bdbb0 con 0x55719d6abfe0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.685+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93946460752160] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.685+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.686+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93946460756192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bd1f0 con 0x55719d6abfe0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.686+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6be5c0 con 0x55719d6b09f0 2024-09-21T08:52:18.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.687+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.687+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93946460758288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6be530 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.687+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93946460756192] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.687+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6be530 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.688+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93946460758288] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.688+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.688+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93946460762192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6be960 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.688+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bfa70 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93946460762192] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93946460753216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bfa70 con 0x55719d6b09f0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=0 2024-09-21T08:52:18.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=1 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=2 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=3 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=4 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=5 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.689+0000 7f4a10326800 20 add_watcher() i=6 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93946460753216] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a10326800 20 add_watcher() i=7 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a10326800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6c2ed0 con 0x55719d6abfe0 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.690+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93946460764048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6c0420 con 0x55719d6abfe0 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.691+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93946460764048] v36'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.691+0000 7f48c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:18.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.691+0000 7f4a10326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.691+0000 7f4a10326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.691+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cb8d0 con 0x55719d6abfe0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.693+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.693+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cbfa0 con 0x55719d6b09f0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.694+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.694+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cbfa0 con 0x55719d6b53e0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.695+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.695+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cc7f0 con 0x55719d6abfe0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.696+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.696+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6c76a0 con 0x7f49fc0448a0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.697+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.697+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6c76a0 con 0x55719d6b53e0 2024-09-21T08:52:18.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.698+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.698+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cd350 con 0x55719d6abfe0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.699+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.699+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cd460 con 0x55719d6b09f0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.700+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.700+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cd510 con 0x7f49fc0448a0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.701+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.701+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cdb10 con 0x55719d6b53e0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.702+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.702+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cdb10 con 0x7f49fc0448a0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.703+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.703+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cdb10 con 0x55719d6b09f0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.704+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.704+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cdc20 con 0x7f49fc0448a0 2024-09-21T08:52:18.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.705+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.705+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6cdc20 con 0x55719d6b09f0 2024-09-21T08:52:18.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.706+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.706+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6abfe0 2024-09-21T08:52:18.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.707+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.707+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.708+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.708+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x7f49fc0448a0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.709+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.709+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.710+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'20 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.710+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6abfe0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.711+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.711+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6abfe0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.712+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.712+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.713+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.713+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x7f49fc0448a0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.714+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.714+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.715+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.715+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.716+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.716+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.717+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.718 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.717+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.718+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.719 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.718+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b09f0 2024-09-21T08:52:18.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.719+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.719+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.720+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.720+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b09f0 2024-09-21T08:52:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.721+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.721+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b53e0 2024-09-21T08:52:18.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.722+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.722+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x55719d6b09f0 2024-09-21T08:52:18.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.723+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.723+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ce0d0 con 0x7f49fc0448a0 2024-09-21T08:52:18.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f48c0fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f4a10326800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f4a10326800 20 Filter name: none 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f483a7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-21T08:52:18.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.724+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 gc.0 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.726+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(99 gc.0 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-21T08:52:18.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.727+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.728+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(100 gc.1 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.728+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.729+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.730+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.730+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.730+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.731+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(105 gc.1 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.734 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.731+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.731+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.731+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(106 gc.2 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.732+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.733+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(111 gc.2 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.733+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.733+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.734+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(112 gc.3 [call] v36'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.734+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.734+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.734+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.734+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.735+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.736+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(117 gc.3 [call] v36'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.736+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-21T08:52:18.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.736+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.737+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(118 gc.4 [call] v36'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.737+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.737+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.737+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.737+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.738+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.739+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(123 gc.4 [call] v36'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.739+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.739+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.740+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(124 gc.5 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.740+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.740+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.740+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.740+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b53e0 2024-09-21T08:52:18.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(128 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.741+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.742+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(129 gc.5 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.742+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.742+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.743+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(130 gc.6 [call] v36'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.743+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(131 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(132 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.746 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(134 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.744+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.745+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(135 gc.6 [call] v36'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.745+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.745+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(136 gc.7 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(137 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b09f0 2024-09-21T08:52:18.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(138 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.747+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(140 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.748+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.749+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(141 gc.7 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.749+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-21T08:52:18.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.749+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(142 gc.8 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(143 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(144 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.750+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.751+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(146 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.751+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.751+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.752+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(147 gc.8 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.752+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-21T08:52:18.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.752+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(148 gc.9 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(149 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(150 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.753+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(152 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.754+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.755+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(153 gc.9 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.755+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-21T08:52:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.755+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(154 gc.10 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(155 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(156 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.756+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(158 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:159 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(159 gc.10 [call] v36'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-21T08:52:18.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.757+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(160 gc.11 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(161 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:162 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(162 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.759+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:163 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(163 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:164 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(164 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.760+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:165 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.761+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(165 gc.11 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.761+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-21T08:52:18.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.761+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(166 gc.12 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(167 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:168 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(168 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.762+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:169 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(169 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:170 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(170 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.763+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:171 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.764+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(171 gc.12 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.764+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-21T08:52:18.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.764+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(172 gc.13 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(173 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:174 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(174 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:175 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(175 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.765+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:176 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.766+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== osd_op_reply(176 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.766+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.766+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:177 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b09f0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.767+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(177 gc.13 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.767+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.767+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.767+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(178 gc.14 [call] v36'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(179 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:180 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6abfe0 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(180 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:181 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 49 ==== osd_op_reply(181 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.768+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:182 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.769+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 50 ==== osd_op_reply(182 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.769+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.769+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:183 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6abfe0 2024-09-21T08:52:18.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.770+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 51 ==== osd_op_reply(183 gc.14 [call] v36'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.770+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-21T08:52:18.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.770+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(184 gc.15 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(185 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:186 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(186 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.771+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:187 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(187 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:188 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(188 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.772+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:189 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.773+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 49 ==== osd_op_reply(189 gc.15 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.773+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.773+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 42 ==== osd_op_reply(190 gc.16 [call] v36'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 43 ==== osd_op_reply(191 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:192 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 44 ==== osd_op_reply(192 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:193 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 45 ==== osd_op_reply(193 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.774+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:194 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 46 ==== osd_op_reply(194 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:195 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 47 ==== osd_op_reply(195 gc.16 [call] v36'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.775+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.776+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 50 ==== osd_op_reply(196 gc.17 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.776+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 51 ==== osd_op_reply(197 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:198 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8e40 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 52 ==== osd_op_reply(198 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:199 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 53 ==== osd_op_reply(199 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:200 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9e50 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 54 ==== osd_op_reply(200 gc.17 [call out=1702b] v0'0 uv21 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 20 garbage collection: RGWGC::process iterating over entry tag='6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.15649714258504884811', time=2024-09-21T08:52:18.387309+0000, chain.objs.size()=7 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_1 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:201 3.2s0 3:43c5e88f:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8130 con 0x55719d6b53e0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.777+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_2 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:202 3.29s0 3:96591276:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f8130 con 0x55719d6b09f0 2024-09-21T08:52:18.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_3 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:203 3.20s0 3:071b5d70:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ffa10 con 0x7f49fc0448a0 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_4 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:204 3.3ds0 3:bea92c5d:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d702340 con 0x55719d6b53e0 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_5 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:205 3.18s0 3:1992cce8:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d704bb0 con 0x55719d6b53e0 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_6 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:206 3.19s0 3:9bc451a6:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d707540 con 0x55719d6abfe0 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_7 2024-09-21T08:52:18.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.778+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:207 3.35s0 3:ae69b9ec:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d709ea0 con 0x55719d6abfe0 2024-09-21T08:52:18.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.780+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 49 ==== osd_op_reply(202 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_2 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.780+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 55 ==== osd_op_reply(201 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_1 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.780+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 56 ==== osd_op_reply(204 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_4 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.780+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 57 ==== osd_op_reply(205 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_5 [call] v36'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.780+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 48 ==== osd_op_reply(203 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_3 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.782+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 52 ==== osd_op_reply(206 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_6 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.782+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 53 ==== osd_op_reply(207 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.1__shadow_.MQblZdbhC1rhZyBzdnYp8xsIEdV1i2b_7 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.782+0000 7f4a10326800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-21T08:52:18.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.782+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:208 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae90 con 0x55719d6b53e0 2024-09-21T08:52:18.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.787+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 58 ==== osd_op_reply(208 gc.17 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.787+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:209 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.788+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 59 ==== osd_op_reply(209 gc.17 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.788+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-21T08:52:18.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.788+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 54 ==== osd_op_reply(210 gc.18 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 55 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 56 ==== osd_op_reply(212 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.789+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 57 ==== osd_op_reply(213 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:214 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 58 ==== osd_op_reply(214 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.790+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:215 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.791+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 59 ==== osd_op_reply(215 gc.18 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.791+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.791+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 60 ==== osd_op_reply(216 gc.19 [call] v36'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 61 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6abfe0 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 62 ==== osd_op_reply(218 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.792+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 63 ==== osd_op_reply(219 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:220 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 64 ==== osd_op_reply(220 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.793+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:221 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6abfe0 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.794+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 65 ==== osd_op_reply(221 gc.19 [call] v36'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.794+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-21T08:52:18.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.794+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.795+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 60 ==== osd_op_reply(222 gc.20 [call] v36'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.795+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.795+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 61 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.795+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.795+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 62 ==== osd_op_reply(224 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 63 ==== osd_op_reply(225 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:226 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 64 ==== osd_op_reply(226 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.796+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:227 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.797+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 65 ==== osd_op_reply(227 gc.20 [call] v36'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.797+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.797+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.798+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 49 ==== osd_op_reply(228 gc.21 [call] v36'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.798+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.798+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 50 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.798+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.798+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 51 ==== osd_op_reply(230 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 52 ==== osd_op_reply(231 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:232 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 53 ==== osd_op_reply(232 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.799+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:233 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.800+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 54 ==== osd_op_reply(233 gc.21 [call] v36'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.800+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.800+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.801+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 66 ==== osd_op_reply(234 gc.22 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.801+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.801+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 67 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.801+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.801+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 68 ==== osd_op_reply(236 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 69 ==== osd_op_reply(237 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 70 ==== osd_op_reply(238 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.802+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.803+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 71 ==== osd_op_reply(239 gc.22 [call] v36'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.803+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-21T08:52:18.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.803+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 72 ==== osd_op_reply(240 gc.23 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 73 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 74 ==== osd_op_reply(242 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 75 ==== osd_op_reply(243 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.804+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.805+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 76 ==== osd_op_reply(244 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.805+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.805+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.806+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 77 ==== osd_op_reply(245 gc.23 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.806+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.806+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 78 ==== osd_op_reply(246 gc.24 [call] v36'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 79 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 80 ==== osd_op_reply(248 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 81 ==== osd_op_reply(249 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.807+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 82 ==== osd_op_reply(250 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 83 ==== osd_op_reply(251 gc.24 [call] v36'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-21T08:52:18.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.808+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.809+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 84 ==== osd_op_reply(252 gc.25 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.809+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 85 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 86 ==== osd_op_reply(254 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 87 ==== osd_op_reply(255 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:256 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 88 ==== osd_op_reply(256 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.810+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:257 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.811+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 89 ==== osd_op_reply(257 gc.25 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.811+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.811+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 50 ==== osd_op_reply(258 gc.26 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 51 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 52 ==== osd_op_reply(260 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 53 ==== osd_op_reply(261 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.813+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.814+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 54 ==== osd_op_reply(262 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.814+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.814+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.815+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 55 ==== osd_op_reply(263 gc.26 [call] v36'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.815+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-21T08:52:18.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.815+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 90 ==== osd_op_reply(264 gc.27 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 91 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 92 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 93 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 94 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.816+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.817+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.817+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 95 ==== osd_op_reply(269 gc.27 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.817+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-21T08:52:18.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.817+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.818+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 56 ==== osd_op_reply(270 gc.28 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.818+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 57 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 58 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 59 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 60 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.819+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.820+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 61 ==== osd_op_reply(275 gc.28 [call] v36'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.820+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-21T08:52:18.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.820+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.821+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 96 ==== osd_op_reply(276 gc.29 [call] v36'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.821+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 97 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b53e0 2024-09-21T08:52:18.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 98 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 99 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 100 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.822+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.823+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 101 ==== osd_op_reply(281 gc.29 [call] v36'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.823+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-21T08:52:18.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.823+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.824+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 62 ==== osd_op_reply(282 gc.30 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.824+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 63 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 64 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 65 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x55719d6b09f0 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 66 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.825+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x55719d6b09f0 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.826+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 67 ==== osd_op_reply(287 gc.30 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.826+0000 7f4a10326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-21T08:52:18.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.826+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 55 ==== osd_op_reply(288 gc.31 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 56 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6f9df0 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 57 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 58 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.828+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.829+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 59 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.829+0000 7f4a10326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:52:18.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.829+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6fae00 con 0x7f49fc0448a0 2024-09-21T08:52:18.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.830+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 60 ==== osd_op_reply(293 gc.31 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.830+0000 7f48c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:18.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.830+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93946460764048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6c6710 con 0x55719d6abfe0 2024-09-21T08:52:18.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.831+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93946460764048] v36'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.831+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93946460741744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bf760 con 0x7f49fc0448a0 2024-09-21T08:52:18.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.832+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93946460741744] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.832+0000 7f4a10326800 20 remove_watcher() i=0 2024-09-21T08:52:18.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.832+0000 7f4a10326800 2 removed watcher, disabling cache 2024-09-21T08:52:18.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.832+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93946460745584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ba070 con 0x55719d6abfe0 2024-09-21T08:52:18.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.833+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93946460745584] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.833+0000 7f4a10326800 20 remove_watcher() i=1 2024-09-21T08:52:18.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.833+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93946460739232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ba070 con 0x55719d6b53e0 2024-09-21T08:52:18.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.834+0000 7f4a0bfe3640 1 -- 172.21.15.196:0/180964138 <== osd.3 v2:172.21.15.196:6800/127179937 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93946460739232] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49fc065040 con 0x55719d6b53e0 2024-09-21T08:52:18.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.834+0000 7f4a10326800 20 remove_watcher() i=2 2024-09-21T08:52:18.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.834+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93946460752160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b96a0 con 0x7f49fc0448a0 2024-09-21T08:52:18.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.835+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.2 v2:172.21.15.196:6816/3551232799 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93946460752160] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x7f49fc0448a0 2024-09-21T08:52:18.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.835+0000 7f4a10326800 20 remove_watcher() i=3 2024-09-21T08:52:18.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.835+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93946460756192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ba070 con 0x55719d6abfe0 2024-09-21T08:52:18.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.836+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 <== osd.1 v2:172.21.15.196:6808/2855083704 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93946460756192] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f4057030 con 0x55719d6abfe0 2024-09-21T08:52:18.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.836+0000 7f4a10326800 20 remove_watcher() i=4 2024-09-21T08:52:18.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.836+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93946460758288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6bc920 con 0x55719d6b09f0 2024-09-21T08:52:18.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.837+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93946460758288] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.837+0000 7f4a10326800 20 remove_watcher() i=5 2024-09-21T08:52:18.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.837+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93946460762192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6b96a0 con 0x55719d6b09f0 2024-09-21T08:52:18.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.838+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93946460762192] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.838+0000 7f4a10326800 20 remove_watcher() i=6 2024-09-21T08:52:18.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.838+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93946460753216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55719d6ba070 con 0x55719d6b09f0 2024-09-21T08:52:18.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a0c7e4640 1 -- 172.21.15.196:0/180964138 <== osd.0 v2:172.21.15.29:6800/3430791726 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93946460753216] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a0402a070 con 0x55719d6b09f0 2024-09-21T08:52:18.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 20 remove_watcher() i=7 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d6b09f0 msgr2=0x55719d6b2de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d6b09f0 0x55719d6b2de0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d6abfe0 msgr2=0x55719d6ae4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d6abfe0 0x55719d6ae4a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f49fc0448a0 msgr2=0x7f49fc01b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f49fc0448a0 0x7f49fc01b830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55719d6b53e0 msgr2=0x55719d6b78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55719d6b53e0 0x55719d6b78a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48d4036b40 msgr2=0x7f48d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48d4036b40 0x7f48d4039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49fc01cfd0 tx=0x7f49fc032000 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 msgr2=0x55719d6a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 --2- 172.21.15.196:0/180964138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d698e10 0x55719d6a02f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4a04018430 tx=0x7f4a0404cc50 comp rx=0 tx=0).stop 2024-09-21T08:52:18.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 reap_dead start 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a037e2640 1 -- 172.21.15.196:0/180964138 reap_dead start 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 shutdown_connections 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 >> 172.21.15.196:0/180964138 conn(0x55719d695170 msgr2=0x55719d693240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 shutdown_connections 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.840+0000 7f4a10326800 1 -- 172.21.15.196:0/180964138 wait complete. 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 msgr2=0x7f48e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 0x7f48e4039050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55719d678ef0 tx=0x7f49fc01ae70 comp rx=0 tx=0).stop 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 msgr2=0x55719d68c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55719d678e80 tx=0x7f4a04018830 comp rx=0 tx=0).stop 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 shutdown_connections 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48e4036b90 0x7f48e4039050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/1834437935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d68c1b0 0x55719d68c5d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 >> 172.21.15.196:0/1834437935 conn(0x55719d681140 msgr2=0x55719d683cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 shutdown_connections 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/1834437935 wait complete. 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 msgr2=0x55719d67d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 0x55719d67d1a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 msgr2=0x55719d678500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 0x55719d678500 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 msgr2=0x7f48f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 0x7f48f4039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f49f4057000 tx=0x7f49f4052000 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 msgr2=0x55719d671490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00b5f0 tx=0x7f49fc000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 shutdown_connections 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55719d67adb0 0x55719d67d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55719d57ca50 0x55719d678500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f48f4036b40 0x7f48f4039000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 --2- 172.21.15.196:0/407969622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55719d578750 0x55719d671490 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 >> 172.21.15.196:0/407969622 conn(0x55719d573fe0 msgr2=0x55719d661a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 shutdown_connections 2024-09-21T08:52:18.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.841+0000 7f4a10326800 1 -- 172.21.15.196:0/407969622 wait complete. 2024-09-21T08:52:18.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-21T08:52:18.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-21T08:52:18.852 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-21T08:52:18.934 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:18.934 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:18.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.933+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf843af800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5630a87fda70 0x5630a87fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf843af800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630a86beb30 con 0x5630a87fe3b0 2024-09-21T08:52:18.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf843af800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5630a86a0360 con 0x5630a87fda70 2024-09-21T08:52:18.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf81ea3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5630a87fda70 0x5630a87fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf81ea3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5630a87fda70 0x5630a87fde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35064/0 (socket says 172.21.15.196:35064) 2024-09-21T08:52:18.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf81ea3640 1 -- 172.21.15.196:0/3116562071 learned_addr learned my addr 172.21.15.196:0/3116562071 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf81ea3640 1 -- 172.21.15.196:0/3116562071 >> v1:172.21.15.29:6789/0 conn(0x5630a87fe3b0 legacy=0x5630a8804b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.934+0000 7fbf81ea3640 1 -- 172.21.15.196:0/3116562071 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a86c6e00 con 0x5630a87fda70 2024-09-21T08:52:18.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.936+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/3116562071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a87fde70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400a520 tx=0x7fbf74045c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac4f696a73484b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.936+0000 7fbf816a2640 1 -- 172.21.15.196:0/3116562071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf74058530 con 0x5630a87fda70 2024-09-21T08:52:18.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.936+0000 7fbf816a2640 1 -- 172.21.15.196:0/3116562071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf740586d0 con 0x5630a87fda70 2024-09-21T08:52:18.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.936+0000 7fbf816a2640 1 -- 172.21.15.196:0/3116562071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf740589f0 con 0x5630a87fda70 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 -- 172.21.15.196:0/3116562071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 msgr2=0x5630a87fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 --2- 172.21.15.196:0/3116562071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a87fde70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400a520 tx=0x7fbf74045c40 comp rx=0 tx=0).stop 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 -- 172.21.15.196:0/3116562071 shutdown_connections 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 --2- 172.21.15.196:0/3116562071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a87fde70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 -- 172.21.15.196:0/3116562071 >> 172.21.15.196:0/3116562071 conn(0x5630a87f95c0 msgr2=0x5630a87fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 -- 172.21.15.196:0/3116562071 shutdown_connections 2024-09-21T08:52:18.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.937+0000 7fbf843af800 1 -- 172.21.15.196:0/3116562071 wait complete. 2024-09-21T08:52:18.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.950+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.950+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf843af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.952 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf843af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630a874b330 con 0x5630a87fda70 2024-09-21T08:52:18.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf81ea3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf81ea3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35080/0 (socket says 172.21.15.196:35080) 2024-09-21T08:52:18.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf81ea3640 1 -- 172.21.15.196:0/2718591868 learned_addr learned my addr 172.21.15.196:0/2718591868 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf81ea3640 1 -- 172.21.15.196:0/2718591868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a8698bc0 con 0x5630a87fda70 2024-09-21T08:52:18.953 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.951+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/2718591868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbf74045c80 tx=0x7fbf74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fe7ee68e81484c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbe6fe07640 1 -- 172.21.15.196:0/2718591868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf74058880 con 0x5630a87fda70 2024-09-21T08:52:18.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbe6fe07640 1 -- 172.21.15.196:0/2718591868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf74058a20 con 0x5630a87fda70 2024-09-21T08:52:18.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbe6fe07640 1 -- 172.21.15.196:0/2718591868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf74058d00 con 0x5630a87fda70 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 -- 172.21.15.196:0/2718591868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 msgr2=0x5630a88ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 --2- 172.21.15.196:0/2718591868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbf74045c80 tx=0x7fbf74051000 comp rx=0 tx=0).stop 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 -- 172.21.15.196:0/2718591868 shutdown_connections 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 --2- 172.21.15.196:0/2718591868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fda70 0x5630a88ee8f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 -- 172.21.15.196:0/2718591868 >> 172.21.15.196:0/2718591868 conn(0x5630a87f95c0 msgr2=0x5630a88ea2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 -- 172.21.15.196:0/2718591868 shutdown_connections 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.952+0000 7fbf843af800 1 -- 172.21.15.196:0/2718591868 wait complete. 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf843af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf843af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630a8806670 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf81ea3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf81ea3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35094/0 (socket says 172.21.15.196:35094) 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.953+0000 7fbf81ea3640 1 -- 172.21.15.196:0/2298067940 learned_addr learned my addr 172.21.15.196:0/2298067940 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbf81ea3640 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a86acfe0 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbf74025e40 tx=0x7fbf74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbe6e604640 1 -- 172.21.15.196:0/2298067940 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf74064590 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbe6e604640 1 -- 172.21.15.196:0/2298067940 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf74064750 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbe6e604640 1 -- 172.21.15.196:0/2298067940 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf74064a70 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630a88f69b0 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.954+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a88f6f30 con 0x5630a87fe3b0 2024-09-21T08:52:18.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbe6e604640 1 -- 172.21.15.196:0/2298067940 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf74064c10 con 0x5630a87fe3b0 2024-09-21T08:52:18.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbe6e604640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 0x7fbe68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbe6e604640 1 -- 172.21.15.196:0/2298067940 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbf74060070 con 0x5630a87fe3b0 2024-09-21T08:52:18.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbf796a2640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 0x7fbe68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 0x5630a88fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a88fdec0 con 0x5630a88fb4d0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbf826a4640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 0x5630a88fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.955+0000 7fbf796a2640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 0x7fbe68039000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5630a8763320 tx=0x7fbf6c001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf826a4640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 0x5630a88fd8c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf826a4640 1 -- 172.21.15.196:0/2298067940 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf7c00a4a0 con 0x5630a88fb4d0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a88fe7a0 con 0x5630a88fb4d0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf826a4640 1 -- 172.21.15.196:0/2298067940 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf7c00a4a0 con 0x5630a88fb4d0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 0x5630a8902540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8902cd0 con 0x5630a89000b0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.956+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 0x5630a8902540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.957+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 0x5630a8902540 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.957+0000 7fbf81ea3640 1 -- 172.21.15.196:0/2298067940 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf74075070 con 0x5630a89000b0 2024-09-21T08:52:18.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.957+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a88feff0 con 0x5630a88fb4d0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.957+0000 7fbf826a4640 1 -- 172.21.15.196:0/2298067940 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf7c00a4a0 con 0x5630a88fb4d0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.957+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a88ff390 con 0x5630a88fb4d0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf826a4640 1 -- 172.21.15.196:0/2298067940 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf7c00a4a0 con 0x5630a88fb4d0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf843af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf843af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630a869a580 con 0x5630a8911650 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35106/0 (socket says 172.21.15.196:35106) 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.958+0000 7fbf826a4640 1 -- 172.21.15.196:0/3680229008 learned_addr learned my addr 172.21.15.196:0/3680229008 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbf826a4640 1 -- 172.21.15.196:0/3680229008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a8911fb0 con 0x5630a8911650 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbf826a4640 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5630a88f7520 tx=0x7fbf7c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbe677fe640 1 -- 172.21.15.196:0/3680229008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c014450 con 0x5630a8911650 2024-09-21T08:52:18.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbe677fe640 1 -- 172.21.15.196:0/3680229008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0145f0 con 0x5630a8911650 2024-09-21T08:52:18.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbe677fe640 1 -- 172.21.15.196:0/3680229008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c0148d0 con 0x5630a8911650 2024-09-21T08:52:18.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630a8912240 con 0x5630a8911650 2024-09-21T08:52:18.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.959+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a8914f20 con 0x5630a8911650 2024-09-21T08:52:18.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbe677fe640 1 -- 172.21.15.196:0/3680229008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf7c011040 con 0x5630a8911650 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbe677fe640 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 0x7fbe5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbe677fe640 1 -- 172.21.15.196:0/3680229008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbf7c01e070 con 0x5630a8911650 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 0x7fbe5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 0x7fbe5c039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5630a88fabb0 tx=0x7fbf74006480 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf843af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.960+0000 7fbf843af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630a88eefe0 con 0x5630a891e2a0 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35110/0 (socket says 172.21.15.196:35110) 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbf826a4640 1 -- 172.21.15.196:0/81574975 learned_addr learned my addr 172.21.15.196:0/81574975 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbf826a4640 1 -- 172.21.15.196:0/81574975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a891ec70 con 0x5630a891e2a0 2024-09-21T08:52:18.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbf826a4640 1 --2- 172.21.15.196:0/81574975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c04cbb0 tx=0x7fbf7c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d6157492dd2833 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbe657fa640 1 -- 172.21.15.196:0/81574975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c013dc0 con 0x5630a891e2a0 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbe657fa640 1 -- 172.21.15.196:0/81574975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c014a70 con 0x5630a891e2a0 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.961+0000 7fbe657fa640 1 -- 172.21.15.196:0/81574975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c014d50 con 0x5630a891e2a0 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- 172.21.15.196:0/81574975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 msgr2=0x5630a891e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 --2- 172.21.15.196:0/81574975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c04cbb0 tx=0x7fbf7c011970 comp rx=0 tx=0).stop 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- 172.21.15.196:0/81574975 shutdown_connections 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 --2- 172.21.15.196:0/81574975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a891e6a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- 172.21.15.196:0/81574975 >> 172.21.15.196:0/81574975 conn(0x5630a891a650 msgr2=0x5630a8918750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- 172.21.15.196:0/81574975 shutdown_connections 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- 172.21.15.196:0/81574975 wait complete. 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 Processor -- start 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- start start 2024-09-21T08:52:18.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf843af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630a891f240 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf826a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35112/0 (socket says 172.21.15.196:35112) 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.962+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 learned_addr learned my addr 172.21.15.196:0/1052052604 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a8925ca0 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbf826a4640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c011be0 tx=0x7fbf7c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbe537fe640 1 -- 172.21.15.196:0/1052052604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c044030 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbe537fe640 1 -- 172.21.15.196:0/1052052604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c022a80 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbe537fe640 1 -- 172.21.15.196:0/1052052604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7c016440 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630a8925f30 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.963+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a8928be0 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbe537fe640 1 -- 172.21.15.196:0/1052052604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbf7c04e9a0 con 0x5630a891e2a0 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbe537fe640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe4c036b40 0x7fbe4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbe537fe640 1 -- 172.21.15.196:0/1052052604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbf7c045070 con 0x5630a891e2a0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe4c036b40 0x7fbe4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a89313e0 0x5630a89338a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8933ff0 con 0x5630a89313e0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.964+0000 7fbf796a2640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a89313e0 0x5630a89338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe4c036b40 0x7fbe4c039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf74001eb0 tx=0x7fbf74081000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf796a2640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a89313e0 0x5630a89338a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x5630a89313e0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 realm 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8930880 con 0x5630a89313e0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x5630a89313e0 2024-09-21T08:52:18.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8934ad0 con 0x5630a89313e0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x5630a89313e0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.965+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a89353a0 con 0x5630a89313e0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x5630a89313e0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf843af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a8935c50 0x5630a8938060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a89387c0 con 0x5630a8935c50 2024-09-21T08:52:18.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf826a4640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a8935c50 0x5630a8938060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.966+0000 7fbf826a4640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a8935c50 0x5630a8938060 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf843af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf843af800 20 searching for the correct realm 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5630a893a8c0 0x5630a893cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5630a893a8c0 0x5630a893cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5630a893a8c0 0x5630a893cd80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf81ea3640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbf7409c040 0x7fbf74006580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.982 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.967+0000 7fbf796a2640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbf7409c040 0x7fbf74006580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf796a2640 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbf7409c040 0x7fbf74006580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x7fbf7409c040 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c00bdb0 con 0x5630a89313e0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.968+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.983 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.969+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.970+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.984 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.971+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.972+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.985 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.973+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.974+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a893a8c0 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a8935c50 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.987 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.975+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x5630a89313e0 2024-09-21T08:52:18.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d450 con 0x7fbf7409c040 2024-09-21T08:52:18.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a89392c0 con 0x5630a89313e0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8939710 con 0x5630a89313e0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.976+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8939bb0 con 0x5630a89313e0 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 zone default found 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 4 Realm: () 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:18.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 zonegroup default 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a893d8d0 con 0x5630a8935c50 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8938ed0 con 0x5630a893a8c0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados->read ofs=0 len=0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a893fc00 con 0x5630a893a8c0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 started sync module instance, tier type = 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.977+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893ef90 con 0x7fbf7409c040 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.979+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.979+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94766986687664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893ef90 con 0x7fbf7409c040 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.979+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a89407b0 con 0x5630a89313e0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.980+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94766986687664] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.980+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.980+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94766986691200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893ef90 con 0x5630a89313e0 2024-09-21T08:52:18.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.980+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8941260 con 0x5630a893a8c0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.981+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.981+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94766986693952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8941b00 con 0x5630a893a8c0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.981+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942560 con 0x7fbf7409c040 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.981+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94766986691200] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.982+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94766986693952] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.982+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.982+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94766986696272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942070 con 0x7fbf7409c040 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.982+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942e30 con 0x5630a89313e0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.983+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94766986696272] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.983+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.983+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94766986685152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942de0 con 0x5630a89313e0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.983+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8943840 con 0x5630a8935c50 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.984+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94766986685152] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:18.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.985+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.985+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94766986701104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942d50 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.985+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8944560 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.986+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94766986701104] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.987+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.987+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94766986705888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8944560 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.987+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8944fd0 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94766986705888] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94766986709664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8944f90 con 0x5630a8935c50 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=0 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=1 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=2 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=3 2024-09-21T08:52:19.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=4 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=5 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.988+0000 7fbf843af800 20 add_watcher() i=6 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94766986709664] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf843af800 20 add_watcher() i=7 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf843af800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8948420 con 0x5630a89313e0 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.989+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94766986706944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8945940 con 0x5630a89313e0 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.990+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94766986706944] v36'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.990+0000 7fbe337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.990+0000 7fbf843af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.990+0000 7fbf843af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.990+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950c60 con 0x5630a89313e0 2024-09-21T08:52:19.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.991+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.991+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a89511d0 con 0x5630a8935c50 2024-09-21T08:52:19.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.992+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.002 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.992+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a89511d0 con 0x5630a893a8c0 2024-09-21T08:52:19.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.993+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.993+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8951a80 con 0x5630a89313e0 2024-09-21T08:52:19.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.994+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.994+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a894ec70 con 0x7fbf7409c040 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.995+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.995+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a894ec40 con 0x5630a893a8c0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.996+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.996+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952580 con 0x5630a89313e0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.998+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.998+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.999+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:18.999+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.000+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.000+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.001+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.001+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.001+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.001+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.003+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.003+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.004+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.004+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.005+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.005+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a89313e0 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.006+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.006+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.007+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.007+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.008+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.008+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.009+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.009+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a89313e0 2024-09-21T08:52:19.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.010+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.010+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a89313e0 2024-09-21T08:52:19.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.011+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.011+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.012+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.012+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.013+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.013+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.014+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.014+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.015+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.015+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.015+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.016+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.016+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.016+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.018+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.018+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.019+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.019+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.020+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.020+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a893a8c0 2024-09-21T08:52:19.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.021+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.021+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x5630a8935c50 2024-09-21T08:52:19.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.022+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.022+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8952690 con 0x7fbf7409c040 2024-09-21T08:52:19.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.023+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.023+0000 7fbe327fc640 20 reqs_thread_entry: start 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf843af800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf843af800 20 Filter name: none 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbda3fff640 20 reqs_thread_entry: start 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a897e840 con 0x5630a89313e0 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a89505e0 con 0x5630a89313e0 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.024+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a89505e0 con 0x5630a89313e0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.025+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.026+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.027+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.028+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x5630a89313e0 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.029+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.030+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.031+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c02a040 con 0x7fbf7409c040 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.032+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.033+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.033+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.033+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.033+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.034+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.035+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.035+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.035+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.035+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.035+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.036+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.037+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.038+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.039+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.040+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a89313e0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.041+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.042+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.043+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.044+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.045+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.046+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.047+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.060 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.048+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.049+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.050+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.051+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.051+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950580 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.051+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.052+0000 7fbe337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.052+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94766986706944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8950520 con 0x5630a89313e0 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.053+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94766986706944] v36'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.053+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94766986687664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8944000 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.054+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94766986687664] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.054+0000 7fbf843af800 20 remove_watcher() i=0 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.054+0000 7fbf843af800 2 removed watcher, disabling cache 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.054+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94766986691200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893f4b0 con 0x5630a89313e0 2024-09-21T08:52:19.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.055+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94766986691200] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.055+0000 7fbf843af800 20 remove_watcher() i=1 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.055+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94766986693952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893f4b0 con 0x5630a893a8c0 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.056+0000 7fbf81ea3640 1 -- 172.21.15.196:0/1052052604 <== osd.3 v2:172.21.15.196:6800/127179937 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94766986693952] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf74075070 con 0x5630a893a8c0 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.056+0000 7fbf843af800 20 remove_watcher() i=2 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.056+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94766986696272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893f4b0 con 0x7fbf7409c040 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.057+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94766986696272] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c049040 con 0x7fbf7409c040 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.057+0000 7fbf843af800 20 remove_watcher() i=3 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.057+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94766986685152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893f4b0 con 0x5630a89313e0 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.058+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94766986685152] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6c049040 con 0x5630a89313e0 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.058+0000 7fbf843af800 20 remove_watcher() i=4 2024-09-21T08:52:19.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.058+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94766986701104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a893eae0 con 0x5630a8935c50 2024-09-21T08:52:19.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.059+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94766986701104] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.059+0000 7fbf843af800 20 remove_watcher() i=5 2024-09-21T08:52:19.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.059+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94766986705888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942930 con 0x5630a8935c50 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.060+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94766986705888] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.060+0000 7fbf843af800 20 remove_watcher() i=6 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.060+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94766986709664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630a8942930 con 0x5630a8935c50 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf826a4640 1 -- 172.21.15.196:0/1052052604 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94766986709664] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf7c02a070 con 0x5630a8935c50 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 20 remove_watcher() i=7 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a8935c50 msgr2=0x5630a8938060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a8935c50 0x5630a8938060 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a89313e0 msgr2=0x5630a89338a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a89313e0 0x5630a89338a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbf7409c040 msgr2=0x7fbf74006580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fbf7409c040 0x7fbf74006580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5630a893a8c0 msgr2=0x5630a893cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5630a893a8c0 0x5630a893cd80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe4c036b40 msgr2=0x7fbe4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe4c036b40 0x7fbe4c039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf74001eb0 tx=0x7fbf74081000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf796a2640 1 -- 172.21.15.196:0/1052052604 reap_dead start 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 msgr2=0x5630a8925760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.061+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c011be0 tx=0x7fbf7c04cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 shutdown_connections 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/1052052604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a891e2a0 0x5630a8925760 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 >> 172.21.15.196:0/1052052604 conn(0x5630a891a650 msgr2=0x5630a891f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 shutdown_connections 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/1052052604 wait complete. 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 msgr2=0x7fbe5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 0x7fbe5c039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5630a88fabb0 tx=0x7fbf74006480 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 msgr2=0x5630a8911a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5630a88f7520 tx=0x7fbf7c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 shutdown_connections 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe5c036b90 0x7fbe5c039050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/3680229008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a8911650 0x5630a8911a70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 >> 172.21.15.196:0/3680229008 conn(0x5630a89065e0 msgr2=0x5630a8909160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 shutdown_connections 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/3680229008 wait complete. 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 msgr2=0x5630a8902540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 0x5630a8902540 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 msgr2=0x5630a88fd8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 0x5630a88fd8c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 msgr2=0x7fbe68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 0x7fbe68039000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5630a8763320 tx=0x7fbf6c001390 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 msgr2=0x5630a88f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbf74025e40 tx=0x7fbf74002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 shutdown_connections 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5630a89000b0 0x5630a8902540 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5630a88fb4d0 0x5630a88fd8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbe68036b40 0x7fbe68039000 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 --2- 172.21.15.196:0/2298067940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630a87fe3b0 0x5630a88f6470 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.062+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 >> 172.21.15.196:0/2298067940 conn(0x5630a87f95c0 msgr2=0x5630a88e8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.063+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 shutdown_connections 2024-09-21T08:52:19.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.063+0000 7fbf843af800 1 -- 172.21.15.196:0/2298067940 wait complete. 2024-09-21T08:52:19.072 INFO:teuthology.orchestra.run.smithi196.stdout:[] 2024-09-21T08:52:19.072 DEBUG:tasks.util.rgw: json result: [] 2024-09-21T08:52:19.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T08:52:19.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T08:52:19.073 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T08:52:19.156 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:19.156 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47c0f24800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b29beee4a0 0x55b29bf826e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47c0f24800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b29be38b30 con 0x55b29beef5b0 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47c0f24800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b29be1a360 con 0x55b29beee4a0 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47bc415640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b29beee4a0 0x55b29bf826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47bc415640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b29beee4a0 0x55b29bf826e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35128/0 (socket says 172.21.15.196:35128) 2024-09-21T08:52:19.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47bc415640 1 -- 172.21.15.196:0/2643309918 learned_addr learned my addr 172.21.15.196:0/2643309918 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.156+0000 7f47bcc16640 1 --1- 172.21.15.196:0/2643309918 >> v1:172.21.15.29:6789/0 conn(0x55b29beef5b0 0x55b29beedd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57968/0 (socket says 172.21.15.196:57968) 2024-09-21T08:52:19.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.157+0000 7f47bc415640 1 -- 172.21.15.196:0/2643309918 >> v1:172.21.15.29:6789/0 conn(0x55b29beef5b0 legacy=0x55b29beedd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.157+0000 7f47bbc14640 1 -- 172.21.15.196:0/2643309918 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116324052 0 0) 0x55b29be38b30 con 0x55b29beef5b0 2024-09-21T08:52:19.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.157+0000 7f47bc415640 1 -- 172.21.15.196:0/2643309918 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29be40e00 con 0x55b29beee4a0 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.158+0000 7f47bc415640 1 --2- 172.21.15.196:0/2643309918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29bf826e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f47a400a520 tx=0x7f47a4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffc6817683b8659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.158+0000 7f47bbc14640 1 -- 172.21.15.196:0/2643309918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a4055070 con 0x55b29beee4a0 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47bbc14640 1 -- 172.21.15.196:0/2643309918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a40515b0 con 0x55b29beee4a0 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47bbc14640 1 -- 172.21.15.196:0/2643309918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a40518d0 con 0x55b29beee4a0 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 -- 172.21.15.196:0/2643309918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 msgr2=0x55b29bf826e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2643309918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29bf826e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f47a400a520 tx=0x7f47a4045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 -- 172.21.15.196:0/2643309918 shutdown_connections 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2643309918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29bf826e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 -- 172.21.15.196:0/2643309918 >> 172.21.15.196:0/2643309918 conn(0x55b29bf74ff0 msgr2=0x55b29bf77410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 -- 172.21.15.196:0/2643309918 shutdown_connections 2024-09-21T08:52:19.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.159+0000 7f47c0f24800 1 -- 172.21.15.196:0/2643309918 wait complete. 2024-09-21T08:52:19.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47c0f24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47c0f24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b29bec5330 con 0x55b29beee4a0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47bcc16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47bcc16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35132/0 (socket says 172.21.15.196:35132) 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47bcc16640 1 -- 172.21.15.196:0/2018759863 learned_addr learned my addr 172.21.15.196:0/2018759863 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.173+0000 7f47bcc16640 1 -- 172.21.15.196:0/2018759863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29be12bc0 con 0x55b29beee4a0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2018759863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001680 tx=0x7f47b4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac2e78cb8d7e91d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f46aae0d640 1 -- 172.21.15.196:0/2018759863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4016070 con 0x55b29beee4a0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f46aae0d640 1 -- 172.21.15.196:0/2018759863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4004480 con 0x55b29beee4a0 2024-09-21T08:52:19.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f46aae0d640 1 -- 172.21.15.196:0/2018759863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4004820 con 0x55b29beee4a0 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47c0f24800 1 -- 172.21.15.196:0/2018759863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 msgr2=0x55b29c06a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2018759863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001680 tx=0x7f47b4001b40 comp rx=0 tx=0).stop 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47c0f24800 1 -- 172.21.15.196:0/2018759863 shutdown_connections 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2018759863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c06a830 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.174+0000 7f47c0f24800 1 -- 172.21.15.196:0/2018759863 >> 172.21.15.196:0/2018759863 conn(0x55b29bf74ff0 msgr2=0x55b29c0661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 -- 172.21.15.196:0/2018759863 shutdown_connections 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 -- 172.21.15.196:0/2018759863 wait complete. 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47c0f24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b29beeeb90 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47bcc16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47bcc16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35142/0 (socket says 172.21.15.196:35142) 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47bcc16640 1 -- 172.21.15.196:0/3113207416 learned_addr learned my addr 172.21.15.196:0/3113207416 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.175+0000 7f47bcc16640 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29be26fe0 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f47bcc16640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001330 tx=0x7f47b4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f46a960a640 1 -- 172.21.15.196:0/3113207416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4021020 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f46a960a640 1 -- 172.21.15.196:0/3113207416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4011400 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29c072840 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f46a960a640 1 -- 172.21.15.196:0/3113207416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4016040 con 0x55b29beee4a0 2024-09-21T08:52:19.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.176+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29c072dc0 con 0x55b29beee4a0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f46a960a640 1 -- 172.21.15.196:0/3113207416 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47b4024020 con 0x55b29beee4a0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f46a960a640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 0x7f46a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f46a960a640 1 -- 172.21.15.196:0/3113207416 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47b404c110 con 0x55b29beee4a0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47bc415640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 0x7f46a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 0x55b29c079280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0798c0 con 0x55b29beef5b0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47bd417640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 0x55b29c079280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47bc415640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 0x7f46a4039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47a4057000 tx=0x7f47a4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.177+0000 7f47bd417640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 0x55b29c079280 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47bd417640 1 -- 172.21.15.196:0/3113207416 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47ac0083e0 con 0x55b29beef5b0 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c076920 con 0x55b29beef5b0 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47bd417640 1 -- 172.21.15.196:0/3113207416 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47ac0083e0 con 0x55b29beef5b0 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 0x55b29c07dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c07e6d0 con 0x55b29c07bbf0 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47bcc16640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 0x55b29c07dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.178+0000 7f47bcc16640 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 0x55b29c07dfe0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.179+0000 7f47bcc16640 1 -- 172.21.15.196:0/3113207416 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c07bbf0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.179+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c07aa90 con 0x55b29beef5b0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.179+0000 7f47bd417640 1 -- 172.21.15.196:0/3113207416 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47ac0083e0 con 0x55b29beef5b0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.179+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c07af10 con 0x55b29beef5b0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.179+0000 7f47bd417640 1 -- 172.21.15.196:0/3113207416 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47ac0083e0 con 0x55b29beef5b0 2024-09-21T08:52:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47c0f24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47c0f24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b29be14580 con 0x55b29c08d060 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35152/0 (socket says 172.21.15.196:35152) 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47bd417640 1 -- 172.21.15.196:0/724581571 learned_addr learned my addr 172.21.15.196:0/724581571 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47bd417640 1 -- 172.21.15.196:0/724581571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c08d9c0 con 0x55b29c08d060 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.180+0000 7f47bd417640 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55b29c073700 tx=0x7f47ac00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f46a27fc640 1 -- 172.21.15.196:0/724581571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac007d00 con 0x55b29c08d060 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f46a27fc640 1 -- 172.21.15.196:0/724581571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac01e020 con 0x55b29c08d060 2024-09-21T08:52:19.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29c08dc50 con 0x55b29c08d060 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f46a27fc640 1 -- 172.21.15.196:0/724581571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac019420 con 0x55b29c08d060 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29c090930 con 0x55b29c08d060 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.181+0000 7f46a27fc640 1 -- 172.21.15.196:0/724581571 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47ac016040 con 0x55b29c08d060 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f46a27fc640 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 0x7f4694039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f46a27fc640 1 -- 172.21.15.196:0/724581571 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47ac01f030 con 0x55b29c08d060 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47bcc16640 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 0x7f4694039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47bcc16640 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 0x7f4694039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55b29c079d60 tx=0x7f47b401d400 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47c0f24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47c0f24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b29c06afe0 con 0x55b29c099d60 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35156/0 (socket says 172.21.15.196:35156) 2024-09-21T08:52:19.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.182+0000 7f47bd417640 1 -- 172.21.15.196:0/565084206 learned_addr learned my addr 172.21.15.196:0/565084206 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47bd417640 1 -- 172.21.15.196:0/565084206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c09a730 con 0x55b29c099d60 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47bd417640 1 --2- 172.21.15.196:0/565084206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f47ac04cb10 tx=0x7f47ac014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea4a5505c33d21b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f4693fff640 1 -- 172.21.15.196:0/565084206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac01d040 con 0x55b29c099d60 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f4693fff640 1 -- 172.21.15.196:0/565084206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac017b00 con 0x55b29c099d60 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f4693fff640 1 -- 172.21.15.196:0/565084206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac017de0 con 0x55b29c099d60 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 -- 172.21.15.196:0/565084206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 msgr2=0x55b29c09a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 --2- 172.21.15.196:0/565084206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f47ac04cb10 tx=0x7f47ac014640 comp rx=0 tx=0).stop 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 -- 172.21.15.196:0/565084206 shutdown_connections 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 --2- 172.21.15.196:0/565084206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c09a160 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 -- 172.21.15.196:0/565084206 >> 172.21.15.196:0/565084206 conn(0x55b29c096070 msgr2=0x55b29c0941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 -- 172.21.15.196:0/565084206 shutdown_connections 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.183+0000 7f47c0f24800 1 -- 172.21.15.196:0/565084206 wait complete. 2024-09-21T08:52:19.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47c0f24800 1 Processor -- start 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47c0f24800 1 -- start start 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47c0f24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47c0f24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b29c09ad40 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47bd417640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35162/0 (socket says 172.21.15.196:35162) 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 learned_addr learned my addr 172.21.15.196:0/2165356287 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.184+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c0a16a0 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f47bd417640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f47ac03f040 tx=0x7f47ac04caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f46927fc640 1 -- 172.21.15.196:0/2165356287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac01d070 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29c0a1930 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f46927fc640 1 -- 172.21.15.196:0/2165356287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac046050 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f46927fc640 1 -- 172.21.15.196:0/2165356287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac039060 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.185+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29c0a45e0 con 0x55b29c099d60 2024-09-21T08:52:19.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f46927fc640 1 -- 172.21.15.196:0/2165356287 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47ac0195c0 con 0x55b29c099d60 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f46927fc640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4688036b40 0x7f4688039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f46927fc640 1 -- 172.21.15.196:0/2165356287 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47ac03f0d0 con 0x55b29c099d60 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4688036b40 0x7f4688039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4688036b40 0x7f4688039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47b4018fd0 tx=0x7f47b4034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29c0acbf0 0x55b29c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.186+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0af800 con 0x55b29c0acbf0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47bc415640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29c0acbf0 0x55b29c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47bc415640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29c0acbf0 0x55b29c0af0b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 20 realm 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0afc30 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.187+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b0500 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b08a0 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c0b1600 0x55b29c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b4000 con 0x55b29c0b1600 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.188+0000 7f47bd417640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c0b1600 0x55b29c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47bd417640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c0b1600 0x55b29c0b39f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47c0f24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47c0f24800 20 searching for the correct realm 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b29c0b5f90 0x55b29c0b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b29c0b5f90 0x55b29c0b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.189+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b29c0b5f90 0x55b29c0b8450 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bcc16640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f47b403c070 0x7f47b403e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bc415640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f47b403c070 0x7f47b403e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bc415640 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f47b403c070 0x7f47b403e890 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.190+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.191+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.192+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.193+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.194+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.195+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.196+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b5f90 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0b1600 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x55b29c0acbf0 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b8b20 con 0x7f47b403c070 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:19.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.197+0000 7f47c0f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b54e0 con 0x55b29c0acbf0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b4d50 con 0x55b29c0acbf0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b4490 con 0x55b29c0acbf0 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 zone default found 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 4 Realm: () 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 zonegroup default 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0b9450 con 0x55b29c0b1600 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.198+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bb680 con 0x55b29c0b5f90 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bba20 con 0x55b29c0b5f90 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 20 started sync module instance, tier type = 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.199+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bab10 con 0x7f47b403c070 2024-09-21T08:52:19.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.200+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.200+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225610551392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bab10 con 0x7f47b403c070 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.200+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bc4b0 con 0x55b29c0acbf0 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.201+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225610551392] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.201+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.201+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225610555328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bab10 con 0x55b29c0acbf0 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.201+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bcf00 con 0x55b29c0b5f90 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.202+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225610555328] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.202+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.202+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225610548832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0baa80 con 0x55b29c0b5f90 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.202+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bddc0 con 0x7f47b403c070 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.203+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225610548832] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.203+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.204+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225610561808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0be1e0 con 0x7f47b403c070 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.204+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0beba0 con 0x55b29c0acbf0 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.204+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.205+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225610561808] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.205+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225610565360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0befc0 con 0x55b29c0acbf0 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.205+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bdd50 con 0x55b29c0b1600 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.206+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.206+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225610569008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bdd50 con 0x55b29c0b1600 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.206+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225610565360] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.206+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bdd50 con 0x55b29c0b1600 2024-09-21T08:52:19.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.207+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225610569008] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.207+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.207+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225610566496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bff70 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.207+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0c0930 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225610566496] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225610570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0c0930 con 0x55b29c0b1600 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=0 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=1 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=2 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=3 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=4 2024-09-21T08:52:19.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=5 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.208+0000 7f47c0f24800 20 add_watcher() i=6 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.209+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225610570064] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.209+0000 7f47c0f24800 20 add_watcher() i=7 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.209+0000 7f47c0f24800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.209+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0c3d90 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.210+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.210+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225610573392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0c1320 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.211+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225610573392] v36'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.211+0000 7f4672fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.211+0000 7f47c0f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.211+0000 7f47c0f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.211+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0cc830 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.212+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.212+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ccee0 con 0x55b29c0b1600 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.213+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.213+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ccee0 con 0x55b29c0b5f90 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.214+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.214+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0cd980 con 0x55b29c0acbf0 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.215+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.215+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ca650 con 0x7f47b403c070 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.216+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.228 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.216+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ca620 con 0x55b29c0b5f90 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.217+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.217+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce2f0 con 0x55b29c0acbf0 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.218+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.219+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce320 con 0x55b29c0b1600 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.220+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.220+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce320 con 0x7f47b403c070 2024-09-21T08:52:19.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.221+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.221+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.222+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.222+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x7f47b403c070 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.223+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.223+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b1600 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.224+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.224+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x7f47b403c070 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.225+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.225+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b1600 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.226+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.226+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0acbf0 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.227+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.227+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.228+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.228+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x7f47b403c070 2024-09-21T08:52:19.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.229+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.229+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.230+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.230+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0acbf0 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.231+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.231+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0acbf0 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.232+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.232+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.233+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.233+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x7f47b403c070 2024-09-21T08:52:19.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.234+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.234+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.235+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.235+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.235+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.235+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.236+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.236+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.237+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.239 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.237+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b1600 2024-09-21T08:52:19.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.238+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.238+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.239+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.239+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b1600 2024-09-21T08:52:19.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.240+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.240+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b5f90 2024-09-21T08:52:19.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.241+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.241+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x55b29c0b1600 2024-09-21T08:52:19.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.242+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.242+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ce430 con 0x7f47b403c070 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f4671fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47c0f24800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47c0f24800 20 Filter name: none 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f45e37fe640 20 reqs_thread_entry: start 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47c0f24800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47c0f24800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.244+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0f9720 con 0x55b29c0acbf0 2024-09-21T08:52:19.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47c0f24800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47c0f24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47c0f24800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47c0f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0f96d0 con 0x7f47b403c070 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.245+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.246+0000 7f4672fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.246+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225610573392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0cd730 con 0x55b29c0acbf0 2024-09-21T08:52:19.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.247+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94225610573392] v36'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.247+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225610551392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0c0620 con 0x7f47b403c070 2024-09-21T08:52:19.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.248+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94225610551392] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.248+0000 7f47c0f24800 20 remove_watcher() i=0 2024-09-21T08:52:19.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.248+0000 7f47c0f24800 2 removed watcher, disabling cache 2024-09-21T08:52:19.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.248+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225610555328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bb060 con 0x55b29c0acbf0 2024-09-21T08:52:19.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.249+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94225610555328] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.249+0000 7f47c0f24800 20 remove_watcher() i=1 2024-09-21T08:52:19.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.249+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225610548832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bb060 con 0x55b29c0b5f90 2024-09-21T08:52:19.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.250+0000 7f47bcc16640 1 -- 172.21.15.196:0/2165356287 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94225610548832] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b400f070 con 0x55b29c0b5f90 2024-09-21T08:52:19.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.250+0000 7f47c0f24800 20 remove_watcher() i=2 2024-09-21T08:52:19.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.250+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225610561808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ba660 con 0x7f47b403c070 2024-09-21T08:52:19.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.251+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94225610561808] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x7f47b403c070 2024-09-21T08:52:19.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.251+0000 7f47c0f24800 20 remove_watcher() i=3 2024-09-21T08:52:19.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.251+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225610565360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0bd910 con 0x55b29c0acbf0 2024-09-21T08:52:19.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.252+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94225610565360] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a4057030 con 0x55b29c0acbf0 2024-09-21T08:52:19.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.252+0000 7f47c0f24800 20 remove_watcher() i=4 2024-09-21T08:52:19.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.252+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225610569008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0ba660 con 0x55b29c0b1600 2024-09-21T08:52:19.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.253+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94225610569008] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.253+0000 7f47c0f24800 20 remove_watcher() i=5 2024-09-21T08:52:19.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.253+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225610566496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0be6f0 con 0x55b29c0b1600 2024-09-21T08:52:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.254+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94225610566496] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.254+0000 7f47c0f24800 20 remove_watcher() i=6 2024-09-21T08:52:19.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.254+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225610570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b29c0beba0 con 0x55b29c0b1600 2024-09-21T08:52:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47bd417640 1 -- 172.21.15.196:0/2165356287 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94225610570064] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47ac057040 con 0x55b29c0b1600 2024-09-21T08:52:19.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 20 remove_watcher() i=7 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c0b1600 msgr2=0x55b29c0b39f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c0b1600 0x55b29c0b39f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29c0acbf0 msgr2=0x55b29c0af0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29c0acbf0 0x55b29c0af0b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f47b403c070 msgr2=0x7f47b403e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f47b403c070 0x7f47b403e890 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b29c0b5f90 msgr2=0x55b29c0b8450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b29c0b5f90 0x55b29c0b8450 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4688036b40 msgr2=0x7f4688039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4688036b40 0x7f4688039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47b4018fd0 tx=0x7f47b4034000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 msgr2=0x55b29c0a1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47bc415640 1 -- 172.21.15.196:0/2165356287 reap_dead start 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.255+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f47ac03f040 tx=0x7f47ac04caa0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 shutdown_connections 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/2165356287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c099d60 0x55b29c0a1160 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 >> 172.21.15.196:0/2165356287 conn(0x55b29c096070 msgr2=0x55b29c094130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 shutdown_connections 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/2165356287 wait complete. 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 msgr2=0x7f4694039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 0x7f4694039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55b29c079d60 tx=0x7f47b401d400 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 msgr2=0x55b29c08d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55b29c073700 tx=0x7f47ac00aec0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 shutdown_connections 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4694036b90 0x7f4694039050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/724581571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29c08d060 0x55b29c08d480 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 >> 172.21.15.196:0/724581571 conn(0x55b29c081ff0 msgr2=0x55b29c084b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 shutdown_connections 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/724581571 wait complete. 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 msgr2=0x55b29c07dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 0x55b29c07dfe0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 msgr2=0x55b29c079280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 0x55b29c079280 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 msgr2=0x7f46a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 0x7f46a4039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47a4057000 tx=0x7f47a4052000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 msgr2=0x55b29c072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.256+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001330 tx=0x7f47b4001250 comp rx=0 tx=0).stop 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 shutdown_connections 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b29c07bbf0 0x55b29c07dfe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b29beef5b0 0x55b29c079280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f46a4036b40 0x7f46a4039000 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 --2- 172.21.15.196:0/3113207416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b29beee4a0 0x55b29c072300 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 >> 172.21.15.196:0/3113207416 conn(0x55b29bf74ff0 msgr2=0x55b29c064ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 shutdown_connections 2024-09-21T08:52:19.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.257+0000 7f47c0f24800 1 -- 172.21.15.196:0/3113207416 wait complete. 2024-09-21T08:52:19.266 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T08:52:19.276 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-21T08:52:19.280 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.306 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.316 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.363 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-21T08:52:19.368 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T08:52:19.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T08:52:19.368 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-21T08:52:19.414 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:19.414 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.413+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.413+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.413+0000 7fd8aa719800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55eaf1877eb0 0x55eaf1907160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.413+0000 7fd8aa719800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eaf17c3b30 con 0x55eaf19076a0 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.413+0000 7fd8aa719800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55eaf17a5360 con 0x55eaf1877eb0 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd8a820d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55eaf1877eb0 0x55eaf1907160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd89ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55eaf19076a0 0x55eaf1909ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57978/0 (socket says 172.21.15.196:57978) 2024-09-21T08:52:19.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd89ffff640 1 -- 172.21.15.196:0/2644742480 learned_addr learned my addr 172.21.15.196:0/2644742480 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:19.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd8a820d640 1 --2- 172.21.15.196:0/2644742480 >> v2:172.21.15.29:3300/0 conn(0x55eaf1877eb0 0x55eaf1907160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35172/0 (socket says 172.21.15.196:35172) 2024-09-21T08:52:19.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd8a820d640 1 -- 172.21.15.196:0/2644742480 >> v1:172.21.15.29:6789/0 conn(0x55eaf19076a0 legacy=0x55eaf1909ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.414+0000 7fd8a820d640 1 -- 172.21.15.196:0/2644742480 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf17cbe00 con 0x55eaf1877eb0 2024-09-21T08:52:19.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8a820d640 1 --2- 172.21.15.196:0/2644742480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf1907160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd89800a470 tx=0x7fd898045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0c40bd56ad75bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8a7a0c640 1 -- 172.21.15.196:0/2644742480 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898053570 con 0x55eaf1877eb0 2024-09-21T08:52:19.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8a7a0c640 1 -- 172.21.15.196:0/2644742480 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898058070 con 0x55eaf1877eb0 2024-09-21T08:52:19.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8a7a0c640 1 -- 172.21.15.196:0/2644742480 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898053880 con 0x55eaf1877eb0 2024-09-21T08:52:19.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 -- 172.21.15.196:0/2644742480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 msgr2=0x55eaf1907160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2644742480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf1907160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd89800a470 tx=0x7fd898045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:19.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 -- 172.21.15.196:0/2644742480 shutdown_connections 2024-09-21T08:52:19.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2644742480 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf1907160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 -- 172.21.15.196:0/2644742480 >> 172.21.15.196:0/2644742480 conn(0x55eaf18fedd0 msgr2=0x55eaf19011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 -- 172.21.15.196:0/2644742480 shutdown_connections 2024-09-21T08:52:19.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.416+0000 7fd8aa719800 1 -- 172.21.15.196:0/2644742480 wait complete. 2024-09-21T08:52:19.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.430+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.430+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.430+0000 7fd8aa719800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.430+0000 7fd8aa719800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1850360 con 0x55eaf1877eb0 2024-09-21T08:52:19.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd8a820d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd8a820d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35182/0 (socket says 172.21.15.196:35182) 2024-09-21T08:52:19.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd8a820d640 1 -- 172.21.15.196:0/407290226 learned_addr learned my addr 172.21.15.196:0/407290226 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd8a820d640 1 -- 172.21.15.196:0/407290226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf179dbc0 con 0x55eaf1877eb0 2024-09-21T08:52:19.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd8a820d640 1 --2- 172.21.15.196:0/407290226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd898025c20 tx=0x7fd898051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0275b090ef8ad7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd79660c640 1 -- 172.21.15.196:0/407290226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd89805c580 con 0x55eaf1877eb0 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd79660c640 1 -- 172.21.15.196:0/407290226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898063030 con 0x55eaf1877eb0 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.431+0000 7fd79660c640 1 -- 172.21.15.196:0/407290226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd89805c850 con 0x55eaf1877eb0 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- 172.21.15.196:0/407290226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 msgr2=0x55eaf19f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 --2- 172.21.15.196:0/407290226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd898025c20 tx=0x7fd898051000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- 172.21.15.196:0/407290226 shutdown_connections 2024-09-21T08:52:19.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 --2- 172.21.15.196:0/407290226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19f3910 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- 172.21.15.196:0/407290226 >> 172.21.15.196:0/407290226 conn(0x55eaf18fedd0 msgr2=0x55eaf19ef2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- 172.21.15.196:0/407290226 shutdown_connections 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- 172.21.15.196:0/407290226 wait complete. 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.432+0000 7fd8aa719800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eaf190b610 con 0x55eaf1877eb0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8a820d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8a820d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35194/0 (socket says 172.21.15.196:35194) 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8a820d640 1 -- 172.21.15.196:0/331529922 learned_addr learned my addr 172.21.15.196:0/331529922 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8a820d640 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf17b1fe0 con 0x55eaf1877eb0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8a820d640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55eaf19f4770 tx=0x7fd898002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd794e09640 1 -- 172.21.15.196:0/331529922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898054af0 con 0x55eaf1877eb0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd794e09640 1 -- 172.21.15.196:0/331529922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898054c90 con 0x55eaf1877eb0 2024-09-21T08:52:19.437 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eaf19fb7b0 con 0x55eaf1877eb0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd794e09640 1 -- 172.21.15.196:0/331529922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898068420 con 0x55eaf1877eb0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.433+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf19fbcd0 con 0x55eaf1877eb0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd794e09640 1 -- 172.21.15.196:0/331529922 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8980685c0 con 0x55eaf1877eb0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd794e09640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 0x7fd790039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd794e09640 1 -- 172.21.15.196:0/331529922 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd898070030 con 0x55eaf1877eb0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd89ffff640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 0x7fd790039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 0x55eaf1a022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.434+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a02860 con 0x55eaf19076a0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 0x55eaf1a022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd89ffff640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 0x7fd790039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd890000f60 tx=0x7fd8900012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 0x55eaf1a022e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/331529922 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a000a4a0 con 0x55eaf19076a0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf19ff8b0 con 0x55eaf19076a0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/331529922 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a000a4a0 con 0x55eaf19076a0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 0x55eaf1a06fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.435+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a07640 con 0x55eaf1a04bb0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.436+0000 7fd8a820d640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 0x55eaf1a06fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.436+0000 7fd8a820d640 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 0x55eaf1a06fa0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.436+0000 7fd8a820d640 1 -- 172.21.15.196:0/331529922 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a04bb0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.436+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a03a50 con 0x55eaf19076a0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/331529922 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a000a4a0 con 0x55eaf19076a0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a03ef0 con 0x55eaf19076a0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/331529922 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8a000a4a0 con 0x55eaf19076a0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8aa719800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.437+0000 7fd8aa719800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eaf179f580 con 0x55eaf1a15fd0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35208/0 (socket says 172.21.15.196:35208) 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/2043609284 learned_addr learned my addr 172.21.15.196:0/2043609284 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/2043609284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf1a16930 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55eaf19fc490 tx=0x7fd8a00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd78dffb640 1 -- 172.21.15.196:0/2043609284 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a0014450 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd78dffb640 1 -- 172.21.15.196:0/2043609284 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00145f0 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eaf1a16bc0 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd78dffb640 1 -- 172.21.15.196:0/2043609284 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00148d0 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.438+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf1a198a0 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.439+0000 7fd78dffb640 1 -- 172.21.15.196:0/2043609284 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8a0011040 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.439+0000 7fd78dffb640 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 0x7fd780039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.439+0000 7fd78dffb640 1 -- 172.21.15.196:0/2043609284 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd8a001e070 con 0x55eaf1a15fd0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.439+0000 7fd8a820d640 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 0x7fd780039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.439+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a820d640 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 0x7fd780039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55eaf1a02cd0 tx=0x7fd89805ed90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8aa719800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8aa719800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eaf19f4060 con 0x55eaf1a22c20 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35220/0 (socket says 172.21.15.196:35220) 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/1930816837 learned_addr learned my addr 172.21.15.196:0/1930816837 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/1930816837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf1a235f0 con 0x55eaf1a22c20 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/1930816837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd8a004cb40 tx=0x7fd8a003bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5362c4f1a555de70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd7877fe640 1 -- 172.21.15.196:0/1930816837 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00168f0 con 0x55eaf1a22c20 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd7877fe640 1 -- 172.21.15.196:0/1930816837 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a0013cb0 con 0x55eaf1a22c20 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.440+0000 7fd7877fe640 1 -- 172.21.15.196:0/1930816837 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a0014a70 con 0x55eaf1a22c20 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- 172.21.15.196:0/1930816837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 msgr2=0x55eaf1a23020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 --2- 172.21.15.196:0/1930816837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd8a004cb40 tx=0x7fd8a003bf20 comp rx=0 tx=0).stop 2024-09-21T08:52:19.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- 172.21.15.196:0/1930816837 shutdown_connections 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 --2- 172.21.15.196:0/1930816837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a23020 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- 172.21.15.196:0/1930816837 >> 172.21.15.196:0/1930816837 conn(0x55eaf1a1efd0 msgr2=0x55eaf1a1d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- 172.21.15.196:0/1930816837 shutdown_connections 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- 172.21.15.196:0/1930816837 wait complete. 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 Processor -- start 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- start start 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.441+0000 7fd8aa719800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1a23bc0 con 0x55eaf1a22c20 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8a8a0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35222/0 (socket says 172.21.15.196:35222) 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 learned_addr learned my addr 172.21.15.196:0/4148385869 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf1a2a5f0 con 0x55eaf1a22c20 2024-09-21T08:52:19.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd8a003e040 tx=0x7fd8a004cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd785ffb640 1 -- 172.21.15.196:0/4148385869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a0031070 con 0x55eaf1a22c20 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd785ffb640 1 -- 172.21.15.196:0/4148385869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a0022a50 con 0x55eaf1a22c20 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd785ffb640 1 -- 172.21.15.196:0/4148385869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a0013e60 con 0x55eaf1a22c20 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eaf1a2a880 con 0x55eaf1a22c20 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.442+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf1a2d530 con 0x55eaf1a22c20 2024-09-21T08:52:19.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.443+0000 7fd785ffb640 1 -- 172.21.15.196:0/4148385869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8a0034070 con 0x55eaf1a22c20 2024-09-21T08:52:19.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.443+0000 7fd785ffb640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd778036b90 0x7fd778039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.443+0000 7fd785ffb640 1 -- 172.21.15.196:0/4148385869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd8a000e040 con 0x55eaf1a22c20 2024-09-21T08:52:19.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.443+0000 7fd8a820d640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd778036b90 0x7fd778039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8a820d640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd778036b90 0x7fd778039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd89800a010 tx=0x7fd89805ee20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf1a35db0 0x55eaf1a38270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a389c0 con 0x55eaf1a35db0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd89ffff640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf1a35db0 0x55eaf1a38270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd89ffff640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf1a35db0 0x55eaf1a38270 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd890009050 con 0x55eaf1a35db0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 20 realm 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.444+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a35200 con 0x55eaf1a35db0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd890009050 con 0x55eaf1a35db0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a394b0 con 0x55eaf1a35db0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd890009050 con 0x55eaf1a35db0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a39d80 con 0x55eaf1a35db0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd890009050 con 0x55eaf1a35db0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a3a7a0 0x55eaf1a3cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a3d280 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.445+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a3a7a0 0x55eaf1a3cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8a8a0e640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a3a7a0 0x55eaf1a3cb90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8aa719800 20 searching for the correct realm 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55eaf1a3f250 0x55eaf1a41710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.446+0000 7fd8a820d640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55eaf1a3f250 0x55eaf1a41710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd8a820d640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55eaf1a3f250 0x55eaf1a41710 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd8a820d640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd89805c070 0x7fd89807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd89ffff640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd89805c070 0x7fd89807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd89ffff640 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd89805c070 0x7fd89807d3f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890009050 con 0x7fd89805c070 2024-09-21T08:52:19.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.447+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890009050 con 0x55eaf1a35db0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.448+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.449+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.450+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.451+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.452+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.453+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3f250 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.454+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x55eaf1a35db0 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a41de0 con 0x7fd89805c070 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a3dc40 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.455+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a3e4e0 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a3d880 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 zone default found 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 4 Realm: () 2024-09-21T08:52:19.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 zonegroup default 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a42260 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.456+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a44510 con 0x55eaf1a3f250 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a448b0 con 0x55eaf1a3f250 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 20 started sync module instance, tier type = 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.457+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a439a0 con 0x7fd89805c070 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.458+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.458+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94467564781216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a439a0 con 0x7fd89805c070 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.458+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a45320 con 0x55eaf1a35db0 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.459+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94467564781216] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.459+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.459+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94467564785168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a439a0 con 0x55eaf1a35db0 2024-09-21T08:52:19.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.459+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a45d90 con 0x55eaf1a3f250 2024-09-21T08:52:19.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.460+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94467564785168] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.461+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.461+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94467564778736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a43910 con 0x55eaf1a3f250 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.461+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a46c50 con 0x7fd89805c070 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.462+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.462+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94467564778736] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.462+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94467564791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a47070 con 0x7fd89805c070 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.462+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a47a30 con 0x55eaf1a35db0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.463+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.463+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94467564795264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a47e50 con 0x55eaf1a35db0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.463+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a48900 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.463+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94467564791712] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.464+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94467564795264] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.464+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.464+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94467564792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a47e50 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.464+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a491a0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.465+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94467564792768] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.465+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.465+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94467564796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a49380 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.465+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a49bd0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94467564796320] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94467564802224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a49aa0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=0 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=1 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=2 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=3 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=4 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=5 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.466+0000 7fd8aa719800 20 add_watcher() i=6 2024-09-21T08:52:19.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94467564802224] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd8aa719800 20 add_watcher() i=7 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd8aa719800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a4d010 con 0x55eaf1a35db0 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.467+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94467564803408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a4a4d0 con 0x55eaf1a35db0 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.468+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94467564803408] v36'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.468+0000 7fd75e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.468+0000 7fd8aa719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.468+0000 7fd8aa719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 5 note: GC not initialized 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd75d7e2640 20 reqs_thread_entry: start 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 20 Filter name: none 2024-09-21T08:52:19.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd6ceffd640 20 reqs_thread_entry: start 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.469+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a808e0 con 0x7fd89805c070 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 : miss 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.1e 8:7fe62c92:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a824a0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 info.flags=0x17 2024-09-21T08:52:19.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 to cache LRU end 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 20 get_obj_state: octx=0x7fd8a002ff70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55eaf1a84b68 s->prefetch_data=0 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.470+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 3.10s0 3:08da35ff:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a85990 con 0x55eaf1a35db0 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.471+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.471+0000 7fd8aa719800 10 manifest: total_size = 5 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.471+0000 7fd8aa719800 20 get_obj_state: setting s->obj_tag to _7Z6PVm-AZehndr2sOIj4zpDn4-eYgp6 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.471+0000 7fd75e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.471+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94467564803408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a7e1d0 con 0x55eaf1a35db0 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.472+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94467564803408] v36'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.472+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94467564781216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a7e1d0 con 0x7fd89805c070 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.473+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94467564781216] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.473+0000 7fd8aa719800 20 remove_watcher() i=0 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.473+0000 7fd8aa719800 2 removed watcher, disabling cache 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.473+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94467564785168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a7e1d0 con 0x55eaf1a35db0 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.474+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94467564785168] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.474+0000 7fd8aa719800 20 remove_watcher() i=1 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.474+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94467564778736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a7e1d0 con 0x55eaf1a3f250 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.475+0000 7fd8a820d640 1 -- 172.21.15.196:0/4148385869 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94467564778736] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898051070 con 0x55eaf1a3f250 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.475+0000 7fd8aa719800 20 remove_watcher() i=2 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.475+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94467564791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a434f0 con 0x7fd89805c070 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.476+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94467564791712] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x7fd89805c070 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.476+0000 7fd8aa719800 20 remove_watcher() i=3 2024-09-21T08:52:19.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.476+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94467564795264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a467a0 con 0x55eaf1a35db0 2024-09-21T08:52:19.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.477+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94467564795264] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd890029040 con 0x55eaf1a35db0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.477+0000 7fd8aa719800 20 remove_watcher() i=4 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.477+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94467564792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a434f0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.479+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94467564792768] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.479+0000 7fd8aa719800 20 remove_watcher() i=5 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.479+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94467564796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a47580 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.480+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94467564796320] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.480+0000 7fd8aa719800 20 remove_watcher() i=6 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.480+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94467564802224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eaf1a434f0 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8a8a0e640 1 -- 172.21.15.196:0/4148385869 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94467564802224] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a0033030 con 0x55eaf1a3a7a0 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 20 remove_watcher() i=7 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a3a7a0 msgr2=0x55eaf1a3cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a3a7a0 0x55eaf1a3cb90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf1a35db0 msgr2=0x55eaf1a38270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf1a35db0 0x55eaf1a38270 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd89805c070 msgr2=0x7fd89807d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd89805c070 0x7fd89807d3f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55eaf1a3f250 msgr2=0x55eaf1a41710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55eaf1a3f250 0x55eaf1a41710 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd778036b90 msgr2=0x7fd778039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd778036b90 0x7fd778039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd89800a010 tx=0x7fd89805ee20 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 msgr2=0x55eaf1a2a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd89ffff640 1 -- 172.21.15.196:0/4148385869 reap_dead start 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.481+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd8a003e040 tx=0x7fd8a004cad0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 shutdown_connections 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/4148385869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a22c20 0x55eaf1a2a0b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 >> 172.21.15.196:0/4148385869 conn(0x55eaf1a1efd0 msgr2=0x55eaf1a24330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 shutdown_connections 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/4148385869 wait complete. 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 msgr2=0x7fd780039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 0x7fd780039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55eaf1a02cd0 tx=0x7fd89805ed90 comp rx=0 tx=0).stop 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 msgr2=0x55eaf1a163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55eaf19fc490 tx=0x7fd8a00188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 shutdown_connections 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd780036b90 0x7fd780039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/2043609284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1a15fd0 0x55eaf1a163f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 >> 172.21.15.196:0/2043609284 conn(0x55eaf1a0af60 msgr2=0x55eaf1a0dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 shutdown_connections 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/2043609284 wait complete. 2024-09-21T08:52:19.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 msgr2=0x55eaf1a06fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 0x55eaf1a06fa0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 msgr2=0x55eaf1a022e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 0x55eaf1a022e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 msgr2=0x7fd790039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 0x7fd790039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd890000f60 tx=0x7fd8900012b0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 msgr2=0x55eaf19fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.482+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55eaf19f4770 tx=0x7fd898002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 shutdown_connections 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55eaf1a04bb0 0x55eaf1a06fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55eaf19076a0 0x55eaf1a022e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd790036b40 0x7fd790039000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 --2- 172.21.15.196:0/331529922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eaf1877eb0 0x55eaf19fb270 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 >> 172.21.15.196:0/331529922 conn(0x55eaf18fedd0 msgr2=0x55eaf19edb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 shutdown_connections 2024-09-21T08:52:19.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.483+0000 7fd8aa719800 1 -- 172.21.15.196:0/331529922 wait complete. 2024-09-21T08:52:19.492 INFO:teuthology.orchestra.run.smithi196.stdout:fooFoofooFooFULL_CONTROL 2024-09-21T08:52:19.493 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-21T08:52:19.495 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-21T08:52:19.499 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T08:52:19.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-21T08:52:19.500 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-21T08:52:19.545 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:19.545 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.544+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.544+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.544+0000 7fc845b30800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562a4bddf920 0x562a4bde1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.544+0000 7fc845b30800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a4bc9bb30 con 0x562a4bddb4e0 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.544+0000 7fc845b30800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562a4bc7d360 con 0x562a4bddf920 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84107f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562a4bddf920 0x562a4bde1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84107f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562a4bddf920 0x562a4bde1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35228/0 (socket says 172.21.15.196:35228) 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84107f640 1 -- 172.21.15.196:0/2692155930 learned_addr learned my addr 172.21.15.196:0/2692155930 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc841880640 1 --1- 172.21.15.196:0/2692155930 >> v1:172.21.15.29:6789/0 conn(0x562a4bddb4e0 0x562a4bddb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57986/0 (socket says 172.21.15.196:57986) 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84107f640 1 -- 172.21.15.196:0/2692155930 >> v1:172.21.15.29:6789/0 conn(0x562a4bddb4e0 legacy=0x562a4bddb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84107f640 1 -- 172.21.15.196:0/2692155930 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4bca3e00 con 0x562a4bddf920 2024-09-21T08:52:19.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.545+0000 7fc84087e640 1 -- 172.21.15.196:0/2692155930 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036979884 0 0) 0x562a4bc9bb30 con 0x562a4bddb4e0 2024-09-21T08:52:19.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc84107f640 1 --2- 172.21.15.196:0/2692155930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddf920 0x562a4bde1d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc83800a520 tx=0x7fc838045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffba67e8cf121ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc84087e640 1 -- 172.21.15.196:0/2692155930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc838055070 con 0x562a4bddf920 2024-09-21T08:52:19.549 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc84087e640 1 -- 172.21.15.196:0/2692155930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380515b0 con 0x562a4bddf920 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc84087e640 1 -- 172.21.15.196:0/2692155930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8380518d0 con 0x562a4bddf920 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 -- 172.21.15.196:0/2692155930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddf920 msgr2=0x562a4bde1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 --2- 172.21.15.196:0/2692155930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddf920 0x562a4bde1d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc83800a520 tx=0x7fc838045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 -- 172.21.15.196:0/2692155930 shutdown_connections 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 --2- 172.21.15.196:0/2692155930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddf920 0x562a4bde1d10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 -- 172.21.15.196:0/2692155930 >> 172.21.15.196:0/2692155930 conn(0x562a4bdd6dd0 msgr2=0x562a4bdd91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 -- 172.21.15.196:0/2692155930 shutdown_connections 2024-09-21T08:52:19.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.547+0000 7fc845b30800 1 -- 172.21.15.196:0/2692155930 wait complete. 2024-09-21T08:52:19.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc845b30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc845b30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562a4bd28360 con 0x562a4bddb4e0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc841880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc841880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35232/0 (socket says 172.21.15.196:35232) 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.561+0000 7fc841880640 1 -- 172.21.15.196:0/1712047332 learned_addr learned my addr 172.21.15.196:0/1712047332 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.562+0000 7fc841880640 1 -- 172.21.15.196:0/1712047332 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4bc75bc0 con 0x562a4bddb4e0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.562+0000 7fc841880640 1 --2- 172.21.15.196:0/1712047332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc83400b240 tx=0x7fc83400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7faa44bd0b5370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.562+0000 7fc72fe07640 1 -- 172.21.15.196:0/1712047332 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc834008070 con 0x562a4bddb4e0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.562+0000 7fc72fe07640 1 -- 172.21.15.196:0/1712047332 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83400d500 con 0x562a4bddb4e0 2024-09-21T08:52:19.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.562+0000 7fc72fe07640 1 -- 172.21.15.196:0/1712047332 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83400d860 con 0x562a4bddb4e0 2024-09-21T08:52:19.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- 172.21.15.196:0/1712047332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 msgr2=0x562a4bd4fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 --2- 172.21.15.196:0/1712047332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc83400b240 tx=0x7fc83400b700 comp rx=0 tx=0).stop 2024-09-21T08:52:19.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- 172.21.15.196:0/1712047332 shutdown_connections 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 --2- 172.21.15.196:0/1712047332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bd4fda0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- 172.21.15.196:0/1712047332 >> 172.21.15.196:0/1712047332 conn(0x562a4bdd6dd0 msgr2=0x562a4bec5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- 172.21.15.196:0/1712047332 shutdown_connections 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- 172.21.15.196:0/1712047332 wait complete. 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc845b30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562a4bde2550 con 0x562a4bddb4e0 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc841880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc841880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35242/0 (socket says 172.21.15.196:35242) 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.563+0000 7fc841880640 1 -- 172.21.15.196:0/3001744866 learned_addr learned my addr 172.21.15.196:0/3001744866 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc841880640 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4bc89fe0 con 0x562a4bddb4e0 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc841880640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x562a4bd4f4a0 tx=0x7fc834000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc72e604640 1 -- 172.21.15.196:0/3001744866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc834019870 con 0x562a4bddb4e0 2024-09-21T08:52:19.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc72e604640 1 -- 172.21.15.196:0/3001744866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834019a10 con 0x562a4bddb4e0 2024-09-21T08:52:19.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a4bed3660 con 0x562a4bddb4e0 2024-09-21T08:52:19.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.564+0000 7fc72e604640 1 -- 172.21.15.196:0/3001744866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc834019d30 con 0x562a4bddb4e0 2024-09-21T08:52:19.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.565+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4bed3b80 con 0x562a4bddb4e0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.565+0000 7fc72e604640 1 -- 172.21.15.196:0/3001744866 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc834017040 con 0x562a4bddb4e0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.565+0000 7fc72e604640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 0x7fc728039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc72e604640 1 -- 172.21.15.196:0/3001744866 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc834015020 con 0x562a4bddb4e0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc84107f640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 0x7fc728039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 0x562a4beda190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4beda710 con 0x562a4bddf920 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc842081640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 0x562a4beda190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc84107f640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 0x7fc728039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc838057000 tx=0x7fc838052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc842081640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 0x562a4beda190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc842081640 1 -- 172.21.15.196:0/3001744866 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc83c00a4a0 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.566+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bed7760 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.567+0000 7fc842081640 1 -- 172.21.15.196:0/3001744866 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc83c00a4a0 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.567+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 0x562a4bedee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.567+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bedf4d0 con 0x562a4bedca40 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.567+0000 7fc841880640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 0x562a4bedee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.567+0000 7fc841880640 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 0x562a4bedee30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.568+0000 7fc841880640 1 -- 172.21.15.196:0/3001744866 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bedca40 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.568+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bedb8e0 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.568+0000 7fc842081640 1 -- 172.21.15.196:0/3001744866 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc83c00a4a0 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.568+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bedbd80 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.568+0000 7fc842081640 1 -- 172.21.15.196:0/3001744866 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc83c00a4a0 con 0x562a4bddf920 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc845b30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc845b30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562a4bc77580 con 0x562a4beede60 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35248/0 (socket says 172.21.15.196:35248) 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc842081640 1 -- 172.21.15.196:0/2860404392 learned_addr learned my addr 172.21.15.196:0/2860404392 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.569+0000 7fc842081640 1 -- 172.21.15.196:0/2860404392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4beee7c0 con 0x562a4beede60 2024-09-21T08:52:19.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc842081640 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x562a4bed41d0 tx=0x7fc83c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc7277fe640 1 -- 172.21.15.196:0/2860404392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c014450 con 0x562a4beede60 2024-09-21T08:52:19.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc7277fe640 1 -- 172.21.15.196:0/2860404392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c0145f0 con 0x562a4beede60 2024-09-21T08:52:19.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a4beeea50 con 0x562a4beede60 2024-09-21T08:52:19.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc7277fe640 1 -- 172.21.15.196:0/2860404392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c0148d0 con 0x562a4beede60 2024-09-21T08:52:19.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4bef1730 con 0x562a4beede60 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.570+0000 7fc7277fe640 1 -- 172.21.15.196:0/2860404392 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc83c011040 con 0x562a4beede60 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc7277fe640 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 0x7fc71c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc7277fe640 1 -- 172.21.15.196:0/2860404392 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc83c01e070 con 0x562a4beede60 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc841880640 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 0x7fc71c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc841880640 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 0x7fc71c039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x562a4bedab60 tx=0x7fc83401b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc845b30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc845b30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562a4bece5e0 con 0x562a4befaae0 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35258/0 (socket says 172.21.15.196:35258) 2024-09-21T08:52:19.585 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.571+0000 7fc842081640 1 -- 172.21.15.196:0/4061252986 learned_addr learned my addr 172.21.15.196:0/4061252986 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc842081640 1 -- 172.21.15.196:0/4061252986 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4befb4b0 con 0x562a4befaae0 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc842081640 1 --2- 172.21.15.196:0/4061252986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc83c04cbb0 tx=0x7fc83c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40459d88b3bdab7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc7257fa640 1 -- 172.21.15.196:0/4061252986 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c013dc0 con 0x562a4befaae0 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc7257fa640 1 -- 172.21.15.196:0/4061252986 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c014a70 con 0x562a4befaae0 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc7257fa640 1 -- 172.21.15.196:0/4061252986 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c014d50 con 0x562a4befaae0 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 -- 172.21.15.196:0/4061252986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 msgr2=0x562a4befaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 --2- 172.21.15.196:0/4061252986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc83c04cbb0 tx=0x7fc83c011970 comp rx=0 tx=0).stop 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 -- 172.21.15.196:0/4061252986 shutdown_connections 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 --2- 172.21.15.196:0/4061252986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4befaee0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 -- 172.21.15.196:0/4061252986 >> 172.21.15.196:0/4061252986 conn(0x562a4bef6e40 msgr2=0x562a4bef4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 -- 172.21.15.196:0/4061252986 shutdown_connections 2024-09-21T08:52:19.586 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.572+0000 7fc845b30800 1 -- 172.21.15.196:0/4061252986 wait complete. 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc845b30800 1 Processor -- start 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc845b30800 1 -- start start 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc845b30800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc845b30800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562a4befbb20 con 0x562a4befaae0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc842081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35274/0 (socket says 172.21.15.196:35274) 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 learned_addr learned my addr 172.21.15.196:0/4203115545 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4beca450 con 0x562a4befaae0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.573+0000 7fc842081640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc83c011be0 tx=0x7fc83c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc7137fe640 1 -- 172.21.15.196:0/4203115545 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c044030 con 0x562a4befaae0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc7137fe640 1 -- 172.21.15.196:0/4203115545 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c022a80 con 0x562a4befaae0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a4beca6e0 con 0x562a4befaae0 2024-09-21T08:52:19.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc7137fe640 1 -- 172.21.15.196:0/4203115545 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83c022da0 con 0x562a4befaae0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4becab80 con 0x562a4befaae0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.574+0000 7fc7137fe640 1 -- 172.21.15.196:0/4203115545 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc83c04e9a0 con 0x562a4befaae0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc7137fe640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc70c036b90 0x7fc70c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc7137fe640 1 -- 172.21.15.196:0/4203115545 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc83c045070 con 0x562a4befaae0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc841880640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc70c036b90 0x7fc70c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc841880640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc70c036b90 0x7fc70c039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc83400bc50 tx=0x7fc834032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bf0fed0 0x562a4bf12390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf12ae0 con 0x562a4bf0fed0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.575+0000 7fc84107f640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bf0fed0 0x562a4bf12390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc84107f640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bf0fed0 0x562a4bf12390 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 realm 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf12f10 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf137e0 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.576+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf13b80 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bf148e0 0x562a4bf16cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf172e0 con 0x562a4bf148e0 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc842081640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bf148e0 0x562a4bf16cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc842081640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bf148e0 0x562a4bf16cd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 20 searching for the correct realm 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x562a4bf19250 0x562a4bf1b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf19250 2024-09-21T08:52:19.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.577+0000 7fc841880640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x562a4bf19250 0x562a4bf1b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc841880640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x562a4bf19250 0x562a4bf1b710 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc841880640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc83403d070 0x7fc834018810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x7fc83403d070 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc84107f640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc83403d070 0x7fc834018810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.578+0000 7fc84107f640 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc83403d070 0x7fc834018810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf148e0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf0fed0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf0fed0 2024-09-21T08:52:19.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.579+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf148e0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf148e0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x7fc83403d070 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf19250 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.580+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf0fed0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf148e0 2024-09-21T08:52:19.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf0fed0 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x7fc83403d070 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1bde0 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.581+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf148e0 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.582+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf0fed0 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf0fed0 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf148e0 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.583+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x7fc83403d070 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.604 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf0fed0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.584+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x7fc83403d070 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf19250 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.585+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.605 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x562a4bf0fed0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc83405a040 con 0x7fc83403d070 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf187c0 con 0x562a4bf0fed0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.606 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.586+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf17770 con 0x562a4bf0fed0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf18130 con 0x562a4bf0fed0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 zone default found 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 4 Realm: () 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 zonegroup default 2024-09-21T08:52:19.607 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1c710 con 0x562a4bf148e0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1e990 con 0x562a4bf19250 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.587+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1ed30 con 0x562a4bf19250 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 20 started sync module instance, tier type = 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:19.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.588+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1ddd0 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.589+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.589+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739662758608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1ddd0 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.589+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1f780 con 0x562a4bf0fed0 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.590+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739662758608] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.590+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.590+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739662762608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1ddd0 con 0x562a4bf0fed0 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.590+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf201f0 con 0x562a4bf19250 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.591+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739662762608] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.591+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.591+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739662765280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf20590 con 0x562a4bf19250 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.591+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf20fe0 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.592+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739662765280] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.592+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.592+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739662768848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf213d0 con 0x7fc83403d070 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.592+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf21dd0 con 0x562a4bf0fed0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.593+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.593+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739662772448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf21d00 con 0x562a4bf0fed0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.593+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf22d00 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.593+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739662768848] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.594+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739662772448] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.594+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.595+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739662774720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf22810 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.595+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf23740 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.595+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739662774720] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.596+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.596+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739662756128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf23740 con 0x562a4bf148e0 2024-09-21T08:52:19.610 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.596+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf24010 con 0x562a4bf148e0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739662780224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf23b60 con 0x562a4bf148e0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=1 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=2 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=3 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=4 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=5 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739662756128] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=6 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739662780224] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 20 add_watcher() i=7 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.597+0000 7fc845b30800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.598+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf23290 con 0x562a4bf0fed0 2024-09-21T08:52:19.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.598+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.598+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739662783488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf23290 con 0x562a4bf0fed0 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739662783488] v36'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc6f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc845b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc845b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc845b30800 5 note: GC not initialized 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc6f27fc640 20 reqs_thread_entry: start 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.599+0000 7fc845b30800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 20 Filter name: none 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc663fff640 20 reqs_thread_entry: start 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf5adb0 con 0x7fc83403d070 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 : miss 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.1e 8:7fe62c92:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf5c970 con 0x562a4bf148e0 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.600+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 info.flags=0x17 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 to cache LRU end 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:19.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 20 get_obj_state: octx=0x7fc83c040510 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562a4bf5f038 s->prefetch_data=0 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 3.10s0 3:08da35ff:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf5fe60 con 0x562a4bf0fed0 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 10 manifest: total_size = 5 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.601+0000 7fc845b30800 20 get_obj_state: setting s->obj_tag to _I9r6OB_Lc9I8JtoyKM3nCECNY-Ls1NS 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.602+0000 7fc6f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.602+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739662783488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf586a0 con 0x562a4bf0fed0 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94739662783488] v36'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739662758608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf586a0 con 0x7fc83403d070 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94739662758608] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc845b30800 20 remove_watcher() i=0 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc845b30800 2 removed watcher, disabling cache 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.603+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739662762608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1e2d0 con 0x562a4bf0fed0 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.605+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94739662762608] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.605+0000 7fc845b30800 20 remove_watcher() i=1 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.605+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739662765280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf586a0 con 0x562a4bf19250 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.606+0000 7fc841880640 1 -- 172.21.15.196:0/4203115545 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94739662765280] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83402d070 con 0x562a4bf19250 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.606+0000 7fc845b30800 20 remove_watcher() i=2 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.606+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739662768848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1f270 con 0x7fc83403d070 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.607+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94739662768848] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x7fc83403d070 2024-09-21T08:52:19.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.607+0000 7fc845b30800 20 remove_watcher() i=3 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.607+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739662772448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1e2d0 con 0x562a4bf0fed0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.608+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94739662772448] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc838057030 con 0x562a4bf0fed0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.608+0000 7fc845b30800 20 remove_watcher() i=4 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.608+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739662774720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1fce0 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.609+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94739662774720] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.609+0000 7fc845b30800 20 remove_watcher() i=5 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.609+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739662756128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf218e0 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.610+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94739662756128] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.610+0000 7fc845b30800 20 remove_watcher() i=6 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.610+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739662780224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a4bf1e2d0 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc842081640 1 -- 172.21.15.196:0/4203115545 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94739662780224] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83c02a070 con 0x562a4bf148e0 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 20 remove_watcher() i=7 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bf148e0 msgr2=0x562a4bf16cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bf148e0 0x562a4bf16cd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bf0fed0 msgr2=0x562a4bf12390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bf0fed0 0x562a4bf12390 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc83403d070 msgr2=0x7fc834018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.611+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fc83403d070 0x7fc834018810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x562a4bf19250 msgr2=0x562a4bf1b710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x562a4bf19250 0x562a4bf1b710 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc70c036b90 msgr2=0x7fc70c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc70c036b90 0x7fc70c039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc83400bc50 tx=0x7fc834032000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 msgr2=0x562a4becbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc83c011be0 tx=0x7fc83c04cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc84107f640 1 -- 172.21.15.196:0/4203115545 reap_dead start 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 shutdown_connections 2024-09-21T08:52:19.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/4203115545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4befaae0 0x562a4becbd60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 >> 172.21.15.196:0/4203115545 conn(0x562a4bef6e40 msgr2=0x562a4bef4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 shutdown_connections 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/4203115545 wait complete. 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 msgr2=0x7fc71c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 0x7fc71c039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x562a4bedab60 tx=0x7fc83401b520 comp rx=0 tx=0).stop 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 msgr2=0x562a4beee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x562a4bed41d0 tx=0x7fc83c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 shutdown_connections 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc71c036b90 0x7fc71c039050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/2860404392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4beede60 0x562a4beee280 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 >> 172.21.15.196:0/2860404392 conn(0x562a4bee2df0 msgr2=0x562a4bee5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 shutdown_connections 2024-09-21T08:52:19.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/2860404392 wait complete. 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 msgr2=0x562a4bedee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 0x562a4bedee30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.612+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 msgr2=0x562a4beda190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 0x562a4beda190 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 msgr2=0x7fc728039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 0x7fc728039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc838057000 tx=0x7fc838052000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 msgr2=0x562a4bed3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x562a4bd4f4a0 tx=0x7fc834000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 shutdown_connections 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562a4bedca40 0x562a4bedee30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562a4bddf920 0x562a4beda190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc728036b90 0x7fc728039050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 --2- 172.21.15.196:0/3001744866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562a4bddb4e0 0x562a4bed3120 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 >> 172.21.15.196:0/3001744866 conn(0x562a4bdd6dd0 msgr2=0x562a4bec48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 shutdown_connections 2024-09-21T08:52:19.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.613+0000 7fc845b30800 1 -- 172.21.15.196:0/3001744866 wait complete. 2024-09-21T08:52:19.624 INFO:teuthology.orchestra.run.smithi196.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-21T08:52:19.625 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-21T08:52:19.627 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-21T08:52:19.640 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:19.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-21T08:52:19.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-21T08:52:19.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-21T08:52:19.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-21T08:52:19.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-21T08:52:19.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-21T08:52:19.736 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-21T08:52:19.781 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:19.781 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:19.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.780+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.780+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.780+0000 7f7318e87800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c836231650 0x55c8362c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.780+0000 7f7318e87800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c83617cb30 con 0x55c8362c0720 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.780+0000 7f7318e87800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c83615e360 con 0x55c836231650 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731697b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c836231650 0x55c8362c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731697b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c836231650 0x55c8362c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35280/0 (socket says 172.21.15.196:35280) 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731697b640 1 -- 172.21.15.196:0/3753273818 learned_addr learned my addr 172.21.15.196:0/3753273818 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731617a640 1 --1- 172.21.15.196:0/3753273818 >> v1:172.21.15.29:6789/0 conn(0x55c8362c0720 0x55c8362c2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58002/0 (socket says 172.21.15.196:58002) 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731697b640 1 -- 172.21.15.196:0/3753273818 >> v1:172.21.15.29:6789/0 conn(0x55c8362c0720 legacy=0x55c8362c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.781+0000 7f731697b640 1 -- 172.21.15.196:0/3753273818 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c836184e00 con 0x55c836231650 2024-09-21T08:52:19.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f731697b640 1 --2- 172.21.15.196:0/3753273818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8362c01e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f730800a520 tx=0x7f7308045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765070a95ce90f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7315979640 1 -- 172.21.15.196:0/3753273818 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7308055070 con 0x55c836231650 2024-09-21T08:52:19.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7315979640 1 -- 172.21.15.196:0/3753273818 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73080515b0 con 0x55c836231650 2024-09-21T08:52:19.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7315979640 1 -- 172.21.15.196:0/3753273818 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73080518d0 con 0x55c836231650 2024-09-21T08:52:19.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7318e87800 1 -- 172.21.15.196:0/3753273818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 msgr2=0x55c8362c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7318e87800 1 --2- 172.21.15.196:0/3753273818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8362c01e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f730800a520 tx=0x7f7308045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7318e87800 1 -- 172.21.15.196:0/3753273818 shutdown_connections 2024-09-21T08:52:19.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7318e87800 1 --2- 172.21.15.196:0/3753273818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8362c01e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.783+0000 7f7318e87800 1 -- 172.21.15.196:0/3753273818 >> 172.21.15.196:0/3753273818 conn(0x55c8362b7db0 msgr2=0x55c8362ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.784+0000 7f7318e87800 1 -- 172.21.15.196:0/3753273818 shutdown_connections 2024-09-21T08:52:19.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.784+0000 7f7318e87800 1 -- 172.21.15.196:0/3753273818 wait complete. 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.797+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.797+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.797+0000 7f7318e87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.797+0000 7f7318e87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c836209360 con 0x55c836231650 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f731697b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f731697b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35298/0 (socket says 172.21.15.196:35298) 2024-09-21T08:52:19.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f731697b640 1 -- 172.21.15.196:0/3154242531 learned_addr learned my addr 172.21.15.196:0/3154242531 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f731697b640 1 -- 172.21.15.196:0/3154242531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c836156bc0 con 0x55c836231650 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f731697b640 1 --2- 172.21.15.196:0/3154242531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7308025da0 tx=0x7f7308051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cba6d0173ad0f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f7204e09640 1 -- 172.21.15.196:0/3154242531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7308051950 con 0x55c836231650 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f7204e09640 1 -- 172.21.15.196:0/3154242531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7308051af0 con 0x55c836231650 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.798+0000 7f7204e09640 1 -- 172.21.15.196:0/3154242531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7308051dd0 con 0x55c836231650 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- 172.21.15.196:0/3154242531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 msgr2=0x55c8363ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 --2- 172.21.15.196:0/3154242531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7308025da0 tx=0x7f7308051000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- 172.21.15.196:0/3154242531 shutdown_connections 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 --2- 172.21.15.196:0/3154242531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363ac880 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- 172.21.15.196:0/3154242531 >> 172.21.15.196:0/3154242531 conn(0x55c8362b7db0 msgr2=0x55c8363a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- 172.21.15.196:0/3154242531 shutdown_connections 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- 172.21.15.196:0/3154242531 wait complete. 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.799+0000 7f7318e87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c8362c4620 con 0x55c836231650 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f731697b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f731697b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35312/0 (socket says 172.21.15.196:35312) 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f731697b640 1 -- 172.21.15.196:0/1349252867 learned_addr learned my addr 172.21.15.196:0/1349252867 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f731697b640 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83616afe0 con 0x55c836231650 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f731697b640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7308067040 tx=0x7f7308002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f7203606640 1 -- 172.21.15.196:0/1349252867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7308073070 con 0x55c836231650 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f7203606640 1 -- 172.21.15.196:0/1349252867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730805a450 con 0x55c836231650 2024-09-21T08:52:19.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8363b6870 con 0x55c836231650 2024-09-21T08:52:19.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f7203606640 1 -- 172.21.15.196:0/1349252867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730805a730 con 0x55c836231650 2024-09-21T08:52:19.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.800+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8363b6df0 con 0x55c836231650 2024-09-21T08:52:19.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.801+0000 7f7203606640 1 -- 172.21.15.196:0/1349252867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7308076070 con 0x55c836231650 2024-09-21T08:52:19.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.801+0000 7f7203606640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 0x7f71fc0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.801+0000 7f7203606640 1 -- 172.21.15.196:0/1349252867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7308062070 con 0x55c836231650 2024-09-21T08:52:19.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.801+0000 7f731617a640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 0x7f71fc0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.801+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 0x55c8363bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363bd920 con 0x55c8362c0720 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f731717c640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 0x55c8363bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f731617a640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 0x7f71fc0390a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f731717c640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 0x55c8363bd3a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f731717c640 1 -- 172.21.15.196:0/1349252867 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f731000a4a0 con 0x55c8362c0720 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363ba970 con 0x55c8362c0720 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.802+0000 7f731717c640 1 -- 172.21.15.196:0/1349252867 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f731000a4a0 con 0x55c8362c0720 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.803+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 0x55c8363c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.803+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363c2730 con 0x55c8363bfc50 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.803+0000 7f731697b640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 0x55c8363c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.803+0000 7f731697b640 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 0x55c8363c2040 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f731697b640 1 -- 172.21.15.196:0/1349252867 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7308075030 con 0x55c8363bfc50 2024-09-21T08:52:19.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363beaf0 con 0x55c8362c0720 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f731717c640 1 -- 172.21.15.196:0/1349252867 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f731000a4a0 con 0x55c8362c0720 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363bef90 con 0x55c8362c0720 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f731717c640 1 -- 172.21.15.196:0/1349252867 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f731000a4a0 con 0x55c8362c0720 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.804+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7318e87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7318e87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c836158580 con 0x55c8363d1080 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35328/0 (socket says 172.21.15.196:35328) 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f731717c640 1 -- 172.21.15.196:0/1152129266 learned_addr learned my addr 172.21.15.196:0/1152129266 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f731717c640 1 -- 172.21.15.196:0/1152129266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8363d19e0 con 0x55c8363d1080 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f731717c640 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55c8363bdd00 tx=0x7f7310018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7200e01640 1 -- 172.21.15.196:0/1152129266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7310014450 con 0x55c8363d1080 2024-09-21T08:52:19.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7200e01640 1 -- 172.21.15.196:0/1152129266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7310014610 con 0x55c8363d1080 2024-09-21T08:52:19.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8363d1c70 con 0x55c8363d1080 2024-09-21T08:52:19.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.805+0000 7f7200e01640 1 -- 172.21.15.196:0/1152129266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7310014930 con 0x55c8363d1080 2024-09-21T08:52:19.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.806+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8363d4950 con 0x55c8363d1080 2024-09-21T08:52:19.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.806+0000 7f7200e01640 1 -- 172.21.15.196:0/1152129266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7310011040 con 0x55c8363d1080 2024-09-21T08:52:19.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.806+0000 7f7200e01640 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 0x7f71f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.806+0000 7f7200e01640 1 -- 172.21.15.196:0/1152129266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f731001e070 con 0x55c8363d1080 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.806+0000 7f731697b640 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 0x7f71f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731697b640 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 0x7f71f0039050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55c8363bdda0 tx=0x7f730808f550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f7318e87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f7318e87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c8363acf70 con 0x55c8363ddce0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35344/0 (socket says 172.21.15.196:35344) 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731717c640 1 -- 172.21.15.196:0/3629685288 learned_addr learned my addr 172.21.15.196:0/3629685288 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731717c640 1 -- 172.21.15.196:0/3629685288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8363de6b0 con 0x55c8363ddce0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.807+0000 7f731717c640 1 --2- 172.21.15.196:0/3629685288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f731004cb80 tx=0x7f731003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb5c16bce848c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f71fa7fc640 1 -- 172.21.15.196:0/3629685288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73100168f0 con 0x55c8363ddce0 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f71fa7fc640 1 -- 172.21.15.196:0/3629685288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7310044020 con 0x55c8363ddce0 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f71fa7fc640 1 -- 172.21.15.196:0/3629685288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7310014c00 con 0x55c8363ddce0 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- 172.21.15.196:0/3629685288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 msgr2=0x55c8363de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 --2- 172.21.15.196:0/3629685288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f731004cb80 tx=0x7f731003bf60 comp rx=0 tx=0).stop 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- 172.21.15.196:0/3629685288 shutdown_connections 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 --2- 172.21.15.196:0/3629685288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363de0e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- 172.21.15.196:0/3629685288 >> 172.21.15.196:0/3629685288 conn(0x55c8363da040 msgr2=0x55c8363d8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- 172.21.15.196:0/3629685288 shutdown_connections 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- 172.21.15.196:0/3629685288 wait complete. 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 Processor -- start 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.808+0000 7f7318e87800 1 -- start start 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f7318e87800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f7318e87800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c8363ded20 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f731717c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35346/0 (socket says 172.21.15.196:35346) 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 learned_addr learned my addr 172.21.15.196:0/3089258535 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8363e56c0 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f731717c640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f731003bfa0 tx=0x7f731004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f71f8ff9640 1 -- 172.21.15.196:0/3089258535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7310022e60 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f71f8ff9640 1 -- 172.21.15.196:0/3089258535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731004b460 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8363e5950 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f71f8ff9640 1 -- 172.21.15.196:0/3089258535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731004b740 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.809+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8363e8600 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.810+0000 7f71f8ff9640 1 -- 172.21.15.196:0/3089258535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f731004e960 con 0x55c8363ddce0 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.810+0000 7f71f8ff9640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71e0036b90 0x7f71e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.810+0000 7f71f8ff9640 1 -- 172.21.15.196:0/3089258535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7310033030 con 0x55c8363ddce0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.810+0000 7f731697b640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71e0036b90 0x7f71e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f731697b640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71e0036b90 0x7f71e0039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7308005a60 tx=0x7f7308092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8363f0e00 0x55c8363f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f3a10 con 0x55c8363f0e00 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f731617a640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8363f0e00 0x55c8363f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.811+0000 7f731617a640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8363f0e00 0x55c8363f32c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730000f610 con 0x55c8363f0e00 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 realm 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f0250 con 0x55c8363f0e00 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730000f610 con 0x55c8363f0e00 2024-09-21T08:52:19.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f4500 con 0x55c8363f0e00 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730000f610 con 0x55c8363f0e00 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f4dd0 con 0x55c8363f0e00 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730000f610 con 0x55c8363f0e00 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363f57f0 0x55c8363f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.812+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f82d0 con 0x55c8363f57f0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f731717c640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363f57f0 0x55c8363f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f731717c640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363f57f0 0x55c8363f7be0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f7318e87800 20 searching for the correct realm 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c8363fa2a0 0x55c8363fc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.813+0000 7f731697b640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c8363fa2a0 0x55c8363fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731697b640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c8363fa2a0 0x55c8363fc760 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731697b640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f73080a1040 0x7f730808f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731617a640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f73080a1040 0x7f730808f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.814+0000 7f731617a640 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f73080a1040 0x7f730808f670 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730000f610 con 0x7f73080a1040 2024-09-21T08:52:19.826 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730000f610 con 0x55c8363f0e00 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.815+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.816+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.817+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.818+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.819+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.820+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.821+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363fa2a0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f57f0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x55c8363f0e00 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fce30 con 0x7f73080a1040 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:19.839 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.822+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f8c90 con 0x55c8363f0e00 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f88d0 con 0x55c8363f0e00 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363f9630 con 0x55c8363f0e00 2024-09-21T08:52:19.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 zone default found 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 4 Realm: () 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 zonegroup default 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.823+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363fd340 con 0x55c8363f57f0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363ff610 con 0x55c8363fa2a0 2024-09-21T08:52:19.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8363ff9b0 con 0x55c8363fa2a0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 started sync module instance, tier type = 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.824+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8363feaa0 con 0x7f73080a1040 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.825+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.825+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94318391980016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8363feaa0 con 0x7f73080a1040 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.825+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364003e0 con 0x55c8363f0e00 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.826+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94318391980016] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.826+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.826+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94318391977456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364003e0 con 0x55c8363f0e00 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.827+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836400e40 con 0x55c8363fa2a0 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.828+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94318391977456] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.828+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.828+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94318391983920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364011e0 con 0x55c8363fa2a0 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.828+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836401be0 con 0x7f73080a1040 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.829+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94318391983920] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.829+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.829+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94318391986512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836402000 con 0x7f73080a1040 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.829+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836402a00 con 0x55c8363f0e00 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.830+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94318391986512] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.830+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.830+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94318391990000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364029c0 con 0x55c8363f0e00 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.830+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836403440 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.831+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94318391990000] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.831+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.831+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94318391994096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836403440 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.831+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836403e00 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.832+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94318391994096] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.832+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.832+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94318391999280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836403440 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.832+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836404870 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.833+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94318391999280] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.833+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94318392001376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836404a50 con 0x55c8363f57f0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=0 2024-09-21T08:52:19.844 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=1 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=2 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=3 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=4 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=5 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f7318e87800 20 add_watcher() i=6 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.834+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94318392001376] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.835+0000 7f7318e87800 20 add_watcher() i=7 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.835+0000 7f7318e87800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.835+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836407e20 con 0x55c8363f0e00 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.835+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.835+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94318392002880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836405240 con 0x55c8363f0e00 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.836+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94318392002880] v36'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.836+0000 7f71cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.836+0000 7f7318e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:19.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.836+0000 7f7318e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:19.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.836+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364107f0 con 0x55c8363f0e00 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.837+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.837+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836410e40 con 0x55c8363f57f0 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.838+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.838+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836410e40 con 0x55c8363fa2a0 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.839+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.839+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836411710 con 0x55c8363f0e00 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.840+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.840+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83640c4a0 con 0x7f73080a1040 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.841+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.841+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83640c460 con 0x55c8363fa2a0 2024-09-21T08:52:19.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.842+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.842+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412250 con 0x55c8363f0e00 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.843+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.843+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412250 con 0x55c8363f57f0 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.844+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.844+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412250 con 0x7f73080a1040 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.845+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.845+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412250 con 0x55c8363fa2a0 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.846+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.846+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364122e0 con 0x7f73080a1040 2024-09-21T08:52:19.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.847+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.847+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364122e0 con 0x55c8363f57f0 2024-09-21T08:52:19.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.849+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.849+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x7f73080a1040 2024-09-21T08:52:19.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.850+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.850+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f57f0 2024-09-21T08:52:19.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.851+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.851+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f0e00 2024-09-21T08:52:19.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.852+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.852+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.853+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.853+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x7f73080a1040 2024-09-21T08:52:19.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.854+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.854+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.854+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.854+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f0e00 2024-09-21T08:52:19.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.855+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.855+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f0e00 2024-09-21T08:52:19.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.856+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.856+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.857+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.857+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x7f73080a1040 2024-09-21T08:52:19.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.858+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.858+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.859+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.859+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.860+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.860+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.861+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.862 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.861+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.863 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.862+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.863 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.862+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f57f0 2024-09-21T08:52:19.864 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.863+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.863+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.864+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.865 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.864+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f57f0 2024-09-21T08:52:19.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.865+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.865+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363fa2a0 2024-09-21T08:52:19.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.866+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.866+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x55c8363f57f0 2024-09-21T08:52:19.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.867+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.867+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836412370 con 0x7f73080a1040 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.868+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.868+0000 7f7147fff640 20 reqs_thread_entry: start 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.868+0000 7f7318e87800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 20 Filter name: none 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7145ffb640 20 reqs_thread_entry: start 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83643d670 con 0x7f73080a1040 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:52:19.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 : miss 2024-09-21T08:52:19.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.869+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 8.1e 8:7fe62c92:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83643efb0 con 0x55c8363f57f0 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(95 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 info.flags=0x17 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 to cache LRU end 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:19.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 4.3e 4:7fd7db12:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bc7e0 con 0x7f73080a1040 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(96 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:97 4.4 4:204700ec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bc7e0 con 0x55c8363f57f0 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(97 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.870+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bc7e0 con 0x55c8363f0e00 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(98 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f730002b040 con 0x55c8363f0e00 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f7318e87800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-21T08:52:19.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 4.11 4:89d5d818:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x55c8363f57f0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(99 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 4.8 4:12947004:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x55c8363fa2a0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(100 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.871+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 4.3b 4:de53e20c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x55c8363fa2a0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(101 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:102 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x7f73080a1040 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(102 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [call out=425b] v0'0 uv11 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f7318e87800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:103 4.1b 4:d81cd92e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x7f73080a1040 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(103 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f730002b040 con 0x7f73080a1040 2024-09-21T08:52:19.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.872+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x7f73080a1040 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(104 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [call out=425b] v0'0 uv8 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:105 4.13 4:cb1bdbde:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x7f73080a1040 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(105 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:106 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364bcc60 con 0x55c8363f0e00 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(106 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [call out=696b] v0'0 uv17 ondisk = 0) ==== 195+0+696 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c8364bbe18 s->prefetch_data=0 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.873+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:107 3.35s0 3:ac130571:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364ba310 con 0x55c8363f0e00 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(107 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 10 manifest: total_size = 6 2024-09-21T08:52:19.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.17812140275728274856 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c8364bbe18 s->prefetch_data=0 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 20 prepare_atomic_modification: state is not atomic. state=0x55c8364bbe18 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.874+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:108 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836444980 con 0x55c8363f0e00 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.875+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(108 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.875+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:109 3.35s0 3:ac130571:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836444980 con 0x55c8363f0e00 2024-09-21T08:52:19.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.876+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(109 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_9c8454ddf7aa50116496bac348d7550d [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.876+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:110 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x55c8363f0e00 2024-09-21T08:52:19.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.876+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.876+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 3.24s0 3:2773ac55:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x55c8363f57f0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(111 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 10 manifest: total_size = 3 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9252781933153034483 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 20 prepare_atomic_modification: state is not atomic. state=0x55c836445d98 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:112 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x7f73080a1040 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(110 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.877+0000 7f71fa7fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.878+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(112 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.878+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:113 3.24s0 3:2773ac55:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836444f60 con 0x55c8363f57f0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.879+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(113 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_b1b9a972ccd8c962a473909b97007eb4 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.879+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:114 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.879+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.879+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:115 3.26s0 3:66d208fc:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836446bc0 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(115 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 10 manifest: total_size = 4 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.2485826874409823012 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 20 prepare_atomic_modification: state is not atomic. state=0x55c836445d98 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.880+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:116 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.881+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(114 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.881+0000 7f71f9ffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.881+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(116 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.881+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:117 3.26s0 3:66d208fc:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836444f60 con 0x7f73080a1040 2024-09-21T08:52:19.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.882+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(117 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.882+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:118 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445410 con 0x7f73080a1040 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.882+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.882+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:119 3.27s0 3:e789a054:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836446bc0 con 0x55c8363f57f0 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(119 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 10 manifest: total_size = 5 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.909370734248523039 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 20 prepare_atomic_modification: state is not atomic. state=0x55c836445d98 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 2024-09-21T08:52:19.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:120 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b340 con 0x55c8363f0e00 2024-09-21T08:52:19.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(118 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [stat,call,call] v36'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.883+0000 7f71fa7fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-21T08:52:19.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.884+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(120 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [stat,call,call] v36'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.884+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:121 3.27s0 3:e789a054:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644ae90 con 0x55c8363f57f0 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.885+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(121 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_24d27c169c2c881eb09a065116f2aa5c [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.885+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:122 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x55c8363f0e00 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.885+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.885+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:123 3.10s0 3:08da35ff:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x55c8363f0e00 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(123 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 10 manifest: total_size = 5 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 20 get_obj_state: setting s->obj_tag to _I9r6OB_Lc9I8JtoyKM3nCECNY-Ls1NS 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 20 get_obj_state: octx=0x7f7310023cb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c836445d98 s->prefetch_data=0 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 20 prepare_atomic_modification: state is not atomic. state=0x55c836445d98 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:124 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x55c8363f0e00 2024-09-21T08:52:19.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(122 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [stat,call,call] v36'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.886+0000 7f71f9ffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.887+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(124 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [stat,call,call] v36'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.887+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:125 3.10s0 3:08da35ff:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(125 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5_bb3aec0fdcdbc2974890f805c585d432 [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:126 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 20 list_objects_ordered: starting attempt 1 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:127 4.3e 4:7fd7db12:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83644b2e0 con 0x7f73080a1040 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:128 4.4 4:204700ec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836446000 con 0x55c8363f57f0 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:129 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a1a0 con 0x55c8363f0e00 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:130 4.11 4:89d5d818:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836450e20 con 0x55c8363f57f0 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:131 4.8 4:12947004:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836453690 con 0x55c8363fa2a0 2024-09-21T08:52:19.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:132 4.3b 4:de53e20c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c8364561c0 con 0x55c8363fa2a0 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:133 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836458f60 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:134 4.1b 4:d81cd92e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836450e20 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.888+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(127 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(128 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:135 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836458f60 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(130 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:136 4.13 4:cb1bdbde:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836445b90 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:137 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83644ee00 con 0x55c8363f0e00 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(131 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(134 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(133 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(129 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(132 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7308075030 con 0x55c8363fa2a0 2024-09-21T08:52:19.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(135 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(136 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(126 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [stat,call,call] v36'21 uv21 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.889+0000 7f71fa7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(137 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [call out=124b] v0'0 uv21 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5])"; uploads.size()=0; is_truncated=0 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:138 4.3e 4:7fd7db12:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836445b30 con 0x7f73080a1040 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:139 4.4 4:204700ec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836458dc0 con 0x55c8363f57f0 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:140 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836454aa0 con 0x55c8363f0e00 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:141 4.11 4:89d5d818:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x55c8363f57f0 2024-09-21T08:52:19.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:142 4.8 4:12947004:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836442c20 con 0x55c8363fa2a0 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:143 4.3b 4:de53e20c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836445b30 con 0x55c8363fa2a0 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:144 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:145 4.1b 4:d81cd92e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836454aa0 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:146 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83645a390 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:147 4.13 4:cb1bdbde:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:148 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83645f150 con 0x55c8363f0e00 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(140 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(142 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f73080b6060 con 0x55c8363fa2a0 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(139 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(141 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(138 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(144 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(145 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(148 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [call out=124b] v0'0 uv21 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.890+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(143 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f73080b6060 con 0x55c8363fa2a0 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.891+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(146 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.891+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(147 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.891+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x7f73080a1040 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.892+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(149 foo.buckets [call] v36'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.892+0000 7f7318e87800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-21T08:52:19.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.892+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x7f73080a1040 2024-09-21T08:52:19.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(150 myfoo [call,call,delete] v36'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f7318e87800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f7318e87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94318392269568 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c836440310 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== watch-notify(notify (1) cookie 94318391999280 notify 154618822679 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c83643d560 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f71f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 94318391999280 notifier 4657 bl.length()=149 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(151 notify.6 [notify cookie 94318392269568 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f71f9ffb640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f714c0032c0 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.893+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.894+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== watch-notify(notify_complete (2) cookie 94318392269568 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c8363e5950 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.894+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:153 8.1e 8:7fe62c92:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836441320 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(153 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 from cache 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5, ofs0, ns] 2024-09-21T08:52:19.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94318392269568 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83643f670 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== watch-notify(notify (1) cookie 94318391994096 notify 154618822680 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c8363e5950 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f71fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 94318391994096 notifier 4657 bl.length()=206 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(154 notify.5 [notify cookie 94318392269568 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f71fa7fc640 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f71dc003d60 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731002a070 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== watch-notify(notify_complete (2) cookie 94318392269568 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c8363e56c0 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:156 4.3e 4:7fd7db12:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445b00 con 0x7f73080a1040 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:157 4.4 4:204700ec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836443370 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:158 4.2 4:420b5d5d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836443c00 con 0x55c8363f0e00 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:159 4.11 4:89d5d818:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83643df10 con 0x55c8363f57f0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:160 4.8 4:12947004:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83643c1b0 con 0x55c8363fa2a0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:161 4.3b 4:de53e20c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836443370 con 0x55c8363fa2a0 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:162 4.22 4:44595218:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836445b00 con 0x7f73080a1040 2024-09-21T08:52:19.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:163 4.1b 4:d81cd92e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c8364407c0 con 0x7f73080a1040 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:164 4.1b 4:d8775b59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83643df10 con 0x7f73080a1040 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:165 4.13 4:cb1bdbde:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83643c1b0 con 0x7f73080a1040 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.895+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:166 4.3c 4:3cc20f61:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c836443c00 con 0x55c8363f0e00 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(157 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(159 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(166 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.10 [delete] v36'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(158 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.2 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 42 ==== osd_op_reply(156 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.0 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(161 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.5 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73080b6060 con 0x55c8363fa2a0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.897+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(160 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.4 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73080b6060 con 0x55c8363fa2a0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.899+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 43 ==== osd_op_reply(163 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.7 [delete] v36'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.899+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 44 ==== osd_op_reply(162 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.6 [delete] v36'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.899+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 45 ==== osd_op_reply(164 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.8 [delete] v36'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 46 ==== osd_op_reply(165 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5.9 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 : miss 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 20 rados->read ofs=0 len=0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:167 6.1d 6:beb3b447:::pubsub..bucket.myfoo%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f57f0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== osd_op_reply(167 pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 info.flags=0x0 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 10 adding default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 to cache LRU end 2024-09-21T08:52:19.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.900+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:168 6.1d 6:beb3b447:::pubsub..bucket.myfoo%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f57f0 2024-09-21T08:52:19.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.901+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(168 pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5 [delete] v36'44 uv37 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.901+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x7f73080a1040 2024-09-21T08:52:19.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.902+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 47 ==== osd_op_reply(169 foo.buckets [call] v36'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.903+0000 7f71cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:19.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.903+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94318392002880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f0e00 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.904+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94318392002880] v36'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.904+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94318391980016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x7f73080a1040 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.905+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 48 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94318391980016] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.905+0000 7f7318e87800 20 remove_watcher() i=0 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.905+0000 7f7318e87800 2 removed watcher, disabling cache 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.905+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94318391977456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f0e00 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.906+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94318391977456] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.906+0000 7f7318e87800 20 remove_watcher() i=1 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.906+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94318391983920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363fa2a0 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.907+0000 7f731697b640 1 -- 172.21.15.196:0/3089258535 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94318391983920] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73080b6060 con 0x55c8363fa2a0 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.907+0000 7f7318e87800 20 remove_watcher() i=2 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.907+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94318391986512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x7f73080a1040 2024-09-21T08:52:19.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.908+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.2 v2:172.21.15.196:6816/3551232799 49 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94318391986512] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300046040 con 0x7f73080a1040 2024-09-21T08:52:19.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.908+0000 7f7318e87800 20 remove_watcher() i=3 2024-09-21T08:52:19.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.908+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94318391990000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f0e00 2024-09-21T08:52:19.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.909+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94318391990000] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7300046040 con 0x55c8363f0e00 2024-09-21T08:52:19.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.909+0000 7f7318e87800 20 remove_watcher() i=4 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.909+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94318391994096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f57f0 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.910+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 49 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94318391994096] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.910+0000 7f7318e87800 20 remove_watcher() i=5 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.910+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94318391999280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f57f0 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.911+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 50 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94318391999280] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.911+0000 7f7318e87800 20 remove_watcher() i=6 2024-09-21T08:52:19.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.911+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94318392001376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c83644a580 con 0x55c8363f57f0 2024-09-21T08:52:19.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f731717c640 1 -- 172.21.15.196:0/3089258535 <== osd.0 v2:172.21.15.29:6800/3430791726 51 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94318392001376] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7310075040 con 0x55c8363f57f0 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 20 remove_watcher() i=7 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363f57f0 msgr2=0x55c8363f7be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363f57f0 0x55c8363f7be0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8363f0e00 msgr2=0x55c8363f32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8363f0e00 0x55c8363f32c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f73080a1040 msgr2=0x7f730808f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f73080a1040 0x7f730808f670 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c8363fa2a0 msgr2=0x55c8363fc760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c8363fa2a0 0x55c8363fc760 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71e0036b90 msgr2=0x7f71e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71e0036b90 0x7f71e0039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7308005a60 tx=0x7f7308092000 comp rx=0 tx=0).stop 2024-09-21T08:52:19.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 msgr2=0x55c8363e5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f731617a640 1 -- 172.21.15.196:0/3089258535 reap_dead start 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f731003bfa0 tx=0x7f731004cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 shutdown_connections 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 --2- 172.21.15.196:0/3089258535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363ddce0 0x55c8363e5180 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 >> 172.21.15.196:0/3089258535 conn(0x55c8363da040 msgr2=0x55c8363d8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 shutdown_connections 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.912+0000 7f7318e87800 1 -- 172.21.15.196:0/3089258535 wait complete. 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 msgr2=0x7f71f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 0x7f71f0039050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55c8363bdda0 tx=0x7f730808f550 comp rx=0 tx=0).stop 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 msgr2=0x55c8363d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55c8363bdd00 tx=0x7f7310018830 comp rx=0 tx=0).stop 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 shutdown_connections 2024-09-21T08:52:19.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71f0036b90 0x7f71f0039050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1152129266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c8363d1080 0x55c8363d14a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 >> 172.21.15.196:0/1152129266 conn(0x55c8363c6010 msgr2=0x55c8363c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 shutdown_connections 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1152129266 wait complete. 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 msgr2=0x55c8363c2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 0x55c8363c2040 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 msgr2=0x55c8363bd3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 0x55c8363bd3a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 msgr2=0x7f71fc0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 0x7f71fc0390a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300001370 comp rx=0 tx=0).stop 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 msgr2=0x55c8363b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7308067040 tx=0x7f7308002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 shutdown_connections 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c8363bfc50 0x55c8363c2040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c8362c0720 0x55c8363bd3a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f71fc036be0 0x7f71fc0390a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 --2- 172.21.15.196:0/1349252867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c836231650 0x55c8363b6330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 >> 172.21.15.196:0/1349252867 conn(0x55c8362b7db0 msgr2=0x55c8363a6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 shutdown_connections 2024-09-21T08:52:19.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.913+0000 7f7318e87800 1 -- 172.21.15.196:0/1349252867 wait complete. 2024-09-21T08:52:19.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T08:52:19.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T08:52:19.924 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-21T08:52:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:19.970 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff719151800 1 -- start start 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff719151800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560231d1f880 0x560231d21c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff719151800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560231bdab30 con 0x560231c8eeb0 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff719151800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x560231bbc360 con 0x560231d1f880 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff70ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560231d1f880 0x560231d21c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff70ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560231d1f880 0x560231d21c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35354/0 (socket says 172.21.15.196:35354) 2024-09-21T08:52:19.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff716c45640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x560231c8eeb0 0x560231d1e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58018/0 (socket says 172.21.15.196:58018) 2024-09-21T08:52:19.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.969+0000 7ff70ffff640 1 -- 172.21.15.196:0/1512604185 learned_addr learned my addr 172.21.15.196:0/1512604185 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.970+0000 7ff70ffff640 1 -- 172.21.15.196:0/1512604185 >> v1:172.21.15.29:6789/0 conn(0x560231c8eeb0 legacy=0x560231d1e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.970+0000 7ff70ffff640 1 -- 172.21.15.196:0/1512604185 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231be2e00 con 0x560231d1f880 2024-09-21T08:52:19.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.971+0000 7ff70ffff640 1 --2- 172.21.15.196:0/1512604185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1f880 0x560231d21c90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff70000a520 tx=0x7ff700045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb423918e465f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff716444640 1 -- 172.21.15.196:0/1512604185 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff700055070 con 0x560231d1f880 2024-09-21T08:52:19.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff716444640 1 -- 172.21.15.196:0/1512604185 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000515b0 con 0x560231d1f880 2024-09-21T08:52:19.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff716444640 1 -- 172.21.15.196:0/1512604185 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7000518d0 con 0x560231d1f880 2024-09-21T08:52:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 -- 172.21.15.196:0/1512604185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1f880 msgr2=0x560231d21c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 --2- 172.21.15.196:0/1512604185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1f880 0x560231d21c90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff70000a520 tx=0x7ff700045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 -- 172.21.15.196:0/1512604185 shutdown_connections 2024-09-21T08:52:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 --2- 172.21.15.196:0/1512604185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1f880 0x560231d21c90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 -- 172.21.15.196:0/1512604185 >> 172.21.15.196:0/1512604185 conn(0x560231d15dd0 msgr2=0x560231d181f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 -- 172.21.15.196:0/1512604185 shutdown_connections 2024-09-21T08:52:19.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.972+0000 7ff719151800 1 -- 172.21.15.196:0/1512604185 wait complete. 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.986+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.986+0000 7ff719151800 1 -- start start 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.986+0000 7ff719151800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.986+0000 7ff719151800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560231c67360 con 0x560231c8eeb0 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff716c45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff716c45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35360/0 (socket says 172.21.15.196:35360) 2024-09-21T08:52:19.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff716c45640 1 -- 172.21.15.196:0/9507822 learned_addr learned my addr 172.21.15.196:0/9507822 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff716c45640 1 -- 172.21.15.196:0/9507822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231bb4bc0 con 0x560231c8eeb0 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff716c45640 1 --2- 172.21.15.196:0/9507822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff708001e40 tx=0x7ff708001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c033c6610d7e50ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff604e09640 1 -- 172.21.15.196:0/9507822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70800e5c0 con 0x560231c8eeb0 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff604e09640 1 -- 172.21.15.196:0/9507822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff708006070 con 0x560231c8eeb0 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.987+0000 7ff604e09640 1 -- 172.21.15.196:0/9507822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70800e910 con 0x560231c8eeb0 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- 172.21.15.196:0/9507822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 msgr2=0x560231e0a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 --2- 172.21.15.196:0/9507822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff708001e40 tx=0x7ff708001e70 comp rx=0 tx=0).stop 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- 172.21.15.196:0/9507822 shutdown_connections 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 --2- 172.21.15.196:0/9507822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e0a8a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:19.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- 172.21.15.196:0/9507822 >> 172.21.15.196:0/9507822 conn(0x560231d15dd0 msgr2=0x560231e06260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- 172.21.15.196:0/9507822 shutdown_connections 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- 172.21.15.196:0/9507822 wait complete. 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- start start 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.988+0000 7ff719151800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560231d22610 con 0x560231c8eeb0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff716c45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff716c45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35366/0 (socket says 172.21.15.196:35366) 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff716c45640 1 -- 172.21.15.196:0/2994606640 learned_addr learned my addr 172.21.15.196:0/2994606640 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff716c45640 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231bc8fe0 con 0x560231c8eeb0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff716c45640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff708004000 tx=0x7ff708000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff603606640 1 -- 172.21.15.196:0/2994606640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70801a7c0 con 0x560231c8eeb0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff603606640 1 -- 172.21.15.196:0/2994606640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70801a960 con 0x560231c8eeb0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560231e127f0 con 0x560231c8eeb0 2024-09-21T08:52:19.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff603606640 1 -- 172.21.15.196:0/2994606640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff70801acc0 con 0x560231c8eeb0 2024-09-21T08:52:19.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.989+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560231e12d10 con 0x560231c8eeb0 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.990+0000 7ff603606640 1 -- 172.21.15.196:0/2994606640 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff708017070 con 0x560231c8eeb0 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.990+0000 7ff603606640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 0x7ff5fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.990+0000 7ff603606640 1 -- 172.21.15.196:0/2994606640 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff708015020 con 0x560231c8eeb0 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.990+0000 7ff70ffff640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 0x7ff5fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 0x560231e19320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e19860 con 0x560231d1f880 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff717446640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 0x560231e19320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff70ffff640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 0x7ff5fc039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff700057000 tx=0x7ff700052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff717446640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 0x560231e19320 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff717446640 1 -- 172.21.15.196:0/2994606640 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff71000a4a0 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.991+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e168f0 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff717446640 1 -- 172.21.15.196:0/2994606640 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff71000a4a0 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 0x560231e1df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e1e670 con 0x560231e1bb90 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff716c45640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 0x560231e1df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff716c45640 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 0x560231e1df80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff716c45640 1 -- 172.21.15.196:0/2994606640 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff70802e070 con 0x560231e1bb90 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.992+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e1aa30 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.993+0000 7ff717446640 1 -- 172.21.15.196:0/2994606640 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff71000a4a0 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.993+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e1aed0 con 0x560231d1f880 2024-09-21T08:52:19.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.993+0000 7ff717446640 1 -- 172.21.15.196:0/2994606640 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff71000a4a0 con 0x560231d1f880 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.993+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.993+0000 7ff719151800 1 -- start start 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff719151800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff719151800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560231bb6580 con 0x560231d1bb10 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35382/0 (socket says 172.21.15.196:35382) 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff717446640 1 -- 172.21.15.196:0/1140214926 learned_addr learned my addr 172.21.15.196:0/1140214926 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff717446640 1 -- 172.21.15.196:0/1140214926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231d1bf30 con 0x560231d1bb10 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff717446640 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x560231e19c40 tx=0x7ff710018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff600e01640 1 -- 172.21.15.196:0/1140214926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff710014450 con 0x560231d1bb10 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff600e01640 1 -- 172.21.15.196:0/1140214926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff710014610 con 0x560231d1bb10 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff600e01640 1 -- 172.21.15.196:0/1140214926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff710014930 con 0x560231d1bb10 2024-09-21T08:52:19.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560231d1a760 con 0x560231d1bb10 2024-09-21T08:52:19.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.994+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560231d1ac60 con 0x560231d1bb10 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.995+0000 7ff600e01640 1 -- 172.21.15.196:0/1140214926 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff710011040 con 0x560231d1bb10 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.995+0000 7ff600e01640 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 0x7ff5f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.995+0000 7ff600e01640 1 -- 172.21.15.196:0/1140214926 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff71001e070 con 0x560231d1bb10 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.995+0000 7ff716c45640 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 0x7ff5f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff716c45640 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 0x7ff5f0039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x560231e19ce0 tx=0x7ff70804b710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff719151800 1 -- start start 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff719151800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff719151800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560231e0b050 con 0x560231e3be70 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35386/0 (socket says 172.21.15.196:35386) 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff717446640 1 -- 172.21.15.196:0/4159834907 learned_addr learned my addr 172.21.15.196:0/4159834907 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff717446640 1 -- 172.21.15.196:0/4159834907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231e3c840 con 0x560231e3be70 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.996+0000 7ff717446640 1 --2- 172.21.15.196:0/4159834907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff71004cba0 tx=0x7ff71002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917dbcb665ec5109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff5fa7fc640 1 -- 172.21.15.196:0/4159834907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff710028040 con 0x560231e3be70 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff5fa7fc640 1 -- 172.21.15.196:0/4159834907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7100400c0 con 0x560231e3be70 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff5fa7fc640 1 -- 172.21.15.196:0/4159834907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff710016980 con 0x560231e3be70 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- 172.21.15.196:0/4159834907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 msgr2=0x560231e3c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 --2- 172.21.15.196:0/4159834907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff71004cba0 tx=0x7ff71002b410 comp rx=0 tx=0).stop 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- 172.21.15.196:0/4159834907 shutdown_connections 2024-09-21T08:52:20.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 --2- 172.21.15.196:0/4159834907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e3c270 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- 172.21.15.196:0/4159834907 >> 172.21.15.196:0/4159834907 conn(0x560231e381d0 msgr2=0x560231e362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- 172.21.15.196:0/4159834907 shutdown_connections 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- 172.21.15.196:0/4159834907 wait complete. 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 Processor -- start 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.997+0000 7ff719151800 1 -- start start 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff719151800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff719151800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560231e3ceb0 con 0x560231e3be70 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff717446640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35398/0 (socket says 172.21.15.196:35398) 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 learned_addr learned my addr 172.21.15.196:0/197989256 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560231e438c0 con 0x560231e3be70 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff717446640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff710011b50 tx=0x7ff71004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff5f8ff9640 1 -- 172.21.15.196:0/197989256 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff710028050 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff5f8ff9640 1 -- 172.21.15.196:0/197989256 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff710016980 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560231e43b50 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff5f8ff9640 1 -- 172.21.15.196:0/197989256 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff71004b230 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.998+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560231e46800 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.999+0000 7ff5f8ff9640 1 -- 172.21.15.196:0/197989256 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff71004b3d0 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.999+0000 7ff5f8ff9640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5e0036b90 0x7ff5e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:19.999+0000 7ff5f8ff9640 1 -- 172.21.15.196:0/197989256 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff71000e040 con 0x560231e3be70 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff716c45640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5e0036b90 0x7ff5e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff716c45640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5e0036b90 0x7ff5e0039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7080012d0 tx=0x7ff70804c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231e4ed90 0x560231e51250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e519a0 con 0x560231e4ed90 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff70ffff640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231e4ed90 0x560231e51250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.000+0000 7ff70ffff640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231e4ed90 0x560231e51250 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 realm 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e51dd0 con 0x560231e4ed90 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e526a0 con 0x560231e4ed90 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e52a40 con 0x560231e4ed90 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e537a0 0x560231e55b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.001+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e561e0 con 0x560231e537a0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff717446640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e537a0 0x560231e55b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff717446640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e537a0 0x560231e55b90 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff719151800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff719151800 20 searching for the correct realm 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560231e58190 0x560231e5a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.002+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff716c45640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560231e58190 0x560231e5a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff716c45640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560231e58190 0x560231e5a650 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff716c45640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff70800f070 0x7ff708017750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff70ffff640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff70800f070 0x7ff708017750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.003+0000 7ff70ffff640 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff70800f070 0x7ff708017750 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.004+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.005+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.006+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.007+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.008+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.009+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e58190 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.010+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x560231e4ed90 2024-09-21T08:52:20.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ad20 con 0x7ff70800f070 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e56ba0 con 0x560231e4ed90 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e567b0 con 0x560231e4ed90 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.011+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e574d0 con 0x560231e4ed90 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 zone default found 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 4 Realm: () 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 zonegroup default 2024-09-21T08:52:20.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e5b1a0 con 0x560231e537a0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e5d420 con 0x560231e58190 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.012+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e5d7c0 con 0x560231e58190 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.013+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.013+0000 7ff719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.013+0000 7ff719151800 20 started sync module instance, tier type = 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.013+0000 7ff719151800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.013+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5c8b0 con 0x7ff70800f070 2024-09-21T08:52:20.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.014+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.014+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567427067312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5c8b0 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.014+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5e210 con 0x560231e4ed90 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.015+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567427067312] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.015+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.015+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567427071264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5c8b0 con 0x560231e4ed90 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.015+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5eab0 con 0x560231e58190 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.017+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.017+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567427071264] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.017+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567427075664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5f720 con 0x560231e58190 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.017+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5c400 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.018+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.018+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567427075664] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.018+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567427078848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e60390 con 0x7ff70800f070 2024-09-21T08:52:20.030 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.018+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5f290 con 0x560231e4ed90 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.019+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.019+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567427082400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5f290 con 0x560231e4ed90 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.019+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567427078848] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.019+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ff00 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.020+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567427082400] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.020+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.020+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567427083456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e61790 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.020+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e62150 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.021+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567427083456] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.021+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.021+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567427085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e62150 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.021+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e62b10 con 0x560231e537a0 2024-09-21T08:52:20.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567427085504] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567427087520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e62cf0 con 0x560231e537a0 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=0 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=1 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=2 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=3 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=4 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=5 2024-09-21T08:52:20.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.022+0000 7ff719151800 20 add_watcher() i=6 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.023+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567427087520] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.023+0000 7ff719151800 20 add_watcher() i=7 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.023+0000 7ff719151800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.023+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e65ee0 con 0x560231e4ed90 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.024+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.024+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567427090592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e63170 con 0x560231e4ed90 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.024+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567427090592] v36'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff5cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:20.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 5 note: GC not initialized 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff547fff640 20 reqs_thread_entry: start 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 20 Filter name: none 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff545ffb640 20 reqs_thread_entry: start 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.025+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e99320 con 0x560231e4ed90 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff719151800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff719151800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff719151800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff719151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:20.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.026+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e9f570 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v36'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff719151800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff719151800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff719151800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94567427338064 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560231e9ada0 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94567427082400 notify 154618822674 ret 0) ==== 621+0+0 (crc 0 0 0) 0x560231be2e00 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff5fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822674 cookie 94567427082400 notifier 4664 bl.length()=579 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94567427338064 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff5fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff5fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff5fa7fc640 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff5dc003ea0 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.027+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94567427338064 notify 154618822674 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff70005bc70 con 0x560231e4ed90 2024-09-21T08:52:20.038 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.028+0000 7ff5cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.028+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567427090592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e97070 con 0x560231e4ed90 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.029+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94567427090592] v36'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.029+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567427067312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e97070 con 0x7ff70800f070 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.030+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94567427067312] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.030+0000 7ff719151800 20 remove_watcher() i=0 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.030+0000 7ff719151800 2 removed watcher, disabling cache 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.030+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567427071264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e97070 con 0x560231e4ed90 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.031+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94567427071264] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.032+0000 7ff719151800 20 remove_watcher() i=1 2024-09-21T08:52:20.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.032+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567427075664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e97070 con 0x560231e58190 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.032+0000 7ff716c45640 1 -- 172.21.15.196:0/197989256 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94567427075664] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff70802e070 con 0x560231e58190 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.032+0000 7ff719151800 20 remove_watcher() i=2 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.032+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567427078848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5dd20 con 0x7ff70800f070 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.033+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94567427078848] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x7ff70800f070 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.033+0000 7ff719151800 20 remove_watcher() i=3 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.033+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567427082400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5ee50 con 0x560231e4ed90 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.034+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94567427082400] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff700057030 con 0x560231e4ed90 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.034+0000 7ff719151800 20 remove_watcher() i=4 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.034+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567427083456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5fac0 con 0x560231e537a0 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.035+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94567427083456] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.035+0000 7ff719151800 20 remove_watcher() i=5 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.035+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567427085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e60d50 con 0x560231e537a0 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.036+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94567427085504] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.036+0000 7ff719151800 20 remove_watcher() i=6 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.036+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567427087520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560231e5dd20 con 0x560231e537a0 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.037+0000 7ff717446640 1 -- 172.21.15.196:0/197989256 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94567427087520] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71002a070 con 0x560231e537a0 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.037+0000 7ff719151800 20 remove_watcher() i=7 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e537a0 msgr2=0x560231e55b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e537a0 0x560231e55b90 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231e4ed90 msgr2=0x560231e51250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231e4ed90 0x560231e51250 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff70800f070 msgr2=0x7ff708017750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff70800f070 0x7ff708017750 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560231e58190 msgr2=0x560231e5a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560231e58190 0x560231e5a650 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5e0036b90 msgr2=0x7ff5e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5e0036b90 0x7ff5e0039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7080012d0 tx=0x7ff70804c000 comp rx=0 tx=0).stop 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 msgr2=0x560231e43380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff70ffff640 1 -- 172.21.15.196:0/197989256 reap_dead start 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff710011b50 tx=0x7ff71004cb30 comp rx=0 tx=0).stop 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 shutdown_connections 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/197989256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231e3be70 0x560231e43380 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 >> 172.21.15.196:0/197989256 conn(0x560231e381d0 msgr2=0x560231e362a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 shutdown_connections 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/197989256 wait complete. 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 msgr2=0x7ff5f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 0x7ff5f0039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x560231e19ce0 tx=0x7ff70804b710 comp rx=0 tx=0).stop 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 msgr2=0x560231d1a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x560231e19c40 tx=0x7ff710018830 comp rx=0 tx=0).stop 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 shutdown_connections 2024-09-21T08:52:20.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5f0036b40 0x7ff5f0039000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 --2- 172.21.15.196:0/1140214926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231d1bb10 0x560231d1a160 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 >> 172.21.15.196:0/1140214926 conn(0x560231e21f50 msgr2=0x560231e24ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 shutdown_connections 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.038+0000 7ff719151800 1 -- 172.21.15.196:0/1140214926 wait complete. 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 msgr2=0x560231e1df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 0x560231e1df80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 msgr2=0x560231e19320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 0x560231e19320 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 msgr2=0x7ff5fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 0x7ff5fc039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff700057000 tx=0x7ff700052000 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 msgr2=0x560231e122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff708004000 tx=0x7ff708000bc0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 shutdown_connections 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560231e1bb90 0x560231e1df80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560231d1f880 0x560231e19320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff5fc036b90 0x7ff5fc039050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 --2- 172.21.15.196:0/2994606640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560231c8eeb0 0x560231e122b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 >> 172.21.15.196:0/2994606640 conn(0x560231d15dd0 msgr2=0x560231e04af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 shutdown_connections 2024-09-21T08:52:20.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.039+0000 7ff719151800 1 -- 172.21.15.196:0/2994606640 wait complete. 2024-09-21T08:52:20.049 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:20.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T08:52:20.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-21T08:52:20.049 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-21T08:52:20.095 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:20.095 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.094+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.094+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.094+0000 7f5ba6b2d800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564b5f668e80 0x564b5f66b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.094+0000 7f5ba6b2d800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b5f521b30 con 0x564b5f6609e0 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.094+0000 7f5ba6b2d800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564b5f503360 con 0x564b5f668e80 2024-09-21T08:52:20.096 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5b9bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564b5f668e80 0x564b5f66b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5b9bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564b5f668e80 0x564b5f66b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35402/0 (socket says 172.21.15.196:35402) 2024-09-21T08:52:20.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5b9bfff640 1 -- 172.21.15.196:0/1467336616 learned_addr learned my addr 172.21.15.196:0/1467336616 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5ba2880640 1 --1- 172.21.15.196:0/1467336616 >> v1:172.21.15.29:6789/0 conn(0x564b5f6609e0 0x564b5f660de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58030/0 (socket says 172.21.15.196:58030) 2024-09-21T08:52:20.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5b9bfff640 1 -- 172.21.15.196:0/1467336616 >> v1:172.21.15.29:6789/0 conn(0x564b5f6609e0 legacy=0x564b5f660de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.095+0000 7f5b9bfff640 1 -- 172.21.15.196:0/1467336616 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f529e00 con 0x564b5f668e80 2024-09-21T08:52:20.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/1467336616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f668e80 0x564b5f66b270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00a520 tx=0x7f5b8c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b121406a37959f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba207f640 1 -- 172.21.15.196:0/1467336616 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c055070 con 0x564b5f668e80 2024-09-21T08:52:20.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba207f640 1 -- 172.21.15.196:0/1467336616 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0515b0 con 0x564b5f668e80 2024-09-21T08:52:20.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba207f640 1 -- 172.21.15.196:0/1467336616 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c0518d0 con 0x564b5f668e80 2024-09-21T08:52:20.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1467336616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f668e80 msgr2=0x564b5f66b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/1467336616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f668e80 0x564b5f66b270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00a520 tx=0x7f5b8c045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1467336616 shutdown_connections 2024-09-21T08:52:20.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/1467336616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f668e80 0x564b5f66b270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1467336616 >> 172.21.15.196:0/1467336616 conn(0x564b5f65c550 msgr2=0x564b5f65e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1467336616 shutdown_connections 2024-09-21T08:52:20.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.097+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1467336616 wait complete. 2024-09-21T08:52:20.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.111+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.111+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba6b2d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba6b2d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b5f5ae360 con 0x564b5f6609e0 2024-09-21T08:52:20.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba2880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba2880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35416/0 (socket says 172.21.15.196:35416) 2024-09-21T08:52:20.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba2880640 1 -- 172.21.15.196:0/1954506877 learned_addr learned my addr 172.21.15.196:0/1954506877 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba2880640 1 -- 172.21.15.196:0/1954506877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f4fbbc0 con 0x564b5f6609e0 2024-09-21T08:52:20.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.112+0000 7f5ba2880640 1 --2- 172.21.15.196:0/1954506877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001e90 tx=0x7f5b9400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b77996d2416c693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5a90e09640 1 -- 172.21.15.196:0/1954506877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9400e5c0 con 0x564b5f6609e0 2024-09-21T08:52:20.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5a90e09640 1 -- 172.21.15.196:0/1954506877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b94006070 con 0x564b5f6609e0 2024-09-21T08:52:20.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5a90e09640 1 -- 172.21.15.196:0/1954506877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9400e890 con 0x564b5f6609e0 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1954506877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 msgr2=0x564b5f753ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/1954506877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001e90 tx=0x7f5b9400b6c0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1954506877 shutdown_connections 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/1954506877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f753ab0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1954506877 >> 172.21.15.196:0/1954506877 conn(0x564b5f65c550 msgr2=0x564b5f74f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1954506877 shutdown_connections 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.113+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/1954506877 wait complete. 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba6b2d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba6b2d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b5f66b9c0 con 0x564b5f6609e0 2024-09-21T08:52:20.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba2880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba2880640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35430/0 (socket says 172.21.15.196:35430) 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.114+0000 7f5ba2880640 1 -- 172.21.15.196:0/4282858174 learned_addr learned my addr 172.21.15.196:0/4282858174 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5ba2880640 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f50ffe0 con 0x564b5f6609e0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5ba2880640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001ed0 tx=0x7f5b94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5a8f606640 1 -- 172.21.15.196:0/4282858174 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9401a880 con 0x564b5f6609e0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5a8f606640 1 -- 172.21.15.196:0/4282858174 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9401aa20 con 0x564b5f6609e0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5a8f606640 1 -- 172.21.15.196:0/4282858174 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9401ad40 con 0x564b5f6609e0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5f75b9d0 con 0x564b5f6609e0 2024-09-21T08:52:20.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.115+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5f75bef0 con 0x564b5f6609e0 2024-09-21T08:52:20.121 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5a8f606640 1 -- 172.21.15.196:0/4282858174 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b94017070 con 0x564b5f6609e0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5a8f606640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 0x7f5a88039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5a8f606640 1 -- 172.21.15.196:0/4282858174 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5b94015020 con 0x564b5f6609e0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 0x7f5a88039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 0x564b5f762500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f762ad0 con 0x564b5f668e80 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5ba3081640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 0x564b5f762500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.116+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 0x7f5a88039000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c057000 tx=0x7f5b8c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba3081640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 0x564b5f762500 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba3081640 1 -- 172.21.15.196:0/4282858174 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b9c00a4a0 con 0x564b5f668e80 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f75fad0 con 0x564b5f668e80 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba3081640 1 -- 172.21.15.196:0/4282858174 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b9c00a4a0 con 0x564b5f668e80 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 0x564b5f7671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f767870 con 0x564b5f764de0 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.117+0000 7f5ba2880640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 0x564b5f7671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba2880640 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 0x564b5f7671d0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba2880640 1 -- 172.21.15.196:0/4282858174 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f764de0 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f763c80 con 0x564b5f668e80 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba3081640 1 -- 172.21.15.196:0/4282858174 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b9c00a4a0 con 0x564b5f668e80 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f764120 con 0x564b5f668e80 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.118+0000 7f5ba3081640 1 -- 172.21.15.196:0/4282858174 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b9c00a4a0 con 0x564b5f668e80 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba6b2d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba6b2d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b5f4fd580 con 0x564b5f776200 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35442/0 (socket says 172.21.15.196:35442) 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba3081640 1 -- 172.21.15.196:0/2462781163 learned_addr learned my addr 172.21.15.196:0/2462781163 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.119+0000 7f5ba3081640 1 -- 172.21.15.196:0/2462781163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f776b60 con 0x564b5f776200 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5ba3081640 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x564b5f75c540 tx=0x7f5b9c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5a8ce01640 1 -- 172.21.15.196:0/2462781163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c014450 con 0x564b5f776200 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5a8ce01640 1 -- 172.21.15.196:0/2462781163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c0145f0 con 0x564b5f776200 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5f776df0 con 0x564b5f776200 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5a8ce01640 1 -- 172.21.15.196:0/2462781163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c0148d0 con 0x564b5f776200 2024-09-21T08:52:20.124 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5f779ad0 con 0x564b5f776200 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.120+0000 7f5a8ce01640 1 -- 172.21.15.196:0/2462781163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b9c011040 con 0x564b5f776200 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5a8ce01640 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 0x7f5a7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5a8ce01640 1 -- 172.21.15.196:0/2462781163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5b9c01e070 con 0x564b5f776200 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 0x7f5a7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 0x7f5a7c039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x564b5f762f00 tx=0x7f5b9404b650 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba6b2d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba6b2d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b5f754260 con 0x564b5f782e50 2024-09-21T08:52:20.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35452/0 (socket says 172.21.15.196:35452) 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.121+0000 7f5ba3081640 1 -- 172.21.15.196:0/3550355259 learned_addr learned my addr 172.21.15.196:0/3550355259 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba3081640 1 -- 172.21.15.196:0/3550355259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f783820 con 0x564b5f782e50 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba3081640 1 --2- 172.21.15.196:0/3550355259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c04cbb0 tx=0x7f5b9c011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15007318cd07676c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5a867fc640 1 -- 172.21.15.196:0/3550355259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c013dc0 con 0x564b5f782e50 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5a867fc640 1 -- 172.21.15.196:0/3550355259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c014a70 con 0x564b5f782e50 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5a867fc640 1 -- 172.21.15.196:0/3550355259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c014d50 con 0x564b5f782e50 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/3550355259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 msgr2=0x564b5f783250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/3550355259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c04cbb0 tx=0x7f5b9c011970 comp rx=0 tx=0).stop 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/3550355259 shutdown_connections 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/3550355259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f783250 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/3550355259 >> 172.21.15.196:0/3550355259 conn(0x564b5f77f200 msgr2=0x564b5f77d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.122+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/3550355259 shutdown_connections 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/3550355259 wait complete. 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba6b2d800 1 Processor -- start 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba6b2d800 1 -- start start 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba6b2d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba6b2d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b5f783df0 con 0x564b5f782e50 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba3081640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35470/0 (socket says 172.21.15.196:35470) 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 learned_addr learned my addr 172.21.15.196:0/2398115769 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.123+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5f78a8b0 con 0x564b5f782e50 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5ba3081640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c011be0 tx=0x7f5b9c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5a84ff9640 1 -- 172.21.15.196:0/2398115769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c044030 con 0x564b5f782e50 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5a84ff9640 1 -- 172.21.15.196:0/2398115769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c022a80 con 0x564b5f782e50 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5a84ff9640 1 -- 172.21.15.196:0/2398115769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b9c022d80 con 0x564b5f782e50 2024-09-21T08:52:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5f78ab40 con 0x564b5f782e50 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5f78d7f0 con 0x564b5f782e50 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.124+0000 7f5a84ff9640 1 -- 172.21.15.196:0/2398115769 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b9c04e9a0 con 0x564b5f782e50 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5a84ff9640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a6c036b90 0x7f5a6c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5a84ff9640 1 -- 172.21.15.196:0/2398115769 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5b9c045070 con 0x564b5f782e50 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a6c036b90 0x7f5a6c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a6c036b90 0x7f5a6c039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b94000fd0 tx=0x7f5b9404d050 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f795fe0 0x564b5f7984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f798bf0 con 0x564b5f795fe0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.125+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f795fe0 0x564b5f7984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f795fe0 0x564b5f7984a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 realm 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f799020 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7998f0 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.126+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f799c90 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba6b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f79a9f0 0x564b5f79cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f79d3f0 con 0x564b5f79a9f0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba3081640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f79a9f0 0x564b5f79cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba3081640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f79a9f0 0x564b5f79cde0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.127+0000 7f5ba6b2d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba6b2d800 20 searching for the correct realm 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564b5f79f380 0x564b5f7a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564b5f79f380 0x564b5f7a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564b5f79f380 0x564b5f7a1840 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba2880640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5b9400f070 0x7f5b94019840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.128+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5b9400f070 0x7f5b94019840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.129+0000 7f5b9bfff640 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5b9400f070 0x7f5b94019840 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.129+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.129+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.129+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.129+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.130+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.131+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.132+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.133+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.134+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.134+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.134+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.134+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.135+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.136+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79f380 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x564b5f795fe0 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.137+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a1f10 con 0x7f5b9400f070 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f79e8d0 con 0x564b5f795fe0 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f79d850 con 0x564b5f795fe0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f79e1d0 con 0x564b5f795fe0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 zone default found 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 4 Realm: () 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:20.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 zonegroup default 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.138+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a2840 con 0x564b5f79a9f0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a4a70 con 0x564b5f79f380 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.139+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a4e10 con 0x564b5f79f380 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.140+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.140+0000 7f5ba6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.140+0000 7f5ba6b2d800 20 started sync module instance, tier type = 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.140+0000 7f5ba6b2d800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.140+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a3eb0 con 0x7f5b9400f070 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.141+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.141+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94881724384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a3eb0 con 0x7f5b9400f070 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.141+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a57d0 con 0x564b5f795fe0 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.142+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94881724384208] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.142+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.142+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94881724388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a3eb0 con 0x564b5f795fe0 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.142+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a6260 con 0x564b5f79f380 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.143+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.143+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94881724390704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a6b00 con 0x564b5f79f380 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.143+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a75a0 con 0x7f5b9400f070 2024-09-21T08:52:20.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.143+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94881724388608] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.144+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94881724390704] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.144+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.144+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94881724393040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a3a00 con 0x7f5b9400f070 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.144+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a7e70 con 0x564b5f795fe0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.145+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.145+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94881724397808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a8260 con 0x564b5f795fe0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.145+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a8d80 con 0x564b5f79a9f0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.145+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94881724393040] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.146+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94881724397808] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.146+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.146+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94881724398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a7090 con 0x564b5f79a9f0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.146+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a9620 con 0x564b5f79a9f0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.147+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.147+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94881724404080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a9a80 con 0x564b5f79a9f0 2024-09-21T08:52:20.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.147+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7aa550 con 0x564b5f79a9f0 2024-09-21T08:52:20.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.147+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94881724398864] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94881724404080] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94881724407872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a9590 con 0x564b5f79a9f0 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=0 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=1 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=2 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=3 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=4 2024-09-21T08:52:20.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=5 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.148+0000 7f5ba6b2d800 20 add_watcher() i=6 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.149+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94881724407872] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.149+0000 7f5ba6b2d800 20 add_watcher() i=7 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.149+0000 7f5ba6b2d800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.149+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7ad540 con 0x564b5f795fe0 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.150+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.150+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94881724401744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7aaa00 con 0x564b5f795fe0 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94881724401744] v36'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5ba6b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5ba6b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5ba6b2d800 5 note: GC not initialized 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f59d3fff640 20 reqs_thread_entry: start 2024-09-21T08:52:20.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5ba6b2d800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f5ba6b2d800 20 Filter name: none 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.151+0000 7f59d1ffb640 20 reqs_thread_entry: start 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7e0860 con 0x564b5f795fe0 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 20 rados_obj.operate() r=0 bl.length=403 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.152+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7e6b20 con 0x564b5f795fe0 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.153+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v36'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.153+0000 7f5ba6b2d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.153+0000 7f5ba6b2d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.153+0000 7f5ba6b2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.153+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94881724654816 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7e55c0 con 0x564b5f795fe0 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== watch-notify(notify (1) cookie 94881724397808 notify 154618822675 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564b5f529e00 con 0x564b5f795fe0 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5a867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822675 cookie 94881724397808 notifier 4671 bl.length()=567 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5a867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5a867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(64 notify.4 [notify cookie 94881724654816 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5a867fc640 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f5a68003ea0 con 0x564b5f795fe0 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.154+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== watch-notify(notify_complete (2) cookie 94881724654816 notify 154618822675 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5b8c05bc30 con 0x564b5f795fe0 2024-09-21T08:52:20.164 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-21T08:51:56.923215Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:51:56.923206Z","tags":[],"group_ids":[]} 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.155+0000 7f5a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.155+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94881724401744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7de5b0 con 0x564b5f795fe0 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.156+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94881724401744] v36'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.156+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94881724384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7de5b0 con 0x7f5b9400f070 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.157+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94881724384208] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.157+0000 7f5ba6b2d800 20 remove_watcher() i=0 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.157+0000 7f5ba6b2d800 2 removed watcher, disabling cache 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.157+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94881724388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7de5b0 con 0x564b5f795fe0 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.158+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94881724388608] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.158+0000 7f5ba6b2d800 20 remove_watcher() i=1 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.158+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94881724390704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7de5b0 con 0x564b5f79f380 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.159+0000 7f5ba2880640 1 -- 172.21.15.196:0/2398115769 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94881724390704] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9402e070 con 0x564b5f79f380 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.159+0000 7f5ba6b2d800 20 remove_watcher() i=2 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.159+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94881724393040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a5500 con 0x7f5b9400f070 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.160+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94881724393040] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x7f5b9400f070 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.160+0000 7f5ba6b2d800 20 remove_watcher() i=3 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.160+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94881724397808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a5d30 con 0x564b5f795fe0 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.161+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94881724397808] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c057030 con 0x564b5f795fe0 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.161+0000 7f5ba6b2d800 20 remove_watcher() i=4 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.161+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94881724398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a5500 con 0x564b5f79a9f0 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.162+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94881724398864] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.162+0000 7f5ba6b2d800 20 remove_watcher() i=5 2024-09-21T08:52:20.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.162+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94881724404080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a5d30 con 0x564b5f79a9f0 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.163+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94881724404080] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.163+0000 7f5ba6b2d800 20 remove_watcher() i=6 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.163+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94881724407872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564b5f7a5500 con 0x564b5f79a9f0 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba3081640 1 -- 172.21.15.196:0/2398115769 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94881724407872] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b9c02a070 con 0x564b5f79a9f0 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 20 remove_watcher() i=7 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f79a9f0 msgr2=0x564b5f79cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f79a9f0 0x564b5f79cde0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f795fe0 msgr2=0x564b5f7984a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f795fe0 0x564b5f7984a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5b9400f070 msgr2=0x7f5b94019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f5b9400f070 0x7f5b94019840 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564b5f79f380 msgr2=0x564b5f7a1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564b5f79f380 0x564b5f7a1840 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a6c036b90 msgr2=0x7f5a6c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a6c036b90 0x7f5a6c039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b94000fd0 tx=0x7f5b9404d050 comp rx=0 tx=0).stop 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 msgr2=0x564b5f78a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c011be0 tx=0x7f5b9c04cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.164+0000 7f5b9bfff640 1 -- 172.21.15.196:0/2398115769 reap_dead start 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 shutdown_connections 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2398115769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f782e50 0x564b5f78a370 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 >> 172.21.15.196:0/2398115769 conn(0x564b5f77f200 msgr2=0x564b5f784560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 shutdown_connections 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2398115769 wait complete. 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 msgr2=0x7f5a7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 0x7f5a7c039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x564b5f762f00 tx=0x7f5b9404b650 comp rx=0 tx=0).stop 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 msgr2=0x564b5f776620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x564b5f75c540 tx=0x7f5b9c0188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 shutdown_connections 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a7c036b90 0x7f5a7c039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/2462781163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f776200 0x564b5f776620 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 >> 172.21.15.196:0/2462781163 conn(0x564b5f76b190 msgr2=0x564b5f76dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 shutdown_connections 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/2462781163 wait complete. 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 msgr2=0x564b5f7671d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 0x564b5f7671d0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 msgr2=0x564b5f762500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 0x564b5f762500 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 msgr2=0x7f5a88039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.165+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 0x7f5a88039000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c057000 tx=0x7f5b8c052000 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 msgr2=0x564b5f75b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5b94001ed0 tx=0x7f5b94000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 shutdown_connections 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564b5f764de0 0x564b5f7671d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564b5f668e80 0x564b5f762500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5a88036b40 0x7f5a88039000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 --2- 172.21.15.196:0/4282858174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b5f6609e0 0x564b5f75b490 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 >> 172.21.15.196:0/4282858174 conn(0x564b5f65c550 msgr2=0x564b5f74dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 shutdown_connections 2024-09-21T08:52:20.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.166+0000 7f5ba6b2d800 1 -- 172.21.15.196:0/4282858174 wait complete. 2024-09-21T08:52:20.178 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-21T08:51:56.923215Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:51:56.923206Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:20.188 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:20.189 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-21T08:52:20.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-21T08:52:20.189 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-21T08:52:20.233 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:20.233 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd055e15800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56430002f8e0 0x564300031cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd055e15800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5642ffeeab30 con 0x5642fff9ee10 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd055e15800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5642ffecc360 con 0x56430002f8e0 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd050e3a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56430002f8e0 0x564300031cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd05163b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5642fff9ee10 0x56430002e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58032/0 (socket says 172.21.15.196:58032) 2024-09-21T08:52:20.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.232+0000 7fd05163b640 1 -- 172.21.15.196:0/683600126 learned_addr learned my addr 172.21.15.196:0/683600126 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:20.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.233+0000 7fd050e3a640 1 -- 172.21.15.196:0/683600126 >> v1:172.21.15.29:6789/0 conn(0x5642fff9ee10 legacy=0x56430002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.233+0000 7fd050e3a640 1 -- 172.21.15.196:0/683600126 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ffef2e00 con 0x56430002f8e0 2024-09-21T08:52:20.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.234+0000 7fd050e3a640 1 --2- 172.21.15.196:0/683600126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430002f8e0 0x564300031cd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd04800a470 tx=0x7fd048045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e864ee8d5342dc45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.234+0000 7fd043fff640 1 -- 172.21.15.196:0/683600126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd048053570 con 0x56430002f8e0 2024-09-21T08:52:20.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd043fff640 1 -- 172.21.15.196:0/683600126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd048058070 con 0x56430002f8e0 2024-09-21T08:52:20.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd043fff640 1 -- 172.21.15.196:0/683600126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd048053880 con 0x56430002f8e0 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 -- 172.21.15.196:0/683600126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430002f8e0 msgr2=0x564300031cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 --2- 172.21.15.196:0/683600126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430002f8e0 0x564300031cd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd04800a470 tx=0x7fd048045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 -- 172.21.15.196:0/683600126 shutdown_connections 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 --2- 172.21.15.196:0/683600126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430002f8e0 0x564300031cd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 -- 172.21.15.196:0/683600126 >> 172.21.15.196:0/683600126 conn(0x564300025df0 msgr2=0x564300028210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 -- 172.21.15.196:0/683600126 shutdown_connections 2024-09-21T08:52:20.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.235+0000 7fd055e15800 1 -- 172.21.15.196:0/683600126 wait complete. 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd055e15800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd055e15800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5642fff77330 con 0x5642fff9ee10 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd05163b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd05163b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35482/0 (socket says 172.21.15.196:35482) 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd05163b640 1 -- 172.21.15.196:0/1938623880 learned_addr learned my addr 172.21.15.196:0/1938623880 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.249+0000 7fd05163b640 1 -- 172.21.15.196:0/1938623880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ffec4bc0 con 0x5642fff9ee10 2024-09-21T08:52:20.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.250+0000 7fd05163b640 1 --2- 172.21.15.196:0/1938623880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd044001d80 tx=0x7fd044001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ffc4cb93a3ae93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.250+0000 7fcf3f606640 1 -- 172.21.15.196:0/1938623880 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd044013030 con 0x5642fff9ee10 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.250+0000 7fcf3f606640 1 -- 172.21.15.196:0/1938623880 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04400e470 con 0x5642fff9ee10 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.250+0000 7fcf3f606640 1 -- 172.21.15.196:0/1938623880 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04400e810 con 0x5642fff9ee10 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- 172.21.15.196:0/1938623880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 msgr2=0x56430011a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 --2- 172.21.15.196:0/1938623880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd044001d80 tx=0x7fd044001e70 comp rx=0 tx=0).stop 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- 172.21.15.196:0/1938623880 shutdown_connections 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 --2- 172.21.15.196:0/1938623880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x56430011a840 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- 172.21.15.196:0/1938623880 >> 172.21.15.196:0/1938623880 conn(0x564300025df0 msgr2=0x564300116200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- 172.21.15.196:0/1938623880 shutdown_connections 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- 172.21.15.196:0/1938623880 wait complete. 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.254 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd055e15800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564300032600 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd05163b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd05163b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35498/0 (socket says 172.21.15.196:35498) 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.251+0000 7fd05163b640 1 -- 172.21.15.196:0/2519316527 learned_addr learned my addr 172.21.15.196:0/2519316527 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fd05163b640 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ffed8fe0 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fd05163b640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd044004000 tx=0x7fd044000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fcf3de03640 1 -- 172.21.15.196:0/2519316527 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd044027070 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fcf3de03640 1 -- 172.21.15.196:0/2519316527 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044001400 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564300122780 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fcf3de03640 1 -- 172.21.15.196:0/2519316527 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd044019a70 con 0x5642fff9ee10 2024-09-21T08:52:20.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.252+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564300122ca0 con 0x5642fff9ee10 2024-09-21T08:52:20.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fcf3de03640 1 -- 172.21.15.196:0/2519316527 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd04402a070 con 0x5642fff9ee10 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fcf3de03640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 0x7fcf38039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fcf3de03640 1 -- 172.21.15.196:0/2519316527 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd04401f070 con 0x5642fff9ee10 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fd050e3a640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 0x7fcf38039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 0x5643001292b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5643001297f0 con 0x56430002f8e0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fd051e3c640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 0x5643001292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.253+0000 7fd050e3a640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 0x7fcf38039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd048057000 tx=0x7fd048052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd051e3c640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 0x5643001292b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd051e3c640 1 -- 172.21.15.196:0/2519316527 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd04c00a4a0 con 0x56430002f8e0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300126880 con 0x56430002f8e0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd051e3c640 1 -- 172.21.15.196:0/2519316527 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd04c00a4a0 con 0x56430002f8e0 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 0x56430012df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430012e620 con 0x56430012bb40 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.254+0000 7fd05163b640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 0x56430012df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.255+0000 7fd05163b640 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 0x56430012df30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.255+0000 7fd05163b640 1 -- 172.21.15.196:0/2519316527 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd044029030 con 0x56430012bb40 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.255+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430012a9e0 con 0x56430002f8e0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.255+0000 7fd051e3c640 1 -- 172.21.15.196:0/2519316527 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd04c00a4a0 con 0x56430002f8e0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.255+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430012ae80 con 0x56430002f8e0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd051e3c640 1 -- 172.21.15.196:0/2519316527 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd04c00a4a0 con 0x56430002f8e0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd055e15800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd055e15800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5642ffec6580 con 0x56430013cf70 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35502/0 (socket says 172.21.15.196:35502) 2024-09-21T08:52:20.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.256+0000 7fd051e3c640 1 -- 172.21.15.196:0/3926225384 learned_addr learned my addr 172.21.15.196:0/3926225384 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fd051e3c640 1 -- 172.21.15.196:0/3926225384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430013d8d0 con 0x56430013cf70 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fd051e3c640 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x564300129bf0 tx=0x7fd04c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fcf36ffd640 1 -- 172.21.15.196:0/3926225384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c014450 con 0x56430013cf70 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fcf36ffd640 1 -- 172.21.15.196:0/3926225384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c014610 con 0x56430013cf70 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fcf36ffd640 1 -- 172.21.15.196:0/3926225384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c014930 con 0x56430013cf70 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56430013db60 con 0x56430013cf70 2024-09-21T08:52:20.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.257+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564300140840 con 0x56430013cf70 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fcf36ffd640 1 -- 172.21.15.196:0/3926225384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd04c011040 con 0x56430013cf70 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fcf36ffd640 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 0x7fcf28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fcf36ffd640 1 -- 172.21.15.196:0/3926225384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd04c01e070 con 0x56430013cf70 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd05163b640 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 0x7fcf28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd05163b640 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 0x7fcf28039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x564300129c90 tx=0x7fd04400c3e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd055e15800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.258+0000 7fd055e15800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56430011aff0 con 0x564300149bd0 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35508/0 (socket says 172.21.15.196:35508) 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fd051e3c640 1 -- 172.21.15.196:0/2572584270 learned_addr learned my addr 172.21.15.196:0/2572584270 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fd051e3c640 1 -- 172.21.15.196:0/2572584270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430014a5a0 con 0x564300149bd0 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fd051e3c640 1 --2- 172.21.15.196:0/2572584270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd04c04cbc0 tx=0x7fd04c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb4c307b610fca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fcf34ff9640 1 -- 172.21.15.196:0/2572584270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c040150 con 0x564300149bd0 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fcf34ff9640 1 -- 172.21.15.196:0/2572584270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0167e0 con 0x564300149bd0 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.259+0000 7fcf34ff9640 1 -- 172.21.15.196:0/2572584270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c014ad0 con 0x564300149bd0 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- 172.21.15.196:0/2572584270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 msgr2=0x564300149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 --2- 172.21.15.196:0/2572584270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd04c04cbc0 tx=0x7fd04c011b10 comp rx=0 tx=0).stop 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- 172.21.15.196:0/2572584270 shutdown_connections 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 --2- 172.21.15.196:0/2572584270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300149fd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- 172.21.15.196:0/2572584270 >> 172.21.15.196:0/2572584270 conn(0x564300145f30 msgr2=0x564300144030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- 172.21.15.196:0/2572584270 shutdown_connections 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- 172.21.15.196:0/2572584270 wait complete. 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 Processor -- start 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- start start 2024-09-21T08:52:20.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd055e15800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56430014ac10 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd051e3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35514/0 (socket says 172.21.15.196:35514) 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.260+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 learned_addr learned my addr 172.21.15.196:0/4118845929 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564300151580 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fd051e3c640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300151040 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011fd0 tx=0x7fd04c04cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fcf26ffd640 1 -- 172.21.15.196:0/4118845929 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c011510 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fcf26ffd640 1 -- 172.21.15.196:0/4118845929 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0116b0 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fcf26ffd640 1 -- 172.21.15.196:0/4118845929 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd04c0133b0 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564300151810 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643001544c0 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.261+0000 7fcf26ffd640 1 -- 172.21.15.196:0/4118845929 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd04c013550 con 0x564300149bd0 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.262+0000 7fcf26ffd640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf1c036b40 0x7fcf1c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.262+0000 7fcf26ffd640 1 -- 172.21.15.196:0/4118845929 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd04c033030 con 0x564300149bd0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.262+0000 7fd05163b640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf1c036b40 0x7fcf1c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.262+0000 7fd05163b640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf1c036b40 0x7fcf1c039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd04402c030 tx=0x7fd044042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430015cd10 0x56430015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430015f920 con 0x56430015cd10 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd050e3a640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430015cd10 0x56430015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd050e3a640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430015cd10 0x56430015f1d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 realm 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430015fd50 con 0x56430015cd10 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.263+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300160620 con 0x56430015cd10 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5643001609c0 con 0x56430015cd10 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564300161720 0x564300163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300164120 con 0x564300161720 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.264+0000 7fd051e3c640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564300161720 0x564300163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd051e3c640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564300161720 0x564300163b10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd055e15800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd055e15800 20 searching for the correct realm 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5643001660b0 0x564300168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd05163b640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5643001660b0 0x564300168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.265+0000 7fd05163b640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5643001660b0 0x564300168570 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd05163b640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd04402c060 0x7fd04404c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd050e3a640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd04402c060 0x7fd04404c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd050e3a640 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd04402c060 0x7fd04404c190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:20.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.266+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.267+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.268+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.269+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.270+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.271+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.272+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x5643001660b0 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x564300161720 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x56430015cd10 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.273+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564300168c40 con 0x7fd04402c060 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:20.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300165600 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300164a50 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300164510 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 zone default found 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 4 Realm: () 2024-09-21T08:52:20.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 zonegroup default 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.274+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300169570 con 0x564300161720 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430016b7a0 con 0x5643001660b0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56430016bb40 con 0x5643001660b0 2024-09-21T08:52:20.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 started sync module instance, tier type = 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.275+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016ac30 con 0x7fd04402c060 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.276+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.276+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94845764284800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016ac30 con 0x7fd04402c060 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.276+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016c590 con 0x56430015cd10 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.277+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94845764284800] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.277+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.278+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94845764288672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016ac30 con 0x56430015cd10 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.278+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016d010 con 0x5643001660b0 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.279+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.279+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94845764291360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016d8b0 con 0x5643001660b0 2024-09-21T08:52:20.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.279+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016e320 con 0x7fd04402c060 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.279+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94845764288672] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.280+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94845764291360] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.280+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.280+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94845764293632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016a780 con 0x7fd04402c060 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.280+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016ebc0 con 0x56430015cd10 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.281+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.281+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94845764298384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016eff0 con 0x56430015cd10 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.281+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016faf0 con 0x564300161720 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.281+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94845764293632] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.282+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.282+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94845764298384] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.282+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94845764302304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016fab0 con 0x564300161720 2024-09-21T08:52:20.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.282+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564300170390 con 0x564300161720 2024-09-21T08:52:20.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.283+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94845764302304] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.284+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.284+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94845764299440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016fab0 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.284+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564300170a30 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94845764299440] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94845764306272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564300170a30 con 0x564300161720 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=0 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=1 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=2 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=3 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=4 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=5 2024-09-21T08:52:20.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=6 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94845764306272] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 20 add_watcher() i=7 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.285+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564300173e60 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.286+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.286+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94845764304144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564300171350 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.287+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94845764304144] v36'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.287+0000 7fcf077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.287+0000 7fd055e15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.287+0000 7fd055e15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.287+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564300173cc0 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.288+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.288+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017d030 con 0x564300161720 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.289+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.289+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017d030 con 0x5643001660b0 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.290+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.290+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017dad0 con 0x56430015cd10 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.291+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.291+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017c690 con 0x7fd04402c060 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.292+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.292+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017c690 con 0x5643001660b0 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.293+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.293+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017e420 con 0x56430015cd10 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.294+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.298 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.294+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017e420 con 0x564300161720 2024-09-21T08:52:20.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.295+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.295+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017e4b0 con 0x7fd04402c060 2024-09-21T08:52:20.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.296+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.296+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017e540 con 0x5643001660b0 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.297+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.297+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ead0 con 0x7fd04402c060 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.298+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.298+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017eab0 con 0x564300161720 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.299+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.299+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x7fd04402c060 2024-09-21T08:52:20.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.300+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.300+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x564300161720 2024-09-21T08:52:20.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.301+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.301+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x56430015cd10 2024-09-21T08:52:20.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.302+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.302+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.303+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.303+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x7fd04402c060 2024-09-21T08:52:20.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.304+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.304+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.305+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.305+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x56430015cd10 2024-09-21T08:52:20.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.306+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.306+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x56430015cd10 2024-09-21T08:52:20.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.307+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.307+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.308+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.308+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x7fd04402c060 2024-09-21T08:52:20.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.309+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.309+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.310+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.310+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.311+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.311+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.312+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.312+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.312+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.313+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x564300161720 2024-09-21T08:52:20.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.314+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.314+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.314+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.315+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x564300161720 2024-09-21T08:52:20.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.316+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.316+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x5643001660b0 2024-09-21T08:52:20.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.317+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.317+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x564300161720 2024-09-21T08:52:20.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.318+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.318+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017ea80 con 0x7fd04402c060 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fcf067e4640 20 reqs_thread_entry: start 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd055e15800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd055e15800 20 Filter name: none 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fce77fff640 20 reqs_thread_entry: start 2024-09-21T08:52:20.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd055e15800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd055e15800 20 rados->read ofs=0 len=0 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.319+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5643001a9940 con 0x56430015cd10 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd055e15800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd055e15800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd055e15800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:52:20.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd055e15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:20.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5643001a98f0 con 0x7fd04402c060 2024-09-21T08:52:20.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.320+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.325 INFO:teuthology.orchestra.run.smithi196.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-21T08:52:20.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.321+0000 7fcf077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:20.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.321+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94845764304144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430017d8c0 con 0x56430015cd10 2024-09-21T08:52:20.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.322+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94845764304144] v36'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.322+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94845764284800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016fcd0 con 0x7fd04402c060 2024-09-21T08:52:20.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.323+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94845764284800] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.323+0000 7fd055e15800 20 remove_watcher() i=0 2024-09-21T08:52:20.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.323+0000 7fd055e15800 2 removed watcher, disabling cache 2024-09-21T08:52:20.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.323+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94845764288672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016b180 con 0x56430015cd10 2024-09-21T08:52:20.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.324+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94845764288672] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.324+0000 7fd055e15800 20 remove_watcher() i=1 2024-09-21T08:52:20.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.324+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94845764291360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016b180 con 0x5643001660b0 2024-09-21T08:52:20.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.325+0000 7fd05163b640 1 -- 172.21.15.196:0/4118845929 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94845764291360] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04403e070 con 0x5643001660b0 2024-09-21T08:52:20.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.325+0000 7fd055e15800 20 remove_watcher() i=2 2024-09-21T08:52:20.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.325+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94845764293632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016b180 con 0x7fd04402c060 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.326+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94845764293632] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x7fd04402c060 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.326+0000 7fd055e15800 20 remove_watcher() i=3 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.326+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94845764298384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016d400 con 0x56430015cd10 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.327+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94845764298384] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd048051070 con 0x56430015cd10 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.327+0000 7fd055e15800 20 remove_watcher() i=4 2024-09-21T08:52:20.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.327+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94845764302304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016b180 con 0x564300161720 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.328+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94845764302304] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.328+0000 7fd055e15800 20 remove_watcher() i=5 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.328+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94845764299440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016d400 con 0x564300161720 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.329+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94845764299440] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.330+0000 7fd055e15800 20 remove_watcher() i=6 2024-09-21T08:52:20.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.330+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94845764306272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56430016eb20 con 0x564300161720 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd051e3c640 1 -- 172.21.15.196:0/4118845929 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94845764306272] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd04c02a070 con 0x564300161720 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 20 remove_watcher() i=7 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564300161720 msgr2=0x564300163b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564300161720 0x564300163b10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430015cd10 msgr2=0x56430015f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430015cd10 0x56430015f1d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd04402c060 msgr2=0x7fd04404c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fd04402c060 0x7fd04404c190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5643001660b0 msgr2=0x564300168570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5643001660b0 0x564300168570 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf1c036b40 msgr2=0x7fcf1c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf1c036b40 0x7fcf1c039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd04402c030 tx=0x7fd044042000 comp rx=0 tx=0).stop 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 msgr2=0x564300151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/4118845929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564300149bd0 0x564300151040 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011fd0 tx=0x7fd04c04cb50 comp rx=0 tx=0).stop 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 reap_dead start 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd050e3a640 1 -- 172.21.15.196:0/4118845929 reap_dead start 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 shutdown_connections 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 >> 172.21.15.196:0/4118845929 conn(0x564300145f30 msgr2=0x564300144000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 shutdown_connections 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/4118845929 wait complete. 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 msgr2=0x7fcf28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 0x7fcf28039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x564300129c90 tx=0x7fd04400c3e0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 msgr2=0x56430013d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.331+0000 7fd055e15800 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x564300129bf0 tx=0x7fd04c018830 comp rx=0 tx=0).stop 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 shutdown_connections 2024-09-21T08:52:20.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf28036b90 0x7fcf28039050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/3926225384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56430013cf70 0x56430013d390 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 >> 172.21.15.196:0/3926225384 conn(0x564300131f00 msgr2=0x564300134a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 shutdown_connections 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/3926225384 wait complete. 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 msgr2=0x56430012df30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 0x56430012df30 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 msgr2=0x5643001292b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 0x5643001292b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 msgr2=0x7fcf38039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 0x7fcf38039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd048057000 tx=0x7fd048052000 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 msgr2=0x564300122240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd044004000 tx=0x7fd044000bc0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 shutdown_connections 2024-09-21T08:52:20.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56430012bb40 0x56430012df30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56430002f8e0 0x5643001292b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fcf38036b90 0x7fcf38039050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 --2- 172.21.15.196:0/2519316527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642fff9ee10 0x564300122240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 >> 172.21.15.196:0/2519316527 conn(0x564300025df0 msgr2=0x564300114b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 shutdown_connections 2024-09-21T08:52:20.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:20.332+0000 7fd055e15800 1 -- 172.21.15.196:0/2519316527 wait complete. 2024-09-21T08:52:20.342 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T08:52:20.359 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:20.364 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-21T08:52:55.365 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-21T08:52:55.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-21T08:52:55.366 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-21T08:52:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.416+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.416+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fee40800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563d49d01980 0x563d49d03d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fee40800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d49bbcb30 con 0x563d49c70d70 2024-09-21T08:52:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fee40800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x563d49b9e360 con 0x563d49d01980 2024-09-21T08:52:55.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fc133640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563d49d01980 0x563d49d03d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fc133640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563d49d01980 0x563d49d03d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51384/0 (socket says 172.21.15.196:51384) 2024-09-21T08:52:55.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fc133640 1 -- 172.21.15.196:0/378944130 learned_addr learned my addr 172.21.15.196:0/378944130 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fc133640 1 -- 172.21.15.196:0/378944130 >> v1:172.21.15.29:6789/0 conn(0x563d49c70d70 legacy=0x563d49d00260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.417+0000 7fe2fc133640 1 -- 172.21.15.196:0/378944130 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49bc4e00 con 0x563d49d01980 2024-09-21T08:52:55.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.419+0000 7fe2fc133640 1 --2- 172.21.15.196:0/378944130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49d01980 0x563d49d03d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000a520 tx=0x7fe2f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dbf614b6834f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fb932640 1 -- 172.21.15.196:0/378944130 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f0055070 con 0x563d49d01980 2024-09-21T08:52:55.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fb932640 1 -- 172.21.15.196:0/378944130 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f00515b0 con 0x563d49d01980 2024-09-21T08:52:55.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fb932640 1 -- 172.21.15.196:0/378944130 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f00518d0 con 0x563d49d01980 2024-09-21T08:52:55.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 -- 172.21.15.196:0/378944130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49d01980 msgr2=0x563d49d03d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 --2- 172.21.15.196:0/378944130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49d01980 0x563d49d03d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000a520 tx=0x7fe2f0045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 -- 172.21.15.196:0/378944130 shutdown_connections 2024-09-21T08:52:55.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 --2- 172.21.15.196:0/378944130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49d01980 0x563d49d03d70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 -- 172.21.15.196:0/378944130 >> 172.21.15.196:0/378944130 conn(0x563d49cf7df0 msgr2=0x563d49cfa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 -- 172.21.15.196:0/378944130 shutdown_connections 2024-09-21T08:52:55.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.420+0000 7fe2fee40800 1 -- 172.21.15.196:0/378944130 wait complete. 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fee40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fee40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563d49c49330 con 0x563d49c70d70 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fc934640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fc934640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51394/0 (socket says 172.21.15.196:51394) 2024-09-21T08:52:55.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.436+0000 7fe2fc934640 1 -- 172.21.15.196:0/4051256552 learned_addr learned my addr 172.21.15.196:0/4051256552 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.437+0000 7fe2fc934640 1 -- 172.21.15.196:0/4051256552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49b96bc0 con 0x563d49c70d70 2024-09-21T08:52:55.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.437+0000 7fe2fc934640 1 --2- 172.21.15.196:0/4051256552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001620 tx=0x7fe2ec001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7704e2f8e790c94e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.437+0000 7fe1eae0d640 1 -- 172.21.15.196:0/4051256552 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec016070 con 0x563d49c70d70 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.437+0000 7fe1eae0d640 1 -- 172.21.15.196:0/4051256552 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00f640 con 0x563d49c70d70 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.437+0000 7fe1eae0d640 1 -- 172.21.15.196:0/4051256552 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec00f9a0 con 0x563d49c70d70 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- 172.21.15.196:0/4051256552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 msgr2=0x563d49dec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 --2- 172.21.15.196:0/4051256552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001620 tx=0x7fe2ec001ae0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- 172.21.15.196:0/4051256552 shutdown_connections 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 --2- 172.21.15.196:0/4051256552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49dec870 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- 172.21.15.196:0/4051256552 >> 172.21.15.196:0/4051256552 conn(0x563d49cf7df0 msgr2=0x563d49de8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- 172.21.15.196:0/4051256552 shutdown_connections 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- 172.21.15.196:0/4051256552 wait complete. 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.438+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fee40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fee40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563d49d04640 con 0x563d49c70d70 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fc934640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fc934640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51406/0 (socket says 172.21.15.196:51406) 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fc934640 1 -- 172.21.15.196:0/1981157822 learned_addr learned my addr 172.21.15.196:0/1981157822 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fc934640 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49baafe0 con 0x563d49c70d70 2024-09-21T08:52:55.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe2fc934640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00f610 tx=0x7fe2ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.439+0000 7fe1e960a640 1 -- 172.21.15.196:0/1981157822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec021020 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.440+0000 7fe1e960a640 1 -- 172.21.15.196:0/1981157822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0117c0 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.440+0000 7fe1e960a640 1 -- 172.21.15.196:0/1981157822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2ec016040 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.440+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d49df4820 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.440+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d49df4d40 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.440+0000 7fe1e960a640 1 -- 172.21.15.196:0/1981157822 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2ec024020 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe1e960a640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 0x7fe1e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe1e960a640 1 -- 172.21.15.196:0/1981157822 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2ec04c4c0 con 0x563d49c70d70 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fc133640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 0x7fe1e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 0x563d49dfb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49dfb8d0 con 0x563d49d01980 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fd135640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 0x563d49dfb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fc133640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 0x7fe1e4039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000a520 tx=0x7fe2f0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.441+0000 7fe2fd135640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 0x563d49dfb350 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fd135640 1 -- 172.21.15.196:0/1981157822 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2f40083e0 con 0x563d49d01980 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49df8900 con 0x563d49d01980 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fd135640 1 -- 172.21.15.196:0/1981157822 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2f40083e0 con 0x563d49d01980 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 0x563d49dffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e006e0 con 0x563d49dfdc00 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.442+0000 7fe2fc934640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 0x563d49dffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.443+0000 7fe2fc934640 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 0x563d49dffff0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.443+0000 7fe2fc934640 1 -- 172.21.15.196:0/1981157822 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49dfdc00 2024-09-21T08:52:55.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.443+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49dfcaa0 con 0x563d49d01980 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fd135640 1 -- 172.21.15.196:0/1981157822 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2f40083e0 con 0x563d49d01980 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49dfcf20 con 0x563d49d01980 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fd135640 1 -- 172.21.15.196:0/1981157822 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2f40083e0 con 0x563d49d01980 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fee40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.444+0000 7fe2fee40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563d49b98580 con 0x563d49e0f070 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51416/0 (socket says 172.21.15.196:51416) 2024-09-21T08:52:55.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe2fd135640 1 -- 172.21.15.196:0/1788952185 learned_addr learned my addr 172.21.15.196:0/1788952185 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe2fd135640 1 -- 172.21.15.196:0/1788952185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49e0f9d0 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe2fd135640 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563d49df56e0 tx=0x7fe2f400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe1e27fc640 1 -- 172.21.15.196:0/1788952185 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4007d00 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.445+0000 7fe1e27fc640 1 -- 172.21.15.196:0/1788952185 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f401e020 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.446+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d49e0fc60 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.446+0000 7fe1e27fc640 1 -- 172.21.15.196:0/1788952185 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4019420 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.446+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d49e12940 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.446+0000 7fe1e27fc640 1 -- 172.21.15.196:0/1788952185 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2f4016040 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe1e27fc640 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 0x7fe1d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe1e27fc640 1 -- 172.21.15.196:0/1788952185 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2f401f030 con 0x563d49e0f070 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fc934640 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 0x7fe1d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fc934640 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 0x7fe1d4039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563d49dfbd70 tx=0x7fe2ec018e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fee40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.447+0000 7fe2fee40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563d49ded020 con 0x563d49e1bce0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51422/0 (socket says 172.21.15.196:51422) 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe2fd135640 1 -- 172.21.15.196:0/3494434891 learned_addr learned my addr 172.21.15.196:0/3494434891 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe2fd135640 1 -- 172.21.15.196:0/3494434891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49e1c6b0 con 0x563d49e1bce0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe2fd135640 1 --2- 172.21.15.196:0/3494434891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005700 tx=0x7fe2f404ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad821801b9e67419 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe1d3fff640 1 -- 172.21.15.196:0/3494434891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f401d040 con 0x563d49e1bce0 2024-09-21T08:52:55.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe1d3fff640 1 -- 172.21.15.196:0/3494434891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40184e0 con 0x563d49e1bce0 2024-09-21T08:52:55.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.448+0000 7fe1d3fff640 1 -- 172.21.15.196:0/3494434891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40144b0 con 0x563d49e1bce0 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- 172.21.15.196:0/3494434891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 msgr2=0x563d49e1c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 --2- 172.21.15.196:0/3494434891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005700 tx=0x7fe2f404ce90 comp rx=0 tx=0).stop 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- 172.21.15.196:0/3494434891 shutdown_connections 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 --2- 172.21.15.196:0/3494434891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e1c0e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- 172.21.15.196:0/3494434891 >> 172.21.15.196:0/3494434891 conn(0x563d49e18040 msgr2=0x563d49e16140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- 172.21.15.196:0/3494434891 shutdown_connections 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- 172.21.15.196:0/3494434891 wait complete. 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 Processor -- start 2024-09-21T08:52:55.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- start start 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fee40800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563d49e1cd20 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fd135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51438/0 (socket says 172.21.15.196:51438) 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.449+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 learned_addr learned my addr 172.21.15.196:0/2941066876 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d49e25880 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe2fd135640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe2f404bae0 tx=0x7fe2f404cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe1d27fc640 1 -- 172.21.15.196:0/2941066876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4030070 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe1d27fc640 1 -- 172.21.15.196:0/2941066876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f4019650 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe1d27fc640 1 -- 172.21.15.196:0/2941066876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f401d070 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d49e25b10 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.450+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d49e287c0 con 0x563d49e1bce0 2024-09-21T08:52:55.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.451+0000 7fe1d27fc640 1 -- 172.21.15.196:0/2941066876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2f4033070 con 0x563d49e1bce0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.451+0000 7fe1d27fc640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1c8036b40 0x7fe1c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe1d27fc640 1 -- 172.21.15.196:0/2941066876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2f4036d60 con 0x563d49e1bce0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fc934640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1c8036b40 0x7fe1c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49e30e70 0x563d49e33330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e33a80 con 0x563d49e30e70 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fc133640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49e30e70 0x563d49e33330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fc934640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1c8036b40 0x7fe1c8039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec018d90 tx=0x7fe2ec034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.452+0000 7fe2fc133640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49e30e70 0x563d49e33330 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 realm 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e33eb0 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e34780 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e34b20 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49e35880 0x563d49e37c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.453+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e381b0 con 0x563d49e35880 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fd135640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49e35880 0x563d49e37c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fd135640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49e35880 0x563d49e37c70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fee40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fee40800 20 searching for the correct realm 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563d49e3a1f0 0x563d49e3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.454+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e3a1f0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc934640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563d49e3a1f0 0x563d49e3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc934640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563d49e3a1f0 0x563d49e3c6b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc934640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe2ec03c070 0x7fe2ec01c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x7fe2ec03c070 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.455+0000 7fe2fc133640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe2ec03c070 0x7fe2ec01c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fc133640 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe2ec03c070 0x7fe2ec01c360 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e30e70 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.456+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e30e70 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.457+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.457+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.457+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.457+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x7fe2ec03c070 2024-09-21T08:52:55.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e3a1f0 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e30e70 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.458+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e35880 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e30e70 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x7fe2ec03c070 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3cd80 con 0x563d49e3a1f0 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.459+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e35880 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.460+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e30e70 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e30e70 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e35880 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.461+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x7fe2ec03c070 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e30e70 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.462+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e35880 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e35880 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x7fe2ec03c070 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.463+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e3a1f0 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e35880 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x563d49e30e70 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.464+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fe2ec059040 con 0x7fe2ec03c070 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:55.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e38c20 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e390a0 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e39540 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:55.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 zone default found 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 4 Realm: () 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 zonegroup default 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.465+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3d200 con 0x563d49e35880 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3f430 con 0x563d49e3a1f0 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3f7d0 con 0x563d49e3a1f0 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 started sync module instance, tier type = 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.466+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3e870 con 0x7fe2ec03c070 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.468+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.468+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94821232667792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3e870 con 0x7fe2ec03c070 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.468+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e40190 con 0x563d49e30e70 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.469+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94821232667792] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.469+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.469+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94821232666016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e40190 con 0x563d49e30e70 2024-09-21T08:52:55.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.469+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e40b50 con 0x563d49e3a1f0 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.470+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.470+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94821232674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e413f0 con 0x563d49e3a1f0 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.470+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94821232666016] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.470+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3fd00 con 0x7fe2ec03c070 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.471+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.471+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94821232679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e42300 con 0x7fe2ec03c070 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.471+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e42cc0 con 0x563d49e30e70 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.472+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94821232674464] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.472+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94821232679296] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.473+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.473+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94821232683024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e42300 con 0x563d49e30e70 2024-09-21T08:52:55.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.473+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e42c30 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.474+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.474+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94821232685232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e42c30 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.474+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94821232683024] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.474+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e41e70 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.475+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94821232685232] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.475+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.475+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94821232686288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e41e70 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.475+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e446a0 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94821232686288] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94821232688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e446a0 con 0x563d49e35880 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=0 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=1 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=2 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=3 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=4 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=5 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.476+0000 7fe2fee40800 20 add_watcher() i=6 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.477+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94821232688080] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.477+0000 7fe2fee40800 20 add_watcher() i=7 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.477+0000 7fe2fee40800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.477+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e479b0 con 0x563d49e30e70 2024-09-21T08:52:55.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.478+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.478+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94821232690016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e44c30 con 0x563d49e30e70 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94821232690016] v36'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe1b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fee40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fee40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fee40800 5 note: GC not initialized 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe1b1fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fee40800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.479+0000 7fe2fee40800 20 Filter name: none 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe1237fe640 20 reqs_thread_entry: start 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b200 con 0x563d49e30e70 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b200 con 0x7fe2ec03c070 2024-09-21T08:52:55.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b1c0 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.480+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b1c0 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b710 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b710 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b6d0 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b6d0 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.481+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b680 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.482+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.482+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b680 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.482+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.482+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7b680 con 0x563d49e35880 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x7fe2ec03c070 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.483+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.484+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.485+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x7fe2ec03c070 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.486+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e30e70 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.487+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.488+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.488+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563d49e7d320 con 0x563d49e35880 2024-09-21T08:52:55.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.488+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.489+0000 7fe1b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.489+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94821232690016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e468f0 con 0x563d49e30e70 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.490+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94821232690016] v36'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.490+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94821232667792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e44360 con 0x7fe2ec03c070 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.491+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94821232667792] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.491+0000 7fe2fee40800 20 remove_watcher() i=0 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.491+0000 7fe2fee40800 2 removed watcher, disabling cache 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.491+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94821232666016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e44360 con 0x563d49e30e70 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.492+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94821232666016] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.492+0000 7fe2fee40800 20 remove_watcher() i=1 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.492+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94821232674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e3e5a0 con 0x563d49e3a1f0 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.494+0000 7fe2fc934640 1 -- 172.21.15.196:0/2941066876 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94821232674464] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2ec00f070 con 0x563d49e3a1f0 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.494+0000 7fe2fee40800 20 remove_watcher() i=2 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.494+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94821232679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e44360 con 0x7fe2ec03c070 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.495+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94821232679296] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x7fe2ec03c070 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.495+0000 7fe2fee40800 20 remove_watcher() i=3 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.495+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94821232683024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e406a0 con 0x563d49e30e70 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.496+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94821232683024] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f0057030 con 0x563d49e30e70 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.496+0000 7fe2fee40800 20 remove_watcher() i=4 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.496+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94821232685232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e41980 con 0x563d49e35880 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.497+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94821232685232] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.497+0000 7fe2fee40800 20 remove_watcher() i=5 2024-09-21T08:52:55.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.497+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94821232686288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e44360 con 0x563d49e35880 2024-09-21T08:52:55.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.498+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94821232686288] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.498+0000 7fe2fee40800 20 remove_watcher() i=6 2024-09-21T08:52:55.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.498+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94821232688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563d49e406a0 con 0x563d49e35880 2024-09-21T08:52:55.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fd135640 1 -- 172.21.15.196:0/2941066876 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94821232688080] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f4032030 con 0x563d49e35880 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 20 remove_watcher() i=7 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49e35880 msgr2=0x563d49e37c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49e35880 0x563d49e37c70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49e30e70 msgr2=0x563d49e33330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49e30e70 0x563d49e33330 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe2ec03c070 msgr2=0x7fe2ec01c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe2ec03c070 0x7fe2ec01c360 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563d49e3a1f0 msgr2=0x563d49e3c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563d49e3a1f0 0x563d49e3c6b0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1c8036b40 msgr2=0x7fe1c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1c8036b40 0x7fe1c8039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec018d90 tx=0x7fe2ec034000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fc133640 1 -- 172.21.15.196:0/2941066876 reap_dead start 2024-09-21T08:52:55.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 msgr2=0x563d49e25340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe2f404bae0 tx=0x7fe2f404cb50 comp rx=0 tx=0).stop 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 shutdown_connections 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/2941066876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e1bce0 0x563d49e25340 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 >> 172.21.15.196:0/2941066876 conn(0x563d49e18040 msgr2=0x563d49e16110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 shutdown_connections 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/2941066876 wait complete. 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 msgr2=0x7fe1d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 0x7fe1d4039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563d49dfbd70 tx=0x7fe2ec018e80 comp rx=0 tx=0).stop 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 msgr2=0x563d49e0f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563d49df56e0 tx=0x7fe2f400aec0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 shutdown_connections 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.500+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1d4036b40 0x7fe1d4039000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1788952185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49e0f070 0x563d49e0f490 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 >> 172.21.15.196:0/1788952185 conn(0x563d49e04000 msgr2=0x563d49e06b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 shutdown_connections 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1788952185 wait complete. 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 msgr2=0x563d49dffff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 0x563d49dffff0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 msgr2=0x563d49dfb350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 0x563d49dfb350 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 msgr2=0x7fe1e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 0x7fe1e4039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000a520 tx=0x7fe2f0052000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 msgr2=0x563d49df42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00f610 tx=0x7fe2ec001250 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 shutdown_connections 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563d49dfdc00 0x563d49dffff0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563d49d01980 0x563d49dfb350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe1e4036b90 0x7fe1e4039050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 --2- 172.21.15.196:0/1981157822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563d49c70d70 0x563d49df42e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 >> 172.21.15.196:0/1981157822 conn(0x563d49cf7df0 msgr2=0x563d49de6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 shutdown_connections 2024-09-21T08:52:55.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.501+0000 7fe2fee40800 1 -- 172.21.15.196:0/1981157822 wait complete. 2024-09-21T08:52:55.511 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-21T08:52:55.511 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T08:52:55.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-21T08:52:55.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-21T08:52:55.512 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-21T08:52:55.554 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:55.554 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.553+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.553+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09d0220800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560a314004b0 0x560a314008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09d0220800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a312c0b30 con 0x560a31400df0 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09d0220800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x560a312a2360 con 0x560a314004b0 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09cdd1b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560a314004b0 0x560a314008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09cdd1b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x560a314004b0 0x560a314008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51454/0 (socket says 172.21.15.196:51454) 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3831914483 learned_addr learned my addr 172.21.15.196:0/3831914483 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09c7fff640 1 --1- 172.21.15.196:0/3831914483 >> v1:172.21.15.29:6789/0 conn(0x560a31400df0 0x560a31405970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:41438/0 (socket says 172.21.15.196:41438) 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3831914483 >> v1:172.21.15.29:6789/0 conn(0x560a31400df0 legacy=0x560a31405970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.554+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3831914483 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a312c8e00 con 0x560a314004b0 2024-09-21T08:52:55.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.556+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3831914483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314008b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f09c000a520 tx=0x7f09c0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d85241aa9f7a755 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.556+0000 7f09cd51a640 1 -- 172.21.15.196:0/3831914483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0055070 con 0x560a314004b0 2024-09-21T08:52:55.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.556+0000 7f09cd51a640 1 -- 172.21.15.196:0/3831914483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c00515b0 con 0x560a314004b0 2024-09-21T08:52:55.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.556+0000 7f09cd51a640 1 -- 172.21.15.196:0/3831914483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c00518d0 con 0x560a314004b0 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 -- 172.21.15.196:0/3831914483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 msgr2=0x560a314008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 --2- 172.21.15.196:0/3831914483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314008b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f09c000a520 tx=0x7f09c0045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 -- 172.21.15.196:0/3831914483 shutdown_connections 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 --2- 172.21.15.196:0/3831914483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314008b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 -- 172.21.15.196:0/3831914483 >> 172.21.15.196:0/3831914483 conn(0x560a313fbde0 msgr2=0x560a313fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 -- 172.21.15.196:0/3831914483 shutdown_connections 2024-09-21T08:52:55.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.557+0000 7f09d0220800 1 -- 172.21.15.196:0/3831914483 wait complete. 2024-09-21T08:52:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.570+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.570+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09d0220800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09d0220800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560a3134d320 con 0x560a314004b0 2024-09-21T08:52:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09cdd1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09cdd1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51458/0 (socket says 172.21.15.196:51458) 2024-09-21T08:52:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09cdd1b640 1 -- 172.21.15.196:0/1038878098 learned_addr learned my addr 172.21.15.196:0/1038878098 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09cdd1b640 1 -- 172.21.15.196:0/1038878098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3129abc0 con 0x560a314004b0 2024-09-21T08:52:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/1038878098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09c0025da0 tx=0x7f09c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cca58351dd3a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f08bbe07640 1 -- 172.21.15.196:0/1038878098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0051890 con 0x560a314004b0 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f08bbe07640 1 -- 172.21.15.196:0/1038878098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0051ac0 con 0x560a314004b0 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.571+0000 7f08bbe07640 1 -- 172.21.15.196:0/1038878098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0051da0 con 0x560a314004b0 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 -- 172.21.15.196:0/1038878098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 msgr2=0x560a314f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 --2- 172.21.15.196:0/1038878098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09c0025da0 tx=0x7f09c0051000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 -- 172.21.15.196:0/1038878098 shutdown_connections 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 --2- 172.21.15.196:0/1038878098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314f2a70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 -- 172.21.15.196:0/1038878098 >> 172.21.15.196:0/1038878098 conn(0x560a313fbde0 msgr2=0x560a314ea020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 -- 172.21.15.196:0/1038878098 shutdown_connections 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 -- 172.21.15.196:0/1038878098 wait complete. 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.572+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09d0220800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09d0220800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560a314074d0 con 0x560a314004b0 2024-09-21T08:52:55.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09cdd1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09cdd1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51468/0 (socket says 172.21.15.196:51468) 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3541189292 learned_addr learned my addr 172.21.15.196:0/3541189292 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a312aefe0 con 0x560a314004b0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09c0025da0 tx=0x7f09c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.573+0000 7f08ba604640 1 -- 172.21.15.196:0/3541189292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c0073070 con 0x560a314004b0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.574+0000 7f08ba604640 1 -- 172.21.15.196:0/3541189292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c005a580 con 0x560a314004b0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.574+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a314fa8c0 con 0x560a314004b0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.574+0000 7f08ba604640 1 -- 172.21.15.196:0/3541189292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c005a860 con 0x560a314004b0 2024-09-21T08:52:55.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.574+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a314fae40 con 0x560a314004b0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.574+0000 7f08ba604640 1 -- 172.21.15.196:0/3541189292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09c0076070 con 0x560a314004b0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f08ba604640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 0x7f08b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f08ba604640 1 -- 172.21.15.196:0/3541189292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f09c0062070 con 0x560a314004b0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09c7fff640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 0x7f08b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 0x560a315013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31501a40 con 0x560a31400df0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09ce51c640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 0x560a315013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09c7fff640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 0x7f08b4039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f09b8000f60 tx=0x7f09b8006390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09ce51c640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 0x560a315013f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09ce51c640 1 -- 172.21.15.196:0/3541189292 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09c800a4a0 con 0x560a31400df0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.575+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a314fe9c0 con 0x560a31400df0 2024-09-21T08:52:55.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.576+0000 7f09ce51c640 1 -- 172.21.15.196:0/3541189292 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09c800a4a0 con 0x560a31400df0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.576+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 0x560a31506160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.576+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31506800 con 0x560a31503d70 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.576+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 0x560a31506160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 0x560a31506160 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09cdd1b640 1 -- 172.21.15.196:0/3541189292 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09c007f070 con 0x560a31503d70 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31502c10 con 0x560a31400df0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09ce51c640 1 -- 172.21.15.196:0/3541189292 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09c800a4a0 con 0x560a31400df0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a315030b0 con 0x560a31400df0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.577+0000 7f09ce51c640 1 -- 172.21.15.196:0/3541189292 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09c800a4a0 con 0x560a31400df0 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09d0220800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09d0220800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560a3129c580 con 0x560a31515120 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51474/0 (socket says 172.21.15.196:51474) 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09ce51c640 1 -- 172.21.15.196:0/3486661022 learned_addr learned my addr 172.21.15.196:0/3486661022 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.578+0000 7f09ce51c640 1 -- 172.21.15.196:0/3486661022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a31515a80 con 0x560a31515120 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f09ce51c640 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x560a314fb5a0 tx=0x7f09c80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f08b37fe640 1 -- 172.21.15.196:0/3486661022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c8014450 con 0x560a31515120 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f08b37fe640 1 -- 172.21.15.196:0/3486661022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c80145f0 con 0x560a31515120 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a31515d10 con 0x560a31515120 2024-09-21T08:52:55.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f08b37fe640 1 -- 172.21.15.196:0/3486661022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c80148d0 con 0x560a31515120 2024-09-21T08:52:55.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.579+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a315189f0 con 0x560a31515120 2024-09-21T08:52:55.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f08b37fe640 1 -- 172.21.15.196:0/3486661022 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09c8011040 con 0x560a31515120 2024-09-21T08:52:55.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f08b37fe640 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 0x7f08a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f08b37fe640 1 -- 172.21.15.196:0/3486661022 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f09c801e070 con 0x560a31515120 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 0x7f08a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 0x7f08a8039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560a31501e90 tx=0x7f09c008f3d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09d0220800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.580+0000 7f09d0220800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560a314f3160 con 0x560a31521da0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51484/0 (socket says 172.21.15.196:51484) 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f09ce51c640 1 -- 172.21.15.196:0/1291744253 learned_addr learned my addr 172.21.15.196:0/1291744253 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f09ce51c640 1 -- 172.21.15.196:0/1291744253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a31522770 con 0x560a31521da0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f09ce51c640 1 --2- 172.21.15.196:0/1291744253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f09c804cbb0 tx=0x7f09c803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f220b044b7acdfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f08b17fa640 1 -- 172.21.15.196:0/1291744253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c80167c0 con 0x560a31521da0 2024-09-21T08:52:55.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f08b17fa640 1 -- 172.21.15.196:0/1291744253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c8013ca0 con 0x560a31521da0 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.581+0000 7f08b17fa640 1 -- 172.21.15.196:0/1291744253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c8016960 con 0x560a31521da0 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- 172.21.15.196:0/1291744253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 msgr2=0x560a315221a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 --2- 172.21.15.196:0/1291744253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f09c804cbb0 tx=0x7f09c803bf60 comp rx=0 tx=0).stop 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- 172.21.15.196:0/1291744253 shutdown_connections 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 --2- 172.21.15.196:0/1291744253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a315221a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- 172.21.15.196:0/1291744253 >> 172.21.15.196:0/1291744253 conn(0x560a3151e100 msgr2=0x560a3151c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- 172.21.15.196:0/1291744253 shutdown_connections 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- 172.21.15.196:0/1291744253 wait complete. 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 Processor -- start 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- start start 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.582+0000 7f09d0220800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560a31522de0 con 0x560a31521da0 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09ce51c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51492/0 (socket says 172.21.15.196:51492) 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 learned_addr learned my addr 172.21.15.196:0/2083997327 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a315297a0 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09ce51c640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f09c80119b0 tx=0x7f09c804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f089f7fe640 1 -- 172.21.15.196:0/2083997327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c8044070 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f089f7fe640 1 -- 172.21.15.196:0/2083997327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c8013e50 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a31529a30 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f089f7fe640 1 -- 172.21.15.196:0/2083997327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c802ba60 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.583+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a3152c6e0 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.584+0000 7f089f7fe640 1 -- 172.21.15.196:0/2083997327 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09c802bc00 con 0x560a31521da0 2024-09-21T08:52:55.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.584+0000 7f089f7fe640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0898036b40 0x7f0898039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.584+0000 7f089f7fe640 1 -- 172.21.15.196:0/2083997327 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f09c800e040 con 0x560a31521da0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.584+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0898036b40 0x7f0898039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.584+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31534ee0 0x560a315373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31537af0 con 0x560a31534ee0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09c7fff640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31534ee0 0x560a315373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0898036b40 0x7f0898039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09c005cfd0 tx=0x7f09c0089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09c7fff640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31534ee0 0x560a315373a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 20 realm 2024-09-21T08:52:55.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31534380 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.585+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a315385d0 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31538ea0 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31539750 0x560a3153bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3153c2c0 con 0x560a31539750 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.586+0000 7f09ce51c640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31539750 0x560a3153bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09ce51c640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31539750 0x560a3153bb60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09d0220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09d0220800 20 searching for the correct realm 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560a3153e3c0 0x560a31540880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560a3153e3c0 0x560a31540880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.587+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560a3153e3c0 0x560a31540880 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09cdd1b640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f09c0078070 0x7f09c00643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09c7fff640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f09c0078070 0x7f09c00643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09c7fff640 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f09c0078070 0x7f09c00643b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.588+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.589+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.590+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.591+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.592+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.593+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.594+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a3153e3c0 2024-09-21T08:52:55.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.595+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31539750 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x560a31534ee0 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560a31540f50 con 0x7f09c0078070 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:55.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3153cdc0 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.596+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3153d240 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3153d6e0 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 zone default found 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 4 Realm: () 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 zonegroup default 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a315413d0 con 0x560a31539750 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3153c9f0 con 0x560a3153e3c0 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.597+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31543720 con 0x560a3153e3c0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 20 started sync module instance, tier type = 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.598+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31542a90 con 0x7f09c0078070 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.599+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.599+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94601777262512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31542a90 con 0x7f09c0078070 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.599+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31544250 con 0x560a31534ee0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.600+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94601777262512] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.600+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.600+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94601777265952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31542a90 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.600+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31544ce0 con 0x560a3153e3c0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.601+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94601777265952] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.602+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.602+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94601777260000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31542a00 con 0x560a3153e3c0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.602+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31545ba0 con 0x7f09c0078070 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.603+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.603+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94601777260000] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.603+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94601777273072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a315451d0 con 0x7f09c0078070 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.603+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31546940 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.604+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.604+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94601777275920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a315471e0 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.604+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31547c60 con 0x560a31539750 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.604+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94601777273072] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.605+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94601777275920] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.605+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.605+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94601777274128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a315471e0 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.605+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31548500 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.606+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94601777274128] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.606+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.606+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94601777278256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31548700 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.606+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31548f50 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94601777278256] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94601777284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31548de0 con 0x560a31539750 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=0 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=1 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=2 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=3 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=4 2024-09-21T08:52:55.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=5 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.607+0000 7f09d0220800 20 add_watcher() i=6 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.608+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94601777284144] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.608+0000 7f09d0220800 20 add_watcher() i=7 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.608+0000 7f09d0220800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.608+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3154c350 con 0x560a31534ee0 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.609+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.609+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94601777285264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31549810 con 0x560a31534ee0 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94601777285264] v36'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f087f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:55.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 5 note: GC not initialized 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f087e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 20 Filter name: none 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f07effff640 20 reqs_thread_entry: start 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3157fb40 con 0x560a31534ee0 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.610+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3157fb40 con 0x7f09c0078070 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3157fb00 con 0x560a31534ee0 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a3157fb00 con 0x560a3153e3c0 2024-09-21T08:52:55.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580050 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.611+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580490 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580490 con 0x560a31534ee0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580490 con 0x560a31534ee0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580490 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31580440 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.612+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a315803f0 con 0x560a31539750 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.613+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.613+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581e40 con 0x560a31534ee0 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581e40 con 0x7f09c0078070 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581e40 con 0x560a3153e3c0 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581e40 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.614+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581e40 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581dc0 con 0x560a3153e3c0 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581dc0 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581dc0 con 0x560a31534ee0 2024-09-21T08:52:55.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.615+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581dc0 con 0x560a3153e3c0 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d70 con 0x560a31539750 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x7f09c0078070 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.616+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31539750 2024-09-21T08:52:55.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31534ee0 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31534ee0 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a3153e3c0 2024-09-21T08:52:55.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31534ee0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.617+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31534ee0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a3153e3c0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a3153e3c0 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a3153e3c0 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.618+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560a31581d50 con 0x560a31539750 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.619+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.620+0000 7f087f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.620+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94601777285264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a3157da30 con 0x560a31534ee0 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.621+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94601777285264] v36'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.621+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94601777262512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31548850 con 0x7f09c0078070 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.622+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94601777262512] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.622+0000 7f09d0220800 20 remove_watcher() i=0 2024-09-21T08:52:55.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.622+0000 7f09d0220800 2 removed watcher, disabling cache 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.622+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94601777265952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31542f90 con 0x560a31534ee0 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.623+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94601777265952] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.623+0000 7f09d0220800 20 remove_watcher() i=1 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.623+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94601777260000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31543d20 con 0x560a3153e3c0 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.624+0000 7f09cdd1b640 1 -- 172.21.15.196:0/2083997327 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94601777260000] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c007f070 con 0x560a3153e3c0 2024-09-21T08:52:55.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.624+0000 7f09d0220800 20 remove_watcher() i=2 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.624+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94601777273072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31543d20 con 0x7f09c0078070 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.625+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94601777273072] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x7f09c0078070 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.625+0000 7f09d0220800 20 remove_watcher() i=3 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.625+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94601777275920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a315458f0 con 0x560a31534ee0 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.626+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94601777275920] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09b800bba0 con 0x560a31534ee0 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.626+0000 7f09d0220800 20 remove_watcher() i=4 2024-09-21T08:52:55.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.626+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94601777274128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31543d20 con 0x560a31539750 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.627+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94601777274128] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.627+0000 7f09d0220800 20 remove_watcher() i=5 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.627+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94601777278256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31546410 con 0x560a31539750 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.628+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94601777278256] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.628+0000 7f09d0220800 20 remove_watcher() i=6 2024-09-21T08:52:55.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.628+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94601777284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560a31543d20 con 0x560a31539750 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09ce51c640 1 -- 172.21.15.196:0/2083997327 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94601777284144] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c8056040 con 0x560a31539750 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 20 remove_watcher() i=7 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31539750 msgr2=0x560a3153bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31539750 0x560a3153bb60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31534ee0 msgr2=0x560a315373a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31534ee0 0x560a315373a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f09c0078070 msgr2=0x7f09c00643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f09c0078070 0x7f09c00643b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560a3153e3c0 msgr2=0x560a31540880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x560a3153e3c0 0x560a31540880 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.629+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0898036b40 msgr2=0x7f0898039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0898036b40 0x7f0898039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09c005cfd0 tx=0x7f09c0089000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 msgr2=0x560a31529260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09c7fff640 1 -- 172.21.15.196:0/2083997327 reap_dead start 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f09c80119b0 tx=0x7f09c804cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 shutdown_connections 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/2083997327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31521da0 0x560a31529260 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 >> 172.21.15.196:0/2083997327 conn(0x560a3151e100 msgr2=0x560a3151c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 shutdown_connections 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/2083997327 wait complete. 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 msgr2=0x7f08a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 0x7f08a8039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560a31501e90 tx=0x7f09c008f3d0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 msgr2=0x560a31515540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x560a314fb5a0 tx=0x7f09c80188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 shutdown_connections 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08a8036b90 0x7f08a8039050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3486661022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a31515120 0x560a31515540 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 >> 172.21.15.196:0/3486661022 conn(0x560a3150a0b0 msgr2=0x560a3150cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 shutdown_connections 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3486661022 wait complete. 2024-09-21T08:52:55.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 msgr2=0x560a31506160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 0x560a31506160 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 msgr2=0x560a315013f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 0x560a315013f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 msgr2=0x7f08b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 0x7f08b4039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f09b8000f60 tx=0x7f09b8006390 comp rx=0 tx=0).stop 2024-09-21T08:52:55.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 msgr2=0x560a314fa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.630+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09c0025da0 tx=0x7f09c0002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 shutdown_connections 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x560a31503d70 0x560a31506160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x560a31400df0 0x560a315013f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f08b4036b40 0x7f08b4039000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 --2- 172.21.15.196:0/3541189292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560a314004b0 0x560a314fa380 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 >> 172.21.15.196:0/3541189292 conn(0x560a313fbde0 msgr2=0x560a314e88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 shutdown_connections 2024-09-21T08:52:55.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.631+0000 7f09d0220800 1 -- 172.21.15.196:0/3541189292 wait complete. 2024-09-21T08:52:55.651 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-21T08:52:55.652 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-21T08:52:55.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-21T08:52:55.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-21T08:52:55.652 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-21T08:52:55.736 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:55.736 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:55.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c982f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56377f2d2df0 0x56377f3621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c982f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56377f21eb30 con 0x56377f362720 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c982f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56377f200360 con 0x56377f2d2df0 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c4aee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56377f2d2df0 0x56377f3621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c4aee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56377f2d2df0 0x56377f3621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51496/0 (socket says 172.21.15.196:51496) 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.735+0000 7f60c4aee640 1 -- 172.21.15.196:0/344091989 learned_addr learned my addr 172.21.15.196:0/344091989 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.736+0000 7f60c4aee640 1 -- 172.21.15.196:0/344091989 >> v1:172.21.15.29:6789/0 conn(0x56377f362720 legacy=0x56377f364b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.736+0000 7f60c4aee640 1 -- 172.21.15.196:0/344091989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f226e00 con 0x56377f2d2df0 2024-09-21T08:52:55.739 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c4aee640 1 --2- 172.21.15.196:0/344091989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f3621e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f60b800a520 tx=0x7f60b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47eb404c2c202e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60bf7fe640 1 -- 172.21.15.196:0/344091989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8055070 con 0x56377f2d2df0 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60bf7fe640 1 -- 172.21.15.196:0/344091989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b80515b0 con 0x56377f2d2df0 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60bf7fe640 1 -- 172.21.15.196:0/344091989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b80518d0 con 0x56377f2d2df0 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 -- 172.21.15.196:0/344091989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 msgr2=0x56377f3621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 --2- 172.21.15.196:0/344091989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f3621e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f60b800a520 tx=0x7f60b8045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 -- 172.21.15.196:0/344091989 shutdown_connections 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 --2- 172.21.15.196:0/344091989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f3621e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 -- 172.21.15.196:0/344091989 >> 172.21.15.196:0/344091989 conn(0x56377f359df0 msgr2=0x56377f35c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 -- 172.21.15.196:0/344091989 shutdown_connections 2024-09-21T08:52:55.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.738+0000 7f60c982f800 1 -- 172.21.15.196:0/344091989 wait complete. 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c982f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c982f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56377f2ab330 con 0x56377f2d2df0 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c4aee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.752+0000 7f60c4aee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51510/0 (socket says 172.21.15.196:51510) 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f60c4aee640 1 -- 172.21.15.196:0/1459092515 learned_addr learned my addr 172.21.15.196:0/1459092515 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f60c4aee640 1 -- 172.21.15.196:0/1459092515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f1f8bc0 con 0x56377f2d2df0 2024-09-21T08:52:55.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f60c4aee640 1 --2- 172.21.15.196:0/1459092515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f60b8025da0 tx=0x7f60b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f263d8152c247e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f5fb2e05640 1 -- 172.21.15.196:0/1459092515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8051950 con 0x56377f2d2df0 2024-09-21T08:52:55.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f5fb2e05640 1 -- 172.21.15.196:0/1459092515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b8051af0 con 0x56377f2d2df0 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.753+0000 7f5fb2e05640 1 -- 172.21.15.196:0/1459092515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8051dd0 con 0x56377f2d2df0 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- 172.21.15.196:0/1459092515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 msgr2=0x56377f35fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 --2- 172.21.15.196:0/1459092515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f60b8025da0 tx=0x7f60b8051000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- 172.21.15.196:0/1459092515 shutdown_connections 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 --2- 172.21.15.196:0/1459092515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f35fb10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- 172.21.15.196:0/1459092515 >> 172.21.15.196:0/1459092515 conn(0x56377f359df0 msgr2=0x56377f44a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- 172.21.15.196:0/1459092515 shutdown_connections 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- 172.21.15.196:0/1459092515 wait complete. 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.754+0000 7f60c982f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56377f3665f0 con 0x56377f2d2df0 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f60c4aee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f60c4aee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51516/0 (socket says 172.21.15.196:51516) 2024-09-21T08:52:55.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f60c4aee640 1 -- 172.21.15.196:0/3478277333 learned_addr learned my addr 172.21.15.196:0/3478277333 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.758 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f60c4aee640 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f20cfe0 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f60b8067040 tx=0x7f60b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.755+0000 7f5fb1602640 1 -- 172.21.15.196:0/3478277333 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8073070 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.756+0000 7f5fb1602640 1 -- 172.21.15.196:0/3478277333 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b805a450 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.756+0000 7f5fb1602640 1 -- 172.21.15.196:0/3478277333 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b805a730 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.756+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56377f4587f0 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.756+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56377f458d70 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.756+0000 7f5fb1602640 1 -- 172.21.15.196:0/3478277333 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f60b8076070 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f5fb1602640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 0x7f5fac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f5fb1602640 1 -- 172.21.15.196:0/3478277333 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f60b8062070 con 0x56377f2d2df0 2024-09-21T08:52:55.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60bffff640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 0x7f5fac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 0x56377f45f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f45f8a0 con 0x56377f362720 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 0x56377f45f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60bffff640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 0x7f5fac039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f60b0000f60 tx=0x7f60b0001410 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 0x56377f45f320 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c52ef640 1 -- 172.21.15.196:0/3478277333 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60c000a4a0 con 0x56377f362720 2024-09-21T08:52:55.761 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.757+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f45c8f0 con 0x56377f362720 2024-09-21T08:52:55.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.758+0000 7f60c52ef640 1 -- 172.21.15.196:0/3478277333 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60c000a4a0 con 0x56377f362720 2024-09-21T08:52:55.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.758+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 0x56377f463fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.758+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f464680 con 0x56377f461bf0 2024-09-21T08:52:55.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.758+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 0x56377f463fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 0x56377f463fe0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c4aee640 1 -- 172.21.15.196:0/3478277333 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f60b8075030 con 0x56377f461bf0 2024-09-21T08:52:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f460a90 con 0x56377f362720 2024-09-21T08:52:55.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c52ef640 1 -- 172.21.15.196:0/3478277333 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60c000a4a0 con 0x56377f362720 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f460f30 con 0x56377f362720 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.759+0000 7f60c52ef640 1 -- 172.21.15.196:0/3478277333 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f60c000a4a0 con 0x56377f362720 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c982f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c982f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56377f1fa580 con 0x56377f473010 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51520/0 (socket says 172.21.15.196:51520) 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c52ef640 1 -- 172.21.15.196:0/3753984376 learned_addr learned my addr 172.21.15.196:0/3753984376 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.760+0000 7f60c52ef640 1 -- 172.21.15.196:0/3753984376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f473970 con 0x56377f473010 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56377f459360 tx=0x7f60c00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f5faa7fc640 1 -- 172.21.15.196:0/3753984376 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c0014450 con 0x56377f473010 2024-09-21T08:52:55.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f5faa7fc640 1 -- 172.21.15.196:0/3753984376 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c00145f0 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56377f473c00 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f5faa7fc640 1 -- 172.21.15.196:0/3753984376 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c00148d0 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.761+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56377f4768e0 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f5faa7fc640 1 -- 172.21.15.196:0/3753984376 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f60c0011040 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f5faa7fc640 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 0x7f5f9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f5faa7fc640 1 -- 172.21.15.196:0/3753984376 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f60c001e070 con 0x56377f473010 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 0x7f5f9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 0x7f5f9c039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x56377f45fd10 tx=0x7f60b806f4a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c982f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.762+0000 7f60c982f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56377f35e0f0 con 0x56377f47fcb0 2024-09-21T08:52:55.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51522/0 (socket says 172.21.15.196:51522) 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f60c52ef640 1 -- 172.21.15.196:0/1976070380 learned_addr learned my addr 172.21.15.196:0/1976070380 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f60c52ef640 1 -- 172.21.15.196:0/1976070380 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f480680 con 0x56377f47fcb0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f60c52ef640 1 --2- 172.21.15.196:0/1976070380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f60c004cb90 tx=0x7f60c0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fdcbec92b9179 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f5f9bfff640 1 -- 172.21.15.196:0/1976070380 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c0044070 con 0x56377f47fcb0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f5f9bfff640 1 -- 172.21.15.196:0/1976070380 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c002ba60 con 0x56377f47fcb0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.763+0000 7f5f9bfff640 1 -- 172.21.15.196:0/1976070380 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c002bd60 con 0x56377f47fcb0 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- 172.21.15.196:0/1976070380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 msgr2=0x56377f4800b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 --2- 172.21.15.196:0/1976070380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f60c004cb90 tx=0x7f60c0011700 comp rx=0 tx=0).stop 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- 172.21.15.196:0/1976070380 shutdown_connections 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 --2- 172.21.15.196:0/1976070380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f4800b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- 172.21.15.196:0/1976070380 >> 172.21.15.196:0/1976070380 conn(0x56377f47c060 msgr2=0x56377f47a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- 172.21.15.196:0/1976070380 shutdown_connections 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- 172.21.15.196:0/1976070380 wait complete. 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 Processor -- start 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- start start 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c982f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56377f480c50 con 0x56377f47fcb0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c52ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51528/0 (socket says 172.21.15.196:51528) 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.764+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 learned_addr learned my addr 172.21.15.196:0/3396217973 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377f487640 con 0x56377f47fcb0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f60c002f040 tx=0x7f60c004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f5f9a7fc640 1 -- 172.21.15.196:0/3396217973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c002b860 con 0x56377f47fcb0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f5f9a7fc640 1 -- 172.21.15.196:0/3396217973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c004e0d0 con 0x56377f47fcb0 2024-09-21T08:52:55.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56377f4878d0 con 0x56377f47fcb0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f5f9a7fc640 1 -- 172.21.15.196:0/3396217973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60c004e3d0 con 0x56377f47fcb0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.765+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56377f48a580 con 0x56377f47fcb0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.766+0000 7f5f9a7fc640 1 -- 172.21.15.196:0/3396217973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f60c003e020 con 0x56377f47fcb0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.766+0000 7f5f9a7fc640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f90036b90 0x7f5f90039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.766+0000 7f5f9a7fc640 1 -- 172.21.15.196:0/3396217973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f60c003c020 con 0x56377f47fcb0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.766+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f90036b90 0x7f5f90039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f492d60 0x56377f495220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f90036b90 0x7f5f90039050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60b808f510 tx=0x7f60b8083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f495970 con 0x56377f492d60 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60bffff640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f492d60 0x56377f495220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60bffff640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f492d60 0x56377f495220 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60b0010620 con 0x56377f492d60 2024-09-21T08:52:55.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 20 realm 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.767+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f4921b0 con 0x56377f492d60 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60b0010620 con 0x56377f492d60 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f496450 con 0x56377f492d60 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60b0010620 con 0x56377f492d60 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f496d20 con 0x56377f492d60 2024-09-21T08:52:55.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60b0010620 con 0x56377f492d60 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f497620 0x56377f499a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.768+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f497620 0x56377f499a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c52ef640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f497620 0x56377f499a50 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c982f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c982f800 20 searching for the correct realm 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56377f49c250 0x56377f49e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49ede0 con 0x56377f49c250 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.769+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56377f49c250 0x56377f49e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56377f49c250 0x56377f49e710 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60c4aee640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f60b809e070 0x7f60b80813a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49ede0 con 0x7f60b809e070 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60bffff640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f60b809e070 0x7f60b80813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60bffff640 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f60b809e070 0x7f60b80813a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.770+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b0010620 con 0x7f60b809e070 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49ede0 con 0x56377f497620 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b0010620 con 0x56377f492d60 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.771+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x7f60b809e070 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.772+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x7f60b809e070 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.773+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.774+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.775+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x7f60b809e070 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.776+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x7f60b809e070 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f49c250 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.777+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f497620 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x56377f492d60 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a1b0 con 0x7f60b809e070 2024-09-21T08:52:55.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:55.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49ab50 con 0x56377f492d60 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.778+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49af40 con 0x56377f492d60 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49b360 con 0x56377f492d60 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 zone default found 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 4 Realm: () 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 zonegroup default 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49b790 con 0x56377f497620 2024-09-21T08:52:55.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f49a760 con 0x56377f49c250 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.779+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a11b0 con 0x56377f49c250 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 20 started sync module instance, tier type = 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.780+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a0580 con 0x7f60b809e070 2024-09-21T08:52:55.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.781+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.781+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796358748832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a0580 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.781+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a1ce0 con 0x56377f492d60 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.782+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796358748832] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.782+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.782+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796358752208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a0580 con 0x56377f492d60 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.782+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a2790 con 0x56377f49c250 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.783+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796358752208] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.783+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.783+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796358746320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a04f0 con 0x56377f49c250 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.783+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a3650 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.784+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.784+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796358759328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a3ef0 con 0x7f60b809e070 2024-09-21T08:52:55.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.784+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a49a0 con 0x56377f492d60 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.785+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796358746320] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.785+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796358759328] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.786+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.786+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796358757248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a3940 con 0x56377f492d60 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.786+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a5240 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.787+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.787+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796358765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a5660 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.787+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a5eb0 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.787+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796358757248] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.788+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796358765968] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.788+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.788+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796358767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a5a80 con 0x56377f497620 2024-09-21T08:52:55.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.788+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a62d0 con 0x56377f497620 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796358767024] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796358768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a6160 con 0x56377f497620 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=0 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=1 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=2 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=3 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=4 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=5 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.789+0000 7f60c982f800 20 add_watcher() i=6 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.790+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796358768560] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.790+0000 7f60c982f800 20 add_watcher() i=7 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.790+0000 7f60c982f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:55.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.790+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a96d0 con 0x56377f492d60 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.791+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.791+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796358769680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a6bf0 con 0x56377f492d60 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.791+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796358769680] v36'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f5f7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 5 note: GC not initialized 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f5f79fe3640 20 reqs_thread_entry: start 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 20 Filter name: none 2024-09-21T08:52:55.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f5eeb7fe640 20 reqs_thread_entry: start 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.792+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f4dc660 con 0x56377f492d60 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.793+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.793+0000 7f60c982f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.793+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56377f4ddbb0 con 0x56377f497620 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.793+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.794+0000 7f5f7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.794+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796358769680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a9030 con 0x56377f492d60 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.795+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94796358769680] v36'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.795+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796358748832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a8b80 con 0x7f60b809e070 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.796+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94796358748832] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.796+0000 7f60c982f800 20 remove_watcher() i=0 2024-09-21T08:52:55.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.796+0000 7f60c982f800 2 removed watcher, disabling cache 2024-09-21T08:52:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.796+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796358752208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a0aa0 con 0x56377f492d60 2024-09-21T08:52:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.797+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94796358752208] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.797+0000 7f60c982f800 20 remove_watcher() i=1 2024-09-21T08:52:55.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.797+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796358746320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a0aa0 con 0x56377f49c250 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.799+0000 7f60c4aee640 1 -- 172.21.15.196:0/3396217973 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94796358746320] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b808f040 con 0x56377f49c250 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.799+0000 7f60c982f800 20 remove_watcher() i=2 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.799+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796358759328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a00d0 con 0x7f60b809e070 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.800+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94796358759328] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x7f60b809e070 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.800+0000 7f60c982f800 20 remove_watcher() i=3 2024-09-21T08:52:55.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.800+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796358757248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a33a0 con 0x56377f492d60 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.801+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94796358757248] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60b002a040 con 0x56377f492d60 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.801+0000 7f60c982f800 20 remove_watcher() i=4 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.801+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796358765968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a00d0 con 0x56377f497620 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.802+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94796358765968] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.802+0000 7f60c982f800 20 remove_watcher() i=5 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.802+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796358767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a33a0 con 0x56377f497620 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.803+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94796358767024] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.803+0000 7f60c982f800 20 remove_watcher() i=6 2024-09-21T08:52:55.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.803+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796358768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56377f4a00d0 con 0x56377f497620 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c52ef640 1 -- 172.21.15.196:0/3396217973 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94796358768560] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60c002a070 con 0x56377f497620 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 20 remove_watcher() i=7 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f497620 msgr2=0x56377f499a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f497620 0x56377f499a50 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f492d60 msgr2=0x56377f495220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f492d60 0x56377f495220 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f60b809e070 msgr2=0x7f60b80813a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f60b809e070 0x7f60b80813a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56377f49c250 msgr2=0x56377f49e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56377f49c250 0x56377f49e710 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f90036b90 msgr2=0x7f5f90039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.804+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f90036b90 0x7f5f90039050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60b808f510 tx=0x7f60b8083000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 msgr2=0x56377f487100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60bffff640 1 -- 172.21.15.196:0/3396217973 reap_dead start 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f60c002f040 tx=0x7f60c004cb20 comp rx=0 tx=0).stop 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 shutdown_connections 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3396217973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f47fcb0 0x56377f487100 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 >> 172.21.15.196:0/3396217973 conn(0x56377f47c060 msgr2=0x56377f47a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 shutdown_connections 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3396217973 wait complete. 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 msgr2=0x7f5f9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 0x7f5f9c039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x56377f45fd10 tx=0x7f60b806f4a0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 msgr2=0x56377f473430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56377f459360 tx=0x7f60c00188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 shutdown_connections 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5f9c036b40 0x7f5f9c039000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3753984376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f473010 0x56377f473430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 >> 172.21.15.196:0/3753984376 conn(0x56377f467fa0 msgr2=0x56377f46ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 shutdown_connections 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3753984376 wait complete. 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 msgr2=0x56377f463fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 0x56377f463fe0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 msgr2=0x56377f45f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 0x56377f45f320 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 msgr2=0x7f5fac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 0x7f5fac039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f60b0000f60 tx=0x7f60b0001410 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 msgr2=0x56377f4582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.805+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f60b8067040 tx=0x7f60b8002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 shutdown_connections 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56377f461bf0 0x56377f463fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56377f362720 0x56377f45f320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5fac036b40 0x7f5fac039000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 --2- 172.21.15.196:0/3478277333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56377f2d2df0 0x56377f4582b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 >> 172.21.15.196:0/3478277333 conn(0x56377f359df0 msgr2=0x56377f35e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 shutdown_connections 2024-09-21T08:52:55.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.806+0000 7f60c982f800 1 -- 172.21.15.196:0/3478277333 wait complete. 2024-09-21T08:52:55.818 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-21T08:52:55.818 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-21T08:52:55.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-21T08:52:55.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-21T08:52:55.819 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-21T08:52:55.865 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:55.865 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.864+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.864+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6df282f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556aab721920 0x556aab723d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6df282f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556aab5ddb30 con 0x556aab71d4e0 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6df282f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556aab5bf360 con 0x556aab721920 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6de7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556aab721920 0x556aab723d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6dedaee640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556aab71d4e0 0x556aab71d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:41452/0 (socket says 172.21.15.196:41452) 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6de7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556aab721920 0x556aab723d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51534/0 (socket says 172.21.15.196:51534) 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6dedaee640 1 -- 172.21.15.196:0/3035929858 learned_addr learned my addr 172.21.15.196:0/3035929858 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6de7fff640 1 -- 172.21.15.196:0/3035929858 >> v1:172.21.15.29:6789/0 conn(0x556aab71d4e0 legacy=0x556aab71d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.865+0000 7f6de7fff640 1 -- 172.21.15.196:0/3035929858 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab5e5e00 con 0x556aab721920 2024-09-21T08:52:55.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.867+0000 7f6de7fff640 1 --2- 172.21.15.196:0/3035929858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab721920 0x556aab723d10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800a470 tx=0x7f6dd8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a08878123d92f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.867+0000 7f6ded2ed640 1 -- 172.21.15.196:0/3035929858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd8053570 con 0x556aab721920 2024-09-21T08:52:55.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.867+0000 7f6ded2ed640 1 -- 172.21.15.196:0/3035929858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd8058070 con 0x556aab721920 2024-09-21T08:52:55.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.867+0000 7f6ded2ed640 1 -- 172.21.15.196:0/3035929858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd8053880 con 0x556aab721920 2024-09-21T08:52:55.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 -- 172.21.15.196:0/3035929858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab721920 msgr2=0x556aab723d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 --2- 172.21.15.196:0/3035929858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab721920 0x556aab723d10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800a470 tx=0x7f6dd8045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 -- 172.21.15.196:0/3035929858 shutdown_connections 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 --2- 172.21.15.196:0/3035929858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab721920 0x556aab723d10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 -- 172.21.15.196:0/3035929858 >> 172.21.15.196:0/3035929858 conn(0x556aab718db0 msgr2=0x556aab71b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 -- 172.21.15.196:0/3035929858 shutdown_connections 2024-09-21T08:52:55.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.868+0000 7f6df282f800 1 -- 172.21.15.196:0/3035929858 wait complete. 2024-09-21T08:52:55.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.881+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.881+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6df282f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6df282f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556aab66a360 con 0x556aab71d4e0 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6dedaee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6dedaee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51538/0 (socket says 172.21.15.196:51538) 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6dedaee640 1 -- 172.21.15.196:0/534284294 learned_addr learned my addr 172.21.15.196:0/534284294 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.882+0000 7f6dedaee640 1 -- 172.21.15.196:0/534284294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab5b7bc0 con 0x556aab71d4e0 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6dedaee640 1 --2- 172.21.15.196:0/534284294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6de0001e10 tx=0x7f6de000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2196075d7b5bc85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6cdbe07640 1 -- 172.21.15.196:0/534284294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de0012020 con 0x556aab71d4e0 2024-09-21T08:52:55.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6cdbe07640 1 -- 172.21.15.196:0/534284294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de000e5a0 con 0x556aab71d4e0 2024-09-21T08:52:55.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6cdbe07640 1 -- 172.21.15.196:0/534284294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de000e8e0 con 0x556aab71d4e0 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6df282f800 1 -- 172.21.15.196:0/534284294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 msgr2=0x556aab6925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6df282f800 1 --2- 172.21.15.196:0/534284294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6de0001e10 tx=0x7f6de000b780 comp rx=0 tx=0).stop 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6df282f800 1 -- 172.21.15.196:0/534284294 shutdown_connections 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6df282f800 1 --2- 172.21.15.196:0/534284294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab6925c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.883+0000 7f6df282f800 1 -- 172.21.15.196:0/534284294 >> 172.21.15.196:0/534284294 conn(0x556aab718db0 msgr2=0x556aab808170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 -- 172.21.15.196:0/534284294 shutdown_connections 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 -- 172.21.15.196:0/534284294 wait complete. 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6df282f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556aab724550 con 0x556aab71d4e0 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6dedaee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6dedaee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51552/0 (socket says 172.21.15.196:51552) 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.884+0000 7f6dedaee640 1 -- 172.21.15.196:0/3865378909 learned_addr learned my addr 172.21.15.196:0/3865378909 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6dedaee640 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab5cbfe0 con 0x556aab71d4e0 2024-09-21T08:52:55.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6dedaee640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6de000b7c0 tx=0x7f6de0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6cda604640 1 -- 172.21.15.196:0/3865378909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de0012030 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6cda604640 1 -- 172.21.15.196:0/3865378909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de0001470 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aab80c600 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6cda604640 1 -- 172.21.15.196:0/3865378909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de001a8d0 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.885+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aab80cb20 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6cda604640 1 -- 172.21.15.196:0/3865378909 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6de0015020 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6cda604640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 0x7f6cd4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6cda604640 1 -- 172.21.15.196:0/3865378909 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6de0020030 con 0x556aab71d4e0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6de7fff640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 0x7f6cd4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 0x556aab81e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab81ebf0 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.886+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 0x556aab81e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 0x556aab81e6b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6de7fff640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 0x7f6cd4039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8057000 tx=0x7f6dd8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6dee2ef640 1 -- 172.21.15.196:0/3865378909 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6de800a4a0 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab81f440 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6dee2ef640 1 -- 172.21.15.196:0/3865378909 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6de800a4a0 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 0x556aab823230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab8239c0 con 0x556aab820d90 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.887+0000 7f6dedaee640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 0x556aab823230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.888+0000 7f6dedaee640 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 0x556aab823230 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.888+0000 7f6dedaee640 1 -- 172.21.15.196:0/3865378909 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab820d90 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.888+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab81fc90 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.888+0000 7f6dee2ef640 1 -- 172.21.15.196:0/3865378909 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6de800a4a0 con 0x556aab721920 2024-09-21T08:52:55.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.888+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab820030 con 0x556aab721920 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6dee2ef640 1 -- 172.21.15.196:0/3865378909 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6de800a4a0 con 0x556aab721920 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6df282f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6df282f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556aab80e450 con 0x556aab832340 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51568/0 (socket says 172.21.15.196:51568) 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.889+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1875971185 learned_addr learned my addr 172.21.15.196:0/1875971185 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1875971185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab832ca0 con 0x556aab832340 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x556aab80d900 tx=0x7f6de80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6cd37fe640 1 -- 172.21.15.196:0/1875971185 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8014450 con 0x556aab832340 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6cd37fe640 1 -- 172.21.15.196:0/1875971185 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de80145f0 con 0x556aab832340 2024-09-21T08:52:55.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aab832f30 con 0x556aab832340 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6cd37fe640 1 -- 172.21.15.196:0/1875971185 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de80148d0 con 0x556aab832340 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.890+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aab835c10 con 0x556aab832340 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6cd37fe640 1 -- 172.21.15.196:0/1875971185 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6de8011040 con 0x556aab832340 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6cd37fe640 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 0x7f6cc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6cd37fe640 1 -- 172.21.15.196:0/1875971185 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6de801e070 con 0x556aab832340 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 0x7f6cc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.891+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 0x7f6cc8039050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556aab80cff0 tx=0x7f6de004b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6df282f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6df282f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556aab5b9580 con 0x556aab83ef90 2024-09-21T08:52:55.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51580/0 (socket says 172.21.15.196:51580) 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6dee2ef640 1 -- 172.21.15.196:0/2441455600 learned_addr learned my addr 172.21.15.196:0/2441455600 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6dee2ef640 1 -- 172.21.15.196:0/2441455600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab83f960 con 0x556aab83ef90 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/2441455600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6de804cbb0 tx=0x7f6de8011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404a478f98186686 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6cd17fa640 1 -- 172.21.15.196:0/2441455600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8013dc0 con 0x556aab83ef90 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.892+0000 7f6cd17fa640 1 -- 172.21.15.196:0/2441455600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8014a70 con 0x556aab83ef90 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6cd17fa640 1 -- 172.21.15.196:0/2441455600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8014d50 con 0x556aab83ef90 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- 172.21.15.196:0/2441455600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 msgr2=0x556aab83f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 --2- 172.21.15.196:0/2441455600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6de804cbb0 tx=0x7f6de8011970 comp rx=0 tx=0).stop 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- 172.21.15.196:0/2441455600 shutdown_connections 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 --2- 172.21.15.196:0/2441455600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab83f390 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- 172.21.15.196:0/2441455600 >> 172.21.15.196:0/2441455600 conn(0x556aab83b340 msgr2=0x556aab839440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- 172.21.15.196:0/2441455600 shutdown_connections 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- 172.21.15.196:0/2441455600 wait complete. 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 Processor -- start 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- start start 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.893+0000 7f6df282f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556aab83fdb0 con 0x556aab83ef90 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6dee2ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51594/0 (socket says 172.21.15.196:51594) 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 learned_addr learned my addr 172.21.15.196:0/1994557765 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab8468b0 con 0x556aab83ef90 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6de8011be0 tx=0x7f6de804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6cbf7fe640 1 -- 172.21.15.196:0/1994557765 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8044030 con 0x556aab83ef90 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6cbf7fe640 1 -- 172.21.15.196:0/1994557765 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8022a80 con 0x556aab83ef90 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6cbf7fe640 1 -- 172.21.15.196:0/1994557765 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8022d80 con 0x556aab83ef90 2024-09-21T08:52:55.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aab846b40 con 0x556aab83ef90 2024-09-21T08:52:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.894+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aab8497f0 con 0x556aab83ef90 2024-09-21T08:52:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.895+0000 7f6cbf7fe640 1 -- 172.21.15.196:0/1994557765 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6de804e9a0 con 0x556aab83ef90 2024-09-21T08:52:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.895+0000 7f6cbf7fe640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cb8036b40 0x7f6cb8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.895+0000 7f6cbf7fe640 1 -- 172.21.15.196:0/1994557765 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6de8045070 con 0x556aab83ef90 2024-09-21T08:52:55.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.895+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cb8036b40 0x7f6cb8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cb8036b40 0x7f6cb8039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6de0000fd0 tx=0x7f6de0033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab851f90 0x556aab854450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab854ba0 con 0x556aab851f90 2024-09-21T08:52:55.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6de7fff640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab851f90 0x556aab854450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6de7fff640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab851f90 0x556aab854450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.896+0000 7f6df282f800 20 realm 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab854fd0 con 0x556aab851f90 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab8558a0 con 0x556aab851f90 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab855c40 con 0x556aab851f90 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab8569a0 0x556aab858d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab8592d0 con 0x556aab8569a0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.897+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab8569a0 0x556aab858d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6dee2ef640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab8569a0 0x556aab858d90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6df282f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6df282f800 20 searching for the correct realm 2024-09-21T08:52:55.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556aab85b310 0x556aab85d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556aab85b310 0x556aab85d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.898+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556aab85b310 0x556aab85d7d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6dedaee640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6de0017050 0x7f6de00405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6de7fff640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6de0017050 0x7f6de00405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6de7fff640 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6de0017050 0x7f6de00405b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.899+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.900+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.901+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.902+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.903+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.904+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.905+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab85b310 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.906+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x556aab851f90 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aab85dea0 con 0x7f6de0017050 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab859d10 con 0x556aab851f90 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab85a190 con 0x556aab851f90 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.907+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab85a630 con 0x556aab851f90 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 zone default found 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 4 Realm: () 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:55.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 zonegroup default 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab85e320 con 0x556aab8569a0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab860550 con 0x556aab85b310 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.908+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab8608f0 con 0x556aab85b310 2024-09-21T08:52:55.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 20 started sync module instance, tier type = 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.909+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab85f990 con 0x7f6de0017050 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.910+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.910+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916632579504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab85f990 con 0x7f6de0017050 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.910+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab8612b0 con 0x556aab851f90 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.911+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916632579504] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.911+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.911+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916632577728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab8612b0 con 0x556aab851f90 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.911+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab861cb0 con 0x556aab85b310 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.912+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.912+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916632586176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab862550 con 0x556aab85b310 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.912+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab862fb0 con 0x7f6de0017050 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.912+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916632577728] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.913+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916632586176] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.913+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.913+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916632588448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab862a90 con 0x7f6de0017050 2024-09-21T08:52:55.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.913+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab863850 con 0x556aab851f90 2024-09-21T08:52:55.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.914+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.914+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916632593232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab863770 con 0x556aab851f90 2024-09-21T08:52:55.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.914+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab864750 con 0x556aab8569a0 2024-09-21T08:52:55.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.914+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916632588448] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.915+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.915+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916632583680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab864b70 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.915+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865530 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.915+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916632593232] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.916+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916632583680] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.916+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.916+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916632597088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865080 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.916+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865a40 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916632597088] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916632595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865a40 con 0x556aab8569a0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=0 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=1 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=2 2024-09-21T08:52:55.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=3 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=4 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=5 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.917+0000 7f6df282f800 20 add_watcher() i=6 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.918+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916632595520] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.919+0000 7f6df282f800 20 add_watcher() i=7 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.919+0000 7f6df282f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.919+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab868e70 con 0x556aab851f90 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.919+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.919+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916632602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab866330 con 0x556aab851f90 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916632602464] v36'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6c9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6df282f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6df282f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6df282f800 5 note: GC not initialized 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.920+0000 7f6c9e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 20 Filter name: none 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6c0ffff640 20 reqs_thread_entry: start 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab89bda0 con 0x556aab851f90 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.921+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aab89d2f0 con 0x556aab8569a0 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.922+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.922+0000 7f6c9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.922+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916632602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab84ef00 con 0x556aab851f90 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.923+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93916632602464] v36'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.923+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916632579504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865730 con 0x7f6de0017050 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.924+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93916632579504] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.924+0000 7f6df282f800 20 remove_watcher() i=0 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.924+0000 7f6df282f800 2 removed watcher, disabling cache 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.924+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916632577728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab865730 con 0x556aab851f90 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.925+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93916632577728] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.925+0000 7f6df282f800 20 remove_watcher() i=1 2024-09-21T08:52:55.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.925+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916632586176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab85f6c0 con 0x556aab85b310 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.927+0000 7f6dedaee640 1 -- 172.21.15.196:0/1994557765 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93916632586176] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de002dcf0 con 0x556aab85b310 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.927+0000 7f6df282f800 20 remove_watcher() i=2 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.927+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916632588448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab8617c0 con 0x7f6de0017050 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.928+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93916632588448] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x7f6de0017050 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.928+0000 7f6df282f800 20 remove_watcher() i=3 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.928+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916632593232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab8617c0 con 0x556aab851f90 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.929+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93916632593232] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dd8051070 con 0x556aab851f90 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.929+0000 7f6df282f800 20 remove_watcher() i=4 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.929+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916632583680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab863350 con 0x556aab8569a0 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.930+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93916632583680] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.930+0000 7f6df282f800 20 remove_watcher() i=5 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.930+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916632597088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab8617c0 con 0x556aab8569a0 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.931+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93916632597088] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.931+0000 7f6df282f800 20 remove_watcher() i=6 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.931+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916632595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aab863350 con 0x556aab8569a0 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6dee2ef640 1 -- 172.21.15.196:0/1994557765 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93916632595520] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6de802a070 con 0x556aab8569a0 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 20 remove_watcher() i=7 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab8569a0 msgr2=0x556aab858d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab8569a0 0x556aab858d90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab851f90 msgr2=0x556aab854450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab851f90 0x556aab854450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6de0017050 msgr2=0x7f6de00405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6de0017050 0x7f6de00405b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556aab85b310 msgr2=0x556aab85d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x556aab85b310 0x556aab85d7d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cb8036b40 msgr2=0x7f6cb8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cb8036b40 0x7f6cb8039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6de0000fd0 tx=0x7f6de0033000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 msgr2=0x556aab846370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6de7fff640 1 -- 172.21.15.196:0/1994557765 reap_dead start 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6de8011be0 tx=0x7f6de804cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 shutdown_connections 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1994557765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab83ef90 0x556aab846370 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 >> 172.21.15.196:0/1994557765 conn(0x556aab83b340 msgr2=0x556aab839410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 shutdown_connections 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1994557765 wait complete. 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 msgr2=0x7f6cc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 0x7f6cc8039050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x556aab80cff0 tx=0x7f6de004b030 comp rx=0 tx=0).stop 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 msgr2=0x556aab832760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x556aab80d900 tx=0x7f6de80188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 shutdown_connections 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cc8036b90 0x7f6cc8039050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 --2- 172.21.15.196:0/1875971185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab832340 0x556aab832760 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 >> 172.21.15.196:0/1875971185 conn(0x556aab8272d0 msgr2=0x556aab829e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 shutdown_connections 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.932+0000 7f6df282f800 1 -- 172.21.15.196:0/1875971185 wait complete. 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 msgr2=0x556aab823230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 0x556aab823230 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 msgr2=0x556aab81e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 0x556aab81e6b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 msgr2=0x7f6cd4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 0x7f6cd4039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8057000 tx=0x7f6dd8052000 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 msgr2=0x556aab80df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6de000b7c0 tx=0x7f6de0000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 shutdown_connections 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x556aab820d90 0x556aab823230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556aab721920 0x556aab81e6b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6cd4036b90 0x7f6cd4039050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 --2- 172.21.15.196:0/3865378909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556aab71d4e0 0x556aab80df10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 >> 172.21.15.196:0/3865378909 conn(0x556aab718db0 msgr2=0x556aab806a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 shutdown_connections 2024-09-21T08:52:55.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.933+0000 7f6df282f800 1 -- 172.21.15.196:0/3865378909 wait complete. 2024-09-21T08:52:55.945 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-21T08:52:55.946 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-21T08:52:55.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-21T08:52:55.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-21T08:52:55.946 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-21T08:52:55.992 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:55.992 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.991+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0ca539800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b073f329b0 0x55b073f31570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0ca539800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b073e7bb30 con 0x55b073f325b0 2024-09-21T08:52:55.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0ca539800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b073e5d360 con 0x55b073f329b0 2024-09-21T08:52:55.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c59d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b073f329b0 0x55b073f31570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:55.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c59d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b073f329b0 0x55b073f31570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51604/0 (socket says 172.21.15.196:51604) 2024-09-21T08:52:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c61d8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b073f325b0 0x55b073f30d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:41458/0 (socket says 172.21.15.196:41458) 2024-09-21T08:52:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c59d7640 1 -- 172.21.15.196:0/1916676592 learned_addr learned my addr 172.21.15.196:0/1916676592 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c59d7640 1 -- 172.21.15.196:0/1916676592 >> v1:172.21.15.29:6789/0 conn(0x55b073f325b0 legacy=0x55b073f30d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c51d6640 1 -- 172.21.15.196:0/1916676592 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527159914 0 0) 0x55b073e7bb30 con 0x55b073f325b0 2024-09-21T08:52:55.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.992+0000 7ff0c59d7640 1 -- 172.21.15.196:0/1916676592 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b073e83e00 con 0x55b073f329b0 2024-09-21T08:52:55.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.994+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/1916676592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f329b0 0x55b073f31570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a520 tx=0x7ff0bc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855c7c35e04d9c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:55.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.994+0000 7ff0c51d6640 1 -- 172.21.15.196:0/1916676592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0bc055070 con 0x55b073f329b0 2024-09-21T08:52:55.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.994+0000 7ff0c51d6640 1 -- 172.21.15.196:0/1916676592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0515b0 con 0x55b073f329b0 2024-09-21T08:52:55.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.994+0000 7ff0c51d6640 1 -- 172.21.15.196:0/1916676592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0bc0518d0 con 0x55b073f329b0 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 -- 172.21.15.196:0/1916676592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f329b0 msgr2=0x55b073f31570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1916676592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f329b0 0x55b073f31570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00a520 tx=0x7ff0bc045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 -- 172.21.15.196:0/1916676592 shutdown_connections 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1916676592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f329b0 0x55b073f31570 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 -- 172.21.15.196:0/1916676592 >> 172.21.15.196:0/1916676592 conn(0x55b073fb7fe0 msgr2=0x55b073fba400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 -- 172.21.15.196:0/1916676592 shutdown_connections 2024-09-21T08:52:55.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:55.995+0000 7ff0ca539800 1 -- 172.21.15.196:0/1916676592 wait complete. 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0ca539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0ca539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b073f08360 con 0x55b073f325b0 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0c61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0c61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51614/0 (socket says 172.21.15.196:51614) 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0c61d8640 1 -- 172.21.15.196:0/3727619247 learned_addr learned my addr 172.21.15.196:0/3727619247 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.009+0000 7ff0c61d8640 1 -- 172.21.15.196:0/3727619247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b073e55bc0 con 0x55b073f325b0 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/3727619247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b240 tx=0x7ff0b800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0e4fc422f50d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7fefb4608640 1 -- 172.21.15.196:0/3727619247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8008070 con 0x55b073f325b0 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7fefb4608640 1 -- 172.21.15.196:0/3727619247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b800d500 con 0x55b073f325b0 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7fefb4608640 1 -- 172.21.15.196:0/3727619247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b800d860 con 0x55b073f325b0 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7ff0ca539800 1 -- 172.21.15.196:0/3727619247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 msgr2=0x55b0740ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.010+0000 7ff0ca539800 1 --2- 172.21.15.196:0/3727619247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b240 tx=0x7ff0b800b700 comp rx=0 tx=0).stop 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- 172.21.15.196:0/3727619247 shutdown_connections 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 --2- 172.21.15.196:0/3727619247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740ad8d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- 172.21.15.196:0/3727619247 >> 172.21.15.196:0/3727619247 conn(0x55b073fb7fe0 msgr2=0x55b0740a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- 172.21.15.196:0/3727619247 shutdown_connections 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- 172.21.15.196:0/3727619247 wait complete. 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0ca539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b073fc5950 con 0x55b073f325b0 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0c61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0c61d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51618/0 (socket says 172.21.15.196:51618) 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.011+0000 7ff0c61d8640 1 -- 172.21.15.196:0/1562751595 learned_addr learned my addr 172.21.15.196:0/1562751595 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7ff0c61d8640 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b073e69fe0 con 0x55b073f325b0 2024-09-21T08:52:56.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55b0740ae730 tx=0x7ff0b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7fefb2e05640 1 -- 172.21.15.196:0/1562751595 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8019870 con 0x55b073f325b0 2024-09-21T08:52:56.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7fefb2e05640 1 -- 172.21.15.196:0/1562751595 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8019a10 con 0x55b073f325b0 2024-09-21T08:52:56.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0740b5830 con 0x55b073f325b0 2024-09-21T08:52:56.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7fefb2e05640 1 -- 172.21.15.196:0/1562751595 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8019d30 con 0x55b073f325b0 2024-09-21T08:52:56.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.012+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0740b5d50 con 0x55b073f325b0 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7fefb2e05640 1 -- 172.21.15.196:0/1562751595 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0b8017040 con 0x55b073f325b0 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7fefb2e05640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 0x7fefac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7fefb2e05640 1 -- 172.21.15.196:0/1562751595 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff0b8015020 con 0x55b073f325b0 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 0x7fefac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 0x55b0740bc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740bccc0 con 0x55b0740ba350 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.013+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 0x55b0740bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 0x7fefac039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc057000 tx=0x7ff0bc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 0x55b0740bc740 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0c69d9640 1 -- 172.21.15.196:0/1562751595 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55b0740ba350 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740b9930 con 0x55b0740ba350 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0c69d9640 1 -- 172.21.15.196:0/1562751595 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55b0740ba350 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 0x55b0740c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.014+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740c1a80 con 0x55b0740beff0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 0x55b0740c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 0x55b0740c13e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0c61d8640 1 -- 172.21.15.196:0/1562751595 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740beff0 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740bde90 con 0x55b0740ba350 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0c69d9640 1 -- 172.21.15.196:0/1562751595 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55b0740ba350 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.015+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740be330 con 0x55b0740ba350 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0c69d9640 1 -- 172.21.15.196:0/1562751595 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55b0740ba350 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0ca539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0ca539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b073e57580 con 0x55b0740d0410 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51628/0 (socket says 172.21.15.196:51628) 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.016+0000 7ff0c69d9640 1 -- 172.21.15.196:0/363293061 learned_addr learned my addr 172.21.15.196:0/363293061 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7ff0c69d9640 1 -- 172.21.15.196:0/363293061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0740d0d70 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55b0740b63a0 tx=0x7ff0c00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7fefabfff640 1 -- 172.21.15.196:0/363293061 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c0014450 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7fefabfff640 1 -- 172.21.15.196:0/363293061 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c00145f0 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0740d1000 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7fefabfff640 1 -- 172.21.15.196:0/363293061 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c00148d0 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.017+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0740d3ce0 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7fefabfff640 1 -- 172.21.15.196:0/363293061 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0c0011040 con 0x55b0740d0410 2024-09-21T08:52:56.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7fefabfff640 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 0x7fefa0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7fefabfff640 1 -- 172.21.15.196:0/363293061 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff0c001e070 con 0x55b0740d0410 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 0x7fefa0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 0x7fefa0039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55b0740bd110 tx=0x7ff0b801b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.018+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0ca539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0ca539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0740ae080 con 0x55b0740dd0e0 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51638/0 (socket says 172.21.15.196:51638) 2024-09-21T08:52:56.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0c69d9640 1 -- 172.21.15.196:0/3452459989 learned_addr learned my addr 172.21.15.196:0/3452459989 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0c69d9640 1 -- 172.21.15.196:0/3452459989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0740ddab0 con 0x55b0740dd0e0 2024-09-21T08:52:56.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/3452459989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff0c004cb80 tx=0x7ff0c003bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670b2efb0247b77f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7fefa9ffb640 1 -- 172.21.15.196:0/3452459989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c00168f0 con 0x55b0740dd0e0 2024-09-21T08:52:56.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7fefa9ffb640 1 -- 172.21.15.196:0/3452459989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c0013c80 con 0x55b0740dd0e0 2024-09-21T08:52:56.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.019+0000 7fefa9ffb640 1 -- 172.21.15.196:0/3452459989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c0014a70 con 0x55b0740dd0e0 2024-09-21T08:52:56.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- 172.21.15.196:0/3452459989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 msgr2=0x55b0740dd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 --2- 172.21.15.196:0/3452459989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff0c004cb80 tx=0x7ff0c003bf60 comp rx=0 tx=0).stop 2024-09-21T08:52:56.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- 172.21.15.196:0/3452459989 shutdown_connections 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 --2- 172.21.15.196:0/3452459989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740dd4e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- 172.21.15.196:0/3452459989 >> 172.21.15.196:0/3452459989 conn(0x55b0740d9440 msgr2=0x55b0740d7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- 172.21.15.196:0/3452459989 shutdown_connections 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- 172.21.15.196:0/3452459989 wait complete. 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 Processor -- start 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- start start 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.020+0000 7ff0ca539800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0740de120 con 0x55b0740dd0e0 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0c69d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51644/0 (socket says 172.21.15.196:51644) 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 learned_addr learned my addr 172.21.15.196:0/2286143700 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0740e4a90 con 0x55b0740dd0e0 2024-09-21T08:52:56.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0c003e040 tx=0x7ff0c004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7fef97fff640 1 -- 172.21.15.196:0/2286143700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c0044030 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7fef97fff640 1 -- 172.21.15.196:0/2286143700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c0013e30 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0740e4d20 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7fef97fff640 1 -- 172.21.15.196:0/2286143700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c0022bb0 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.021+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0740e79d0 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7fef97fff640 1 -- 172.21.15.196:0/2286143700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0c004ea20 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7fef97fff640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef90036b40 0x7fef90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7fef97fff640 1 -- 172.21.15.196:0/2286143700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff0c0045070 con 0x55b0740dd0e0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef90036b40 0x7fef90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740f0140 0x55b0740f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.022+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f2d50 con 0x55b0740f0140 2024-09-21T08:52:56.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740f0140 0x55b0740f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef90036b40 0x7fef90039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e6d0 tx=0x7ff0b8032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740f0140 0x55b0740f2600 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 20 realm 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f3180 con 0x55b0740f0140 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.023+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f3a50 con 0x55b0740f0140 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f3df0 con 0x55b0740f0140 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740f4b50 0x55b0740f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f7480 con 0x55b0740f4b50 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740f4b50 0x55b0740f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.024+0000 7ff0c69d9640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740f4b50 0x55b0740f6f40 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0ca539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0ca539800 20 searching for the correct realm 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b0740f94c0 0x55b0740fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f94c0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b0740f94c0 0x55b0740fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b0740f94c0 0x55b0740fb980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c61d8640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0b803d070 0x7ff0b8018810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x7ff0b803d070 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.025+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0b803d070 0x7ff0b8018810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c59d7640 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0b803d070 0x7ff0b8018810 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f4b50 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f0140 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.026+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f0140 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f4b50 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f4b50 2024-09-21T08:52:56.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x7ff0b803d070 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.027+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f94c0 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f0140 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f4b50 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.028+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f0140 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x7ff0b803d070 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc050 con 0x55b0740f94c0 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.029+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f4b50 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.030+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f0140 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f0140 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f4b50 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.031+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x7ff0b803d070 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f0140 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.032+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x7ff0b803d070 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f94c0 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.033+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x55b0740f0140 2024-09-21T08:52:56.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff0b805a040 con 0x7ff0b803d070 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f7ec0 con 0x55b0740f0140 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f8340 con 0x55b0740f0140 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.034+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740f87e0 con 0x55b0740f0140 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 zone default found 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 4 Realm: () 2024-09-21T08:52:56.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 zonegroup default 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fc4d0 con 0x55b0740f4b50 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fe700 con 0x55b0740f94c0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.035+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0740feaa0 con 0x55b0740f94c0 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.036+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.036+0000 7ff0ca539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.036+0000 7ff0ca539800 20 started sync module instance, tier type = 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.036+0000 7ff0ca539800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.036+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fdb40 con 0x7ff0b803d070 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.037+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.037+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94216349802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fdb40 con 0x7ff0b803d070 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.037+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740ff460 con 0x55b0740f0140 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.038+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94216349802288] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.038+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.038+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94216349800560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740ff460 con 0x55b0740f0140 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.038+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740ffe60 con 0x55b0740f94c0 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.039+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94216349800560] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.040+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.040+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94216349806512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740ff3d0 con 0x55b0740f94c0 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.040+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074100d20 con 0x7ff0b803d070 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.041+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94216349806512] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.041+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.041+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94216349812848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074101140 con 0x7ff0b803d070 2024-09-21T08:52:56.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.041+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074101b00 con 0x55b0740f0140 2024-09-21T08:52:56.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.042+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94216349812848] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.042+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.042+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94216349814384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074101b00 con 0x55b0740f0140 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.042+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0741024c0 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.043+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94216349814384] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.043+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.043+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94216349816400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074101a70 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.043+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0741031e0 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.044+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94216349816400] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.044+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.044+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94216349821024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0741031e0 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.044+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074103c20 con 0x55b0740f4b50 2024-09-21T08:52:56.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94216349824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074104090 con 0x55b0740f4b50 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=0 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=1 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=2 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=3 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=4 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.045+0000 7ff0ca539800 20 add_watcher() i=5 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94216349821024] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0ca539800 20 add_watcher() i=6 2024-09-21T08:52:56.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94216349824752] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0ca539800 20 add_watcher() i=7 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0ca539800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.053+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b074102c80 con 0x55b0740f0140 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.054+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.054+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94216349826016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074102c80 con 0x55b0740f0140 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94216349826016] v36'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7fef7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 5 note: GC not initialized 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7feef77fe640 20 reqs_thread_entry: start 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 20 Filter name: none 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7feef57fa640 20 reqs_thread_entry: start 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.055+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b07413a030 con 0x55b0740f0140 2024-09-21T08:52:56.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.056+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.056+0000 7ff0ca539800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.056+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b07413b580 con 0x55b0740f4b50 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.056+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.057+0000 7fef7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.057+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94216349826016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074138630 con 0x55b0740f0140 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.058+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94216349826016] v36'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.058+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94216349802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074103be0 con 0x7ff0b803d070 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.059+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94216349802288] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.059+0000 7ff0ca539800 20 remove_watcher() i=0 2024-09-21T08:52:56.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.059+0000 7ff0ca539800 2 removed watcher, disabling cache 2024-09-21T08:52:56.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.059+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94216349800560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fdf30 con 0x55b0740f0140 2024-09-21T08:52:56.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.060+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94216349800560] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.060+0000 7ff0ca539800 20 remove_watcher() i=1 2024-09-21T08:52:56.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.060+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94216349806512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fdf30 con 0x55b0740f94c0 2024-09-21T08:52:56.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.061+0000 7ff0c61d8640 1 -- 172.21.15.196:0/2286143700 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94216349806512] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b802d070 con 0x55b0740f94c0 2024-09-21T08:52:56.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.061+0000 7ff0ca539800 20 remove_watcher() i=2 2024-09-21T08:52:56.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.061+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94216349812848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fefb0 con 0x7ff0b803d070 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.062+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94216349812848] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x7ff0b803d070 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.062+0000 7ff0ca539800 20 remove_watcher() i=3 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.062+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94216349814384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fefb0 con 0x55b0740f0140 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.064+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94216349814384] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc057030 con 0x55b0740f0140 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.064+0000 7ff0ca539800 20 remove_watcher() i=4 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.064+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94216349816400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074100e70 con 0x55b0740f4b50 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.065+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94216349816400] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.065+0000 7ff0ca539800 20 remove_watcher() i=5 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.065+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94216349821024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0740fefb0 con 0x55b0740f4b50 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.066+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94216349821024] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.066+0000 7ff0ca539800 20 remove_watcher() i=6 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.066+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94216349824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b074100e70 con 0x55b0740f4b50 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0c69d9640 1 -- 172.21.15.196:0/2286143700 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94216349824752] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c002a070 con 0x55b0740f4b50 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 20 remove_watcher() i=7 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740f4b50 msgr2=0x55b0740f6f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740f4b50 0x55b0740f6f40 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740f0140 msgr2=0x55b0740f2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740f0140 0x55b0740f2600 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0b803d070 msgr2=0x7ff0b8018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7ff0b803d070 0x7ff0b8018810 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b0740f94c0 msgr2=0x55b0740fb980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55b0740f94c0 0x55b0740fb980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef90036b40 msgr2=0x7fef90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef90036b40 0x7fef90039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e6d0 tx=0x7ff0b8032000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 msgr2=0x55b0740e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0c59d7640 1 -- 172.21.15.196:0/2286143700 reap_dead start 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0c003e040 tx=0x7ff0c004cb10 comp rx=0 tx=0).stop 2024-09-21T08:52:56.077 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 shutdown_connections 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 --2- 172.21.15.196:0/2286143700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740dd0e0 0x55b0740e4550 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 >> 172.21.15.196:0/2286143700 conn(0x55b0740d9440 msgr2=0x55b0740d7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 shutdown_connections 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.067+0000 7ff0ca539800 1 -- 172.21.15.196:0/2286143700 wait complete. 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 msgr2=0x7fefa0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 0x7fefa0039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55b0740bd110 tx=0x7ff0b801b520 comp rx=0 tx=0).stop 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 msgr2=0x55b0740d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55b0740b63a0 tx=0x7ff0c00188f0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 shutdown_connections 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefa0036b40 0x7fefa0039000 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/363293061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0740d0410 0x55b0740d0830 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 >> 172.21.15.196:0/363293061 conn(0x55b0740c53a0 msgr2=0x55b0740c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.078 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 shutdown_connections 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/363293061 wait complete. 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 msgr2=0x55b0740c13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 0x55b0740c13e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 msgr2=0x55b0740bc740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 0x55b0740bc740 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 msgr2=0x7fefac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 0x7fefac039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc057000 tx=0x7ff0bc052000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 msgr2=0x55b0740b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55b0740ae730 tx=0x7ff0b8000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 shutdown_connections 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55b0740beff0 0x55b0740c13e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55b0740ba350 0x55b0740bc740 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fefac036b90 0x7fefac039050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 --2- 172.21.15.196:0/1562751595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b073f325b0 0x55b0740b52f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 >> 172.21.15.196:0/1562751595 conn(0x55b073fb7fe0 msgr2=0x55b0740a7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 shutdown_connections 2024-09-21T08:52:56.080 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.068+0000 7ff0ca539800 1 -- 172.21.15.196:0/1562751595 wait complete. 2024-09-21T08:52:56.080 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-21T08:52:56.081 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-21T08:52:56.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-21T08:52:56.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-21T08:52:56.081 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-21T08:52:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:56.127 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.126+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.126+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f3596540800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564747a28710 0x564747a28b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f3596540800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647478e7b30 con 0x564747a29050 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f3596540800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5647478c9360 con 0x564747a28710 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f35922d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564747a28710 0x564747a28b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f35922d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564747a28710 0x564747a28b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51654/0 (socket says 172.21.15.196:51654) 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f35922d1640 1 -- 172.21.15.196:0/28405566 learned_addr learned my addr 172.21.15.196:0/28405566 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f35922d1640 1 -- 172.21.15.196:0/28405566 >> v1:172.21.15.29:6789/0 conn(0x564747a29050 legacy=0x564747a2da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.127+0000 7f35922d1640 1 -- 172.21.15.196:0/28405566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647478efe00 con 0x564747a28710 2024-09-21T08:52:56.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.129+0000 7f35922d1640 1 --2- 172.21.15.196:0/28405566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747a28b10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f358c005fd0 tx=0x7f358c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc655892d1a787e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.129+0000 7f35912cf640 1 -- 172.21.15.196:0/28405566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c04e600 con 0x564747a28710 2024-09-21T08:52:56.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.129+0000 7f35912cf640 1 -- 172.21.15.196:0/28405566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c04e7a0 con 0x564747a28710 2024-09-21T08:52:56.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.129+0000 7f35912cf640 1 -- 172.21.15.196:0/28405566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c04eaa0 con 0x564747a28710 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 -- 172.21.15.196:0/28405566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 msgr2=0x564747a28b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 --2- 172.21.15.196:0/28405566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747a28b10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f358c005fd0 tx=0x7f358c045cf0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 -- 172.21.15.196:0/28405566 shutdown_connections 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 --2- 172.21.15.196:0/28405566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747a28b10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 -- 172.21.15.196:0/28405566 >> 172.21.15.196:0/28405566 conn(0x564747a23fe0 msgr2=0x564747a26400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 -- 172.21.15.196:0/28405566 shutdown_connections 2024-09-21T08:52:56.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.130+0000 7f3596540800 1 -- 172.21.15.196:0/28405566 wait complete. 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f3596540800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f3596540800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564747974360 con 0x564747a28710 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f35922d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f35922d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51660/0 (socket says 172.21.15.196:51660) 2024-09-21T08:52:56.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.144+0000 7f35922d1640 1 -- 172.21.15.196:0/2825938914 learned_addr learned my addr 172.21.15.196:0/2825938914 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.145+0000 7f35922d1640 1 -- 172.21.15.196:0/2825938914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647478c1bc0 con 0x564747a28710 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.145+0000 7f35922d1640 1 --2- 172.21.15.196:0/2825938914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f358c045d30 tx=0x7f358c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b818fd3200cc907b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.145+0000 7f3480608640 1 -- 172.21.15.196:0/2825938914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c04eb40 con 0x564747a28710 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.145+0000 7f3480608640 1 -- 172.21.15.196:0/2825938914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c05c040 con 0x564747a28710 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.145+0000 7f3480608640 1 -- 172.21.15.196:0/2825938914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c04ee10 con 0x564747a28710 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 -- 172.21.15.196:0/2825938914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 msgr2=0x56474799e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 --2- 172.21.15.196:0/2825938914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f358c045d30 tx=0x7f358c050000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 -- 172.21.15.196:0/2825938914 shutdown_connections 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 --2- 172.21.15.196:0/2825938914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x56474799e6e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 -- 172.21.15.196:0/2825938914 >> 172.21.15.196:0/2825938914 conn(0x564747a23fe0 msgr2=0x564747b132b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 -- 172.21.15.196:0/2825938914 shutdown_connections 2024-09-21T08:52:56.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.146+0000 7f3596540800 1 -- 172.21.15.196:0/2825938914 wait complete. 2024-09-21T08:52:56.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f3596540800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f3596540800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564747a2f5f0 con 0x564747a28710 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f35922d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f35922d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51672/0 (socket says 172.21.15.196:51672) 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f35922d1640 1 -- 172.21.15.196:0/2802023243 learned_addr learned my addr 172.21.15.196:0/2802023243 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.147+0000 7f35922d1640 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647478d5fe0 con 0x564747a28710 2024-09-21T08:52:56.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f35922d1640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f358c045d30 tx=0x7f358c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f347ee05640 1 -- 172.21.15.196:0/2802023243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c061420 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f347ee05640 1 -- 172.21.15.196:0/2802023243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c070070 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f347ee05640 1 -- 172.21.15.196:0/2802023243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358c0616f0 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564747b219a0 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.148+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564747b21e40 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f347ee05640 1 -- 172.21.15.196:0/2802023243 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f358c061890 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f347ee05640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 0x7f3478039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f347ee05640 1 -- 172.21.15.196:0/2802023243 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f358c066070 con 0x564747a28710 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f3591ad0640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 0x7f3478039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 0x564747b283a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b28970 con 0x564747a29050 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.149+0000 7f3592ad2640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 0x564747b283a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3591ad0640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 0x7f3478039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f357c001e10 tx=0x7f357c001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3592ad2640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 0x564747b283a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3592ad2640 1 -- 172.21.15.196:0/2802023243 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35840083e0 con 0x564747a29050 2024-09-21T08:52:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b25aa0 con 0x564747a29050 2024-09-21T08:52:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3592ad2640 1 -- 172.21.15.196:0/2802023243 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35840083e0 con 0x564747a29050 2024-09-21T08:52:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 0x564747b2d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.150+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b2d7a0 con 0x564747b2acc0 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.151+0000 7f35922d1640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 0x564747b2d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.151+0000 7f35922d1640 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 0x564747b2d0b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.151+0000 7f35922d1640 1 -- 172.21.15.196:0/2802023243 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f358c07c070 con 0x564747b2acc0 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.151+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b29b60 con 0x564747a29050 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3592ad2640 1 -- 172.21.15.196:0/2802023243 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35840083e0 con 0x564747a29050 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b29fe0 con 0x564747a29050 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3592ad2640 1 -- 172.21.15.196:0/2802023243 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35840083e0 con 0x564747a29050 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.152+0000 7f3596540800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3596540800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647478c3580 con 0x564747b3c130 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51674/0 (socket says 172.21.15.196:51674) 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3592ad2640 1 -- 172.21.15.196:0/3895054816 learned_addr learned my addr 172.21.15.196:0/3895054816 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3592ad2640 1 -- 172.21.15.196:0/3895054816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564747b3ca90 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3592ad2640 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x564747b22860 tx=0x7f358400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3477fff640 1 -- 172.21.15.196:0/3895054816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3584007d00 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3477fff640 1 -- 172.21.15.196:0/3895054816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358401e020 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3477fff640 1 -- 172.21.15.196:0/3895054816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3584019420 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564747b3cd20 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.153+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564747b3fa00 con 0x564747b3c130 2024-09-21T08:52:56.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.154+0000 7f3477fff640 1 -- 172.21.15.196:0/3895054816 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3584016040 con 0x564747b3c130 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.154+0000 7f3477fff640 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 0x7f346c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.154+0000 7f3477fff640 1 -- 172.21.15.196:0/3895054816 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f358401f030 con 0x564747b3c130 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.154+0000 7f35922d1640 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 0x7f346c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f35922d1640 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 0x7f346c039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x564747b28e10 tx=0x7f358c046130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3596540800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3596540800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56474799ccc0 con 0x564747b48d50 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51676/0 (socket says 172.21.15.196:51676) 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3592ad2640 1 -- 172.21.15.196:0/4126945199 learned_addr learned my addr 172.21.15.196:0/4126945199 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3592ad2640 1 -- 172.21.15.196:0/4126945199 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564747b49690 con 0x564747b48d50 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.155+0000 7f3592ad2640 1 --2- 172.21.15.196:0/4126945199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3584005700 tx=0x7f358404ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6ba7bbcdf722ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3475ffb640 1 -- 172.21.15.196:0/4126945199 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358401d040 con 0x564747b48d50 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3475ffb640 1 -- 172.21.15.196:0/4126945199 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35840184e0 con 0x564747b48d50 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3475ffb640 1 -- 172.21.15.196:0/4126945199 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35840144b0 con 0x564747b48d50 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 -- 172.21.15.196:0/4126945199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 msgr2=0x564747b49150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 --2- 172.21.15.196:0/4126945199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3584005700 tx=0x7f358404ce90 comp rx=0 tx=0).stop 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 -- 172.21.15.196:0/4126945199 shutdown_connections 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 --2- 172.21.15.196:0/4126945199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b49150 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 -- 172.21.15.196:0/4126945199 >> 172.21.15.196:0/4126945199 conn(0x564747b45100 msgr2=0x564747b43200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 -- 172.21.15.196:0/4126945199 shutdown_connections 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 -- 172.21.15.196:0/4126945199 wait complete. 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.156+0000 7f3596540800 1 Processor -- start 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3596540800 1 -- start start 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3596540800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3596540800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564747b49d30 con 0x564747b48d50 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3592ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51688/0 (socket says 172.21.15.196:51688) 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 learned_addr learned my addr 172.21.15.196:0/3611971653 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564747b506e0 con 0x564747b48d50 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3592ad2640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3584005700 tx=0x7f35840175e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3463fff640 1 -- 172.21.15.196:0/3611971653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3584030070 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3463fff640 1 -- 172.21.15.196:0/3611971653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3584019860 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564747b50970 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.157+0000 7f3463fff640 1 -- 172.21.15.196:0/3611971653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f358401d070 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.158+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564747b53620 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.158+0000 7f3463fff640 1 -- 172.21.15.196:0/3611971653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3584033070 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.158+0000 7f3463fff640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f345c036b90 0x7f345c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.158+0000 7f3463fff640 1 -- 172.21.15.196:0/3611971653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f358403f940 con 0x564747b48d50 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.158+0000 7f35922d1640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f345c036b90 0x7f345c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.159+0000 7f35922d1640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f345c036b90 0x7f345c039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x564747b2dba0 tx=0x7f358c081000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.159+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.159+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747b5bcb0 0x564747b5e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.159+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b5e8c0 con 0x564747b5bcb0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.159+0000 7f3591ad0640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747b5bcb0 0x564747b5e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3591ad0640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747b5bcb0 0x564747b5e170 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f357c00bdb0 con 0x564747b5bcb0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 realm 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b5b100 con 0x564747b5bcb0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f357c00bdb0 con 0x564747b5bcb0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b5f190 con 0x564747b5bcb0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f357c00bdb0 con 0x564747b5bcb0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b5fa60 con 0x564747b5bcb0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f357c00bdb0 con 0x564747b5bcb0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.160+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.161+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b60310 0x564747b62720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.161+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b62e80 con 0x564747b60310 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.161+0000 7f3592ad2640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b60310 0x564747b62720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.161+0000 7f3592ad2640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b60310 0x564747b62720 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3596540800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3596540800 20 searching for the correct realm 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564747b64f30 0x564747b673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f35922d1640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564747b64f30 0x564747b673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f35922d1640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564747b64f30 0x564747b673f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f35922d1640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f358c0769b0 0x7f358c06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.162+0000 7f3591ad0640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f358c0769b0 0x7f358c06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3591ad0640 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f358c0769b0 0x7f358c06b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c00bdb0 con 0x7f358c0769b0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c00bdb0 con 0x564747b5bcb0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.163+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.164+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.165+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.166+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.167+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.168+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.169+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b64f30 2024-09-21T08:52:56.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b60310 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x564747b5bcb0 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564747b67ac0 con 0x7f358c0769b0 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:56.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.170+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b63930 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b63d80 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b64220 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 zone default found 2024-09-21T08:52:56.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 4 Realm: () 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 zonegroup default 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.171+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b67f40 con 0x564747b60310 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b63570 con 0x564747b64f30 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b6a290 con 0x564747b64f30 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 started sync module instance, tier type = 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.172+0000 7f3596540800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:56.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.173+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b69600 con 0x7f358c0769b0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.174+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.174+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864145816368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b69600 con 0x7f358c0769b0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.174+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6aba0 con 0x564747b5bcb0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.175+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864145816368] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.175+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.175+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864145819376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6afc0 con 0x564747b5bcb0 2024-09-21T08:52:56.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.175+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6b850 con 0x564747b64f30 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.176+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.176+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864145822144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6c0f0 con 0x564747b64f30 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.176+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6cba0 con 0x7f358c0769b0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.176+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864145819376] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.177+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.177+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864145820432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6cf90 con 0x7f358c0769b0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.177+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864145822144] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.177+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6d990 con 0x564747b5bcb0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.178+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864145820432] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.178+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.178+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864145824832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6d4a0 con 0x564747b5bcb0 2024-09-21T08:52:56.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.178+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6e230 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.179+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.179+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864145824832] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.179+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864145827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6d4a0 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.179+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6e850 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.180+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864145827456] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.180+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.180+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864145833344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6e850 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.180+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f2a0 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864145833344] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864145837456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f710 con 0x564747b60310 2024-09-21T08:52:56.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=0 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=1 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=2 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=3 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=4 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=5 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.181+0000 7f3596540800 20 add_watcher() i=6 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.182+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864145837456] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.182+0000 7f3596540800 20 add_watcher() i=7 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.182+0000 7f3596540800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.182+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f710 con 0x564747b5bcb0 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.183+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.183+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864145838688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6ffe0 con 0x564747b5bcb0 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864145838688] v36'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 5 note: GC not initialized 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f33c37fe640 20 reqs_thread_entry: start 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 20 Filter name: none 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f33c17fa640 20 reqs_thread_entry: start 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.184+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747ba5700 con 0x564747b5bcb0 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.185+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.185+0000 7f3596540800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.185+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564747ba6c50 con 0x564747b60310 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.185+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.186+0000 7f3448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.186+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864145838688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747ba41b0 con 0x564747b5bcb0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.187+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94864145838688] v36'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.187+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864145816368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f260 con 0x7f358c0769b0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.188+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94864145816368] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.188+0000 7f3596540800 20 remove_watcher() i=0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.188+0000 7f3596540800 2 removed watcher, disabling cache 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.188+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864145819376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f260 con 0x564747b5bcb0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.189+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94864145819376] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.189+0000 7f3596540800 20 remove_watcher() i=1 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.189+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864145822144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6a6f0 con 0x564747b64f30 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.190+0000 7f35922d1640 1 -- 172.21.15.196:0/3611971653 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94864145822144] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f358c07c070 con 0x564747b64f30 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.190+0000 7f3596540800 20 remove_watcher() i=2 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.190+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864145820432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f260 con 0x7f358c0769b0 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.191+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94864145820432] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x7f358c0769b0 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.191+0000 7f3596540800 20 remove_watcher() i=3 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.191+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864145824832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6f260 con 0x564747b5bcb0 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.192+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94864145824832] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f357c02a040 con 0x564747b5bcb0 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.192+0000 7f3596540800 20 remove_watcher() i=4 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.192+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864145827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6aba0 con 0x564747b60310 2024-09-21T08:52:56.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.193+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94864145827456] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.193+0000 7f3596540800 20 remove_watcher() i=5 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.193+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864145833344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6aba0 con 0x564747b60310 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.194+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94864145833344] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.194+0000 7f3596540800 20 remove_watcher() i=6 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.194+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864145837456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564747b6aba0 con 0x564747b60310 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3592ad2640 1 -- 172.21.15.196:0/3611971653 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94864145837456] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3584032030 con 0x564747b60310 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 20 remove_watcher() i=7 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b60310 msgr2=0x564747b62720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b60310 0x564747b62720 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747b5bcb0 msgr2=0x564747b5e170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747b5bcb0 0x564747b5e170 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f358c0769b0 msgr2=0x7f358c06b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f358c0769b0 0x7f358c06b3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564747b64f30 msgr2=0x564747b673f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.195+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564747b64f30 0x564747b673f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f345c036b90 msgr2=0x7f345c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f345c036b90 0x7f345c039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x564747b2dba0 tx=0x7f358c081000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 msgr2=0x564747b501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3591ad0640 1 -- 172.21.15.196:0/3611971653 reap_dead start 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3584005700 tx=0x7f35840175e0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 shutdown_connections 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3611971653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b48d50 0x564747b501a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 >> 172.21.15.196:0/3611971653 conn(0x564747b45100 msgr2=0x564747b431d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 shutdown_connections 2024-09-21T08:52:56.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3611971653 wait complete. 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 msgr2=0x7f346c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 0x7f346c039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x564747b28e10 tx=0x7f358c046130 comp rx=0 tx=0).stop 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 msgr2=0x564747b3c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x564747b22860 tx=0x7f358400aec0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 shutdown_connections 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f346c036b40 0x7f346c039000 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/3895054816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747b3c130 0x564747b3c550 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 >> 172.21.15.196:0/3895054816 conn(0x564747b310c0 msgr2=0x564747b33c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 shutdown_connections 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/3895054816 wait complete. 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 msgr2=0x564747b2d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 0x564747b2d0b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 msgr2=0x564747b283a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.196+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 0x564747b283a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 msgr2=0x7f3478039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 0x7f3478039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f357c001e10 tx=0x7f357c001390 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 msgr2=0x564747b21460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f358c045d30 tx=0x7f358c003330 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 shutdown_connections 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564747b2acc0 0x564747b2d0b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564747a29050 0x564747b283a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3478036b90 0x7f3478039050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 --2- 172.21.15.196:0/2802023243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564747a28710 0x564747b21460 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 >> 172.21.15.196:0/2802023243 conn(0x564747a23fe0 msgr2=0x564747b12e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 shutdown_connections 2024-09-21T08:52:56.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.197+0000 7f3596540800 1 -- 172.21.15.196:0/2802023243 wait complete. 2024-09-21T08:52:56.216 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-21T08:52:56.216 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T08:52:56.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-21T08:52:56.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-21T08:52:56.217 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-21T08:52:56.263 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:56.264 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f804bd1f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55adea1c0710 0x55adea1c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f804bd1f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55adea07fb30 con 0x55adea1c1050 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f804bd1f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55adea061360 con 0x55adea1c0710 2024-09-21T08:52:56.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f8047995640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55adea1c0710 0x55adea1c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f803f194640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55adea1c1050 0x55adea1c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:41472/0 (socket says 172.21.15.196:41472) 2024-09-21T08:52:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f8047995640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55adea1c0710 0x55adea1c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51704/0 (socket says 172.21.15.196:51704) 2024-09-21T08:52:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.263+0000 7f803f194640 1 -- 172.21.15.196:0/2921315010 learned_addr learned my addr 172.21.15.196:0/2921315010 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.264+0000 7f8047995640 1 -- 172.21.15.196:0/2921315010 >> v1:172.21.15.29:6789/0 conn(0x55adea1c1050 legacy=0x55adea1c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.264+0000 7f8047995640 1 -- 172.21.15.196:0/2921315010 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea087e00 con 0x55adea1c0710 2024-09-21T08:52:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.265+0000 7f8047995640 1 --2- 172.21.15.196:0/2921315010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1c0b10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f803800a470 tx=0x7f8038045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd3161d395690c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f8047194640 1 -- 172.21.15.196:0/2921315010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038053570 con 0x55adea1c0710 2024-09-21T08:52:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f8047194640 1 -- 172.21.15.196:0/2921315010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8038058070 con 0x55adea1c0710 2024-09-21T08:52:56.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f8047194640 1 -- 172.21.15.196:0/2921315010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038053880 con 0x55adea1c0710 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 -- 172.21.15.196:0/2921315010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 msgr2=0x55adea1c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 --2- 172.21.15.196:0/2921315010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1c0b10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f803800a470 tx=0x7f8038045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 -- 172.21.15.196:0/2921315010 shutdown_connections 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 --2- 172.21.15.196:0/2921315010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1c0b10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 -- 172.21.15.196:0/2921315010 >> 172.21.15.196:0/2921315010 conn(0x55adea1bbfe0 msgr2=0x55adea1be400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 -- 172.21.15.196:0/2921315010 shutdown_connections 2024-09-21T08:52:56.268 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.266+0000 7f804bd1f800 1 -- 172.21.15.196:0/2921315010 wait complete. 2024-09-21T08:52:56.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f804bd1f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f804bd1f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55adea10c360 con 0x55adea1c0710 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f8047995640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f8047995640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51716/0 (socket says 172.21.15.196:51716) 2024-09-21T08:52:56.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.280+0000 7f8047995640 1 -- 172.21.15.196:0/64761419 learned_addr learned my addr 172.21.15.196:0/64761419 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.281+0000 7f8047995640 1 -- 172.21.15.196:0/64761419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea059bc0 con 0x55adea1c0710 2024-09-21T08:52:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.281+0000 7f8047995640 1 --2- 172.21.15.196:0/64761419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8038025c20 tx=0x7f8038051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4bf841ac004d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.281+0000 7f7f35e0b640 1 -- 172.21.15.196:0/64761419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038053ba0 con 0x55adea1c0710 2024-09-21T08:52:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.281+0000 7f7f35e0b640 1 -- 172.21.15.196:0/64761419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8038063030 con 0x55adea1c0710 2024-09-21T08:52:56.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.281+0000 7f7f35e0b640 1 -- 172.21.15.196:0/64761419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038053440 con 0x55adea1c0710 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- 172.21.15.196:0/64761419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 msgr2=0x55adea1366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 --2- 172.21.15.196:0/64761419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8038025c20 tx=0x7f8038051000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- 172.21.15.196:0/64761419 shutdown_connections 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 --2- 172.21.15.196:0/64761419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea1366e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- 172.21.15.196:0/64761419 >> 172.21.15.196:0/64761419 conn(0x55adea1bbfe0 msgr2=0x55adea2ab2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- 172.21.15.196:0/64761419 shutdown_connections 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- 172.21.15.196:0/64761419 wait complete. 2024-09-21T08:52:56.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f804bd1f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55adea1c75f0 con 0x55adea1c0710 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.282+0000 7f8047995640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f8047995640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51718/0 (socket says 172.21.15.196:51718) 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f8047995640 1 -- 172.21.15.196:0/672697815 learned_addr learned my addr 172.21.15.196:0/672697815 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f8047995640 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea06dfe0 con 0x55adea1c0710 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f8047995640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55adea135de0 tx=0x7f8038002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f7f2ffff640 1 -- 172.21.15.196:0/672697815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038078070 con 0x55adea1c0710 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f7f2ffff640 1 -- 172.21.15.196:0/672697815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8038053570 con 0x55adea1c0710 2024-09-21T08:52:56.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adea2b9910 con 0x55adea1c0710 2024-09-21T08:52:56.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f7f2ffff640 1 -- 172.21.15.196:0/672697815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038053850 con 0x55adea1c0710 2024-09-21T08:52:56.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.283+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adea2b9e90 con 0x55adea1c0710 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f7f2ffff640 1 -- 172.21.15.196:0/672697815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f803807b070 con 0x55adea1c0710 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f7f2ffff640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 0x7f7f30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f7f2ffff640 1 -- 172.21.15.196:0/672697815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8038070070 con 0x55adea1c0710 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f803f194640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 0x7f7f30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 0x55adea2c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.284+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2c0a10 con 0x55adea1c1050 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f8048196640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 0x55adea2c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f803f194640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 0x7f7f30039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8030000f60 tx=0x7f80300012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f8048196640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 0x55adea2c0440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f8048196640 1 -- 172.21.15.196:0/672697815 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f804000a4a0 con 0x55adea1c1050 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2bda10 con 0x55adea1c1050 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f8048196640 1 -- 172.21.15.196:0/672697815 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f804000a4a0 con 0x55adea1c1050 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 0x55adea2c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.285+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2c5840 con 0x55adea2c2d60 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.286+0000 7f8047995640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 0x55adea2c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.286+0000 7f8047995640 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 0x55adea2c5150 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.286+0000 7f8047995640 1 -- 172.21.15.196:0/672697815 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f803807a030 con 0x55adea2c2d60 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.287+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2c1b40 con 0x55adea1c1050 2024-09-21T08:52:56.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.287+0000 7f8048196640 1 -- 172.21.15.196:0/672697815 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f804000a4a0 con 0x55adea1c1050 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.287+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2c1fe0 con 0x55adea1c1050 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.287+0000 7f8048196640 1 -- 172.21.15.196:0/672697815 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f804000a4a0 con 0x55adea1c1050 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f804bd1f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f804bd1f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55adea05b580 con 0x55adea2d40e0 2024-09-21T08:52:56.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51734/0 (socket says 172.21.15.196:51734) 2024-09-21T08:52:56.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f8048196640 1 -- 172.21.15.196:0/3049642971 learned_addr learned my addr 172.21.15.196:0/3049642971 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.288+0000 7f8048196640 1 -- 172.21.15.196:0/3049642971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea2d4a40 con 0x55adea2d40e0 2024-09-21T08:52:56.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f8048196640 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55adea2c0e10 tx=0x7f8040018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f7f2d7fa640 1 -- 172.21.15.196:0/3049642971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040014450 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f7f2d7fa640 1 -- 172.21.15.196:0/3049642971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040014610 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adea2d4cd0 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f7f2d7fa640 1 -- 172.21.15.196:0/3049642971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040014930 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.289+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adea2d79b0 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f7f2d7fa640 1 -- 172.21.15.196:0/3049642971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8040011040 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f7f2d7fa640 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 0x7f7f20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f7f2d7fa640 1 -- 172.21.15.196:0/3049642971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f804001e070 con 0x55adea2d40e0 2024-09-21T08:52:56.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f8047995640 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 0x7f7f20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f8047995640 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 0x7f7f20039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8038090010 tx=0x7f803808ebc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f804bd1f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f804bd1f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55adea134d50 con 0x55adea2e0d40 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51736/0 (socket says 172.21.15.196:51736) 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.290+0000 7f8048196640 1 -- 172.21.15.196:0/795889297 learned_addr learned my addr 172.21.15.196:0/795889297 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f8048196640 1 -- 172.21.15.196:0/795889297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea2e1680 con 0x55adea2e0d40 2024-09-21T08:52:56.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f8048196640 1 --2- 172.21.15.196:0/795889297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f804004cba0 tx=0x7f804002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597fef5bd678a6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f7f26ffd640 1 -- 172.21.15.196:0/795889297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040028040 con 0x55adea2e0d40 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f7f26ffd640 1 -- 172.21.15.196:0/795889297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80400400c0 con 0x55adea2e0d40 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f7f26ffd640 1 -- 172.21.15.196:0/795889297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040016980 con 0x55adea2e0d40 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f804bd1f800 1 -- 172.21.15.196:0/795889297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 msgr2=0x55adea2e1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f804bd1f800 1 --2- 172.21.15.196:0/795889297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f804004cba0 tx=0x7f804002b410 comp rx=0 tx=0).stop 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f804bd1f800 1 -- 172.21.15.196:0/795889297 shutdown_connections 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f804bd1f800 1 --2- 172.21.15.196:0/795889297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e1140 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.291+0000 7f804bd1f800 1 -- 172.21.15.196:0/795889297 >> 172.21.15.196:0/795889297 conn(0x55adea2dd0f0 msgr2=0x55adea2db1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 -- 172.21.15.196:0/795889297 shutdown_connections 2024-09-21T08:52:56.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 -- 172.21.15.196:0/795889297 wait complete. 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 Processor -- start 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 -- start start 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f804bd1f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55adea2e1d20 con 0x55adea2e0d40 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f8048196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51738/0 (socket says 172.21.15.196:51738) 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.292+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 learned_addr learned my addr 172.21.15.196:0/3414202946 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adea2e8720 con 0x55adea2e0d40 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f8048196640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f804003f040 tx=0x7f804004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f7f257fa640 1 -- 172.21.15.196:0/3414202946 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040028040 con 0x55adea2e0d40 2024-09-21T08:52:56.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f7f257fa640 1 -- 172.21.15.196:0/3414202946 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040031030 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adea2e89b0 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f7f257fa640 1 -- 172.21.15.196:0/3414202946 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8040016ab0 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adea2eb660 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.293+0000 7f7f257fa640 1 -- 172.21.15.196:0/3414202946 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f804004b230 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f7f257fa640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f10036aa0 0x7f7f10038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f7f257fa640 1 -- 172.21.15.196:0/3414202946 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f804000e040 con 0x55adea2e0d40 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f8047995640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f10036aa0 0x7f7f10038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea2f3e20 0x55adea2f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2f6a30 con 0x55adea2f3e20 2024-09-21T08:52:56.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f8047995640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f10036aa0 0x7f7f10038f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55adea2c0eb0 tx=0x7f8038093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.294+0000 7f803f194640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea2f3e20 0x55adea2f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f803f194640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea2f3e20 0x55adea2f62e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8030009050 con 0x55adea2f3e20 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 realm 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2f3270 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8030009050 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2f7510 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8030009050 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.295+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2f7de0 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8030009050 con 0x55adea2f3e20 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2f8690 0x55adea2faa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2fb1c0 con 0x55adea2f8690 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f8048196640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2f8690 0x55adea2faa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f8048196640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2f8690 0x55adea2faa80 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 20 searching for the correct realm 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.296+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55adea2fd270 0x55adea2ff730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f8047995640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55adea2fd270 0x55adea2ff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f8047995640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55adea2fd270 0x55adea2ff730 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f8047995640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f803807d060 0x7f80380900b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.297+0000 7f803f194640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f803807d060 0x7f80380900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.298+0000 7f803f194640 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f803807d060 0x7f80380900b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.298+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030009050 con 0x7f803807d060 2024-09-21T08:52:56.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.298+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.298+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.298+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030009050 con 0x55adea2f3e20 2024-09-21T08:52:56.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.299+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x7f803807d060 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.300+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8030029040 con 0x7f803807d060 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.301+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.302+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x7f803807d060 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.303+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x7f803807d060 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.304+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2fd270 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x55adea2f3e20 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55adea2ffe00 con 0x7f803807d060 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8030029040 con 0x7f803807d060 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.305+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2fbc70 con 0x55adea2f3e20 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2fc0f0 con 0x55adea2f3e20 2024-09-21T08:52:56.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8030029040 con 0x55adea2f3e20 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea2fc590 con 0x55adea2f3e20 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 zone default found 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 4 Realm: () 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 zonegroup default 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.306+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea300280 con 0x55adea2f8690 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea3024b0 con 0x55adea2fd270 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea302850 con 0x55adea2fd270 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 started sync module instance, tier type = 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.307+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3018f0 con 0x7f803807d060 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.308+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.308+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94205446725136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3018f0 con 0x7f803807d060 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.308+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea303250 con 0x55adea2f3e20 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.309+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94205446725136] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.310+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.310+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94205446729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3018f0 con 0x55adea2f3e20 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.310+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea303cc0 con 0x55adea2fd270 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.311+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.311+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94205446731696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea304590 con 0x55adea2fd270 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.311+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305030 con 0x7f803807d060 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.311+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94205446729056] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.312+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.312+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94205446736640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305420 con 0x7f803807d060 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.312+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305de0 con 0x55adea2f3e20 2024-09-21T08:52:56.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.312+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94205446731696] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.313+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.313+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94205446734048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305de0 con 0x55adea2f3e20 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.313+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3067f0 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.313+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94205446736640] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.314+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94205446734048] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.314+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.314+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94205446722624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305de0 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.315+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305de0 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.315+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94205446722624] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.316+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.316+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94205446740272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305d50 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.316+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea307bb0 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94205446740272] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94205446746336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea307bb0 con 0x55adea2f8690 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=0 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=1 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=2 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=3 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=4 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=5 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.317+0000 7f804bd1f800 20 add_watcher() i=6 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94205446746336] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f804bd1f800 20 add_watcher() i=7 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f804bd1f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea30afb0 con 0x55adea2f3e20 2024-09-21T08:52:56.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.318+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94205446748368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3084a0 con 0x55adea2f3e20 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.319+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94205446748368] v36'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.319+0000 7f7efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.319+0000 7f804bd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.319+0000 7f804bd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 5 note: GC not initialized 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f7efcfe1640 20 reqs_thread_entry: start 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 20 Filter name: none 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f7e767fc640 20 reqs_thread_entry: start 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea33dfb0 con 0x55adea2f3e20 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.320+0000 7f804bd1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.321+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55adea33f500 con 0x55adea2f8690 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.321+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.322+0000 7f7efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.322+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94205446748368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea2f14d0 con 0x55adea2f3e20 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.323+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94205446748368] v36'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.323+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94205446725136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3078a0 con 0x7f803807d060 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.324+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94205446725136] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.324+0000 7f804bd1f800 20 remove_watcher() i=0 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.324+0000 7f804bd1f800 2 removed watcher, disabling cache 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.324+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94205446729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea301e10 con 0x55adea2f3e20 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.325+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94205446729056] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.325+0000 7f804bd1f800 20 remove_watcher() i=1 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.325+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94205446731696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea301e10 con 0x55adea2fd270 2024-09-21T08:52:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.326+0000 7f8047995640 1 -- 172.21.15.196:0/3414202946 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94205446731696] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803807a030 con 0x55adea2fd270 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.326+0000 7f804bd1f800 20 remove_watcher() i=2 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.326+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94205446736640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3037b0 con 0x7f803807d060 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.327+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94205446736640] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x7f803807d060 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.327+0000 7f804bd1f800 20 remove_watcher() i=3 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.327+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94205446734048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea304b00 con 0x55adea2f3e20 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.328+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94205446734048] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80300391c0 con 0x55adea2f3e20 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.328+0000 7f804bd1f800 20 remove_watcher() i=4 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.328+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94205446722624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3037b0 con 0x55adea2f8690 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.329+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94205446722624] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.329+0000 7f804bd1f800 20 remove_watcher() i=5 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.329+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94205446740272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea3037b0 con 0x55adea2f8690 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.330+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94205446740272] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.330+0000 7f804bd1f800 20 remove_watcher() i=6 2024-09-21T08:52:56.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.330+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94205446746336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55adea305930 con 0x55adea2f8690 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f8048196640 1 -- 172.21.15.196:0/3414202946 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94205446746336] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002a070 con 0x55adea2f8690 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 20 remove_watcher() i=7 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2f8690 msgr2=0x55adea2faa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2f8690 0x55adea2faa80 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea2f3e20 msgr2=0x55adea2f62e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea2f3e20 0x55adea2f62e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f803807d060 msgr2=0x7f80380900b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f803807d060 0x7f80380900b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55adea2fd270 msgr2=0x55adea2ff730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55adea2fd270 0x55adea2ff730 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f10036aa0 msgr2=0x7f7f10038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f10036aa0 0x7f7f10038f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55adea2c0eb0 tx=0x7f8038093000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 msgr2=0x55adea2e81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f804003f040 tx=0x7f804004cb30 comp rx=0 tx=0).stop 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f803f194640 1 -- 172.21.15.196:0/3414202946 reap_dead start 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 shutdown_connections 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.331+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3414202946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2e0d40 0x55adea2e81e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 >> 172.21.15.196:0/3414202946 conn(0x55adea2dd0f0 msgr2=0x55adea2db1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 shutdown_connections 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3414202946 wait complete. 2024-09-21T08:52:56.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 msgr2=0x7f7f20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 0x7f7f20039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8038090010 tx=0x7f803808ebc0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 msgr2=0x55adea2d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55adea2c0e10 tx=0x7f8040018830 comp rx=0 tx=0).stop 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 shutdown_connections 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f20036b40 0x7f7f20039000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/3049642971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea2d40e0 0x55adea2d4500 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 >> 172.21.15.196:0/3049642971 conn(0x55adea2c9070 msgr2=0x55adea2cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 shutdown_connections 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/3049642971 wait complete. 2024-09-21T08:52:56.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 msgr2=0x55adea2c5150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 0x55adea2c5150 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 msgr2=0x55adea2c0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 0x55adea2c0440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 msgr2=0x7f7f30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 0x7f7f30039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8030000f60 tx=0x7f80300012b0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 msgr2=0x55adea2b93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55adea135de0 tx=0x7f8038002fb0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 shutdown_connections 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55adea2c2d60 0x55adea2c5150 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55adea1c1050 0x55adea2c0440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7f30036b90 0x7f7f30039050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 --2- 172.21.15.196:0/672697815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adea1c0710 0x55adea2b93d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.332+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 >> 172.21.15.196:0/672697815 conn(0x55adea1bbfe0 msgr2=0x55adea2aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.333+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 shutdown_connections 2024-09-21T08:52:56.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.333+0000 7f804bd1f800 1 -- 172.21.15.196:0/672697815 wait complete. 2024-09-21T08:52:56.346 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-21T08:00:00.000000Z","epoch":1726905600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-21T08:52:56.346 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-21T08:52:56.346 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-21T08:52:56.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-21T08:52:56.346 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-21T08:52:56.398 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:56.399 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.397+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb671c0f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651b5ddc940 0x5651b5dded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb671c0f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651b5c98b30 con 0x5651b5dd8500 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb671c0f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5651b5c7a360 con 0x5651b5ddc940 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb666f02640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651b5ddc940 0x5651b5dded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb666f02640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651b5ddc940 0x5651b5dded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51746/0 (socket says 172.21.15.196:51746) 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb666f02640 1 -- 172.21.15.196:0/3493888904 learned_addr learned my addr 172.21.15.196:0/3493888904 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb666f02640 1 -- 172.21.15.196:0/3493888904 >> v1:172.21.15.29:6789/0 conn(0x5651b5dd8500 legacy=0x5651b5dd8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.398+0000 7fb666f02640 1 -- 172.21.15.196:0/3493888904 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5ca0e00 con 0x5651b5ddc940 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.400+0000 7fb666f02640 1 --2- 172.21.15.196:0/3493888904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ddc940 0x5651b5dded30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb65800a520 tx=0x7fb658045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5888490454c3ca36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.400+0000 7fb66ef02640 1 -- 172.21.15.196:0/3493888904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb658055070 con 0x5651b5ddc940 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.400+0000 7fb66ef02640 1 -- 172.21.15.196:0/3493888904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6580515b0 con 0x5651b5ddc940 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.400+0000 7fb66ef02640 1 -- 172.21.15.196:0/3493888904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6580518d0 con 0x5651b5ddc940 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 -- 172.21.15.196:0/3493888904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ddc940 msgr2=0x5651b5dded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3493888904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ddc940 0x5651b5dded30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb65800a520 tx=0x7fb658045ba0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 -- 172.21.15.196:0/3493888904 shutdown_connections 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3493888904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ddc940 0x5651b5dded30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 -- 172.21.15.196:0/3493888904 >> 172.21.15.196:0/3493888904 conn(0x5651b5dd3e30 msgr2=0x5651b5dd6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 -- 172.21.15.196:0/3493888904 shutdown_connections 2024-09-21T08:52:56.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.401+0000 7fb671c0f800 1 -- 172.21.15.196:0/3493888904 wait complete. 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.414+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.414+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.414+0000 7fb671c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.414+0000 7fb671c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651b5d25370 con 0x5651b5dd8500 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb66f703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb66f703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51750/0 (socket says 172.21.15.196:51750) 2024-09-21T08:52:56.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb66f703640 1 -- 172.21.15.196:0/4290994953 learned_addr learned my addr 172.21.15.196:0/4290994953 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb66f703640 1 -- 172.21.15.196:0/4290994953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5c72bc0 con 0x5651b5dd8500 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb66f703640 1 --2- 172.21.15.196:0/4290994953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb660001d00 tx=0x7fb66000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e45ed9088c83f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb55d60a640 1 -- 172.21.15.196:0/4290994953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66000f400 con 0x5651b5dd8500 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb55d60a640 1 -- 172.21.15.196:0/4290994953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660001e50 con 0x5651b5dd8500 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.415+0000 7fb55d60a640 1 -- 172.21.15.196:0/4290994953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66000f600 con 0x5651b5dd8500 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- 172.21.15.196:0/4290994953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 msgr2=0x5651b5ec7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 --2- 172.21.15.196:0/4290994953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb660001d00 tx=0x7fb66000b5b0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- 172.21.15.196:0/4290994953 shutdown_connections 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 --2- 172.21.15.196:0/4290994953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ec7840 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- 172.21.15.196:0/4290994953 >> 172.21.15.196:0/4290994953 conn(0x5651b5dd3e30 msgr2=0x5651b5ec3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- 172.21.15.196:0/4290994953 shutdown_connections 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- 172.21.15.196:0/4290994953 wait complete. 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.416+0000 7fb671c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651b5ddf570 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb66f703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb66f703640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51762/0 (socket says 172.21.15.196:51762) 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb66f703640 1 -- 172.21.15.196:0/3575016160 learned_addr learned my addr 172.21.15.196:0/3575016160 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb66f703640 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5c86fe0 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb66f703640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb660002000 tx=0x7fb660000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb55be07640 1 -- 172.21.15.196:0/3575016160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66001a5b0 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651b5ed0890 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb55be07640 1 -- 172.21.15.196:0/3575016160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66001a750 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb55be07640 1 -- 172.21.15.196:0/3575016160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66002c060 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.417+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b5ed0e10 con 0x5651b5dd8500 2024-09-21T08:52:56.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.418+0000 7fb55be07640 1 -- 172.21.15.196:0/3575016160 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb660017070 con 0x5651b5dd8500 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.418+0000 7fb55be07640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 0x7fb554039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.418+0000 7fb55be07640 1 -- 172.21.15.196:0/3575016160 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb660015020 con 0x5651b5dd8500 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.418+0000 7fb666f02640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 0x7fb554039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 0x5651b5ed73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5ed7940 con 0x5651b5ddc940 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb66ff04640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 0x5651b5ed73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb666f02640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 0x7fb554039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb658057000 tx=0x7fb658052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb66ff04640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 0x5651b5ed73c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb66ff04640 1 -- 172.21.15.196:0/3575016160 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66800a4a0 con 0x5651b5ddc940 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.419+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5ed4990 con 0x5651b5ddc940 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb66ff04640 1 -- 172.21.15.196:0/3575016160 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb66800a4a0 con 0x5651b5ddc940 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 0x5651b5edc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5edc750 con 0x5651b5ed9c70 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb66f703640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 0x5651b5edc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb66f703640 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 0x5651b5edc060 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.420+0000 7fb66f703640 1 -- 172.21.15.196:0/3575016160 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5ed9c70 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5ed8b10 con 0x5651b5ddc940 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb66ff04640 1 -- 172.21.15.196:0/3575016160 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb66800a4a0 con 0x5651b5ddc940 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5ed8fb0 con 0x5651b5ddc940 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb66ff04640 1 -- 172.21.15.196:0/3575016160 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb66800a4a0 con 0x5651b5ddc940 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.421+0000 7fb671c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb671c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651b5c74580 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51766/0 (socket says 172.21.15.196:51766) 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb66ff04640 1 -- 172.21.15.196:0/2496309077 learned_addr learned my addr 172.21.15.196:0/2496309077 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb66ff04640 1 -- 172.21.15.196:0/2496309077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5eeba00 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb66ff04640 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x5651b5ed7d20 tx=0x7fb668018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb559602640 1 -- 172.21.15.196:0/2496309077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668014450 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb559602640 1 -- 172.21.15.196:0/2496309077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668014610 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651b5eebc90 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb559602640 1 -- 172.21.15.196:0/2496309077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668014930 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.422+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b5eee970 con 0x5651b5eeb0a0 2024-09-21T08:52:56.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.423+0000 7fb559602640 1 -- 172.21.15.196:0/2496309077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb668011040 con 0x5651b5eeb0a0 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.423+0000 7fb559602640 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 0x7fb548039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.423+0000 7fb559602640 1 -- 172.21.15.196:0/2496309077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb66801e070 con 0x5651b5eeb0a0 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.423+0000 7fb66f703640 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 0x7fb548039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66f703640 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 0x7fb548039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5651b5ed7dc0 tx=0x7fb66004b010 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb671c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb671c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651b5ec7ff0 con 0x5651b5ef7d50 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51772/0 (socket says 172.21.15.196:51772) 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66ff04640 1 -- 172.21.15.196:0/1817837394 learned_addr learned my addr 172.21.15.196:0/1817837394 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66ff04640 1 -- 172.21.15.196:0/1817837394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5ef8720 con 0x5651b5ef7d50 2024-09-21T08:52:56.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb66ff04640 1 --2- 172.21.15.196:0/1817837394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb66804cbb0 tx=0x7fb66804ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1f646e3d7a0d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.424+0000 7fb552ffd640 1 -- 172.21.15.196:0/1817837394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668040150 con 0x5651b5ef7d50 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb552ffd640 1 -- 172.21.15.196:0/1817837394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668016960 con 0x5651b5ef7d50 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb552ffd640 1 -- 172.21.15.196:0/1817837394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668016440 con 0x5651b5ef7d50 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- 172.21.15.196:0/1817837394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 msgr2=0x5651b5ef8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 --2- 172.21.15.196:0/1817837394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb66804cbb0 tx=0x7fb66804ce60 comp rx=0 tx=0).stop 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- 172.21.15.196:0/1817837394 shutdown_connections 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 --2- 172.21.15.196:0/1817837394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5ef8150 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- 172.21.15.196:0/1817837394 >> 172.21.15.196:0/1817837394 conn(0x5651b5ef40b0 msgr2=0x5651b5ef21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- 172.21.15.196:0/1817837394 shutdown_connections 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- 172.21.15.196:0/1817837394 wait complete. 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 Processor -- start 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- start start 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.425+0000 7fb671c0f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651b5ef8d90 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb66ff04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51774/0 (socket says 172.21.15.196:51774) 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 learned_addr learned my addr 172.21.15.196:0/2701357539 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b5eff700 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb66ff04640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb66803e040 tx=0x7fb66804cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb5517fa640 1 -- 172.21.15.196:0/2701357539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668011c00 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb5517fa640 1 -- 172.21.15.196:0/2701357539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668031030 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651b5eff990 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb5517fa640 1 -- 172.21.15.196:0/2701357539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668011720 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.426+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b5f02640 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.427+0000 7fb5517fa640 1 -- 172.21.15.196:0/2701357539 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb668014b20 con 0x5651b5ef7d50 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.427+0000 7fb5517fa640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb538036b90 0x7fb538039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.427+0000 7fb5517fa640 1 -- 172.21.15.196:0/2701357539 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb66800e040 con 0x5651b5ef7d50 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.427+0000 7fb66f703640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb538036b90 0x7fb538039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb66f703640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb538036b90 0x7fb538039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5651b5edcb50 tx=0x7fb660035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5f0adf0 0x5651b5f0d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f0da00 con 0x5651b5f0adf0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb666f02640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5f0adf0 0x5651b5f0d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.428+0000 7fb666f02640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5f0adf0 0x5651b5f0d2b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 realm 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f0ddd0 con 0x5651b5f0adf0 2024-09-21T08:52:56.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f0e670 con 0x5651b5f0adf0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f0ea10 con 0x5651b5f0adf0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5f0f770 0x5651b5f11b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.429+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f12130 con 0x5651b5f0f770 2024-09-21T08:52:56.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb66ff04640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5f0f770 0x5651b5f11b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb66ff04640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5f0f770 0x5651b5f11b60 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb671c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb671c0f800 20 searching for the correct realm 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651b5f14130 0x5651b5f165f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.430+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb66f703640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651b5f14130 0x5651b5f165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb66f703640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651b5f14130 0x5651b5f165f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb66f703640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb66003f0f0 0x7fb660040590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb666f02640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb66003f0f0 0x7fb660040590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.431+0000 7fb666f02640 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb66003f0f0 0x7fb660040590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.432+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.432+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.432+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.432+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.433+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.434+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.435+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.436+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.437+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.438+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f14130 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0f770 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x5651b5f0adf0 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.439+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f16cc0 con 0x7fb66003f0f0 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:56.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f13680 con 0x5651b5f0adf0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f12600 con 0x5651b5f0adf0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f12f80 con 0x5651b5f0adf0 2024-09-21T08:52:56.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 zone default found 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 4 Realm: () 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 zonegroup default 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.440+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f175f0 con 0x5651b5f0f770 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f19820 con 0x5651b5f14130 2024-09-21T08:52:56.464 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f19bc0 con 0x5651b5f14130 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 started sync module instance, tier type = 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.441+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18cb0 con 0x7fb66003f0f0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.442+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.442+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908944847360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18cb0 con 0x7fb66003f0f0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.442+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1a5c0 con 0x5651b5f0adf0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.443+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908944847360] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.465 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.444+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.444+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908944851152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18cb0 con 0x5651b5f0adf0 2024-09-21T08:52:56.466 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.444+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1b050 con 0x5651b5f14130 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.445+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908944851152] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.445+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.445+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908944844800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18c20 con 0x5651b5f14130 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.445+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1bdf0 con 0x7fb66003f0f0 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.446+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908944844800] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.446+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.446+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908944856128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1c210 con 0x7fb66003f0f0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.446+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1cbd0 con 0x5651b5f0adf0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.447+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.447+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908944860960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1cb40 con 0x5651b5f0adf0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.447+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1db80 con 0x5651b5f0f770 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.447+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908944856128] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.448+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908944860960] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.448+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.448+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908944863168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1d660 con 0x5651b5f0f770 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.448+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1e420 con 0x5651b5f0f770 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.449+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.449+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908944867184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1e880 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.449+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1f3a0 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.449+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908944863168] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908944867184] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908944871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1e390 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=0 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=1 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=2 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=3 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=4 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=5 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.450+0000 7fb671c0f800 20 add_watcher() i=6 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.451+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908944871024] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.451+0000 7fb671c0f800 20 add_watcher() i=7 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.451+0000 7fb671c0f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.451+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f22390 con 0x5651b5f0adf0 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.452+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.452+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908944857184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1f810 con 0x5651b5f0adf0 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908944857184] v36'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb671c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb671c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:56.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb671c0f800 5 note: GC not initialized 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb524fe1640 20 reqs_thread_entry: start 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb671c0f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.453+0000 7fb671c0f800 20 Filter name: none 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb49e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f55750 con 0x5651b5f0f770 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-21T08:52:56.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f53d90 con 0x5651b5f0adf0 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.454+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f54660 con 0x5651b5f0f770 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.455+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.455+0000 7fb671c0f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-21T08:52:56.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.455+0000 7fb671c0f800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.455+0000 7fb671c0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.455+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94908945088944 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f58d40 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== watch-notify(notify (1) cookie 94908944871024 notify 154618822685 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5651b5f551a0 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb552ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94908944871024 notifier 4734 bl.length()=556 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(65 notify.7 [notify cookie 94908945088944 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb552ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb552ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb552ffd640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb534003ea0 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== watch-notify(notify_complete (2) cookie 94908945088944 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5651b5eff990 con 0x5651b5f0f770 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.456+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f54660 con 0x5651b5f0adf0 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb671c0f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T08:52:56.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb671c0f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb671c0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94908945088944 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f58e20 con 0x5651b5f0f770 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== watch-notify(notify (1) cookie 94908944863168 notify 154618822686 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5651b5eff990 con 0x5651b5f0f770 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb552ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94908944863168 notifier 4734 bl.length()=177 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb552ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb552ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb552ffd640 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb534003ea0 con 0x5651b5f0f770 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(68 notify.5 [notify cookie 94908945088944 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.458+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== watch-notify(notify_complete (2) cookie 94908945088944 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5651b5eff700 con 0x5651b5f0f770 2024-09-21T08:52:56.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.459+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.481 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-21T08:52:56.455495Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:52:56.455485Z","tags":[],"group_ids":[]} 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.459+0000 7fb525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.459+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908944857184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f53410 con 0x5651b5f0adf0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.460+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94908944857184] v36'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.460+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908944847360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f53410 con 0x7fb66003f0f0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.461+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94908944847360] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.461+0000 7fb671c0f800 20 remove_watcher() i=0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.461+0000 7fb671c0f800 2 removed watcher, disabling cache 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.461+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908944851152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f53410 con 0x5651b5f0adf0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.462+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94908944851152] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.463+0000 7fb671c0f800 20 remove_watcher() i=1 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.463+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908944844800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f53410 con 0x5651b5f14130 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.463+0000 7fb66f703640 1 -- 172.21.15.196:0/2701357539 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94908944844800] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002e070 con 0x5651b5f14130 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.464+0000 7fb671c0f800 20 remove_watcher() i=2 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.464+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908944856128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18800 con 0x7fb66003f0f0 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.464+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94908944856128] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x7fb66003f0f0 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.464+0000 7fb671c0f800 20 remove_watcher() i=3 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.464+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908944860960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18800 con 0x5651b5f0adf0 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.466+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94908944860960] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb658057030 con 0x5651b5f0adf0 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.466+0000 7fb671c0f800 20 remove_watcher() i=4 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.466+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908944863168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1c720 con 0x5651b5f0f770 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.467+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94908944863168] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.467+0000 7fb671c0f800 20 remove_watcher() i=5 2024-09-21T08:52:56.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.467+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908944867184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f18800 con 0x5651b5f0f770 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.468+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94908944867184] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.468+0000 7fb671c0f800 20 remove_watcher() i=6 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.468+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908944871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5651b5f1c720 con 0x5651b5f0f770 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb66ff04640 1 -- 172.21.15.196:0/2701357539 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94908944871024] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x5651b5f0f770 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 20 remove_watcher() i=7 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5f0f770 msgr2=0x5651b5f11b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5f0f770 0x5651b5f11b60 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5f0adf0 msgr2=0x5651b5f0d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5f0adf0 0x5651b5f0d2b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb66003f0f0 msgr2=0x7fb660040590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fb66003f0f0 0x7fb660040590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651b5f14130 msgr2=0x5651b5f165f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5651b5f14130 0x5651b5f165f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb538036b90 msgr2=0x7fb538039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb538036b90 0x7fb538039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5651b5edcb50 tx=0x7fb660035000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 msgr2=0x5651b5eff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb666f02640 1 -- 172.21.15.196:0/2701357539 reap_dead start 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb66803e040 tx=0x7fb66804cb40 comp rx=0 tx=0).stop 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 shutdown_connections 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2701357539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5ef7d50 0x5651b5eff1c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 >> 172.21.15.196:0/2701357539 conn(0x5651b5ef40b0 msgr2=0x5651b5ef2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 shutdown_connections 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.469+0000 7fb671c0f800 1 -- 172.21.15.196:0/2701357539 wait complete. 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 msgr2=0x7fb548039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 0x7fb548039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5651b5ed7dc0 tx=0x7fb66004b010 comp rx=0 tx=0).stop 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 msgr2=0x5651b5eeb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x5651b5ed7d20 tx=0x7fb668018830 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 shutdown_connections 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb548036b40 0x7fb548039000 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/2496309077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5eeb0a0 0x5651b5eeb4c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 >> 172.21.15.196:0/2496309077 conn(0x5651b5ee0030 msgr2=0x5651b5ee2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 shutdown_connections 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/2496309077 wait complete. 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 msgr2=0x5651b5edc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 0x5651b5edc060 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 msgr2=0x5651b5ed73c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 0x5651b5ed73c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 msgr2=0x7fb554039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 0x7fb554039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb658057000 tx=0x7fb658052000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 msgr2=0x5651b5ed0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb660002000 tx=0x7fb660000bc0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 shutdown_connections 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5651b5ed9c70 0x5651b5edc060 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5651b5ddc940 0x5651b5ed73c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fb554036b40 0x7fb554039000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 --2- 172.21.15.196:0/3575016160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651b5dd8500 0x5651b5ed0350 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 >> 172.21.15.196:0/3575016160 conn(0x5651b5dd3e30 msgr2=0x5651b5ec1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 shutdown_connections 2024-09-21T08:52:56.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.470+0000 7fb671c0f800 1 -- 172.21.15.196:0/3575016160 wait complete. 2024-09-21T08:52:56.491 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-21T08:52:56.455495Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:52:56.455485Z', 'tags': [], 'group_ids': []} 2024-09-21T08:52:56.503 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:52:56.507 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-21T08:52:56.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-21T08:52:56.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-21T08:52:56.508 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-21T08:52:56.554 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:52:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:52:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5d280f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ee5c9ab920 0x55ee5c9add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5d280f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee5c867b30 con 0x55ee5c9a74e0 2024-09-21T08:52:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5d280f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ee5c849360 con 0x55ee5c9ab920 2024-09-21T08:52:56.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5cd79b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ee5c9ab920 0x55ee5c9add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5cdf9c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ee5c9a74e0 0x55ee5c9a78e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:41482/0 (socket says 172.21.15.196:41482) 2024-09-21T08:52:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.554+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1962317625 learned_addr learned my addr 172.21.15.196:0/1962317625 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:52:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.555+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1962317625 >> v1:172.21.15.29:6789/0 conn(0x55ee5c9a74e0 legacy=0x55ee5c9a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.555+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1962317625 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5c86fe00 con 0x55ee5c9ab920 2024-09-21T08:52:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.556+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/1962317625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9ab920 0x55ee5c9add10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400a470 tx=0x7fa5c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d35bde2d1ed49d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5ccf9a640 1 -- 172.21.15.196:0/1962317625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c4053570 con 0x55ee5c9ab920 2024-09-21T08:52:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5ccf9a640 1 -- 172.21.15.196:0/1962317625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c4058070 con 0x55ee5c9ab920 2024-09-21T08:52:56.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5ccf9a640 1 -- 172.21.15.196:0/1962317625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c4053880 con 0x55ee5c9ab920 2024-09-21T08:52:56.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 -- 172.21.15.196:0/1962317625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9ab920 msgr2=0x55ee5c9add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1962317625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9ab920 0x55ee5c9add10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400a470 tx=0x7fa5c4045a20 comp rx=0 tx=0).stop 2024-09-21T08:52:56.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 -- 172.21.15.196:0/1962317625 shutdown_connections 2024-09-21T08:52:56.559 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1962317625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9ab920 0x55ee5c9add10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 -- 172.21.15.196:0/1962317625 >> 172.21.15.196:0/1962317625 conn(0x55ee5c9a2db0 msgr2=0x55ee5c9a51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 -- 172.21.15.196:0/1962317625 shutdown_connections 2024-09-21T08:52:56.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.557+0000 7fa5d280f800 1 -- 172.21.15.196:0/1962317625 wait complete. 2024-09-21T08:52:56.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5d280f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5d280f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ee5c8f4360 con 0x55ee5c9a74e0 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5cdf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5cdf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51800/0 (socket says 172.21.15.196:51800) 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.571+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/2142931276 learned_addr learned my addr 172.21.15.196:0/2142931276 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.572+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/2142931276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5c841bc0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.572+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2142931276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001e10 tx=0x7fa5c000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdb78021bdbbf84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.572+0000 7fa4bbe07640 1 -- 172.21.15.196:0/2142931276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c0012020 con 0x55ee5c9a74e0 2024-09-21T08:52:56.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.572+0000 7fa4bbe07640 1 -- 172.21.15.196:0/2142931276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c000e5a0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.572+0000 7fa4bbe07640 1 -- 172.21.15.196:0/2142931276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c000e8e0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- 172.21.15.196:0/2142931276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 msgr2=0x55ee5c91c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2142931276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001e10 tx=0x7fa5c000b780 comp rx=0 tx=0).stop 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- 172.21.15.196:0/2142931276 shutdown_connections 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2142931276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5c91c5c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- 172.21.15.196:0/2142931276 >> 172.21.15.196:0/2142931276 conn(0x55ee5c9a2db0 msgr2=0x55ee5ca92120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- 172.21.15.196:0/2142931276 shutdown_connections 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- 172.21.15.196:0/2142931276 wait complete. 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5d280f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ee5c9ae550 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5cdf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5cdf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51806/0 (socket says 172.21.15.196:51806) 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.573+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/2049894315 learned_addr learned my addr 172.21.15.196:0/2049894315 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5c855fe0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001e10 tx=0x7fa5c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa4ba604640 1 -- 172.21.15.196:0/2049894315 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c0012030 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee5caa19c0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa4ba604640 1 -- 172.21.15.196:0/2049894315 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c001a7a0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5caa1ee0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.574+0000 7fa4ba604640 1 -- 172.21.15.196:0/2049894315 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c001aac0 con 0x55ee5c9a74e0 2024-09-21T08:52:56.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa4ba604640 1 -- 172.21.15.196:0/2049894315 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa5c0015020 con 0x55ee5c9a74e0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa4ba604640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 0x7fa4b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa4ba604640 1 -- 172.21.15.196:0/2049894315 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa5c0020030 con 0x55ee5c9a74e0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 0x7fa4b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 0x55ee5caa84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.575+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caa8a80 con 0x55ee5c9ab920 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 0x55ee5caa84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 0x7fa4b4039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4057000 tx=0x7fa5c4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 0x55ee5caa84f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2049894315 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5c800a4a0 con 0x55ee5c9ab920 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caa5aa0 con 0x55ee5c9ab920 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2049894315 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5c800a4a0 con 0x55ee5c9ab920 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 0x55ee5caad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.576+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caad840 con 0x55ee5caaadb0 2024-09-21T08:52:56.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.577+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 0x55ee5caad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.577+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 0x55ee5caad1a0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.577+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/2049894315 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5caaadb0 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.577+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caa9c50 con 0x55ee5c9ab920 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.578+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2049894315 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5c800a4a0 con 0x55ee5c9ab920 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.578+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caaa0f0 con 0x55ee5c9ab920 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.578+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2049894315 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5c800a4a0 con 0x55ee5c9ab920 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.578+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5d280f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5d280f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ee5c843580 con 0x55ee5cabc1b0 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51820/0 (socket says 172.21.15.196:51820) 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2572583276 learned_addr learned my addr 172.21.15.196:0/2572583276 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5ce79d640 1 -- 172.21.15.196:0/2572583276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5cabcb10 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55ee5caa8e80 tx=0x7fa5c8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa4b37fe640 1 -- 172.21.15.196:0/2572583276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8014450 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa4b37fe640 1 -- 172.21.15.196:0/2572583276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c80145f0 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee5cabcda0 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.579+0000 7fa4b37fe640 1 -- 172.21.15.196:0/2572583276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8014910 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.580+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5cabfa80 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.580+0000 7fa4b37fe640 1 -- 172.21.15.196:0/2572583276 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa5c8011040 con 0x55ee5cabc1b0 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.580+0000 7fa4b37fe640 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 0x7fa4a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.580+0000 7fa4b37fe640 1 -- 172.21.15.196:0/2572583276 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa5c801e070 con 0x55ee5cabc1b0 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.580+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 0x7fa4a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 0x7fa4a8039050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ee5caa8ef0 tx=0x7fa5c0024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5d280f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5d280f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ca9c990 con 0x55ee5cac8e10 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51826/0 (socket says 172.21.15.196:51826) 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5ce79d640 1 -- 172.21.15.196:0/3391909340 learned_addr learned my addr 172.21.15.196:0/3391909340 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.581+0000 7fa5ce79d640 1 -- 172.21.15.196:0/3391909340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5cac97e0 con 0x55ee5cac8e10 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/3391909340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa5c804ccc0 tx=0x7fa5c804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1315114ccbf1bc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa4b17fa640 1 -- 172.21.15.196:0/3391909340 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8028040 con 0x55ee5cac8e10 2024-09-21T08:52:56.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa4b17fa640 1 -- 172.21.15.196:0/3391909340 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c8046df0 con 0x55ee5cac8e10 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa4b17fa640 1 -- 172.21.15.196:0/3391909340 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8014c00 con 0x55ee5cac8e10 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 -- 172.21.15.196:0/3391909340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 msgr2=0x55ee5cac9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 --2- 172.21.15.196:0/3391909340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa5c804ccc0 tx=0x7fa5c804cf90 comp rx=0 tx=0).stop 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 -- 172.21.15.196:0/3391909340 shutdown_connections 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 --2- 172.21.15.196:0/3391909340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cac9210 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 -- 172.21.15.196:0/3391909340 >> 172.21.15.196:0/3391909340 conn(0x55ee5cac5170 msgr2=0x55ee5cac3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 -- 172.21.15.196:0/3391909340 shutdown_connections 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 -- 172.21.15.196:0/3391909340 wait complete. 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.582+0000 7fa5d280f800 1 Processor -- start 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5d280f800 1 -- start start 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5d280f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5d280f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ee5cac9e90 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5ce79d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:51830/0 (socket says 172.21.15.196:51830) 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 learned_addr learned my addr 172.21.15.196:0/1470212872 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5cad0830 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.583+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5c804bbe0 tx=0x7fa5c804cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa49f7fe640 1 -- 172.21.15.196:0/1470212872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8028070 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa49f7fe640 1 -- 172.21.15.196:0/1470212872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c804a030 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa49f7fe640 1 -- 172.21.15.196:0/1470212872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5c8046770 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee5cad0ac0 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5cad3770 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.584+0000 7fa49f7fe640 1 -- 172.21.15.196:0/1470212872 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa5c8044020 con 0x55ee5cac8e10 2024-09-21T08:52:56.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa49f7fe640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa498036b90 0x7fa498039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa49f7fe640 1 -- 172.21.15.196:0/1470212872 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa5c800e040 con 0x55ee5cac8e10 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa498036b90 0x7fa498039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa498036b90 0x7fa498039050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001750 tx=0x7fa5c0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5cadbf50 0x55ee5cade410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cadeb60 con 0x55ee5cadbf50 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.585+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5cadbf50 0x55ee5cade410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5cadbf50 0x55ee5cade410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 realm 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cadef90 con 0x55ee5cadbf50 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cadf860 con 0x55ee5cadbf50 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.599 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.586+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cadfc00 con 0x55ee5cadbf50 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5cae0960 0x55ee5cae2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae3360 con 0x55ee5cae0960 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5cae0960 0x55ee5cae2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.587+0000 7fa5ce79d640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5cae0960 0x55ee5cae2d50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5d280f800 20 searching for the correct realm 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ee5cae52d0 0x55ee5cae7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ee5cae52d0 0x55ee5cae7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ee5cae52d0 0x55ee5cae7790 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.600 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cdf9c640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa5c0017050 0x7fa5c002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x7fa5c0017050 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.588+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa5c0017050 0x7fa5c002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5cd79b640 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa5c0017050 0x7fa5c002d3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae0960 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cadbf50 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.589+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cadbf50 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae0960 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae0960 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.590+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x7fa5c0017050 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cadbf50 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.602 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.591+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae0960 2024-09-21T08:52:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cadbf50 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x7fa5c0017050 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.592+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae0960 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae7e60 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cadbf50 2024-09-21T08:52:56.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.593+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cadbf50 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae0960 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae52d0 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x7fa5c0017050 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.594+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cadbf50 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae0960 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae52d0 2024-09-21T08:52:56.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.595+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae0960 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x7fa5c0017050 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae52d0 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cae0960 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.596+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x55ee5cadbf50 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa5c0063040 con 0x7fa5c0017050 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:52:56.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae4840 con 0x55ee5cadbf50 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae37c0 con 0x55ee5cadbf50 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.597+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae4140 con 0x55ee5cadbf50 2024-09-21T08:52:56.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 zone default found 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 4 Realm: () 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 zonegroup default 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae8790 con 0x55ee5cae0960 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caea9c0 con 0x55ee5cae52d0 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caead60 con 0x55ee5cae52d0 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 started sync module instance, tier type = 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.598+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae9e00 con 0x7fa5c0017050 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.600+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.600+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94482245526272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae9e00 con 0x7fa5c0017050 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.600+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caeb780 con 0x55ee5cadbf50 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.602+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.602+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94482245526272] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.602+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94482245530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caeb780 con 0x55ee5cadbf50 2024-09-21T08:52:56.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.602+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cae9950 con 0x55ee5cae52d0 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.603+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.603+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94482245534320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caecb40 con 0x55ee5cae52d0 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.603+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caed560 con 0x7fa5c0017050 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.603+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94482245530224] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.604+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94482245534320] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.604+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.604+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94482245535376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caebb20 con 0x7fa5c0017050 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.604+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caede30 con 0x55ee5cadbf50 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.605+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.605+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94482245540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caee200 con 0x55ee5cadbf50 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.605+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caeecf0 con 0x55ee5cae0960 2024-09-21T08:52:56.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.605+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94482245535376] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.606+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94482245540144] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.606+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.606+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94482245537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caee200 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.606+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caef590 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.607+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94482245537872] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.608+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.608+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94482245541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caef770 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.608+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caeffc0 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94482245541200] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94482245547168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caefe30 con 0x55ee5cae0960 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=0 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=1 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=2 2024-09-21T08:52:56.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=3 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=4 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=5 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.609+0000 7fa5d280f800 20 add_watcher() i=6 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94482245547168] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5d280f800 20 add_watcher() i=7 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5d280f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caf3410 con 0x55ee5cadbf50 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.620 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.610+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94482245548288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5caf08c0 con 0x55ee5cadbf50 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94482245548288] v36'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa47f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa5d280f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa5d280f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa5d280f800 5 note: GC not initialized 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.611+0000 7fa47e7fc640 20 reqs_thread_entry: start 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa5d280f800 20 init_complete bucket index max shards: 11 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa5d280f800 20 Filter name: none 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa3effff640 20 reqs_thread_entry: start 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa5d280f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-21T08:52:56.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.612+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb267d0 con 0x55ee5cae0960 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5d280f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5d280f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.613+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2ab70 con 0x7fa5c0017050 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v36'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5d280f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94482245789248 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b7a0 con 0x55ee5cae0960 2024-09-21T08:52:56.632 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== watch-notify(notify (1) cookie 94482245537872 notify 154618822687 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55ee5cad3770 con 0x55ee5cae0960 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa4b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94482245537872 notifier 4741 bl.length()=382 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(64 notify.5 [notify cookie 94482245789248 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa4b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa4b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.614+0000 7fa4b17fa640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa490003ea0 con 0x55ee5cae0960 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== watch-notify(notify_complete (2) cookie 94482245789248 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cad0ac0 con 0x55ee5cae0960 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2a640 con 0x55ee5cadbf50 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5d280f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 : miss 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5d280f800 20 rados->read ofs=0 len=0 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 8.1f 8:fceaba51:root::.bucket.meta.myfoo6%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28970 con 0x7fa5c0017050 2024-09-21T08:52:56.633 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.615+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 .bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.616+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 8.1f 8:fceaba51:root::.bucket.meta.myfoo6%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb32780 con 0x7fa5c0017050 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(68 .bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9, ofs0, ns] 2024-09-21T08:52:56.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94482245776560 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2cbe0 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify (1) cookie 94482245526272 notify 154618822678 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55ee5cb28d60 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa4b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 94482245526272 notifier 4741 bl.length()=748 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa4b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa4b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa4b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(69 notify.0 [notify cookie 94482245776560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa4b17fa640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa490003ea0 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== watch-notify(notify_complete (2) cookie 94482245776560 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cb2b9b0 con 0x7fa5c0017050 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): orig_sources= new_sources= 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): potential sources added=[] removed=[] 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): orig_dests= new_dests= 2024-09-21T08:52:56.635 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): potential dests added=[] removed=[] 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.617+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb274b0 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.618+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(71 bud.buckets [call] v36'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.618+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb31fb0 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.619+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(72 bud.buckets [call] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.619+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb31fb0 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v36'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94482245776560 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2cbe0 con 0x7fa5c0017050 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== watch-notify(notify (1) cookie 94482245535376 notify 154618822679 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55ee5cb28ae0 con 0x7fa5c0017050 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa4b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 94482245535376 notifier 4741 bl.length()=316 2024-09-21T08:52:56.636 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa4b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa4b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa4b0ff9640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa3f8003400 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(74 notify.3 [notify cookie 94482245776560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== watch-notify(notify_complete (2) cookie 94482245776560 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cb2b9b0 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.621+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:76 8.1f 8:fceaba51:root::.bucket.meta.myfoo6%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb304f0 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(76 .bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5d280f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:52:56.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5d280f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9, ofs0, ns] 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.622+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94482245776560 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27fd0 con 0x7fa5c0017050 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== watch-notify(notify (1) cookie 94482245526272 notify 154618822680 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55ee5cb2b9b0 con 0x7fa5c0017050 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa4b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 94482245526272 notifier 4741 bl.length()=748 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa4b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa4b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa4b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(77 notify.0 [notify cookie 94482245776560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa4b17fa640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa490003ea0 con 0x7fa5c0017050 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== watch-notify(notify_complete (2) cookie 94482245776560 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5c86fe00 con 0x7fa5c0017050 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): orig_sources= new_sources= 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): potential sources added=[] removed=[] 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): orig_dests= new_dests= 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5d280f800 20 handle_bi_update(): bucket=:myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]): potential dests added=[] removed=[] 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 4.8 4:1229778f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27b20 con 0x55ee5cae52d0 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.623+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(79 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.624+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 4.3 4:c12bfcbc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cadbf50 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.624+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.624+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:81 4.7 4:e38ff118:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cae0960 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(81 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 4.2e 4:75de2592:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cae52d0 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(82 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:83 4.20 4:073c4179:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cadbf50 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(83 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.625+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:84 4.3 4:c04edd47:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cadbf50 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(84 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 4.0 4:01ecc0ae:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb27f50 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(85 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 4.14 4:2a90a86c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28340 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(86 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.626+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 4.16 4:6a5a2a1b:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28340 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(87 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:88 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28340 con 0x7fa5c0017050 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(88 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [call out=378b] v0'0 uv8 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5d280f800 10 cls_bucket_list_unordered: got thirteen 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:89 4.b 4:d1208894:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28340 con 0x7fa5c0017050 2024-09-21T08:52:56.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(89 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5d280f800 20 get_obj_state: octx=0x55ee5cb2ada0 obj=myfoo6:thirteen state=0x55ee5cb2bdb8 s->prefetch_data=0 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.627+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:90 3.17s0 3:eaabae82:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb28340 con 0x55ee5cadbf50 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(90 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 10 manifest: total_size = 8 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.15909371235553582255 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-21T08:52:56.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 get_obj_state: octx=0x55ee5cb2ada0 obj=myfoo6:thirteen state=0x55ee5cb2bdb8 s->prefetch_data=0 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.628+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:91 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb314b0 con 0x7fa5c0017050 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.629+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(91 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.629+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:92 3.17s0 3:eaabae82:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb314b0 con 0x55ee5cadbf50 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.630+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(92 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v36'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.630+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb35e90 con 0x7fa5c0017050 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:1 objects processed in :myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9]). Next marker thirteen 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.630+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x7fa5c0017050 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(93 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [stat,call,call] v36'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa4b17fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v36'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5d280f800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T08:52:56.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.631+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94482245816224 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== watch-notify(notify (1) cookie 94482245537872 notify 154618822688 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ee5cad0ac0 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa4b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 94482245537872 notifier 4741 bl.length()=556 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa4b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa4b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(95 notify.5 [notify cookie 94482245816224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa4b0ff9640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa3f8003460 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== watch-notify(notify_complete (2) cookie 94482245816224 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cad0830 con 0x55ee5cae0960 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.632+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cadbf50 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.633+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.633+0000 7fa5d280f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T08:52:56.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.633+0000 7fa5d280f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.633+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.633+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94482245816224 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== watch-notify(notify (1) cookie 94482245537872 notify 154618822689 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ee5cad0830 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa4b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 94482245537872 notifier 4741 bl.length()=177 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(98 notify.5 [notify cookie 94482245816224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa4b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa4b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa4b0ff9640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa3f8003460 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== watch-notify(notify_complete (2) cookie 94482245816224 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cac97e0 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5d280f800 10 removing user index: bar 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.634+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(100 bar [delete] v36'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5d280f800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5d280f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94482245816224 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== watch-notify(notify (1) cookie 94482245547168 notify 154618822690 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ee5cac97e0 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa4b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 94482245547168 notifier 4741 bl.length()=152 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(101 notify.7 [notify cookie 94482245816224 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa4b0ff9640 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa3f8003460 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.635+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== watch-notify(notify_complete (2) cookie 94482245816224 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee5cabfa80 con 0x55ee5cae0960 2024-09-21T08:52:56.649 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-21T08:52:56.455495Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:52:56.455485Z","tags":[],"group_ids":[]} 2024-09-21T08:52:56.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.636+0000 7fa47f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.636+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94482245548288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cadbf50 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.637+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94482245548288] v36'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.637+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94482245526272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x7fa5c0017050 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.638+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94482245526272] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.638+0000 7fa5d280f800 20 remove_watcher() i=0 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.638+0000 7fa5d280f800 2 removed watcher, disabling cache 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.638+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94482245530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cadbf50 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.639+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94482245530224] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.639+0000 7fa5d280f800 20 remove_watcher() i=1 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.639+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94482245534320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae52d0 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.640+0000 7fa5cdf9c640 1 -- 172.21.15.196:0/1470212872 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94482245534320] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c0018950 con 0x55ee5cae52d0 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.640+0000 7fa5d280f800 20 remove_watcher() i=2 2024-09-21T08:52:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.640+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94482245535376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x7fa5c0017050 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.641+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94482245535376] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x7fa5c0017050 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.641+0000 7fa5d280f800 20 remove_watcher() i=3 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.641+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94482245540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cadbf50 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.642+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94482245540144] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c4051070 con 0x55ee5cadbf50 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.642+0000 7fa5d280f800 20 remove_watcher() i=4 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.642+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94482245537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.643+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94482245537872] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.643+0000 7fa5d280f800 20 remove_watcher() i=5 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.643+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94482245541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.644+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94482245541200] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.644+0000 7fa5d280f800 20 remove_watcher() i=6 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.644+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94482245547168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ee5cb2b1f0 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5ce79d640 1 -- 172.21.15.196:0/1470212872 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94482245547168] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5c802a070 con 0x55ee5cae0960 2024-09-21T08:52:56.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 20 remove_watcher() i=7 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5cae0960 msgr2=0x55ee5cae2d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5cae0960 0x55ee5cae2d50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5cadbf50 msgr2=0x55ee5cade410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5cadbf50 0x55ee5cade410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa5c0017050 msgr2=0x7fa5c002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa5c0017050 0x7fa5c002d3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ee5cae52d0 msgr2=0x55ee5cae7790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.645+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ee5cae52d0 0x55ee5cae7790 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa498036b90 msgr2=0x7fa498039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa498036b90 0x7fa498039050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001750 tx=0x7fa5c0030000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 msgr2=0x55ee5cad02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5cd79b640 1 -- 172.21.15.196:0/1470212872 reap_dead start 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa5c804bbe0 tx=0x7fa5c804cc50 comp rx=0 tx=0).stop 2024-09-21T08:52:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 shutdown_connections 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/1470212872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cac8e10 0x55ee5cad02f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 >> 172.21.15.196:0/1470212872 conn(0x55ee5cac5170 msgr2=0x55ee5cac3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 shutdown_connections 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/1470212872 wait complete. 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 msgr2=0x7fa4a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 0x7fa4a8039050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ee5caa8ef0 tx=0x7fa5c0024ec0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 msgr2=0x55ee5cabc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55ee5caa8e80 tx=0x7fa5c8018830 comp rx=0 tx=0).stop 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 shutdown_connections 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4a8036b90 0x7fa4a8039050 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2572583276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5cabc1b0 0x55ee5cabc5d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 >> 172.21.15.196:0/2572583276 conn(0x55ee5cab1140 msgr2=0x55ee5cab3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 shutdown_connections 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2572583276 wait complete. 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 msgr2=0x55ee5caad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 0x55ee5caad1a0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 msgr2=0x55ee5caa84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.646+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 0x55ee5caa84f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 msgr2=0x7fa4b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 0x7fa4b4039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4057000 tx=0x7fa5c4052000 comp rx=0 tx=0).stop 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 msgr2=0x55ee5caa1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0001e10 tx=0x7fa5c0000ed0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 shutdown_connections 2024-09-21T08:52:56.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ee5caaadb0 0x55ee5caad1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ee5c9ab920 0x55ee5caa84f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa4b4036b40 0x7fa4b4039000 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 --2- 172.21.15.196:0/2049894315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ee5c9a74e0 0x55ee5caa1480 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 >> 172.21.15.196:0/2049894315 conn(0x55ee5c9a2db0 msgr2=0x55ee5ca90a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 shutdown_connections 2024-09-21T08:52:56.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:52:56.647+0000 7fa5d280f800 1 -- 172.21.15.196:0/2049894315 wait complete. 2024-09-21T08:52:56.660 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-21T08:52:56.455495Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:52:56.455485Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:01.667 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:53:01.667 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-21T08:53:01.667 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-21T08:53:01.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-21T08:53:01.668 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-21T08:53:01.727 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:01.727 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:01.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.726+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.726+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb9a0e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fcacabfae0 0x55fcacabfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb9a0e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcac97fb30 con 0x55fcacac0450 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb9a0e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55fcac961360 con 0x55fcacabfae0 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb50f7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fcacabfae0 0x55fcacabfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb48f6640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55fcacac0450 0x55fcacac4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:51170/0 (socket says 172.21.15.196:51170) 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb50f7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fcacabfae0 0x55fcacabfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57174/0 (socket says 172.21.15.196:57174) 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb48f6640 1 -- 172.21.15.196:0/598705105 learned_addr learned my addr 172.21.15.196:0/598705105 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:01.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb50f7640 1 -- 172.21.15.196:0/598705105 >> v1:172.21.15.29:6789/0 conn(0x55fcacac0450 legacy=0x55fcacac4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.727+0000 7f6cb50f7640 1 -- 172.21.15.196:0/598705105 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcac987e00 con 0x55fcacabfae0 2024-09-21T08:53:01.730 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.729+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/598705105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabfee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a470 tx=0x7f6ca8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4749f23ef25792ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.729+0000 7f6ca7fff640 1 -- 172.21.15.196:0/598705105 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053570 con 0x55fcacabfae0 2024-09-21T08:53:01.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.729+0000 7f6ca7fff640 1 -- 172.21.15.196:0/598705105 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8058070 con 0x55fcacabfae0 2024-09-21T08:53:01.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.729+0000 7f6ca7fff640 1 -- 172.21.15.196:0/598705105 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053880 con 0x55fcacabfae0 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/598705105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 msgr2=0x55fcacabfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/598705105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabfee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a470 tx=0x7f6ca8045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/598705105 shutdown_connections 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/598705105 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabfee0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/598705105 >> 172.21.15.196:0/598705105 conn(0x55fcacaba600 msgr2=0x55fcacabca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/598705105 shutdown_connections 2024-09-21T08:53:01.732 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.730+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/598705105 wait complete. 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.745+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb9a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb9a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fcaca0c370 con 0x55fcacabfae0 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb50f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb50f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57186/0 (socket says 172.21.15.196:57186) 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb50f7640 1 -- 172.21.15.196:0/1018119743 learned_addr learned my addr 172.21.15.196:0/1018119743 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.746+0000 7f6cb50f7640 1 -- 172.21.15.196:0/1018119743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcac959bc0 con 0x55fcacabfae0 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.747+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/1018119743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8025c20 tx=0x7f6ca8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6ce417ae355a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.747+0000 7f6ba3606640 1 -- 172.21.15.196:0/1018119743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053ba0 con 0x55fcacabfae0 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.747+0000 7f6ba3606640 1 -- 172.21.15.196:0/1018119743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8063030 con 0x55fcacabfae0 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.747+0000 7f6ba3606640 1 -- 172.21.15.196:0/1018119743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053440 con 0x55fcacabfae0 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/1018119743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 msgr2=0x55fcacabf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/1018119743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8025c20 tx=0x7f6ca8051000 comp rx=0 tx=0).stop 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/1018119743 shutdown_connections 2024-09-21T08:53:01.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/1018119743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacabf270 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/1018119743 >> 172.21.15.196:0/1018119743 conn(0x55fcacaba600 msgr2=0x55fcacbaa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/1018119743 shutdown_connections 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/1018119743 wait complete. 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb9a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fcacac6590 con 0x55fcacabfae0 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.748+0000 7f6cb50f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb50f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57188/0 (socket says 172.21.15.196:57188) 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb50f7640 1 -- 172.21.15.196:0/2380613610 learned_addr learned my addr 172.21.15.196:0/2380613610 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb50f7640 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcac96dfe0 con 0x55fcacabfae0 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55fcacabe970 tx=0x7f6ca8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6ba1e03640 1 -- 172.21.15.196:0/2380613610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8078070 con 0x55fcacabfae0 2024-09-21T08:53:01.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6ba1e03640 1 -- 172.21.15.196:0/2380613610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8053570 con 0x55fcacabfae0 2024-09-21T08:53:01.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcacbb99c0 con 0x55fcacabfae0 2024-09-21T08:53:01.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6ba1e03640 1 -- 172.21.15.196:0/2380613610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053850 con 0x55fcacabfae0 2024-09-21T08:53:01.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.749+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcacbb9f40 con 0x55fcacabfae0 2024-09-21T08:53:01.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.750+0000 7f6ba1e03640 1 -- 172.21.15.196:0/2380613610 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ca807b070 con 0x55fcacabfae0 2024-09-21T08:53:01.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.750+0000 7f6ba1e03640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 0x7f6b9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.750+0000 7f6ba1e03640 1 -- 172.21.15.196:0/2380613610 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6ca8070070 con 0x55fcacabfae0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.750+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 0x7f6b9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 0x55fcacbc04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbc0b10 con 0x55fcacac0450 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 0x55fcacbc04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 0x7f6b9c039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000f60 tx=0x7f6cac0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 0x55fcacbc04f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2380613610 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cb000a4a0 con 0x55fcacac0450 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.751+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbbdac0 con 0x55fcacac0450 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.752+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2380613610 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cb000a4a0 con 0x55fcacac0450 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.752+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 0x55fcacbc52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.752+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbc5990 con 0x55fcacbc2eb0 2024-09-21T08:53:01.756 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.752+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 0x55fcacbc52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.752+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 0x55fcacbc52a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.753+0000 7f6cb50f7640 1 -- 172.21.15.196:0/2380613610 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbc2eb0 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.753+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbc1c90 con 0x55fcacac0450 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.753+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2380613610 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cb000a4a0 con 0x55fcacac0450 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.753+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbc2130 con 0x55fcacac0450 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.753+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2380613610 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6cb000a4a0 con 0x55fcacac0450 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb9a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb9a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fcac95b580 con 0x55fcacbd4230 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57204/0 (socket says 172.21.15.196:57204) 2024-09-21T08:53:01.757 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2635943125 learned_addr learned my addr 172.21.15.196:0/2635943125 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.754+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2635943125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcacbd4b90 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x55fcacbc0f10 tx=0x7f6cb0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6b9affd640 1 -- 172.21.15.196:0/2635943125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0014450 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6b9affd640 1 -- 172.21.15.196:0/2635943125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0014610 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcacbd4e20 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6b9affd640 1 -- 172.21.15.196:0/2635943125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0014930 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.755+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcacbd7b00 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.756+0000 7f6b9affd640 1 -- 172.21.15.196:0/2635943125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6cb0011040 con 0x55fcacbd4230 2024-09-21T08:53:01.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.756+0000 7f6b9affd640 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 0x7f6b8c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.756+0000 7f6b9affd640 1 -- 172.21.15.196:0/2635943125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6cb001e070 con 0x55fcacbd4230 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.756+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 0x7f6b8c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.756+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 0x7f6b8c039050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55fcacbc1000 tx=0x7f6ca808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb9a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb9a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fcacbb4a80 con 0x55fcacbe0e00 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57206/0 (socket says 172.21.15.196:57206) 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2022391021 learned_addr learned my addr 172.21.15.196:0/2022391021 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb58f8640 1 -- 172.21.15.196:0/2022391021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcacbe17d0 con 0x55fcacbe0e00 2024-09-21T08:53:01.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.757+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/2022391021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6cb004ccb0 tx=0x7f6cb0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccac140f3806e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6b98ff9640 1 -- 172.21.15.196:0/2022391021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0016940 con 0x55fcacbe0e00 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6b98ff9640 1 -- 172.21.15.196:0/2022391021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0014ad0 con 0x55fcacbe0e00 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6b98ff9640 1 -- 172.21.15.196:0/2022391021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0046aa0 con 0x55fcacbe0e00 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2022391021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 msgr2=0x55fcacbe1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2022391021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6cb004ccb0 tx=0x7f6cb0011970 comp rx=0 tx=0).stop 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2022391021 shutdown_connections 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2022391021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe1200 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2022391021 >> 172.21.15.196:0/2022391021 conn(0x55fcacbdd1f0 msgr2=0x55fcacbdb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2022391021 shutdown_connections 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2022391021 wait complete. 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 Processor -- start 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.758+0000 7f6cb9a0e800 1 -- start start 2024-09-21T08:53:01.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb9a0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb9a0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fcacbe1e10 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb58f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57210/0 (socket says 172.21.15.196:57210) 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 learned_addr learned my addr 172.21.15.196:0/3110786196 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcacbe88d0 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.759+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe8390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6cb004bbd0 tx=0x7f6cb004cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.760+0000 7f6b8affd640 1 -- 172.21.15.196:0/3110786196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0016940 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.760+0000 7f6b8affd640 1 -- 172.21.15.196:0/3110786196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0014c80 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.760+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcacbe8b60 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.760+0000 7f6b8affd640 1 -- 172.21.15.196:0/3110786196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cb00136f0 con 0x55fcacbe0e00 2024-09-21T08:53:01.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.760+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcacbeb810 con 0x55fcacbe0e00 2024-09-21T08:53:01.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.761+0000 7f6b8affd640 1 -- 172.21.15.196:0/3110786196 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6cb002b350 con 0x55fcacbe0e00 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.761+0000 7f6b8affd640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b80036b40 0x7f6b80039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.761+0000 7f6b8affd640 1 -- 172.21.15.196:0/3110786196 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6cb0034070 con 0x55fcacbe0e00 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.761+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b80036b40 0x7f6b80039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b80036b40 0x7f6b80039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a470 tx=0x7f6ca8093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacbf3fd0 0x55fcacbf6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbf6be0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacbf3fd0 0x55fcacbf6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacbf3fd0 0x55fcacbf6490 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cac009050 con 0x55fcacbf3fd0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.762+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 realm 2024-09-21T08:53:01.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbf3420 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cac009050 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbf76d0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cac009050 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbf7fa0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cac009050 con 0x55fcacbf3fd0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbf88e0 0x55fcacbfacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.763+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfb460 con 0x55fcacbf88e0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbf88e0 0x55fcacbfacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb58f8640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbf88e0 0x55fcacbfacd0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb9a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb9a0e800 20 searching for the correct realm 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fcacbfd430 0x55fcacbff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.764+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fcacbfd430 0x55fcacbff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fcacbfd430 0x55fcacbff8f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb50f7640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ca807d060 0x7f6ca8004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.777 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ca807d060 0x7f6ca8004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.765+0000 7f6cb48f6640 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ca807d060 0x7f6ca8004280 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac009050 con 0x7f6ca807d060 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac009050 con 0x55fcacbf3fd0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.766+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.778 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.767+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x7f6ca807d060 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.768+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6cac029040 con 0x7f6ca807d060 2024-09-21T08:53:01.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.769+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.770+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.771+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x7f6ca807d060 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.772+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x7f6ca807d060 2024-09-21T08:53:01.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbfd430 2024-09-21T08:53:01.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.773+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf88e0 2024-09-21T08:53:01.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfffc0 con 0x7f6ca807d060 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cac029040 con 0x7f6ca807d060 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfbe20 con 0x55fcacbf3fd0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.774+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfc6c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cac029040 con 0x55fcacbf3fd0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacbfba60 con 0x55fcacbf3fd0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 zone default found 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 4 Realm: () 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 zonegroup default 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc004a0 con 0x55fcacbf88e0 2024-09-21T08:53:01.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.775+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc02770 con 0x55fcacbfd430 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc02b10 con 0x55fcacbfd430 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 20 started sync module instance, tier type = 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.776+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc01c00 con 0x7f6ca807d060 2024-09-21T08:53:01.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.777+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.777+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94543718392112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc01c00 con 0x7f6ca807d060 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.777+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc03540 con 0x55fcacbf3fd0 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.778+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94543718392112] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.779+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.779+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94543718396528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc01c00 con 0x55fcacbf3fd0 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.779+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc03f90 con 0x55fcacbfd430 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.780+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.780+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94543718396528] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.780+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94543718389584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc01b70 con 0x55fcacbfd430 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.780+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc04e50 con 0x7f6ca807d060 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.781+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94543718389584] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.781+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.781+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94543718402464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc05270 con 0x7f6ca807d060 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.781+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc05b40 con 0x55fcacbf3fd0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.783+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.783+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94543718402464] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.783+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94543718404720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc05690 con 0x55fcacbf3fd0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.783+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc04e00 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.784+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.784+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94543718409680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc04e00 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.784+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc07500 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.784+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94543718404720] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.785+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94543718409680] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.785+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.785+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94543718410736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc07010 con 0x55fcacbf88e0 2024-09-21T08:53:01.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.785+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc07a10 con 0x55fcacbf88e0 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94543718410736] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94543718413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc07e30 con 0x55fcacbf88e0 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=0 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=1 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=2 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=3 2024-09-21T08:53:01.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=4 2024-09-21T08:53:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=5 2024-09-21T08:53:01.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.786+0000 7f6cb9a0e800 20 add_watcher() i=6 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.787+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94543718413600] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.787+0000 7f6cb9a0e800 20 add_watcher() i=7 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.787+0000 7f6cb9a0e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.787+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc06020 con 0x55fcacbf3fd0 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.788+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.788+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94543718414656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc06020 con 0x55fcacbf3fd0 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94543718414656] v36'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6b6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 5 note: GC not initialized 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6b6a7e4640 20 reqs_thread_entry: start 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 20 Filter name: none 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6adbfff640 20 reqs_thread_entry: start 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.789+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3e3c0 con 0x55fcacbf88e0 2024-09-21T08:53:01.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3ca00 con 0x55fcacbf88e0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-21T08:53:01.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.790+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3d2d0 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.791+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v36'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.791+0000 7f6cb9a0e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.791+0000 7f6cb9a0e800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.791+0000 7f6cb9a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.791+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94543718632992 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc419b0 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify (1) cookie 94543718409680 notify 154618822691 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55fcacc3de10 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6b98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 94543718409680 notifier 4748 bl.length()=556 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6b98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6b98ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6b98ff9640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f6b78003ea0 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(65 notify.5 [notify cookie 94543718632992 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== watch-notify(notify_complete (2) cookie 94543718632992 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fcacbe8b60 con 0x55fcacbf88e0 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.792+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3d280 con 0x55fcacbf88e0 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.793+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v36'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.793+0000 7f6cb9a0e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.793+0000 7f6cb9a0e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.793+0000 7f6cb9a0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.793+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94543718632912 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc41e60 con 0x55fcacbfd430 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 94543718389584 notify 154618822662 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6ca8098040 con 0x55fcacbfd430 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6b8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822662 cookie 94543718389584 notifier 4748 bl.length()=177 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6b8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6b8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 notify.2 [notify cookie 94543718632912 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6b8bfff640 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f6ae8003400 con 0x55fcacbfd430 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== watch-notify(notify_complete (2) cookie 94543718632912 notify 154618822662 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fcacbb9f40 con 0x55fcacbfd430 2024-09-21T08:53:01.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.794+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.804 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-21T08:53:01.791449Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:01.791440Z","tags":[],"group_ids":[]} 2024-09-21T08:53:01.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.795+0000 7f6b6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:01.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.795+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94543718414656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.796+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94543718414656] v36'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.796+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94543718392112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x7f6ca807d060 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.797+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94543718392112] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.797+0000 7f6cb9a0e800 20 remove_watcher() i=0 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.797+0000 7f6cb9a0e800 2 removed watcher, disabling cache 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.797+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94543718396528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.798+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94543718396528] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.798+0000 7f6cb9a0e800 20 remove_watcher() i=1 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.798+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94543718389584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbfd430 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.799+0000 7f6cb50f7640 1 -- 172.21.15.196:0/3110786196 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94543718389584] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca807a030 con 0x55fcacbfd430 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.799+0000 7f6cb9a0e800 20 remove_watcher() i=2 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.799+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94543718402464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x7f6ca807d060 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.800+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94543718402464] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x7f6ca807d060 2024-09-21T08:53:01.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.800+0000 7f6cb9a0e800 20 remove_watcher() i=3 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.800+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94543718404720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.801+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94543718404720] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cac0391c0 con 0x55fcacbf3fd0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.801+0000 7f6cb9a0e800 20 remove_watcher() i=4 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.801+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94543718409680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf88e0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.803+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94543718409680] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.803+0000 7f6cb9a0e800 20 remove_watcher() i=5 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.803+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94543718410736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf88e0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.804+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94543718410736] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.804+0000 7f6cb9a0e800 20 remove_watcher() i=6 2024-09-21T08:53:01.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.804+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94543718413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55fcacc3c0a0 con 0x55fcacbf88e0 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.805+0000 7f6cb58f8640 1 -- 172.21.15.196:0/3110786196 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94543718413600] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cb002a070 con 0x55fcacbf88e0 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.805+0000 7f6cb9a0e800 20 remove_watcher() i=7 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbf88e0 msgr2=0x55fcacbfacd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbf88e0 0x55fcacbfacd0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacbf3fd0 msgr2=0x55fcacbf6490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacbf3fd0 0x55fcacbf6490 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ca807d060 msgr2=0x7f6ca8004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f6ca807d060 0x7f6ca8004280 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fcacbfd430 msgr2=0x55fcacbff8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55fcacbfd430 0x55fcacbff8f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b80036b40 msgr2=0x7f6b80039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b80036b40 0x7f6b80039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a470 tx=0x7f6ca8093000 comp rx=0 tx=0).stop 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 msgr2=0x55fcacbe8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/3110786196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbe0e00 0x55fcacbe8390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6cb004bbd0 tx=0x7f6cb004cc40 comp rx=0 tx=0).stop 2024-09-21T08:53:01.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 reap_dead start 2024-09-21T08:53:01.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb48f6640 1 -- 172.21.15.196:0/3110786196 reap_dead start 2024-09-21T08:53:01.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 shutdown_connections 2024-09-21T08:53:01.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 >> 172.21.15.196:0/3110786196 conn(0x55fcacbdd1f0 msgr2=0x55fcacbdb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 shutdown_connections 2024-09-21T08:53:01.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/3110786196 wait complete. 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 msgr2=0x7f6b8c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 0x7f6b8c039050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55fcacbc1000 tx=0x7f6ca808ec10 comp rx=0 tx=0).stop 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 msgr2=0x55fcacbd4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x55fcacbc0f10 tx=0x7f6cb0018830 comp rx=0 tx=0).stop 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 shutdown_connections 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b8c036b90 0x7f6b8c039050 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2635943125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacbd4230 0x55fcacbd4650 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 >> 172.21.15.196:0/2635943125 conn(0x55fcacbc91c0 msgr2=0x55fcacbcbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 shutdown_connections 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.806+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2635943125 wait complete. 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 msgr2=0x55fcacbc52a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 0x55fcacbc52a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 msgr2=0x55fcacbc04f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 0x55fcacbc04f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 msgr2=0x7f6b9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 0x7f6b9c039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000f60 tx=0x7f6cac0012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 msgr2=0x55fcacbb9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55fcacabe970 tx=0x7f6ca8002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 shutdown_connections 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55fcacbc2eb0 0x55fcacbc52a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55fcacac0450 0x55fcacbc04f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6b9c036b40 0x7f6b9c039000 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 --2- 172.21.15.196:0/2380613610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fcacabfae0 0x55fcacbb9480 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 >> 172.21.15.196:0/2380613610 conn(0x55fcacaba600 msgr2=0x55fcacba8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 shutdown_connections 2024-09-21T08:53:01.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.807+0000 7f6cb9a0e800 1 -- 172.21.15.196:0/2380613610 wait complete. 2024-09-21T08:53:01.817 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-21T08:53:01.791449Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:01.791440Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:01.830 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:53:01.834 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-21T08:53:01.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-21T08:53:01.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-21T08:53:01.835 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-21T08:53:01.881 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:01.881 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.880+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.880+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.880+0000 7f618d526800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ad3a4bf920 0x55ad3a4c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.880+0000 7f618d526800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad3a37bb30 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.880+0000 7f618d526800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ad3a35d360 con 0x55ad3a4bf920 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f61889be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ad3a4bf920 0x55ad3a4c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f61891bf640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ad3a4bb4e0 0x55ad3a4bb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:51174/0 (socket says 172.21.15.196:51174) 2024-09-21T08:53:01.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f61891bf640 1 -- 172.21.15.196:0/2715083259 learned_addr learned my addr 172.21.15.196:0/2715083259 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:01.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f617bfff640 1 -- 172.21.15.196:0/2715083259 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383768463 0 0) 0x55ad3a37bb30 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.883 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f617bfff640 1 -- 172.21.15.196:0/2715083259 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6174004020 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f61889be640 1 -- 172.21.15.196:0/2715083259 >> v1:172.21.15.29:6789/0 conn(0x55ad3a4bb4e0 legacy=0x55ad3a4bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.881+0000 7f61889be640 1 -- 172.21.15.196:0/2715083259 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a383e00 con 0x55ad3a4bf920 2024-09-21T08:53:01.884 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.883+0000 7f61889be640 1 --2- 172.21.15.196:0/2715083259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bf920 0x55ad3a4c1d10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f618000a470 tx=0x7f6180045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2557507c796da317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.883+0000 7f617bfff640 1 -- 172.21.15.196:0/2715083259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6180059070 con 0x55ad3a4bf920 2024-09-21T08:53:01.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.883+0000 7f617bfff640 1 -- 172.21.15.196:0/2715083259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180054570 con 0x55ad3a4bf920 2024-09-21T08:53:01.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.883+0000 7f617bfff640 1 -- 172.21.15.196:0/2715083259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6180054850 con 0x55ad3a4bf920 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 -- 172.21.15.196:0/2715083259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bf920 msgr2=0x55ad3a4c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 --2- 172.21.15.196:0/2715083259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bf920 0x55ad3a4c1d10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f618000a470 tx=0x7f6180045920 comp rx=0 tx=0).stop 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 -- 172.21.15.196:0/2715083259 shutdown_connections 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 --2- 172.21.15.196:0/2715083259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bf920 0x55ad3a4c1d10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 -- 172.21.15.196:0/2715083259 >> 172.21.15.196:0/2715083259 conn(0x55ad3a4b6dd0 msgr2=0x55ad3a4b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 -- 172.21.15.196:0/2715083259 shutdown_connections 2024-09-21T08:53:01.886 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.884+0000 7f618d526800 1 -- 172.21.15.196:0/2715083259 wait complete. 2024-09-21T08:53:01.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.897+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.897+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.897+0000 7f618d526800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.897+0000 7f618d526800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a408360 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f61891bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f61891bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57224/0 (socket says 172.21.15.196:57224) 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f61891bf640 1 -- 172.21.15.196:0/2414977098 learned_addr learned my addr 172.21.15.196:0/2414977098 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f61891bf640 1 -- 172.21.15.196:0/2414977098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a355bc0 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f61891bf640 1 --2- 172.21.15.196:0/2414977098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f617c001db0 tx=0x7f617c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9014b1f83d39027 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f6077606640 1 -- 172.21.15.196:0/2414977098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c012020 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.898+0000 7f6077606640 1 -- 172.21.15.196:0/2414977098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c00e5a0 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f6077606640 1 -- 172.21.15.196:0/2414977098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c00e940 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 -- 172.21.15.196:0/2414977098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 msgr2=0x55ad3a5ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 --2- 172.21.15.196:0/2414977098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f617c001db0 tx=0x7f617c00b6c0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 -- 172.21.15.196:0/2414977098 shutdown_connections 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 --2- 172.21.15.196:0/2414977098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5ad8a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 -- 172.21.15.196:0/2414977098 >> 172.21.15.196:0/2414977098 conn(0x55ad3a4b6dd0 msgr2=0x55ad3a5a4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 -- 172.21.15.196:0/2414977098 shutdown_connections 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.899+0000 7f618d526800 1 -- 172.21.15.196:0/2414977098 wait complete. 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f618d526800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f618d526800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a4c2550 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f61891bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f61891bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57234/0 (socket says 172.21.15.196:57234) 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f61891bf640 1 -- 172.21.15.196:0/296849204 learned_addr learned my addr 172.21.15.196:0/296849204 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f61891bf640 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a369fe0 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.900+0000 7f61891bf640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c010 tx=0x7f617c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.901+0000 7f6075e03640 1 -- 172.21.15.196:0/296849204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c012030 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.901+0000 7f6075e03640 1 -- 172.21.15.196:0/296849204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c01a750 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.901+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3a5b5820 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.901+0000 7f6075e03640 1 -- 172.21.15.196:0/296849204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c01aa30 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.904 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.901+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3a5b5d40 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f6075e03640 1 -- 172.21.15.196:0/296849204 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f617c015020 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f6075e03640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 0x7f6070039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f6075e03640 1 -- 172.21.15.196:0/296849204 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f617c020030 con 0x55ad3a4bb4e0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f61889be640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 0x7f6070039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 0x55ad3a5bc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5bc890 con 0x55ad3a4bf920 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f61899c0640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 0x55ad3a5bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f61889be640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 0x7f6070039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55ad3a4bc2e0 tx=0x7f6180050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.902+0000 7f61899c0640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 0x55ad3a5bc350 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f61899c0640 1 -- 172.21.15.196:0/296849204 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618400a4a0 con 0x55ad3a4bf920 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5b9920 con 0x55ad3a4bf920 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f61899c0640 1 -- 172.21.15.196:0/296849204 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f618400a4a0 con 0x55ad3a4bf920 2024-09-21T08:53:01.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 0x55ad3a5c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5c1630 con 0x55ad3a5beba0 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.903+0000 7f61891bf640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 0x55ad3a5c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.904+0000 7f61891bf640 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 0x55ad3a5c0f90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.904+0000 7f61891bf640 1 -- 172.21.15.196:0/296849204 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f617c018950 con 0x55ad3a5beba0 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.904+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5bda40 con 0x55ad3a4bf920 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.904+0000 7f61899c0640 1 -- 172.21.15.196:0/296849204 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f618400a4a0 con 0x55ad3a4bf920 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.904+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5bdee0 con 0x55ad3a4bf920 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f61899c0640 1 -- 172.21.15.196:0/296849204 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f618400a4a0 con 0x55ad3a4bf920 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f618d526800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f618d526800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a357580 con 0x55ad3a5cffc0 2024-09-21T08:53:01.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57246/0 (socket says 172.21.15.196:57246) 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.905+0000 7f61899c0640 1 -- 172.21.15.196:0/4028047803 learned_addr learned my addr 172.21.15.196:0/4028047803 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f61899c0640 1 -- 172.21.15.196:0/4028047803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a5d0920 con 0x55ad3a5cffc0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f61899c0640 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x55ad3a5b6390 tx=0x7f61840188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f606effd640 1 -- 172.21.15.196:0/4028047803 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6184014450 con 0x55ad3a5cffc0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f606effd640 1 -- 172.21.15.196:0/4028047803 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61840145f0 con 0x55ad3a5cffc0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3a5d0bb0 con 0x55ad3a5cffc0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f606effd640 1 -- 172.21.15.196:0/4028047803 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61840148d0 con 0x55ad3a5cffc0 2024-09-21T08:53:01.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.906+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3a5d3890 con 0x55ad3a5cffc0 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f606effd640 1 -- 172.21.15.196:0/4028047803 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6184011040 con 0x55ad3a5cffc0 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f606effd640 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 0x7f6060039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f606effd640 1 -- 172.21.15.196:0/4028047803 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f618401e070 con 0x55ad3a5cffc0 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f61891bf640 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 0x7f6060039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.907+0000 7f61891bf640 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 0x7f6060039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55ad3a5bccc0 tx=0x7f617c042040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f618d526800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f618d526800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a5ae050 con 0x55ad3a5dcc70 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57256/0 (socket says 172.21.15.196:57256) 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f61899c0640 1 -- 172.21.15.196:0/2105370303 learned_addr learned my addr 172.21.15.196:0/2105370303 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.908+0000 7f61899c0640 1 -- 172.21.15.196:0/2105370303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a5dd640 con 0x55ad3a5dcc70 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f61899c0640 1 --2- 172.21.15.196:0/2105370303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f618404cb90 tx=0x7f6184011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958695761764fb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f606cff9640 1 -- 172.21.15.196:0/2105370303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6184044070 con 0x55ad3a5dcc70 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f606cff9640 1 -- 172.21.15.196:0/2105370303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184013c90 con 0x55ad3a5dcc70 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f606cff9640 1 -- 172.21.15.196:0/2105370303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f618402ba60 con 0x55ad3a5dcc70 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 -- 172.21.15.196:0/2105370303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 msgr2=0x55ad3a5dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 --2- 172.21.15.196:0/2105370303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f618404cb90 tx=0x7f6184011700 comp rx=0 tx=0).stop 2024-09-21T08:53:01.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 -- 172.21.15.196:0/2105370303 shutdown_connections 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 --2- 172.21.15.196:0/2105370303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5dd070 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 -- 172.21.15.196:0/2105370303 >> 172.21.15.196:0/2105370303 conn(0x55ad3a5d9010 msgr2=0x55ad3a5d7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 -- 172.21.15.196:0/2105370303 shutdown_connections 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 -- 172.21.15.196:0/2105370303 wait complete. 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.909+0000 7f618d526800 1 Processor -- start 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f618d526800 1 -- start start 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f618d526800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f618d526800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a5ddba0 con 0x55ad3a5dcc70 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f61899c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57264/0 (socket says 172.21.15.196:57264) 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 learned_addr learned my addr 172.21.15.196:0/1201936341 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a5e4530 con 0x55ad3a5dcc70 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.910+0000 7f61899c0640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f618402f040 tx=0x7f618404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f605effd640 1 -- 172.21.15.196:0/1201936341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f618402b560 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f605effd640 1 -- 172.21.15.196:0/1201936341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618402b700 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f605effd640 1 -- 172.21.15.196:0/1201936341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f618404e070 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3a5e47c0 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3a5e7470 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.911+0000 7f605effd640 1 -- 172.21.15.196:0/1201936341 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f618403e020 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f605effd640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6054036b90 0x7f6054039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f605effd640 1 -- 172.21.15.196:0/1201936341 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f618403c020 con 0x55ad3a5dcc70 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f61891bf640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6054036b90 0x7f6054039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f61891bf640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6054036b90 0x7f6054039050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f617c04b1f0 tx=0x7f617c037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a5efd60 0x55ad3a5f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f2970 con 0x55ad3a5efd60 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.912+0000 7f61889be640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a5efd60 0x55ad3a5f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f61889be640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a5efd60 0x55ad3a5f2220 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 realm 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f2da0 con 0x55ad3a5efd60 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f3670 con 0x55ad3a5efd60 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.913+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f3a10 con 0x55ad3a5efd60 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f618d526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5f4770 0x55ad3a5f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f7170 con 0x55ad3a5f4770 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f61899c0640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5f4770 0x55ad3a5f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.914+0000 7f61899c0640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5f4770 0x55ad3a5f6b60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f618d526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f618d526800 20 searching for the correct realm 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad3a5f9100 0x55ad3a5fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61891bf640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad3a5f9100 0x55ad3a5fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61891bf640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad3a5f9100 0x55ad3a5fb5c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61891bf640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f617c059040 0x7f617c00c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:01.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.915+0000 7f61889be640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f617c059040 0x7f617c00c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:01.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.916+0000 7f61889be640 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f617c059040 0x7f617c00c360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.916+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.916+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.916+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.916+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.917+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.918+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.919+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.920+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.921+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.922+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f9100 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.923+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x55ad3a5efd60 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fbc90 con 0x7f617c059040 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f8650 con 0x55ad3a5efd60 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.938 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f7ec0 con 0x55ad3a5efd60 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.924+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f7600 con 0x55ad3a5efd60 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 zone default found 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 4 Realm: () 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:01.939 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 zonegroup default 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5f7ad0 con 0x55ad3a5f4770 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fe4a0 con 0x55ad3a5f9100 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fe840 con 0x55ad3a5f9100 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.940 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 started sync module instance, tier type = 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.925+0000 7f618d526800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.926+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fd930 con 0x7f617c059040 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.926+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.927+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94202497064528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fd930 con 0x7f617c059040 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.927+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5ff240 con 0x55ad3a5efd60 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.928+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94202497064528] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.928+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.928+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94202497062016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5ff200 con 0x55ad3a5efd60 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.928+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5ffce0 con 0x55ad3a5f9100 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.929+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94202497062016] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.929+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.929+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94202497068368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5ff170 con 0x55ad3a5f9100 2024-09-21T08:53:01.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.929+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a600ba0 con 0x7f617c059040 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.930+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.930+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94202497075408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a601320 con 0x7f617c059040 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.930+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94202497068368] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.930+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a6000d0 con 0x55ad3a5efd60 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.931+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94202497075408] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.931+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.931+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94202497076592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a6000d0 con 0x55ad3a5efd60 2024-09-21T08:53:01.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.931+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a6022f0 con 0x55ad3a5f4770 2024-09-21T08:53:01.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.932+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94202497076592] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.932+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.932+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94202497080768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a6022b0 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.932+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a602d20 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.933+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94202497080768] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.934+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.934+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94202497083472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a602d20 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.934+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a603740 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94202497083472] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94202497086000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a603700 con 0x55ad3a5f4770 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=0 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=1 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=2 2024-09-21T08:53:01.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=3 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=4 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=5 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.935+0000 7f618d526800 20 add_watcher() i=6 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94202497086000] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f618d526800 20 add_watcher() i=7 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f618d526800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a606bc0 con 0x55ad3a5efd60 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.936+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94202497079024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a604080 con 0x55ad3a5efd60 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.937+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94202497079024] v36'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.937+0000 7f603ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:01.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.937+0000 7f618d526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.937+0000 7f618d526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.937+0000 7f618d526800 5 note: GC not initialized 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f603efe5640 20 reqs_thread_entry: start 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 20 Filter name: none 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f603cfe1640 20 reqs_thread_entry: start 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 20 rados->read ofs=0 len=0 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a639f20 con 0x7f617c059040 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:53:01.949 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.938+0000 7f618d526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.939+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a63e2c0 con 0x55ad3a5f4770 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.940+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v36'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.940+0000 7f603ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.941+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94202497079024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a637c70 con 0x55ad3a5efd60 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.941+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94202497079024] v36'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.941+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94202497064528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a637c70 con 0x7f617c059040 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.942+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94202497064528] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.942+0000 7f618d526800 20 remove_watcher() i=0 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.942+0000 7f618d526800 2 removed watcher, disabling cache 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.942+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94202497062016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a637c70 con 0x55ad3a5efd60 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.944+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94202497062016] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.944+0000 7f618d526800 20 remove_watcher() i=1 2024-09-21T08:53:01.950 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.944+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94202497068368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a637c70 con 0x55ad3a5f9100 2024-09-21T08:53:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.945+0000 7f61891bf640 1 -- 172.21.15.196:0/1201936341 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94202497068368] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c04cd70 con 0x55ad3a5f9100 2024-09-21T08:53:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.945+0000 7f618d526800 20 remove_watcher() i=2 2024-09-21T08:53:01.951 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.945+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94202497075408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fde50 con 0x7f617c059040 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.946+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94202497075408] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x7f617c059040 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.946+0000 7f618d526800 20 remove_watcher() i=3 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.946+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94202497076592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fd480 con 0x55ad3a5efd60 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.947+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94202497076592] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618005c040 con 0x55ad3a5efd60 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.947+0000 7f618d526800 20 remove_watcher() i=4 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.947+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94202497080768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fed50 con 0x55ad3a5f4770 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.948+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94202497080768] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.948+0000 7f618d526800 20 remove_watcher() i=5 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.948+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94202497083472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a6008d0 con 0x55ad3a5f4770 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.949+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94202497083472] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.949+0000 7f618d526800 20 remove_watcher() i=6 2024-09-21T08:53:01.955 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.949+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94202497086000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ad3a5fde50 con 0x55ad3a5f4770 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f61899c0640 1 -- 172.21.15.196:0/1201936341 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94202497086000] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618402a070 con 0x55ad3a5f4770 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 20 remove_watcher() i=7 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5f4770 msgr2=0x55ad3a5f6b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5f4770 0x55ad3a5f6b60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a5efd60 msgr2=0x55ad3a5f2220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a5efd60 0x55ad3a5f2220 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f617c059040 msgr2=0x7f617c00c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f617c059040 0x7f617c00c360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad3a5f9100 msgr2=0x55ad3a5fb5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ad3a5f9100 0x55ad3a5fb5c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6054036b90 msgr2=0x7f6054039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6054036b90 0x7f6054039050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f617c04b1f0 tx=0x7f617c037000 comp rx=0 tx=0).stop 2024-09-21T08:53:01.956 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 msgr2=0x55ad3a5e3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f618402f040 tx=0x7f618404cb20 comp rx=0 tx=0).stop 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f61889be640 1 -- 172.21.15.196:0/1201936341 reap_dead start 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 shutdown_connections 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 --2- 172.21.15.196:0/1201936341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5dcc70 0x55ad3a5e3ff0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.950+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 >> 172.21.15.196:0/1201936341 conn(0x55ad3a5d9010 msgr2=0x55ad3a5d70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 shutdown_connections 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/1201936341 wait complete. 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 msgr2=0x7f6060039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 0x7f6060039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55ad3a5bccc0 tx=0x7f617c042040 comp rx=0 tx=0).stop 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 msgr2=0x55ad3a5d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x55ad3a5b6390 tx=0x7f61840188f0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 shutdown_connections 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6060036b40 0x7f6060039000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/4028047803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a5cffc0 0x55ad3a5d03e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 >> 172.21.15.196:0/4028047803 conn(0x55ad3a5c4f50 msgr2=0x55ad3a5c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 shutdown_connections 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/4028047803 wait complete. 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 msgr2=0x55ad3a5c0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 0x55ad3a5c0f90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 msgr2=0x55ad3a5bc350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 0x55ad3a5bc350 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 msgr2=0x7f6070039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 0x7f6070039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55ad3a4bc2e0 tx=0x7f6180050000 comp rx=0 tx=0).stop 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 msgr2=0x55ad3a5b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:01.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c010 tx=0x7f617c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 shutdown_connections 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ad3a5beba0 0x55ad3a5c0f90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ad3a4bf920 0x55ad3a5bc350 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f6070036b40 0x7f6070039000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 --2- 172.21.15.196:0/296849204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ad3a4bb4e0 0x55ad3a5b52e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 >> 172.21.15.196:0/296849204 conn(0x55ad3a4b6dd0 msgr2=0x55ad3a5a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 shutdown_connections 2024-09-21T08:53:01.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:01.951+0000 7f618d526800 1 -- 172.21.15.196:0/296849204 wait complete. 2024-09-21T08:53:01.961 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-21T08:53:02.007 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:53:02.007 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-21T08:53:02.013 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-21T08:53:02.013 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-21T08:53:02.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-21T08:53:02.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-21T08:53:02.014 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-21T08:53:02.060 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:02.060 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:02.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.059+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.059+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.059+0000 7f53a920e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ae4e7984e0 0x55ae4e7988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.059+0000 7f53a920e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae4e658b30 con 0x55ae4e798e20 2024-09-21T08:53:02.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.059+0000 7f53a920e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ae4e63a360 con 0x55ae4e7984e0 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a490c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ae4e7984e0 0x55ae4e7988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a490c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ae4e7984e0 0x55ae4e7988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57272/0 (socket says 172.21.15.196:57272) 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a490c640 1 -- 172.21.15.196:0/479163234 learned_addr learned my addr 172.21.15.196:0/479163234 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a410b640 1 --1- 172.21.15.196:0/479163234 >> v1:172.21.15.29:6789/0 conn(0x55ae4e798e20 0x55ae4e79d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:51180/0 (socket says 172.21.15.196:51180) 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a490c640 1 -- 172.21.15.196:0/479163234 >> v1:172.21.15.29:6789/0 conn(0x55ae4e798e20 legacy=0x55ae4e79d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.060+0000 7f53a490c640 1 -- 172.21.15.196:0/479163234 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e660e00 con 0x55ae4e7984e0 2024-09-21T08:53:02.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.062+0000 7f53a490c640 1 --2- 172.21.15.196:0/479163234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e7988e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f539c00a6b0 tx=0x7f539c047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3d7be0e02ab321 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.062+0000 7f53a390a640 1 -- 172.21.15.196:0/479163234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c00a200 con 0x55ae4e7984e0 2024-09-21T08:53:02.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.062+0000 7f53a390a640 1 -- 172.21.15.196:0/479163234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c00a3a0 con 0x55ae4e7984e0 2024-09-21T08:53:02.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.062+0000 7f53a390a640 1 -- 172.21.15.196:0/479163234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c008700 con 0x55ae4e7984e0 2024-09-21T08:53:02.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 -- 172.21.15.196:0/479163234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 msgr2=0x55ae4e7988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 --2- 172.21.15.196:0/479163234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e7988e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f539c00a6b0 tx=0x7f539c047e30 comp rx=0 tx=0).stop 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 -- 172.21.15.196:0/479163234 shutdown_connections 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 --2- 172.21.15.196:0/479163234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e7988e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 -- 172.21.15.196:0/479163234 >> 172.21.15.196:0/479163234 conn(0x55ae4e793db0 msgr2=0x55ae4e7961d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 -- 172.21.15.196:0/479163234 shutdown_connections 2024-09-21T08:53:02.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.063+0000 7f53a920e800 1 -- 172.21.15.196:0/479163234 wait complete. 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.076+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.076+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.076+0000 7f53a920e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a920e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ae4e6e5360 con 0x55ae4e7984e0 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57286/0 (socket says 172.21.15.196:57286) 2024-09-21T08:53:02.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a490c640 1 -- 172.21.15.196:0/642899606 learned_addr learned my addr 172.21.15.196:0/642899606 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a490c640 1 -- 172.21.15.196:0/642899606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e632bc0 con 0x55ae4e7984e0 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f53a490c640 1 --2- 172.21.15.196:0/642899606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f539c048360 tx=0x7f539c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d803e97b719f1e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f5292e0d640 1 -- 172.21.15.196:0/642899606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c00a200 con 0x55ae4e7984e0 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f5292e0d640 1 -- 172.21.15.196:0/642899606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c065070 con 0x55ae4e7984e0 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.077+0000 7f5292e0d640 1 -- 172.21.15.196:0/642899606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c0086e0 con 0x55ae4e7984e0 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 -- 172.21.15.196:0/642899606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 msgr2=0x55ae4e886620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 --2- 172.21.15.196:0/642899606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f539c048360 tx=0x7f539c051000 comp rx=0 tx=0).stop 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 -- 172.21.15.196:0/642899606 shutdown_connections 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 --2- 172.21.15.196:0/642899606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e886620 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 -- 172.21.15.196:0/642899606 >> 172.21.15.196:0/642899606 conn(0x55ae4e793db0 msgr2=0x55ae4e881fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 -- 172.21.15.196:0/642899606 shutdown_connections 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.078+0000 7f53a920e800 1 -- 172.21.15.196:0/642899606 wait complete. 2024-09-21T08:53:02.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a920e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a920e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ae4e79f4a0 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57298/0 (socket says 172.21.15.196:57298) 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a490c640 1 -- 172.21.15.196:0/1772508581 learned_addr learned my addr 172.21.15.196:0/1772508581 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.079+0000 7f53a490c640 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e646fe0 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f53a490c640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f539c062040 tx=0x7f539c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f529160a640 1 -- 172.21.15.196:0/1772508581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c008590 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f529160a640 1 -- 172.21.15.196:0/1772508581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c06f030 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f529160a640 1 -- 172.21.15.196:0/1772508581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539c04f4c0 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4e88e3f0 con 0x55ae4e7984e0 2024-09-21T08:53:02.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.080+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4e88e970 con 0x55ae4e7984e0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f529160a640 1 -- 172.21.15.196:0/1772508581 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f539c04f660 con 0x55ae4e7984e0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f529160a640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 0x7f528c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f529160a640 1 -- 172.21.15.196:0/1772508581 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f539c05d040 con 0x55ae4e7984e0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f53a410b640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 0x7f528c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 0x55ae4e894e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8954a0 con 0x55ae4e798e20 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f53a510d640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 0x55ae4e894e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.081+0000 7f53a410b640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 0x7f528c039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f538c000f60 tx=0x7f538c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a510d640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 0x55ae4e894e30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a510d640 1 -- 172.21.15.196:0/1772508581 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f539400a4a0 con 0x55ae4e798e20 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8924f0 con 0x55ae4e798e20 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a510d640 1 -- 172.21.15.196:0/1772508581 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f539400a4a0 con 0x55ae4e798e20 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 0x55ae4e899be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.082+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e89a2d0 con 0x55ae4e8977f0 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.083+0000 7f53a490c640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 0x55ae4e899be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.083+0000 7f53a490c640 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 0x55ae4e899be0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.083+0000 7f53a490c640 1 -- 172.21.15.196:0/1772508581 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f539c06b410 con 0x55ae4e8977f0 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.083+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e896690 con 0x55ae4e798e20 2024-09-21T08:53:02.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a510d640 1 -- 172.21.15.196:0/1772508581 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f539400a4a0 con 0x55ae4e798e20 2024-09-21T08:53:02.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e896af0 con 0x55ae4e798e20 2024-09-21T08:53:02.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a510d640 1 -- 172.21.15.196:0/1772508581 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f539400a4a0 con 0x55ae4e798e20 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a920e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.084+0000 7f53a920e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ae4e634580 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57314/0 (socket says 172.21.15.196:57314) 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a510d640 1 -- 172.21.15.196:0/1994487272 learned_addr learned my addr 172.21.15.196:0/1994487272 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a510d640 1 -- 172.21.15.196:0/1994487272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e8ad980 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a510d640 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55ae4e88f2b0 tx=0x7f5394018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f528a7fc640 1 -- 172.21.15.196:0/1994487272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394014450 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f528a7fc640 1 -- 172.21.15.196:0/1994487272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53940145f0 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4e8adc10 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f528a7fc640 1 -- 172.21.15.196:0/1994487272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394014910 con 0x55ae4e8ad020 2024-09-21T08:53:02.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.085+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4e8b08f0 con 0x55ae4e8ad020 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.086+0000 7f528a7fc640 1 -- 172.21.15.196:0/1994487272 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5394011040 con 0x55ae4e8ad020 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.086+0000 7f528a7fc640 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 0x7f527c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.086+0000 7f528a7fc640 1 -- 172.21.15.196:0/1994487272 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f539401e070 con 0x55ae4e8ad020 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.086+0000 7f53a490c640 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 0x7f527c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a490c640 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 0x7f527c039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55ae4e895940 tx=0x7f539c06ae60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a920e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a920e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ae4e886d10 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57322/0 (socket says 172.21.15.196:57322) 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a510d640 1 -- 172.21.15.196:0/2614345857 learned_addr learned my addr 172.21.15.196:0/2614345857 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a510d640 1 -- 172.21.15.196:0/2614345857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e8ba6c0 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.087+0000 7f53a510d640 1 --2- 172.21.15.196:0/2614345857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f539404cc50 tx=0x7f539404cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac8f86335342b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f527bfff640 1 -- 172.21.15.196:0/2614345857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394014ab0 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f527bfff640 1 -- 172.21.15.196:0/2614345857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394014c50 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f527bfff640 1 -- 172.21.15.196:0/2614345857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394022a80 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- 172.21.15.196:0/2614345857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 msgr2=0x55ae4e8ba0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 --2- 172.21.15.196:0/2614345857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f539404cc50 tx=0x7f539404cf00 comp rx=0 tx=0).stop 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- 172.21.15.196:0/2614345857 shutdown_connections 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 --2- 172.21.15.196:0/2614345857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8ba0f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- 172.21.15.196:0/2614345857 >> 172.21.15.196:0/2614345857 conn(0x55ae4e8b6050 msgr2=0x55ae4e8b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- 172.21.15.196:0/2614345857 shutdown_connections 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- 172.21.15.196:0/2614345857 wait complete. 2024-09-21T08:53:02.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 Processor -- start 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.088+0000 7f53a920e800 1 -- start start 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a920e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a920e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ae4e8bad70 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a510d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57328/0 (socket says 172.21.15.196:57328) 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 learned_addr learned my addr 172.21.15.196:0/2210320649 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4e8c1730 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f53a510d640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8c11f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f539404cbb0 tx=0x7f539404cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f527a7fc640 1 -- 172.21.15.196:0/2210320649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394014ab0 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f527a7fc640 1 -- 172.21.15.196:0/2210320649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394014e00 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.089+0000 7f527a7fc640 1 -- 172.21.15.196:0/2210320649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539404e210 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.090+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4e8c19c0 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.090+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4e8c4670 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.090+0000 7f527a7fc640 1 -- 172.21.15.196:0/2210320649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f539404e470 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f527a7fc640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5270036b40 0x7f5270039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f527a7fc640 1 -- 172.21.15.196:0/2210320649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5394033030 con 0x55ae4e8b9cf0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a490c640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5270036b40 0x7f5270039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a490c640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5270036b40 0x7f5270039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f539c06b720 tx=0x7f539c092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e8cce10 0x55ae4e8cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8cfa20 con 0x55ae4e8cce10 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.091+0000 7f53a410b640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e8cce10 0x55ae4e8cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a410b640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e8cce10 0x55ae4e8cf2d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f538c00f610 con 0x55ae4e8cce10 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 realm 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8cc260 con 0x55ae4e8cce10 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f538c00f610 con 0x55ae4e8cce10 2024-09-21T08:53:02.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d0510 con 0x55ae4e8cce10 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f538c00f610 con 0x55ae4e8cce10 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d0de0 con 0x55ae4e8cce10 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.092+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f538c00f610 con 0x55ae4e8cce10 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:02.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8d1800 0x55ae4e8d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d42e0 con 0x55ae4e8d1800 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a510d640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8d1800 0x55ae4e8d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a510d640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8d1800 0x55ae4e8d3bf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 20 searching for the correct realm 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ae4e8d62b0 0x55ae4e8d8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.093+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a490c640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ae4e8d62b0 0x55ae4e8d8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a490c640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ae4e8d62b0 0x55ae4e8d8770 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a490c640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f539c009c10 0x7f539c08a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a410b640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f539c009c10 0x7f539c08a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.094+0000 7f53a410b640 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f539c009c10 0x7f539c08a0b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c00f610 con 0x7f539c009c10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c00f610 con 0x55ae4e8cce10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.095+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.096+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.097+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.098+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.099+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.100+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.101+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8d1800 2024-09-21T08:53:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x55ae4e8cce10 2024-09-21T08:53:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d8e40 con 0x7f539c009c10 2024-09-21T08:53:02.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:02.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.102+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d4ca0 con 0x55ae4e8cce10 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d48e0 con 0x55ae4e8cce10 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d5640 con 0x55ae4e8cce10 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:02.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 zone default found 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 4 Realm: () 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 zonegroup default 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.103+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8d9320 con 0x55ae4e8d1800 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8db5f0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8db990 con 0x55ae4e8d62b0 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 started sync module instance, tier type = 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.104+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daa30 con 0x7f539c009c10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.105+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.105+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94207130578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daa30 con 0x7f539c009c10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.105+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8dc3f0 con 0x55ae4e8cce10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.106+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94207130578816] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.106+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.106+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94207130582736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daa30 con 0x55ae4e8cce10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.106+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8dce80 con 0x55ae4e8d62b0 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.107+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94207130582736] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.107+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.107+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94207130576256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8da9a0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.108+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ddd40 con 0x7f539c009c10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.108+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.108+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94207130589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8de480 con 0x7f539c009c10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.108+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8defa0 con 0x55ae4e8cce10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.109+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94207130576256] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.110+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94207130589808] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.110+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.110+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94207130593904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8def60 con 0x55ae4e8cce10 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.110+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8df840 con 0x55ae4e8d1800 2024-09-21T08:53:02.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.111+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94207130593904] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.111+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.111+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94207130596240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8def60 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.111+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e0200 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.112+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.112+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94207130598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e01b0 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.112+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e11b0 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.112+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94207130596240] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94207130598736] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94207130587760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e0cc0 con 0x55ae4e8d1800 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=0 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=1 2024-09-21T08:53:02.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=2 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=3 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=4 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=5 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.113+0000 7f53a920e800 20 add_watcher() i=6 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94207130587760] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a920e800 20 add_watcher() i=7 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a920e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e11a0 con 0x55ae4e8cce10 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.115+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94207130600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e1a50 con 0x55ae4e8cce10 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.116+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94207130600864] v36'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.116+0000 7f525afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.116+0000 7f53a920e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:02.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.116+0000 7f53a920e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.116+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ecf40 con 0x55ae4e8cce10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.117+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.117+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ed610 con 0x55ae4e8d1800 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.119+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.119+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ed610 con 0x55ae4e8d62b0 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.120+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.120+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ee0b0 con 0x55ae4e8cce10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.121+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.121+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e8c30 con 0x7f539c009c10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.122+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.122+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e8c00 con 0x55ae4e8d62b0 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.123+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.123+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e8c00 con 0x55ae4e8cce10 2024-09-21T08:53:02.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.124+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.124+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e8dc0 con 0x55ae4e8d1800 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.125+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.125+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8e8dc0 con 0x7f539c009c10 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.126+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.126+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x55ae4e8d62b0 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.127+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.127+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x7f539c009c10 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.128+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.128+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x55ae4e8d1800 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.130+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.130+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x7f539c009c10 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.131+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.131+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x55ae4e8d1800 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.132+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.132+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eea10 con 0x55ae4e8cce10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.133+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.133+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8eebe0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.134+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.134+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef100 con 0x7f539c009c10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.135+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.135+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.136+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.136+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8cce10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.137+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.137+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8cce10 2024-09-21T08:53:02.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.138+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.138+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.139+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.139+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x7f539c009c10 2024-09-21T08:53:02.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.140+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.140+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.141+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.141+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.142+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.142+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.143+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.143+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.144+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.144+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d1800 2024-09-21T08:53:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.145+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.145+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.146+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.146+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d1800 2024-09-21T08:53:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.147+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.147+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.148+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.148+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x55ae4e8d1800 2024-09-21T08:53:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.150+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.150+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8ef0e0 con 0x7f539c009c10 2024-09-21T08:53:02.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f5259fe3640 20 reqs_thread_entry: start 2024-09-21T08:53:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:02.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 20 Filter name: none 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f51cb7fe640 20 reqs_thread_entry: start 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e919b20 con 0x7f539c009c10 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.151+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e91c540 con 0x55ae4e8cce10 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 : miss 2024-09-21T08:53:02.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 8.1f 8:fceaba51:root::.bucket.meta.myfoo6%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e91c350 con 0x7f539c009c10 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(96 .bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv4 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x17 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.152+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 4.8 4:1229778f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e9998c0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.153+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(97 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.153+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 4.3 4:c12bfcbc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999900 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.153+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(98 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.153+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 4.7 4:e38ff118:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999900 con 0x55ae4e8d1800 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.153+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(99 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 4.2e 4:75de2592:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(100 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:101 4.20 4:073c4179:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(101 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:102 4.3 4:c04edd47:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(102 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.154+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:103 4.0 4:01ecc0ae:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(103 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:104 4.14 4:2a90a86c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8d62b0 2024-09-21T08:53:02.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(104 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:105 4.16 4:6a5a2a1b:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x55ae4e8d62b0 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(105 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.155+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999940 con 0x7f539c009c10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(106 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [call out=345b] v0'0 uv10 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 10 cls_bucket_list_unordered: got thirteen 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 4.b 4:d1208894:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999900 con 0x7f539c009c10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(107 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 20 get_obj_state: octx=0x7f539402ba10 obj=myfoo6:thirteen state=0x55ae4e997948 s->prefetch_data=0 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:108 3.17s0 3:eaabae82:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e998770 con 0x55ae4e8cce10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(108 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 10 manifest: total_size = 8 2024-09-21T08:53:02.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 20 get_obj_state: setting s->obj_tag to _qJCDO6QJ5BIO91vEHqbWu05OjUi4KUL 2024-09-21T08:53:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 20 get_obj_state: octx=0x7f539402ba10 obj=myfoo6:thirteen state=0x55ae4e997948 s->prefetch_data=0 2024-09-21T08:53:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 20 prepare_atomic_modification: state is not atomic. state=0x55ae4e997948 2024-09-21T08:53:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 2024-09-21T08:53:02.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.156+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:109 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999030 con 0x7f539c009c10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.158+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(109 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [stat,call,call] v36'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.158+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:110 3.17s0 3:eaabae82:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e999030 con 0x55ae4e8cce10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(110 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9_thirteen [call] v36'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:111 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e920f00 con 0x7f539c009c10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 20 list_objects_ordered: starting attempt 1 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:112 4.8 4:1229778f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e922840 con 0x55ae4e8d62b0 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 4.3 4:c12bfcbc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e922840 con 0x55ae4e8cce10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:114 4.7 4:e38ff118:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e927610 con 0x55ae4e8d1800 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:115 4.2e 4:75de2592:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92a030 con 0x55ae4e8d62b0 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:116 4.20 4:073c4179:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92a030 con 0x55ae4e8cce10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:117 4.3 4:c04edd47:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8cce10 2024-09-21T08:53:02.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.159+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:118 4.0 4:01ecc0ae:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931f40 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:119 4.14 4:2a90a86c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e934a30 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:120 4.16 4:6a5a2a1b:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92a030 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:121 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x7f539c009c10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(114 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(112 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(115 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(113 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(118 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(116 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(119 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:122 4.b 4:d1208894:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e920f00 con 0x7f539c009c10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.160+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(117 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(120 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(122 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(111 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f527bfff640 20 handle_completion(): completion ok for obj=thirteen 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(121 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9])"; uploads.size()=0; is_truncated=0 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:123 4.8 4:1229778f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8d62b0 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:124 4.3 4:c12bfcbc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e933420 con 0x55ae4e8cce10 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:125 4.7 4:e38ff118:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a20 con 0x55ae4e8d1800 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:126 4.2e 4:75de2592:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92b480 con 0x55ae4e8d62b0 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:127 4.20 4:073c4179:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8cce10 2024-09-21T08:53:02.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:128 4.3 4:c04edd47:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e933420 con 0x55ae4e8cce10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:129 4.0 4:01ecc0ae:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(124 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(127 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(123 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(125 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:130 4.14 4:2a90a86c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e920f00 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:131 4.16 4:6a5a2a1b:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a20 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(126 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:132 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92eb80 con 0x7f539c009c10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(128 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.161+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:133 4.b 4:d1208894:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e929f20 con 0x7f539c009c10 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(129 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(130 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(132 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(131 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(133 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.162+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e920f00 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.163+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(134 bud.buckets [call] v36'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.163+0000 7f53a920e800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.163+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.163+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 20 rados_obj.operate() r=0 bl.length=166 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a00 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(136 myfoo6 [call,call,delete] v36'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-21T08:53:02.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.164+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94207130923280 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930bb0 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== watch-notify(notify (1) cookie 94207130589808 notify 154618822682 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55ae4e91b880 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f527b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 94207130589808 notifier 4762 bl.length()=150 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(137 notify.3 [notify cookie 94207130923280 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f527b7fe640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f51d8003320 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== watch-notify(notify_complete (2) cookie 94207130923280 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae4e8ec8f0 con 0x7f539c009c10 2024-09-21T08:53:02.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.165+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:139 8.1f 8:fceaba51:root::.bucket.meta.myfoo6%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930bb0 con 0x7f539c009c10 2024-09-21T08:53:02.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(139 .bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [call,call,delete] v36'5 uv5 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a920e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 from cache 2024-09-21T08:53:02.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a920e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9, ofs0, ns] 2024-09-21T08:53:02.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94207130923280 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930700 con 0x7f539c009c10 2024-09-21T08:53:02.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== watch-notify(notify (1) cookie 94207130578816 notify 154618822683 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55ae4e8ec8f0 con 0x7f539c009c10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f527bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94207130578816 notifier 4762 bl.length()=207 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f527bfff640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f5268003d60 con 0x7f539c009c10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.166+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(140 notify.0 [notify cookie 94207130923280 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== watch-notify(notify_complete (2) cookie 94207130923280 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae4e8ed2e0 con 0x7f539c009c10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:142 4.8 4:1229778f:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8d62b0 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:143 4.3 4:c12bfcbc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930bb0 con 0x55ae4e8cce10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:144 4.7 4:e38ff118:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931470 con 0x55ae4e8d1800 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:145 4.2e 4:75de2592:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92fa90 con 0x55ae4e8d62b0 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:146 4.20 4:073c4179:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x55ae4e8cce10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:147 4.3 4:c04edd47:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930bb0 con 0x55ae4e8cce10 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:148 4.0 4:01ecc0ae:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931470 con 0x55ae4e8d62b0 2024-09-21T08:53:02.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:149 4.14 4:2a90a86c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92fa90 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:150 4.16 4:6a5a2a1b:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931470 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:151 4.b 4:d32d9f7c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930bb0 con 0x7f539c009c10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.167+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:152 4.b 4:d1208894:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e92f110 con 0x7f539c009c10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(142 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.0 [delete] v36'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(150 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.8 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(144 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.2 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(149 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.7 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(143 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.1 [delete] v36'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(148 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.6 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(146 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.4 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(147 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.5 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(145 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(151 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.9 [delete] v36'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(152 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9.10 [delete] v36'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 : miss 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:153 6.2 6:43bbcc07:::pubsub..bucket.myfoo6%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930fc0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(153 pubsub..bucket.myfoo6/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 info.flags=0x0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 10 adding default.rgw.log++pubsub..bucket.myfoo6/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 to cache LRU end 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.169+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:154 6.2 6:43bbcc07:::pubsub..bucket.myfoo6%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930fc0 con 0x55ae4e8d62b0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.171+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(154 pubsub..bucket.myfoo6/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.9 [delete] v36'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.171+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a00 con 0x55ae4e8cce10 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.172+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(155 bud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.172+0000 7f53a920e800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.172+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930fc0 con 0x55ae4e8cce10 2024-09-21T08:53:02.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.173+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v36'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.173+0000 7f53a920e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.173+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94207130845888 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a00 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== watch-notify(notify (1) cookie 94207130596240 notify 154618822692 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ae4e8ecac0 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f527b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822692 cookie 94207130596240 notifier 4762 bl.length()=170 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(157 notify.5 [notify cookie 94207130845888 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f527b7fe640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f51d80032c0 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== watch-notify(notify_complete (2) cookie 94207130845888 notify 154618822692 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae4e8c19c0 con 0x55ae4e8d1800 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a920e800 10 removing email index: 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a920e800 10 removing user buckets index 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.174+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930fc0 con 0x55ae4e8cce10 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.175+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(159 bud.buckets [delete] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.175+0000 7f53a920e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-21T08:53:02.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.175+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94207130845888 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a00 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== watch-notify(notify (1) cookie 94207130598736 notify 154618822693 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ae4e8c19c0 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(160 notify.6 [notify cookie 94207130845888 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f527bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94207130598736 notifier 4762 bl.length()=160 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f527bfff640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f5268003d60 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== watch-notify(notify_complete (2) cookie 94207130845888 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae4e8c1730 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a920e800 10 removing user index: bud 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.176+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e928a00 con 0x7f539c009c10 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.177+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(162 bud [call,call,delete] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.177+0000 7f53a920e800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.177+0000 7f53a920e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.177+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94207130934992 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e930fc0 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== watch-notify(notify (1) cookie 94207130596240 notify 154618822694 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ae4e8c1730 con 0x55ae4e8d1800 2024-09-21T08:53:02.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f527bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822694 cookie 94207130596240 notifier 4762 bl.length()=152 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f527bfff640 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f5268003d60 con 0x55ae4e8d1800 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(163 notify.5 [notify cookie 94207130934992 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.178+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== watch-notify(notify_complete (2) cookie 94207130934992 notify 154618822694 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae4e8ba6c0 con 0x55ae4e8d1800 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.179+0000 7f525afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.179+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94207130600864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931ed0 con 0x55ae4e8cce10 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.180+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 49 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94207130600864] v36'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.180+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94207130578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e931ed0 con 0x7f539c009c10 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.181+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94207130578816] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.181+0000 7f53a920e800 20 remove_watcher() i=0 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.181+0000 7f53a920e800 2 removed watcher, disabling cache 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.181+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94207130582736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daf80 con 0x55ae4e8cce10 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.182+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 50 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94207130582736] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.182+0000 7f53a920e800 20 remove_watcher() i=1 2024-09-21T08:53:02.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.182+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94207130576256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daf80 con 0x55ae4e8d62b0 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.183+0000 7f53a490c640 1 -- 172.21.15.196:0/2210320649 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94207130576256] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539c099040 con 0x55ae4e8d62b0 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.183+0000 7f53a920e800 20 remove_watcher() i=2 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.183+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94207130589808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8da580 con 0x7f539c009c10 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.184+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94207130589808] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x7f539c009c10 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.184+0000 7f53a920e800 20 remove_watcher() i=3 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.184+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94207130593904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daf80 con 0x55ae4e8cce10 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.185+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 <== osd.1 v2:172.21.15.196:6808/2855083704 51 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94207130593904] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f538c02b040 con 0x55ae4e8cce10 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.185+0000 7f53a920e800 20 remove_watcher() i=4 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.185+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94207130596240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8da580 con 0x55ae4e8d1800 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.186+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94207130596240] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.186+0000 7f53a920e800 20 remove_watcher() i=5 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.186+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94207130598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8dea70 con 0x55ae4e8d1800 2024-09-21T08:53:02.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.188+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94207130598736] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.188+0000 7f53a920e800 20 remove_watcher() i=6 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.188+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94207130587760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ae4e8daf80 con 0x55ae4e8d1800 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a510d640 1 -- 172.21.15.196:0/2210320649 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94207130587760] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f539402a070 con 0x55ae4e8d1800 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 20 remove_watcher() i=7 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8d1800 msgr2=0x55ae4e8d3bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8d1800 0x55ae4e8d3bf0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e8cce10 msgr2=0x55ae4e8cf2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e8cce10 0x55ae4e8cf2d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f539c009c10 msgr2=0x7f539c08a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f539c009c10 0x7f539c08a0b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ae4e8d62b0 msgr2=0x55ae4e8d8770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ae4e8d62b0 0x55ae4e8d8770 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5270036b40 msgr2=0x7f5270039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5270036b40 0x7f5270039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f539c06b720 tx=0x7f539c092000 comp rx=0 tx=0).stop 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 msgr2=0x55ae4e8c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/2210320649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8b9cf0 0x55ae4e8c11f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f539404cbb0 tx=0x7f539404cbe0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 reap_dead start 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a410b640 1 -- 172.21.15.196:0/2210320649 reap_dead start 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 shutdown_connections 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 >> 172.21.15.196:0/2210320649 conn(0x55ae4e8b6050 msgr2=0x55ae4e8b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 shutdown_connections 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/2210320649 wait complete. 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 msgr2=0x7f527c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 0x7f527c039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55ae4e895940 tx=0x7f539c06ae60 comp rx=0 tx=0).stop 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 msgr2=0x55ae4e8ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55ae4e88f2b0 tx=0x7f5394018830 comp rx=0 tx=0).stop 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 shutdown_connections 2024-09-21T08:53:02.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f527c036b40 0x7f527c039000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 --2- 172.21.15.196:0/1994487272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e8ad020 0x55ae4e8ad440 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.189+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 >> 172.21.15.196:0/1994487272 conn(0x55ae4e89dba0 msgr2=0x55ae4e8a0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 shutdown_connections 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1994487272 wait complete. 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 msgr2=0x55ae4e899be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 0x55ae4e899be0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 msgr2=0x55ae4e894e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 0x55ae4e894e30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 msgr2=0x7f528c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 0x7f528c039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f538c000f60 tx=0x7f538c001370 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 msgr2=0x55ae4e88deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f539c062040 tx=0x7f539c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 shutdown_connections 2024-09-21T08:53:02.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ae4e8977f0 0x55ae4e899be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ae4e798e20 0x55ae4e894e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f528c036b90 0x7f528c039050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 --2- 172.21.15.196:0/1772508581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ae4e7984e0 0x55ae4e88deb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 >> 172.21.15.196:0/1772508581 conn(0x55ae4e793db0 msgr2=0x55ae4e880850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 shutdown_connections 2024-09-21T08:53:02.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.190+0000 7f53a920e800 1 -- 172.21.15.196:0/1772508581 wait complete. 2024-09-21T08:53:02.200 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-21T08:53:02.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-21T08:53:02.201 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-21T08:53:02.246 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:02.246 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:02.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.245+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.245+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.245+0000 7fa9fc834800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5641629995f0 0x564162a2a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.245+0000 7fa9fc834800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641628e4b30 con 0x564162a2ab80 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.245+0000 7fa9fc834800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5641628c6360 con 0x5641629995f0 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.246+0000 7fa9f7b4b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5641629995f0 0x564162a2a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.246+0000 7fa9f7b4b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5641629995f0 0x564162a2a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57344/0 (socket says 172.21.15.196:57344) 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.246+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3862974826 learned_addr learned my addr 172.21.15.196:0/3862974826 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.246+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3862974826 >> v1:172.21.15.29:6789/0 conn(0x564162a2ab80 legacy=0x564162a2cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.246+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3862974826 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641628ece00 con 0x5641629995f0 2024-09-21T08:53:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.248+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3862974826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162a2a640 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800a520 tx=0x7fa9e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ae6933d842cea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.248+0000 7fa9f734a640 1 -- 172.21.15.196:0/3862974826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e8055070 con 0x5641629995f0 2024-09-21T08:53:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.248+0000 7fa9f734a640 1 -- 172.21.15.196:0/3862974826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e80515b0 con 0x5641629995f0 2024-09-21T08:53:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.248+0000 7fa9f734a640 1 -- 172.21.15.196:0/3862974826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e80518d0 con 0x5641629995f0 2024-09-21T08:53:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 -- 172.21.15.196:0/3862974826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 msgr2=0x564162a2a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3862974826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162a2a640 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800a520 tx=0x7fa9e8045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 -- 172.21.15.196:0/3862974826 shutdown_connections 2024-09-21T08:53:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3862974826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162a2a640 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 -- 172.21.15.196:0/3862974826 >> 172.21.15.196:0/3862974826 conn(0x564162a1fdb0 msgr2=0x564162a221d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 -- 172.21.15.196:0/3862974826 shutdown_connections 2024-09-21T08:53:02.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.249+0000 7fa9fc834800 1 -- 172.21.15.196:0/3862974826 wait complete. 2024-09-21T08:53:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.262+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.265 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.262+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9fc834800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9fc834800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564162971360 con 0x5641629995f0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9f7b4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9f7b4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57350/0 (socket says 172.21.15.196:57350) 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/4169011513 learned_addr learned my addr 172.21.15.196:0/4169011513 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/4169011513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641628bebc0 con 0x5641629995f0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.263+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/4169011513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8025da0 tx=0x7fa9e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aa094d7be9afc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa8e5e0b640 1 -- 172.21.15.196:0/4169011513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e8051890 con 0x5641629995f0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa8e5e0b640 1 -- 172.21.15.196:0/4169011513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e8051ac0 con 0x5641629995f0 2024-09-21T08:53:02.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa8e5e0b640 1 -- 172.21.15.196:0/4169011513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e8051da0 con 0x5641629995f0 2024-09-21T08:53:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 -- 172.21.15.196:0/4169011513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 msgr2=0x564162b16a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 --2- 172.21.15.196:0/4169011513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8025da0 tx=0x7fa9e8051000 comp rx=0 tx=0).stop 2024-09-21T08:53:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 -- 172.21.15.196:0/4169011513 shutdown_connections 2024-09-21T08:53:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 --2- 172.21.15.196:0/4169011513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b16a80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 -- 172.21.15.196:0/4169011513 >> 172.21.15.196:0/4169011513 conn(0x564162a1fdb0 msgr2=0x564162b12440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 -- 172.21.15.196:0/4169011513 shutdown_connections 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.264+0000 7fa9fc834800 1 -- 172.21.15.196:0/4169011513 wait complete. 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9fc834800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9fc834800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564162a2e930 con 0x5641629995f0 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9f7b4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9f7b4b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57366/0 (socket says 172.21.15.196:57366) 2024-09-21T08:53:02.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/437033136 learned_addr learned my addr 172.21.15.196:0/437033136 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.265+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641628d2fe0 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000c00 tx=0x7fa9e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa8dffff640 1 -- 172.21.15.196:0/437033136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e8073070 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa8dffff640 1 -- 172.21.15.196:0/437033136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e805a450 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564162b1e7e0 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa8dffff640 1 -- 172.21.15.196:0/437033136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e805a730 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.266+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564162b1ed60 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa8dffff640 1 -- 172.21.15.196:0/437033136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9e8076070 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa8dffff640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 0x7fa8e0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa8dffff640 1 -- 172.21.15.196:0/437033136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa9e8062070 con 0x5641629995f0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 0x7fa8e0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 0x564162b25370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b25940 con 0x564162a2ab80 2024-09-21T08:53:02.271 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9f834c640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 0x564162b25370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 0x7fa8e0039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0001e10 tx=0x7fa9e0001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.267+0000 7fa9f834c640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 0x564162b25370 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9f834c640 1 -- 172.21.15.196:0/437033136 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9f000a4a0 con 0x564162a2ab80 2024-09-21T08:53:02.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b22940 con 0x564162a2ab80 2024-09-21T08:53:02.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9f834c640 1 -- 172.21.15.196:0/437033136 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9f000a4a0 con 0x564162a2ab80 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 0x564162b2a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b2a750 con 0x564162b27cc0 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.268+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 0x564162b2a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.269+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 0x564162b2a0b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.269+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/437033136 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9e807f070 con 0x564162b27cc0 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.269+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b26b60 con 0x564162a2ab80 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.269+0000 7fa9f834c640 1 -- 172.21.15.196:0/437033136 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9f000a4a0 con 0x564162a2ab80 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.269+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b27000 con 0x564162a2ab80 2024-09-21T08:53:02.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9f834c640 1 -- 172.21.15.196:0/437033136 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9f000a4a0 con 0x564162a2ab80 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9fc834800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9fc834800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5641628c0580 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57372/0 (socket says 172.21.15.196:57372) 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.270+0000 7fa9f834c640 1 -- 172.21.15.196:0/2728098396 learned_addr learned my addr 172.21.15.196:0/2728098396 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa9f834c640 1 -- 172.21.15.196:0/2728098396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564162b39a20 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa9f834c640 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x564162b25d20 tx=0x7fa9f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa8dd7fa640 1 -- 172.21.15.196:0/2728098396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0014450 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa8dd7fa640 1 -- 172.21.15.196:0/2728098396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f00145f0 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564162b39cb0 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa8dd7fa640 1 -- 172.21.15.196:0/2728098396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0014910 con 0x564162b390c0 2024-09-21T08:53:02.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.271+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564162b3c990 con 0x564162b390c0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa8dd7fa640 1 -- 172.21.15.196:0/2728098396 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9f0011040 con 0x564162b390c0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa8dd7fa640 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 0x7fa8d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa8dd7fa640 1 -- 172.21.15.196:0/2728098396 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f001e070 con 0x564162b390c0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 0x7fa8d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 0x7fa8d0039050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564162b25de0 tx=0x7fa9e8050fb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9fc834800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.272+0000 7fa9fc834800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564162b17170 con 0x564162b45d20 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57382/0 (socket says 172.21.15.196:57382) 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9f834c640 1 -- 172.21.15.196:0/2577186741 learned_addr learned my addr 172.21.15.196:0/2577186741 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9f834c640 1 -- 172.21.15.196:0/2577186741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564162b466f0 con 0x564162b45d20 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9f834c640 1 --2- 172.21.15.196:0/2577186741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa9f004cae0 tx=0x7fa9f0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2998954b1e111d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/2577186741 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0013c90 con 0x564162b45d20 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/2577186741 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f0013e30 con 0x564162b45d20 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/2577186741 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0014be0 con 0x564162b45d20 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9fc834800 1 -- 172.21.15.196:0/2577186741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 msgr2=0x564162b46120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2577186741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa9f004cae0 tx=0x7fa9f0011700 comp rx=0 tx=0).stop 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.273+0000 7fa9fc834800 1 -- 172.21.15.196:0/2577186741 shutdown_connections 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2577186741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b46120 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 -- 172.21.15.196:0/2577186741 >> 172.21.15.196:0/2577186741 conn(0x564162b42080 msgr2=0x564162b40180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 -- 172.21.15.196:0/2577186741 shutdown_connections 2024-09-21T08:53:02.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 -- 172.21.15.196:0/2577186741 wait complete. 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 Processor -- start 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 -- start start 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9fc834800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564162b46cb0 con 0x564162b45d20 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9f834c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:57388/0 (socket says 172.21.15.196:57388) 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 learned_addr learned my addr 172.21.15.196:0/3174870122 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.274+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564162b4d680 con 0x564162b45d20 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa9f834c640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa9f003e040 tx=0x7fa9f004ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa8d57fa640 1 -- 172.21.15.196:0/3174870122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0016440 con 0x564162b45d20 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa8d57fa640 1 -- 172.21.15.196:0/3174870122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f004b3e0 con 0x564162b45d20 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564162b4d910 con 0x564162b45d20 2024-09-21T08:53:02.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa8d57fa640 1 -- 172.21.15.196:0/3174870122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f004b6c0 con 0x564162b45d20 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564162b505c0 con 0x564162b45d20 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.275+0000 7fa8d57fa640 1 -- 172.21.15.196:0/3174870122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9f004e900 con 0x564162b45d20 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa8d57fa640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8c0036b90 0x7fa8c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa8d57fa640 1 -- 172.21.15.196:0/3174870122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f0033070 con 0x564162b45d20 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8c0036b90 0x7fa8c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8c0036b90 0x7fa8c0039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8067ff0 tx=0x7fa9e8094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162b58e90 0x564162b5b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b5baa0 con 0x564162b58e90 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.276+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162b58e90 0x564162b5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162b58e90 0x564162b5b350 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e000bdb0 con 0x564162b58e90 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 realm 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b582e0 con 0x564162b58e90 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e000bdb0 con 0x564162b58e90 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b5c590 con 0x564162b58e90 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e000bdb0 con 0x564162b58e90 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.277+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b5ce60 con 0x564162b58e90 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9e000bdb0 con 0x564162b58e90 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b5d7a0 0x564162b5fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b60360 con 0x564162b5d7a0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9f834c640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b5d7a0 0x564162b5fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9f834c640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b5d7a0 0x564162b5fbd0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.278+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9fc834800 20 searching for the correct realm 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564162b62330 0x564162b647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564162b64ec0 con 0x564162b62330 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564162b62330 0x564162b647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564162b62330 0x564162b647f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9f7b4b640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa9e8078070 0x7fa9e80670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.279+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa9e8078070 0x7fa9e80670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9ef34a640 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa9e8078070 0x7fa9e80670d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e000bdb0 con 0x7fa9e8078070 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e000bdb0 con 0x564162b58e90 2024-09-21T08:53:02.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.280+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.281+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.282+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.283+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.284+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.285+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.286+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b62330 2024-09-21T08:53:02.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b5d7a0 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.287+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x564162b58e90 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa9e80a8040 con 0x7fa9e8078070 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:02.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b60d20 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b615c0 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.288+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b60960 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 zone default found 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 4 Realm: () 2024-09-21T08:53:02.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 zonegroup default 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b65340 con 0x564162b5d7a0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b675f0 con 0x564162b62330 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.289+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b67990 con 0x564162b62330 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.290+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.290+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.290+0000 7fa9fc834800 20 started sync module instance, tier type = 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.290+0000 7fa9fc834800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.290+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b66a80 con 0x7fa9e8078070 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.291+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.291+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94838828986288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b66a80 con 0x7fa9e8078070 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.291+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b683e0 con 0x564162b58e90 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.292+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94838828986288] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.292+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.292+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94838828990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b66a80 con 0x564162b58e90 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.292+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b68e30 con 0x564162b62330 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.293+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94838828990192] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.293+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.293+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94838828983760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b669f0 con 0x564162b62330 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.293+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b69bf0 con 0x7fa9e8078070 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.294+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94838828983760] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.294+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.294+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838828995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b69fe0 con 0x7fa9e8078070 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.294+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6aa20 con 0x564162b58e90 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.295+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94838828995152] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.295+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.295+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94838828999920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6a9e0 con 0x564162b58e90 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.295+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6b430 con 0x564162b5d7a0 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.296+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94838828999920] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.296+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.296+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94838828996208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6b430 con 0x564162b5d7a0 2024-09-21T08:53:02.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.296+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6be30 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.297+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.297+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94838829005120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6c2b0 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.297+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6cdc0 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.297+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94838828996208] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94838829005120] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94838829009008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6bd60 con 0x564162b5d7a0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=0 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=1 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=2 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=3 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=4 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=5 2024-09-21T08:53:02.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.298+0000 7fa9fc834800 20 add_watcher() i=6 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.299+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94838829009008] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.299+0000 7fa9fc834800 20 add_watcher() i=7 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.299+0000 7fa9fc834800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.299+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162b6fdb0 con 0x564162b58e90 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.300+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.300+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94838829002624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6d260 con 0x564162b58e90 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.301+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94838829002624] v36'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.301+0000 7fa8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.301+0000 7fa9fc834800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.301+0000 7fa9fc834800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.301+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b78770 con 0x564162b58e90 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.302+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.302+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b78da0 con 0x564162b5d7a0 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.303+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.303+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b78da0 con 0x564162b62330 2024-09-21T08:53:02.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.304+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.304+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b79880 con 0x564162b58e90 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.305+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.305+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b76530 con 0x7fa9e8078070 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.306+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.306+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b764a0 con 0x564162b62330 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.307+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.307+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a150 con 0x564162b58e90 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.308+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.308+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a1e0 con 0x564162b5d7a0 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.309+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.309+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a2d0 con 0x7fa9e8078070 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.310+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.310+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.311+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.311+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x7fa9e8078070 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.312+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.312+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b5d7a0 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.314+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.314+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x7fa9e8078070 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.315+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.315+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b5d7a0 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.316+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.316+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b58e90 2024-09-21T08:53:02.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.317+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.317+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.318+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.318+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x7fa9e8078070 2024-09-21T08:53:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.319+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.319+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.320+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.320+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b58e90 2024-09-21T08:53:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.321+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.321+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b58e90 2024-09-21T08:53:02.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.322+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.322+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.323+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.323+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x7fa9e8078070 2024-09-21T08:53:02.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.324+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.324+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x564162b62330 2024-09-21T08:53:02.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.325+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.325+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.326+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.326+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.327+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.327+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b62330 2024-09-21T08:53:02.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.328+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.328+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x564162b5d7a0 2024-09-21T08:53:02.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.329+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.329+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x564162b62330 2024-09-21T08:53:02.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.330+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.330+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x564162b5d7a0 2024-09-21T08:53:02.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.331+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.331+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x564162b62330 2024-09-21T08:53:02.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.332+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.332+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7e0 con 0x564162b5d7a0 2024-09-21T08:53:02.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.333+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.333+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b7a7b0 con 0x7fa9e8078070 2024-09-21T08:53:02.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.334+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa8acfe1640 20 reqs_thread_entry: start 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa9fc834800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa9fc834800 20 Filter name: none 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa8267fc640 20 reqs_thread_entry: start 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa9fc834800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-21T08:53:02.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.335+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162ba55c0 con 0x564162b5d7a0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=380 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162ba8050 con 0x564162b5d7a0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 : miss 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:96 8.0 8:05c28218:root::.bucket.meta.myfoo7%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162ba7f00 con 0x564162b62330 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=382 2024-09-21T08:53:02.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 info.flags=0x17 2024-09-21T08:53:02.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 to cache LRU end 2024-09-21T08:53:02.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:02.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.336+0000 7fa9fc834800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:53:02.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9fc834800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:97 4.18 4:1be5f563:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25430 con 0x7fa9e8078070 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(97 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 4.f 4:f333afb0:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25470 con 0x564162b58e90 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(98 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.337+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 4.2d 4:b58d5579:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25470 con 0x564162b5d7a0 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(99 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 4.16 4:6ad811ea:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25470 con 0x564162b62330 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(100 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 4.16 4:699c3dec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25470 con 0x564162b62330 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(101 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.338+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:102 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25430 con 0x7fa9e8078070 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.339+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(102 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [call out=377b] v0'0 uv5 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.339+0000 7fa9fc834800 10 cls_bucket_list_unordered: got fourteen 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.339+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:103 4.26 4:67aff773:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25430 con 0x564162b5d7a0 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.339+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(103 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.339+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:104 4.11 4:8abed372:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c253f0 con 0x564162b5d7a0 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(104 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:105 4.24 4:26bcea59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c253f0 con 0x564162b5d7a0 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(105 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:106 4.22 4:45c9d341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c253b0 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(106 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.340+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 4.3e 4:7c9766b6:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c25ad0 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(107 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 20 get_obj_state: octx=0x7fa9f002df60 obj=myfoo7:fourteen state=0x564162c234b8 s->prefetch_data=0 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:108 3.36s0 3:6c500acd:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162c242e0 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(108 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 10 manifest: total_size = 8 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.5297259017368718393 2024-09-21T08:53:02.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 20 get_obj_state: octx=0x7fa9f002df60 obj=myfoo7:fourteen state=0x564162c234b8 s->prefetch_data=0 2024-09-21T08:53:02.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 20 prepare_atomic_modification: state is not atomic. state=0x564162c234b8 2024-09-21T08:53:02.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 2024-09-21T08:53:02.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.341+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:109 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162c24c80 con 0x7fa9e8078070 2024-09-21T08:53:02.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.342+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(109 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.342+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:110 3.36s0 3:6c500acd:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162c24c80 con 0x7fa9e8078070 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(110 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10_fourteen [call] v36'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:111 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bacab0 con 0x7fa9e8078070 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 20 list_objects_ordered: starting attempt 1 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:112 4.18 4:1be5f563:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bacab0 con 0x7fa9e8078070 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 4.f 4:f333afb0:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bb0cf0 con 0x564162b58e90 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:114 4.2d 4:b58d5579:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bacab0 con 0x564162b5d7a0 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:115 4.16 4:6ad811ea:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bacab0 con 0x564162b62330 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:116 4.16 4:699c3dec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8090 con 0x564162b62330 2024-09-21T08:53:02.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:117 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:118 4.26 4:67aff773:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbd800 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:119 4.11 4:8abed372:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:120 4.24 4:26bcea59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc2810 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:121 4.22 4:45c9d341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:122 4.3e 4:7c9766b6:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc84b0 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(115 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(114 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.344+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(113 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(112 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(118 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(121 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(119 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(122 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(120 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(116 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(111 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa8d67fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(117 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10])"; uploads.size()=0; is_truncated=0 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:123 4.18 4:1be5f563:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:124 4.f 4:f333afb0:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc2810 con 0x564162b58e90 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:125 4.2d 4:b58d5579:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:126 4.16 4:6ad811ea:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc6b60 con 0x564162b62330 2024-09-21T08:53:02.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:127 4.16 4:699c3dec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b62330 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:128 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc2810 con 0x7fa9e8078070 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.345+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:129 4.26 4:67aff773:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:130 4.11 4:8abed372:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:131 4.24 4:26bcea59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:132 4.22 4:45c9d341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc2810 con 0x7fa9e8078070 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(125 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:133 4.3e 4:7c9766b6:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(129 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(124 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(126 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(130 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(131 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(127 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(123 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(128 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(132 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(133 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.346+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b5d7a0 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.347+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(134 fud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.347+0000 7fa9fc834800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.347+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.347+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.348+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.348+0000 7fa9fc834800 20 rados_obj.operate() r=0 bl.length=168 2024-09-21T08:53:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.348+0000 7fa9fc834800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.348+0000 7fa9fc834800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.348+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(136 myfoo7 [call,call,delete] v36'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9fc834800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9fc834800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94838829359744 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== watch-notify(notify (1) cookie 94838828995152 notify 154618822684 ret 0) ==== 192+0+0 (crc 0 0 0) 0x564162b768d0 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa8d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94838828995152 notifier 4769 bl.length()=150 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa8d67fc640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa82c0032c0 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(137 notify.3 [notify cookie 94838829359744 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.349+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.350+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== watch-notify(notify_complete (2) cookie 94838829359744 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564162b75e20 con 0x7fa9e8078070 2024-09-21T08:53:02.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.350+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:139 8.0 8:05c28218:root::.bucket.meta.myfoo7%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b62330 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 from cache 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10, ofs0, ns] 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94838829252208 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== watch-notify(notify (1) cookie 94838828990192 notify 154618822677 ret 0) ==== 250+0+0 (crc 0 0 0) 0x564162b75e20 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa8d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 94838828990192 notifier 4769 bl.length()=208 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(140 notify.1 [notify cookie 94838829252208 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa8bc003d60 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== watch-notify(notify_complete (2) cookie 94838829252208 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564162b782a0 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:142 4.18 4:1be5f563:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x7fa9e8078070 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:143 4.f 4:f333afb0:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b58e90 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:144 4.2d 4:b58d5579:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8580 con 0x564162b5d7a0 2024-09-21T08:53:02.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:145 4.16 4:6ad811ea:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8e90 con 0x564162b62330 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:146 4.16 4:699c3dec:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b62330 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:147 4.3d 4:bdba6d1c:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8580 con 0x7fa9e8078070 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:148 4.26 4:67aff773:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:149 4.11 4:8abed372:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8e90 con 0x564162b5d7a0 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:150 4.24 4:26bcea59:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaee0 con 0x564162b5d7a0 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:151 4.22 4:45c9d341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8580 con 0x7fa9e8078070 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.351+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:152 4.3e 4:7c9766b6:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bb8e90 con 0x7fa9e8078070 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(142 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.0 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(152 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.10 [delete] v36'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(150 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.8 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(145 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.3 [delete] v36'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(149 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.7 [delete] v36'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 42 ==== osd_op_reply(147 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.5 [delete] v36'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.353+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(148 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.6 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(146 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.4 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(144 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.2 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 43 ==== osd_op_reply(151 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.9 [delete] v36'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(143 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10.1 [delete] v36'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 : miss 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 20 rados->read ofs=0 len=0 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:153 6.b 6:d30737f8:::pubsub..bucket.myfoo7%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b62330 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 info.flags=0x0 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 10 adding default.rgw.log++pubsub..bucket.myfoo7/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 to cache LRU end 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.354+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:154 6.b 6:d30737f8:::pubsub..bucket.myfoo7%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b62330 2024-09-21T08:53:02.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.355+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(154 pubsub..bucket.myfoo7/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.10 [delete] v36'28 uv21 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.355+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.356+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(155 fud.buckets [call] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.356+0000 7fa9fc834800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.356+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v36'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9fc834800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94838829372976 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaea0 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== watch-notify(notify (1) cookie 94838828983760 notify 154618822663 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564162ba73f0 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa8d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822663 cookie 94838828983760 notifier 4769 bl.length()=170 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(157 notify.2 [notify cookie 94838829372976 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa8bc003d60 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== watch-notify(notify_complete (2) cookie 94838829372976 notify 154618822663 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564162b505c0 con 0x564162b62330 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9fc834800 10 removing email index: 2024-09-21T08:53:02.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9fc834800 10 removing user buckets index 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.357+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaea0 con 0x564162b5d7a0 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.358+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(159 fud.buckets [delete] v36'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.358+0000 7fa9fc834800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.358+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94838829330080 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== watch-notify(notify (1) cookie 94838829005120 notify 154618822695 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564162b76b60 con 0x564162b5d7a0 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa8d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822695 cookie 94838829005120 notifier 4769 bl.length()=160 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(160 notify.6 [notify cookie 94838829330080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.381 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa8d67fc640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa82c0032c0 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 49 ==== watch-notify(notify_complete (2) cookie 94838829330080 notify 154618822695 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564162b4d910 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 50 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9fc834800 10 removing user index: fud 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.359+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaea0 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 51 ==== osd_op_reply(162 fud [call,call,delete] v36'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9fc834800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9fc834800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94838829330080 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564162bc5630 con 0x564162b5d7a0 2024-09-21T08:53:02.382 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 52 ==== watch-notify(notify (1) cookie 94838828996208 notify 154618822696 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564162b4d910 con 0x564162b5d7a0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa8d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822696 cookie 94838828996208 notifier 4769 bl.length()=152 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa8d6ffd640 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa8bc003d60 con 0x564162b5d7a0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.360+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 53 ==== osd_op_reply(163 notify.5 [notify cookie 94838829330080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.361+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 54 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.361+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 55 ==== watch-notify(notify_complete (2) cookie 94838829330080 notify 154618822696 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564162b4d680 con 0x564162b5d7a0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.362+0000 7fa8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.362+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94838829002624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162bbaea0 con 0x564162b58e90 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.363+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94838829002624] v36'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.363+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94838828986288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6af80 con 0x7fa9e8078070 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.364+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 44 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94838828986288] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.364+0000 7fa9fc834800 20 remove_watcher() i=0 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.364+0000 7fa9fc834800 2 removed watcher, disabling cache 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.364+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94838828990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b66fb0 con 0x564162b58e90 2024-09-21T08:53:02.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.365+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94838828990192] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.365+0000 7fa9fc834800 20 remove_watcher() i=1 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.365+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94838828983760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b66fb0 con 0x564162b62330 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.366+0000 7fa9f7b4b640 1 -- 172.21.15.196:0/3174870122 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94838828983760] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e8099040 con 0x564162b62330 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.366+0000 7fa9fc834800 20 remove_watcher() i=2 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.366+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838828995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b665d0 con 0x7fa9e8078070 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.367+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.2 v2:172.21.15.196:6816/3551232799 45 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94838828995152] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x7fa9e8078070 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.367+0000 7fa9fc834800 20 remove_watcher() i=3 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.367+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94838828999920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b69250 con 0x564162b58e90 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.368+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94838828999920] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e002a040 con 0x564162b58e90 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.368+0000 7fa9fc834800 20 remove_watcher() i=4 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.368+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94838828996208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b665d0 con 0x564162b5d7a0 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.369+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 56 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94838828996208] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.369+0000 7fa9fc834800 20 remove_watcher() i=5 2024-09-21T08:53:02.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.369+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94838829005120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b6a4f0 con 0x564162b5d7a0 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.370+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 57 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94838829005120] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.370+0000 7fa9fc834800 20 remove_watcher() i=6 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.370+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94838829009008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564162b665d0 con 0x564162b5d7a0 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9f834c640 1 -- 172.21.15.196:0/3174870122 <== osd.0 v2:172.21.15.29:6800/3430791726 58 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94838829009008] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f002a070 con 0x564162b5d7a0 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 20 remove_watcher() i=7 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b5d7a0 msgr2=0x564162b5fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b5d7a0 0x564162b5fbd0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162b58e90 msgr2=0x564162b5b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162b58e90 0x564162b5b350 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa9e8078070 msgr2=0x7fa9e80670d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa9e8078070 0x7fa9e80670d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564162b62330 msgr2=0x564162b647f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564162b62330 0x564162b647f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8c0036b90 msgr2=0x7fa8c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8c0036b90 0x7fa8c0039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8067ff0 tx=0x7fa9e8094000 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9ef34a640 1 -- 172.21.15.196:0/3174870122 reap_dead start 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 msgr2=0x564162b4d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa9f003e040 tx=0x7fa9f004ca70 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 shutdown_connections 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 --2- 172.21.15.196:0/3174870122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b45d20 0x564162b4d140 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 >> 172.21.15.196:0/3174870122 conn(0x564162b42080 msgr2=0x564162b40150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 shutdown_connections 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.371+0000 7fa9fc834800 1 -- 172.21.15.196:0/3174870122 wait complete. 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 msgr2=0x7fa8d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 0x7fa8d0039050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x564162b25de0 tx=0x7fa9e8050fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 msgr2=0x564162b394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x564162b25d20 tx=0x7fa9f0018830 comp rx=0 tx=0).stop 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 shutdown_connections 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8d0036b90 0x7fa8d0039050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/2728098396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564162b390c0 0x564162b394e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 >> 172.21.15.196:0/2728098396 conn(0x564162b2e050 msgr2=0x564162b30bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 shutdown_connections 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/2728098396 wait complete. 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 msgr2=0x564162b2a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 0x564162b2a0b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 msgr2=0x564162b25370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 0x564162b25370 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 msgr2=0x7fa8e0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 0x7fa8e0039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0001e10 tx=0x7fa9e0001390 comp rx=0 tx=0).stop 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 msgr2=0x564162b1e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000c00 tx=0x7fa9e8002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 shutdown_connections 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564162b27cc0 0x564162b2a0b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564162a2ab80 0x564162b25370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fa8e0036b40 0x7fa8e0039000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 --2- 172.21.15.196:0/437033136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641629995f0 0x564162b1e2a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 >> 172.21.15.196:0/437033136 conn(0x564162a1fdb0 msgr2=0x564162b10cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 shutdown_connections 2024-09-21T08:53:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:02.372+0000 7fa9fc834800 1 -- 172.21.15.196:0/437033136 wait complete. 2024-09-21T08:53:42.394 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-21T08:53:42.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-21T08:53:42.395 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-21T08:53:42.446 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:42.446 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:42.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.445+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.445+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fc052a800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c2844614c0 0x55c2844618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fc052a800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c284321b30 con 0x55c284461e00 2024-09-21T08:53:42.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fc052a800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c284303360 con 0x55c2844614c0 2024-09-21T08:53:42.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fbc221640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c2844614c0 0x55c2844618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fb3a20640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c284461e00 0x55c284466980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57866/0 (socket says 172.21.15.196:57866) 2024-09-21T08:53:42.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fb3a20640 1 -- 172.21.15.196:0/277964789 learned_addr learned my addr 172.21.15.196:0/277964789 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:42.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fbc221640 1 --2- 172.21.15.196:0/277964789 >> v2:172.21.15.29:3300/0 conn(0x55c2844614c0 0x55c2844618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35146/0 (socket says 172.21.15.196:35146) 2024-09-21T08:53:42.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fbc221640 1 -- 172.21.15.196:0/277964789 >> v1:172.21.15.29:6789/0 conn(0x55c284461e00 legacy=0x55c284466980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.446+0000 7f3fbc221640 1 -- 172.21.15.196:0/277964789 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c284329e00 con 0x55c2844614c0 2024-09-21T08:53:42.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.448+0000 7f3fbc221640 1 --2- 172.21.15.196:0/277964789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c2844618c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a470 tx=0x7f3fac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b020c605b288f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.448+0000 7f3fbba20640 1 -- 172.21.15.196:0/277964789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac053570 con 0x55c2844614c0 2024-09-21T08:53:42.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fbba20640 1 -- 172.21.15.196:0/277964789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac058070 con 0x55c2844614c0 2024-09-21T08:53:42.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fbba20640 1 -- 172.21.15.196:0/277964789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac053880 con 0x55c2844614c0 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 -- 172.21.15.196:0/277964789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 msgr2=0x55c2844618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 --2- 172.21.15.196:0/277964789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c2844618c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a470 tx=0x7f3fac045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 -- 172.21.15.196:0/277964789 shutdown_connections 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 --2- 172.21.15.196:0/277964789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c2844618c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 -- 172.21.15.196:0/277964789 >> 172.21.15.196:0/277964789 conn(0x55c28445cdf0 msgr2=0x55c28445f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 -- 172.21.15.196:0/277964789 shutdown_connections 2024-09-21T08:53:42.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.449+0000 7f3fc052a800 1 -- 172.21.15.196:0/277964789 wait complete. 2024-09-21T08:53:42.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.465+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.465+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.465+0000 7f3fc052a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.465+0000 7f3fc052a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c2843ae330 con 0x55c2844614c0 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3fbc221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3fbc221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35162/0 (socket says 172.21.15.196:35162) 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3fbc221640 1 -- 172.21.15.196:0/944911676 learned_addr learned my addr 172.21.15.196:0/944911676 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3fbc221640 1 -- 172.21.15.196:0/944911676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2842fbbc0 con 0x55c2844614c0 2024-09-21T08:53:42.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3fbc221640 1 --2- 172.21.15.196:0/944911676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3fac025c20 tx=0x7f3fac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a696bdfc4acd96e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3eaa60c640 1 -- 172.21.15.196:0/944911676 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac05c580 con 0x55c2844614c0 2024-09-21T08:53:42.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3eaa60c640 1 -- 172.21.15.196:0/944911676 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac063030 con 0x55c2844614c0 2024-09-21T08:53:42.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.466+0000 7f3eaa60c640 1 -- 172.21.15.196:0/944911676 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac05c850 con 0x55c2844614c0 2024-09-21T08:53:42.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 -- 172.21.15.196:0/944911676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 msgr2=0x55c284550770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 --2- 172.21.15.196:0/944911676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3fac025c20 tx=0x7f3fac051000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 -- 172.21.15.196:0/944911676 shutdown_connections 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 --2- 172.21.15.196:0/944911676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284550770 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 -- 172.21.15.196:0/944911676 >> 172.21.15.196:0/944911676 conn(0x55c28445cdf0 msgr2=0x55c28454c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 -- 172.21.15.196:0/944911676 shutdown_connections 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.467+0000 7f3fc052a800 1 -- 172.21.15.196:0/944911676 wait complete. 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fc052a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fc052a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c2844684e0 con 0x55c2844614c0 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fbc221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fbc221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35164/0 (socket says 172.21.15.196:35164) 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fbc221640 1 -- 172.21.15.196:0/1265685946 learned_addr learned my addr 172.21.15.196:0/1265685946 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.468+0000 7f3fbc221640 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28430ffe0 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3fbc221640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a330 tx=0x7f3fac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3ea8e09640 1 -- 172.21.15.196:0/1265685946 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac06c030 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3ea8e09640 1 -- 172.21.15.196:0/1265685946 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac05c580 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c284553e60 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3ea8e09640 1 -- 172.21.15.196:0/1265685946 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fac05c860 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.469+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2845543e0 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3ea8e09640 1 -- 172.21.15.196:0/1265685946 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3fac053440 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3ea8e09640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 0x7f3ea4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3ea8e09640 1 -- 172.21.15.196:0/1265685946 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3fac070020 con 0x55c2844614c0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 0x7f3ea4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 0x55c2845625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284562b00 con 0x55c284461e00 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3fbca22640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 0x55c2845625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.475 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.470+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 0x7f3ea4039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000f60 tx=0x7f3fa40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fbca22640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 0x55c2845625c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fbca22640 1 -- 172.21.15.196:0/1265685946 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fb400a4a0 con 0x55c284461e00 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284563350 con 0x55c284461e00 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fbca22640 1 -- 172.21.15.196:0/1265685946 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fb400a4a0 con 0x55c284461e00 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 0x55c284567210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.471+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845679a0 con 0x55c284564d80 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.472+0000 7f3fbc221640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 0x55c284567210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.472+0000 7f3fbc221640 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 0x55c284567210 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.472+0000 7f3fbc221640 1 -- 172.21.15.196:0/1265685946 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fac07b070 con 0x55c284564d80 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.472+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284563ba0 con 0x55c284461e00 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.473+0000 7f3fbca22640 1 -- 172.21.15.196:0/1265685946 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fb400a4a0 con 0x55c284461e00 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.473+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284563f40 con 0x55c284461e00 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.473+0000 7f3fbca22640 1 -- 172.21.15.196:0/1265685946 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fb400a4a0 con 0x55c284461e00 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.473+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fc052a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fc052a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c284555cb0 con 0x55c284576270 2024-09-21T08:53:42.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35180/0 (socket says 172.21.15.196:35180) 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fbca22640 1 -- 172.21.15.196:0/3775790492 learned_addr learned my addr 172.21.15.196:0/3775790492 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fbca22640 1 -- 172.21.15.196:0/3775790492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c284576bd0 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.474+0000 7f3fbca22640 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x55c284554e30 tx=0x7f3fb4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.475+0000 7f3ea1ffb640 1 -- 172.21.15.196:0/3775790492 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb4014450 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.475+0000 7f3ea1ffb640 1 -- 172.21.15.196:0/3775790492 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4014610 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.475+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c284576e60 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.475+0000 7f3ea1ffb640 1 -- 172.21.15.196:0/3775790492 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb4014930 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.475+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c284579b40 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3ea1ffb640 1 -- 172.21.15.196:0/3775790492 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3fb4011040 con 0x55c284576270 2024-09-21T08:53:42.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3ea1ffb640 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 0x7f3e94039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3ea1ffb640 1 -- 172.21.15.196:0/3775790492 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3fb401e070 con 0x55c284576270 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fbc221640 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 0x7f3e94039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fbc221640 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 0x7f3e94039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55c284554980 tx=0x7f3fac008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fc052a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fc052a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c2842fd580 con 0x55c284582ea0 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.476+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35184/0 (socket says 172.21.15.196:35184) 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3fbca22640 1 -- 172.21.15.196:0/2633205245 learned_addr learned my addr 172.21.15.196:0/2633205245 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3fbca22640 1 -- 172.21.15.196:0/2633205245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c284583870 con 0x55c284582ea0 2024-09-21T08:53:42.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3fbca22640 1 --2- 172.21.15.196:0/2633205245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3fb404cc70 tx=0x7f3fb404ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7896a02defbbc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3e9b7fe640 1 -- 172.21.15.196:0/2633205245 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb4042070 con 0x55c284582ea0 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3e9b7fe640 1 -- 172.21.15.196:0/2633205245 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4014c00 con 0x55c284582ea0 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.477+0000 7f3e9b7fe640 1 -- 172.21.15.196:0/2633205245 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb402b480 con 0x55c284582ea0 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- 172.21.15.196:0/2633205245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 msgr2=0x55c2845832a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2633205245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3fb404cc70 tx=0x7f3fb404ce70 comp rx=0 tx=0).stop 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- 172.21.15.196:0/2633205245 shutdown_connections 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2633205245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c2845832a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- 172.21.15.196:0/2633205245 >> 172.21.15.196:0/2633205245 conn(0x55c28457f250 msgr2=0x55c28457d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- 172.21.15.196:0/2633205245 shutdown_connections 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- 172.21.15.196:0/2633205245 wait complete. 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 Processor -- start 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- start start 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fc052a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c284583cc0 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fbca22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35186/0 (socket says 172.21.15.196:35186) 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.478+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 learned_addr learned my addr 172.21.15.196:0/2142808975 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28458a720 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3fbca22640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fb404cc70 tx=0x7f3fb404cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3e99ffb640 1 -- 172.21.15.196:0/2142808975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb4011980 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3e99ffb640 1 -- 172.21.15.196:0/2142808975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4033070 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c28458a9b0 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3e99ffb640 1 -- 172.21.15.196:0/2142808975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fb40133b0 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.479+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28458d660 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.480+0000 7f3e99ffb640 1 -- 172.21.15.196:0/2142808975 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3fb404ea90 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.480+0000 7f3e99ffb640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e8c036b40 0x7f3e8c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.480+0000 7f3e99ffb640 1 -- 172.21.15.196:0/2142808975 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3fb400e040 con 0x55c284582ea0 2024-09-21T08:53:42.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.480+0000 7f3fbc221640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e8c036b40 0x7f3e8c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fbc221640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e8c036b40 0x7f3e8c039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fac05ce90 tx=0x7f3fac086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284595f00 0x55c2845983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284598b10 con 0x55c284595f00 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284595f00 0x55c2845983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.481+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284595f00 0x55c2845983c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fa4009050 con 0x55c284595f00 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 realm 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284595350 con 0x55c284595f00 2024-09-21T08:53:42.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fa4009050 con 0x55c284595f00 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284599600 con 0x55c284595f00 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fa4009050 con 0x55c284595f00 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c284599ed0 con 0x55c284595f00 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fa4009050 con 0x55c284595f00 2024-09-21T08:53:42.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.482+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c28459a810 0x55c28459cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c28459d390 con 0x55c28459a810 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fbca22640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c28459a810 0x55c28459cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fbca22640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c28459a810 0x55c28459cc00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fc052a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:42.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fc052a800 20 searching for the correct realm 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c28459f360 0x55c2845a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.483+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fbc221640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c28459f360 0x55c2845a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fbc221640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c28459f360 0x55c2845a1820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fbc221640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3fac05c070 0x7f3fac0902c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.484+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3fac05c070 0x7f3fac0902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.485+0000 7f3fb3a20640 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3fac05c070 0x7f3fac0902c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.485+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4009050 con 0x7f3fac05c070 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.485+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.485+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.485+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4009050 con 0x55c284595f00 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.486+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x7f3fac05c070 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.487+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fa4029040 con 0x7f3fac05c070 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.488+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.489+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.490+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x7f3fac05c070 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.491+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.492+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x7f3fac05c070 2024-09-21T08:53:42.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459f360 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c28459a810 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.493+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x55c284595f00 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a1ef0 con 0x7f3fac05c070 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fa4029040 con 0x7f3fac05c070 2024-09-21T08:53:42.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c28459dd50 con 0x55c284595f00 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c28459e5f0 con 0x55c284595f00 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fa4029040 con 0x55c284595f00 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.494+0000 7f3fc052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c28459d990 con 0x55c284595f00 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 zone default found 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 4 Realm: () 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:42.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 zonegroup default 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a23b0 con 0x55c28459a810 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a4680 con 0x55c28459f360 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.495+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a4a20 con 0x55c28459f360 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 20 started sync module instance, tier type = 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.496+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a3b10 con 0x7f3fac05c070 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.497+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.497+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293932523568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a3b10 con 0x7f3fac05c070 2024-09-21T08:53:42.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.497+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a5490 con 0x55c284595f00 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.498+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293932523568] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.498+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.498+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293932527520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a3b10 con 0x55c284595f00 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.498+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a5f40 con 0x55c28459f360 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.500+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293932527520] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.500+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.500+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293932521056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a3a80 con 0x55c28459f360 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.500+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a6e00 con 0x7f3fac05c070 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.501+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.501+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293932521056] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.501+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293932534096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a6d70 con 0x7f3fac05c070 2024-09-21T08:53:42.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.501+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a7cc0 con 0x55c284595f00 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.502+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293932534096] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.502+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.502+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293932536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a7cc0 con 0x55c284595f00 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.502+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a8680 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.503+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.503+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293932540368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a8ed0 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.503+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a9910 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.504+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293932536160] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.504+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293932540368] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.505+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.505+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293932544992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a8a60 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.505+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a9fa0 con 0x55c28459a810 2024-09-21T08:53:42.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293932544992] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293932537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a9fa0 con 0x55c28459a810 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=0 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=1 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=2 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=3 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=4 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=5 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.506+0000 7f3fc052a800 20 add_watcher() i=6 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293932537872] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fc052a800 20 add_watcher() i=7 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fc052a800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845ad220 con 0x55c284595f00 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.507+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293932559248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a9fa0 con 0x55c284595f00 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.508+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293932559248] v36'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.508+0000 7f3e727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 5 note: GC not initialized 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3e717e2640 20 reqs_thread_entry: start 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 20 Filter name: none 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3de2ffd640 20 reqs_thread_entry: start 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.509+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e0710 con 0x55c284595f00 2024-09-21T08:53:42.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fc052a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fc052a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fc052a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fc052a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.510+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x55c28459a810 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.511+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call] v36'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.511+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x55c28459a810 2024-09-21T08:53:42.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.512+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(64 usage.10 [call] v36'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.513+0000 7f3e727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.513+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293932559248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x55c284595f00 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.514+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94293932559248] v36'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.514+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293932523568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x7f3fac05c070 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.515+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94293932523568] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.515+0000 7f3fc052a800 20 remove_watcher() i=0 2024-09-21T08:53:42.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.515+0000 7f3fc052a800 2 removed watcher, disabling cache 2024-09-21T08:53:42.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.515+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293932527520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x55c284595f00 2024-09-21T08:53:42.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.516+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94293932527520] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.516+0000 7f3fc052a800 20 remove_watcher() i=1 2024-09-21T08:53:42.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.516+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293932521056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845e01f0 con 0x55c28459f360 2024-09-21T08:53:42.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.517+0000 7f3fbc221640 1 -- 172.21.15.196:0/2142808975 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94293932521056] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fac099070 con 0x55c28459f360 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.517+0000 7f3fc052a800 20 remove_watcher() i=2 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.517+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293932534096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a4fa0 con 0x7f3fac05c070 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.518+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94293932534096] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x7f3fac05c070 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.518+0000 7f3fc052a800 20 remove_watcher() i=3 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.518+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293932536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a6950 con 0x55c284595f00 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.520+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94293932536160] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fa40391c0 con 0x55c284595f00 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.520+0000 7f3fc052a800 20 remove_watcher() i=4 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.520+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293932540368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a4fa0 con 0x55c28459a810 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.521+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94293932540368] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.521+0000 7f3fc052a800 20 remove_watcher() i=5 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.521+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293932544992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a7160 con 0x55c28459a810 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.522+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94293932544992] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.522+0000 7f3fc052a800 20 remove_watcher() i=6 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.522+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293932537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2845a6950 con 0x55c28459a810 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fbca22640 1 -- 172.21.15.196:0/2142808975 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94293932537872] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fb402a070 con 0x55c28459a810 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 20 remove_watcher() i=7 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c28459a810 msgr2=0x55c28459cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c28459a810 0x55c28459cc00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284595f00 msgr2=0x55c2845983c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284595f00 0x55c2845983c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3fac05c070 msgr2=0x7f3fac0902c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3fac05c070 0x7f3fac0902c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c28459f360 msgr2=0x55c2845a1820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55c28459f360 0x55c2845a1820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e8c036b40 msgr2=0x7f3e8c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e8c036b40 0x7f3e8c039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fac05ce90 tx=0x7f3fac086000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 msgr2=0x55c28458a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fb3a20640 1 -- 172.21.15.196:0/2142808975 reap_dead start 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fb404cc70 tx=0x7f3fb404cc00 comp rx=0 tx=0).stop 2024-09-21T08:53:42.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 shutdown_connections 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 --2- 172.21.15.196:0/2142808975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284582ea0 0x55c28458a1e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 >> 172.21.15.196:0/2142808975 conn(0x55c28457f250 msgr2=0x55c28457d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 shutdown_connections 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.523+0000 7f3fc052a800 1 -- 172.21.15.196:0/2142808975 wait complete. 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 msgr2=0x7f3e94039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 0x7f3e94039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55c284554980 tx=0x7f3fac008310 comp rx=0 tx=0).stop 2024-09-21T08:53:42.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 msgr2=0x55c284576690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x55c284554e30 tx=0x7f3fb4018830 comp rx=0 tx=0).stop 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 shutdown_connections 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3e94036b90 0x7f3e94039050 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/3775790492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c284576270 0x55c284576690 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 >> 172.21.15.196:0/3775790492 conn(0x55c28456b200 msgr2=0x55c28456dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 shutdown_connections 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/3775790492 wait complete. 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 msgr2=0x55c284567210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 0x55c284567210 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 msgr2=0x55c2845625c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 0x55c2845625c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 msgr2=0x7f3ea4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 0x7f3ea4039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000f60 tx=0x7f3fa40012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 msgr2=0x55c284555770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a330 tx=0x7f3fac002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 shutdown_connections 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55c284564d80 0x55c284567210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55c284461e00 0x55c2845625c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3ea4036b40 0x7f3ea4039000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 --2- 172.21.15.196:0/1265685946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c2844614c0 0x55c284555770 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 >> 172.21.15.196:0/1265685946 conn(0x55c28445cdf0 msgr2=0x55c28454a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 shutdown_connections 2024-09-21T08:53:42.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.524+0000 7f3fc052a800 1 -- 172.21.15.196:0/1265685946 wait complete. 2024-09-21T08:53:42.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-21T08:53:42.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-21T08:53:42.545 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-21T08:53:42.590 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:42.590 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.589+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.589+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.589+0000 7f9d9832c800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5612535e6990 0x5612535e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.589+0000 7f9d9832c800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612534a2b30 con 0x5612535e2550 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.589+0000 7f9d9832c800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561253484360 con 0x5612535e6990 2024-09-21T08:53:42.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d8bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5612535e6990 0x5612535e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d940b7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5612535e2550 0x5612535e2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57880/0 (socket says 172.21.15.196:57880) 2024-09-21T08:53:42.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d940b7640 1 -- 172.21.15.196:0/3799387786 learned_addr learned my addr 172.21.15.196:0/3799387786 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:42.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d8bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5612535e6990 0x5612535e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35202/0 (socket says 172.21.15.196:35202) 2024-09-21T08:53:42.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d8bfff640 1 -- 172.21.15.196:0/3799387786 >> v1:172.21.15.29:6789/0 conn(0x5612535e2550 legacy=0x5612535e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.590+0000 7f9d8bfff640 1 -- 172.21.15.196:0/3799387786 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612534aae00 con 0x5612535e6990 2024-09-21T08:53:42.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.592+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/3799387786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e6990 0x5612535e8d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00a600 tx=0x7f9d7c047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9fa1aab5e10482 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.592+0000 7f9d938b6640 1 -- 172.21.15.196:0/3799387786 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c056070 con 0x5612535e6990 2024-09-21T08:53:42.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.592+0000 7f9d938b6640 1 -- 172.21.15.196:0/3799387786 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00a200 con 0x5612535e6990 2024-09-21T08:53:42.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.592+0000 7f9d938b6640 1 -- 172.21.15.196:0/3799387786 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c008590 con 0x5612535e6990 2024-09-21T08:53:42.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 -- 172.21.15.196:0/3799387786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e6990 msgr2=0x5612535e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3799387786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e6990 0x5612535e8d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00a600 tx=0x7f9d7c047cb0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 -- 172.21.15.196:0/3799387786 shutdown_connections 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3799387786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e6990 0x5612535e8d80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 -- 172.21.15.196:0/3799387786 >> 172.21.15.196:0/3799387786 conn(0x5612535ddde0 msgr2=0x5612535e0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 -- 172.21.15.196:0/3799387786 shutdown_connections 2024-09-21T08:53:42.596 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.593+0000 7f9d9832c800 1 -- 172.21.15.196:0/3799387786 wait complete. 2024-09-21T08:53:42.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d9832c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d9832c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56125352f330 con 0x5612535e2550 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d940b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d940b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35214/0 (socket says 172.21.15.196:35214) 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.607+0000 7f9d940b7640 1 -- 172.21.15.196:0/3603135573 learned_addr learned my addr 172.21.15.196:0/3603135573 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.608+0000 7f9d940b7640 1 -- 172.21.15.196:0/3603135573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125347cbc0 con 0x5612535e2550 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.608+0000 7f9d940b7640 1 --2- 172.21.15.196:0/3603135573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001e10 tx=0x7f9d8400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a025c581cd563 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.608+0000 7f9c8260c640 1 -- 172.21.15.196:0/3603135573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d84012020 con 0x5612535e2550 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.608+0000 7f9c8260c640 1 -- 172.21.15.196:0/3603135573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8400e5a0 con 0x5612535e2550 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.608+0000 7f9c8260c640 1 -- 172.21.15.196:0/3603135573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8400e8e0 con 0x5612535e2550 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- 172.21.15.196:0/3603135573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 msgr2=0x5612536d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3603135573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001e10 tx=0x7f9d8400b780 comp rx=0 tx=0).stop 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- 172.21.15.196:0/3603135573 shutdown_connections 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3603135573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536d4a70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- 172.21.15.196:0/3603135573 >> 172.21.15.196:0/3603135573 conn(0x5612535ddde0 msgr2=0x5612536cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- 172.21.15.196:0/3603135573 shutdown_connections 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- 172.21.15.196:0/3603135573 wait complete. 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d9832c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5612535e95c0 con 0x5612535e2550 2024-09-21T08:53:42.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.609+0000 7f9d940b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d940b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35216/0 (socket says 172.21.15.196:35216) 2024-09-21T08:53:42.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d940b7640 1 -- 172.21.15.196:0/2753578053 learned_addr learned my addr 172.21.15.196:0/2753578053 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d940b7640 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561253490fe0 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d940b7640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400b7c0 tx=0x7f9d84000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9c80e09640 1 -- 172.21.15.196:0/2753578053 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d84012030 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9c80e09640 1 -- 172.21.15.196:0/2753578053 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d84001470 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9c80e09640 1 -- 172.21.15.196:0/2753578053 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8401a8d0 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612536dc990 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.610+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612536dceb0 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.611+0000 7f9c80e09640 1 -- 172.21.15.196:0/2753578053 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d84015020 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.611+0000 7f9c80e09640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 0x7f9c7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.611+0000 7f9c80e09640 1 -- 172.21.15.196:0/2753578053 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9d84020030 con 0x5612535e2550 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.611+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 0x7f9c7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 0x5612536e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612536e3a00 con 0x5612535e6990 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d948b8640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 0x5612536e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 0x7f9c7c039050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c058000 tx=0x7f9d7c00a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d948b8640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 0x5612536e34c0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d948b8640 1 -- 172.21.15.196:0/2753578053 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d8c00a4a0 con 0x5612535e6990 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.612+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612536e0a90 con 0x5612535e6990 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.613+0000 7f9d948b8640 1 -- 172.21.15.196:0/2753578053 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d8c00a4a0 con 0x5612535e6990 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.613+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 0x5612536e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.613+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612536e8830 con 0x5612536e5d50 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.613+0000 7f9d940b7640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 0x5612536e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.613+0000 7f9d940b7640 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 0x5612536e8140 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.614+0000 7f9d940b7640 1 -- 172.21.15.196:0/2753578053 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612536e5d50 2024-09-21T08:53:42.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.614+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612536e4bf0 con 0x5612535e6990 2024-09-21T08:53:42.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.614+0000 7f9d948b8640 1 -- 172.21.15.196:0/2753578053 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d8c00a4a0 con 0x5612535e6990 2024-09-21T08:53:42.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.614+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612536e5090 con 0x5612535e6990 2024-09-21T08:53:42.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.614+0000 7f9d948b8640 1 -- 172.21.15.196:0/2753578053 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d8c00a4a0 con 0x5612535e6990 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d9832c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d9832c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56125347e580 con 0x5612536f7180 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35218/0 (socket says 172.21.15.196:35218) 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d948b8640 1 -- 172.21.15.196:0/3363429746 learned_addr learned my addr 172.21.15.196:0/3363429746 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.615+0000 7f9d948b8640 1 -- 172.21.15.196:0/3363429746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612536f7ae0 con 0x5612536f7180 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9d948b8640 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x5612536e3e00 tx=0x7f9d8c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9c79ffb640 1 -- 172.21.15.196:0/3363429746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c014450 con 0x5612536f7180 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9c79ffb640 1 -- 172.21.15.196:0/3363429746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c014610 con 0x5612536f7180 2024-09-21T08:53:42.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612536f7d70 con 0x5612536f7180 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9c79ffb640 1 -- 172.21.15.196:0/3363429746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c014930 con 0x5612536f7180 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.616+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612536faa50 con 0x5612536f7180 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9c79ffb640 1 -- 172.21.15.196:0/3363429746 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d8c011040 con 0x5612536f7180 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9c79ffb640 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 0x7f9c6c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9c79ffb640 1 -- 172.21.15.196:0/3363429746 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9d8c01e070 con 0x5612536f7180 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d940b7640 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 0x7f9c6c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d940b7640 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 0x7f9c6c039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5612536e3ea0 tx=0x7f9d8404b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d9832c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d9832c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5612536d5220 con 0x561253703e00 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.617+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35232/0 (socket says 172.21.15.196:35232) 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9d948b8640 1 -- 172.21.15.196:0/1229668330 learned_addr learned my addr 172.21.15.196:0/1229668330 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9d948b8640 1 -- 172.21.15.196:0/1229668330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612537047d0 con 0x561253703e00 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9d948b8640 1 --2- 172.21.15.196:0/1229668330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c04cbd0 tx=0x7f9d8c04ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f21df351509d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9c737fe640 1 -- 172.21.15.196:0/1229668330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c043020 con 0x561253703e00 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9c737fe640 1 -- 172.21.15.196:0/1229668330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c040150 con 0x561253703e00 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9c737fe640 1 -- 172.21.15.196:0/1229668330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c016590 con 0x561253703e00 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.618+0000 7f9d9832c800 1 -- 172.21.15.196:0/1229668330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 msgr2=0x561253704200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1229668330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c04cbd0 tx=0x7f9d8c04ce80 comp rx=0 tx=0).stop 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- 172.21.15.196:0/1229668330 shutdown_connections 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1229668330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x561253704200 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- 172.21.15.196:0/1229668330 >> 172.21.15.196:0/1229668330 conn(0x5612537001b0 msgr2=0x5612536fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- 172.21.15.196:0/1229668330 shutdown_connections 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- 172.21.15.196:0/1229668330 wait complete. 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 Processor -- start 2024-09-21T08:53:42.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- start start 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x56125370b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d9832c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561253704da0 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x56125370b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d948b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x56125370b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35248/0 (socket says 172.21.15.196:35248) 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.619+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 learned_addr learned my addr 172.21.15.196:0/1206604159 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125370b830 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9d948b8640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x56125370b2f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c011dc0 tx=0x7f9d8c04cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9c71ffb640 1 -- 172.21.15.196:0/1206604159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c011c00 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9c71ffb640 1 -- 172.21.15.196:0/1206604159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c014d30 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56125370bac0 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9c71ffb640 1 -- 172.21.15.196:0/1206604159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8c04b3a0 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.620+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125370e770 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9c71ffb640 1 -- 172.21.15.196:0/1206604159 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d8c04b540 con 0x561253703e00 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9c71ffb640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c64036b40 0x7f9c64039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9c71ffb640 1 -- 172.21.15.196:0/1206604159 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9d8c00e040 con 0x561253703e00 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d940b7640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c64036b40 0x7f9c64039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561253716f50 0x561253719410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253719b60 con 0x561253716f50 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d940b7640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c64036b40 0x7f9c64039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9d84000fd0 tx=0x7f9d84033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.621+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561253716f50 0x561253719410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561253716f50 0x561253719410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 realm 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253719f90 con 0x561253716f50 2024-09-21T08:53:42.629 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371a860 con 0x561253716f50 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.622+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371ac00 con 0x561253716f50 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d9832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56125371b960 0x56125371dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371e290 con 0x56125371b960 2024-09-21T08:53:42.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d948b8640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56125371b960 0x56125371dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.631 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.623+0000 7f9d948b8640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56125371b960 0x56125371dd50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d9832c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:42.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d9832c800 20 searching for the correct realm 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5612537202c0 0x561253722780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d940b7640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5612537202c0 0x561253722780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d940b7640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5612537202c0 0x561253722780 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d940b7640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9d84017050 0x7f9d840405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.624+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9d84017050 0x7f9d840405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d8bfff640 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9d84017050 0x7f9d840405b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.625+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.626+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.627+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.628+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.629+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.630+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.631+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x5612537202c0 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.632+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x561253716f50 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561253722e50 con 0x7f9d84017050 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371ecc0 con 0x561253716f50 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.633+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371e8d0 con 0x561253716f50 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371e8a0 con 0x561253716f50 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 zone default found 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 4 Realm: () 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:42.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 zonegroup default 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56125371f5b0 con 0x56125371b960 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253725160 con 0x5612537202c0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.634+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253725500 con 0x5612537202c0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.635+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.635+0000 7f9d9832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.635+0000 7f9d9832c800 20 started sync module instance, tier type = 2024-09-21T08:53:42.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.635+0000 7f9d9832c800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.635+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537245a0 con 0x7f9d84017050 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.636+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.636+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94636709398928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537245a0 con 0x7f9d84017050 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.636+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253725dd0 con 0x561253716f50 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.637+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94636709398928] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.637+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.637+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94636709402784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537245a0 con 0x561253716f50 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.637+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253726860 con 0x5612537202c0 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.638+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94636709402784] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.638+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.638+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94636709396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253724510 con 0x5612537202c0 2024-09-21T08:53:42.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.638+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253727720 con 0x7f9d84017050 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.639+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94636709396720] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.639+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.640+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94636709409392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253727b40 con 0x7f9d84017050 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.640+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253728500 con 0x561253716f50 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.640+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94636709409392] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.641+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.641+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94636709413424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253727b40 con 0x561253716f50 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.641+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253728f10 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.642+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.642+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94636709415520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253729760 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.642+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56125372a1a0 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.642+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94636709413424] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.643+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.643+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94636709420144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56125372a160 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.643+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56125372ac30 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.643+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94636709415520] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94636709422944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56125372ac30 con 0x56125371b960 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=0 2024-09-21T08:53:42.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=1 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=2 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=3 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=4 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=5 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94636709420144] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.644+0000 7f9d9832c800 20 add_watcher() i=6 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94636709422944] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d9832c800 20 add_watcher() i=7 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d9832c800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253727690 con 0x561253716f50 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.645+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94636709417648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253727690 con 0x561253716f50 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.646+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94636709417648] v36'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9c4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 5 note: GC not initialized 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9c497e2640 20 reqs_thread_entry: start 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 20 Filter name: none 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9bbaffd640 20 reqs_thread_entry: start 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.647+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253760a20 con 0x561253716f50 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.648+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.648+0000 7f9d9832c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.648+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561253761f70 con 0x56125371b960 2024-09-21T08:53:42.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.648+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.649+0000 7f9c4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.649+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94636709417648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253736cf0 con 0x561253716f50 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.650+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94636709417648] v36'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.650+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94636709398928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537292b0 con 0x7f9d84017050 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.651+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94636709398928] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.651+0000 7f9d9832c800 20 remove_watcher() i=0 2024-09-21T08:53:42.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.651+0000 7f9d9832c800 2 removed watcher, disabling cache 2024-09-21T08:53:42.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.651+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94636709402784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537292b0 con 0x561253716f50 2024-09-21T08:53:42.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.652+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94636709402784] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.652+0000 7f9d9832c800 20 remove_watcher() i=1 2024-09-21T08:53:42.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.652+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94636709396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537258a0 con 0x5612537202c0 2024-09-21T08:53:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.653+0000 7f9d940b7640 1 -- 172.21.15.196:0/1206604159 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94636709396720] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8402dcf0 con 0x5612537202c0 2024-09-21T08:53:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.653+0000 7f9d9832c800 20 remove_watcher() i=2 2024-09-21T08:53:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.653+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94636709409392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537292b0 con 0x7f9d84017050 2024-09-21T08:53:42.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.654+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94636709409392] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x7f9d84017050 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.654+0000 7f9d9832c800 20 remove_watcher() i=3 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.654+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94636709413424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537240f0 con 0x561253716f50 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.655+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94636709413424] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d7c058030 con 0x561253716f50 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.656+0000 7f9d9832c800 20 remove_watcher() i=4 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.656+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94636709415520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253727270 con 0x56125371b960 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.657+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94636709415520] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.657+0000 7f9d9832c800 20 remove_watcher() i=5 2024-09-21T08:53:42.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.657+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94636709420144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612537292b0 con 0x56125371b960 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.658+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94636709420144] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.658+0000 7f9d9832c800 20 remove_watcher() i=6 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.658+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94636709422944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561253728230 con 0x56125371b960 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d948b8640 1 -- 172.21.15.196:0/1206604159 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94636709422944] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d8c045040 con 0x56125371b960 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 20 remove_watcher() i=7 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56125371b960 msgr2=0x56125371dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56125371b960 0x56125371dd50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561253716f50 msgr2=0x561253719410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561253716f50 0x561253719410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9d84017050 msgr2=0x7f9d840405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f9d84017050 0x7f9d840405b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5612537202c0 msgr2=0x561253722780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5612537202c0 0x561253722780 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c64036b40 msgr2=0x7f9c64039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c64036b40 0x7f9c64039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9d84000fd0 tx=0x7f9d84033000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 msgr2=0x56125370b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 --2- 172.21.15.196:0/1206604159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561253703e00 0x56125370b2f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c011dc0 tx=0x7f9d8c04cb60 comp rx=0 tx=0).stop 2024-09-21T08:53:42.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 reap_dead start 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d8bfff640 1 -- 172.21.15.196:0/1206604159 reap_dead start 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 shutdown_connections 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 >> 172.21.15.196:0/1206604159 conn(0x5612537001b0 msgr2=0x5612536fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 shutdown_connections 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/1206604159 wait complete. 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.659+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 msgr2=0x7f9c6c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 0x7f9c6c039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5612536e3ea0 tx=0x7f9d8404b030 comp rx=0 tx=0).stop 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 msgr2=0x5612536f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x5612536e3e00 tx=0x7f9d8c018830 comp rx=0 tx=0).stop 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 shutdown_connections 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c6c036b40 0x7f9c6c039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/3363429746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612536f7180 0x5612536f75a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 >> 172.21.15.196:0/3363429746 conn(0x5612536ec110 msgr2=0x5612536eec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 shutdown_connections 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/3363429746 wait complete. 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 msgr2=0x5612536e8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 0x5612536e8140 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 msgr2=0x5612536e34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 0x5612536e34c0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 msgr2=0x7f9c7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 0x7f9c7c039050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c058000 tx=0x7f9d7c00a000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 msgr2=0x5612536dc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400b7c0 tx=0x7f9d84000ed0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 shutdown_connections 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5612536e5d50 0x5612536e8140 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5612535e6990 0x5612536e34c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9c7c036b90 0x7f9c7c039050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 --2- 172.21.15.196:0/2753578053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612535e2550 0x5612536dc450 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 >> 172.21.15.196:0/2753578053 conn(0x5612535ddde0 msgr2=0x5612536ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 shutdown_connections 2024-09-21T08:53:42.672 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.660+0000 7f9d9832c800 1 -- 172.21.15.196:0/2753578053 wait complete. 2024-09-21T08:53:42.673 INFO:teuthology.orchestra.run.smithi196.stdout:{"entries":[],"summary":[]} 2024-09-21T08:53:42.673 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-21T08:53:42.673 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-21T08:53:42.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-21T08:53:42.673 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-21T08:53:42.718 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:42.719 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ef124800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556676fc9eb0 0x556677059160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ef124800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556676f15b30 con 0x5566770596a0 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ef124800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556676ef7360 con 0x556676fc9eb0 2024-09-21T08:53:42.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34eaee0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556676fc9eb0 0x556677059160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34eaee0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556676fc9eb0 0x556677059160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35262/0 (socket says 172.21.15.196:35262) 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34eaee0640 1 -- 172.21.15.196:0/2369180440 learned_addr learned my addr 172.21.15.196:0/2369180440 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.718+0000 7f34ea6df640 1 --1- 172.21.15.196:0/2369180440 >> v1:172.21.15.29:6789/0 conn(0x5566770596a0 0x55667705bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57890/0 (socket says 172.21.15.196:57890) 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.719+0000 7f34eaee0640 1 -- 172.21.15.196:0/2369180440 >> v1:172.21.15.29:6789/0 conn(0x5566770596a0 legacy=0x55667705bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.719+0000 7f34eaee0640 1 -- 172.21.15.196:0/2369180440 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556676f1de00 con 0x556676fc9eb0 2024-09-21T08:53:42.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.719+0000 7f34e9ede640 1 -- 172.21.15.196:0/2369180440 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539368468 0 0) 0x556676f15b30 con 0x5566770596a0 2024-09-21T08:53:42.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.720+0000 7f34eaee0640 1 --2- 172.21.15.196:0/2369180440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x556677059160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00a520 tx=0x7f34dc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d119c3e6a0b8509 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34e9ede640 1 -- 172.21.15.196:0/2369180440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc055070 con 0x556676fc9eb0 2024-09-21T08:53:42.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34e9ede640 1 -- 172.21.15.196:0/2369180440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc0515b0 con 0x556676fc9eb0 2024-09-21T08:53:42.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34e9ede640 1 -- 172.21.15.196:0/2369180440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc0518d0 con 0x556676fc9eb0 2024-09-21T08:53:42.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 -- 172.21.15.196:0/2369180440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 msgr2=0x556677059160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 --2- 172.21.15.196:0/2369180440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x556677059160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00a520 tx=0x7f34dc045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 -- 172.21.15.196:0/2369180440 shutdown_connections 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 --2- 172.21.15.196:0/2369180440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x556677059160 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 -- 172.21.15.196:0/2369180440 >> 172.21.15.196:0/2369180440 conn(0x556677050dd0 msgr2=0x5566770531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 -- 172.21.15.196:0/2369180440 shutdown_connections 2024-09-21T08:53:42.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.721+0000 7f34ef124800 1 -- 172.21.15.196:0/2369180440 wait complete. 2024-09-21T08:53:42.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34ef124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34ef124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556676fa2360 con 0x556676fc9eb0 2024-09-21T08:53:42.737 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34eaee0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34eaee0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35264/0 (socket says 172.21.15.196:35264) 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.735+0000 7f34eaee0640 1 -- 172.21.15.196:0/963314225 learned_addr learned my addr 172.21.15.196:0/963314225 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.736+0000 7f34eaee0640 1 -- 172.21.15.196:0/963314225 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556676eefbc0 con 0x556676fc9eb0 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.736+0000 7f34eaee0640 1 --2- 172.21.15.196:0/963314225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f34dc000c00 tx=0x7f34dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a71fe605a33b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.736+0000 7f33d8e09640 1 -- 172.21.15.196:0/963314225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc0519d0 con 0x556676fc9eb0 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.736+0000 7f33d8e09640 1 -- 172.21.15.196:0/963314225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc051b70 con 0x556676fc9eb0 2024-09-21T08:53:42.738 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.736+0000 7f33d8e09640 1 -- 172.21.15.196:0/963314225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc051e50 con 0x556676fc9eb0 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- 172.21.15.196:0/963314225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 msgr2=0x5566771456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 --2- 172.21.15.196:0/963314225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f34dc000c00 tx=0x7f34dc051000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- 172.21.15.196:0/963314225 shutdown_connections 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 --2- 172.21.15.196:0/963314225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x5566771456f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- 172.21.15.196:0/963314225 >> 172.21.15.196:0/963314225 conn(0x556677050dd0 msgr2=0x5566771410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- 172.21.15.196:0/963314225 shutdown_connections 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- 172.21.15.196:0/963314225 wait complete. 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.737+0000 7f34ef124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55667705d610 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34eaee0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34eaee0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35274/0 (socket says 172.21.15.196:35274) 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34eaee0640 1 -- 172.21.15.196:0/1890489043 learned_addr learned my addr 172.21.15.196:0/1890489043 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34eaee0640 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556676f03fe0 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34eaee0640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f34dc005570 tx=0x7f34dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f33d7606640 1 -- 172.21.15.196:0/1890489043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc073070 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f33d7606640 1 -- 172.21.15.196:0/1890489043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc05a580 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667714d4a0 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f33d7606640 1 -- 172.21.15.196:0/1890489043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc05a8a0 con 0x556676fc9eb0 2024-09-21T08:53:42.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.738+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667714da20 con 0x556676fc9eb0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.739+0000 7f33d7606640 1 -- 172.21.15.196:0/1890489043 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34dc076070 con 0x556676fc9eb0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.739+0000 7f33d7606640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 0x7f33d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.739+0000 7f33d7606640 1 -- 172.21.15.196:0/1890489043 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f34dc062070 con 0x556676fc9eb0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34ea6df640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 0x7f33d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 0x556677153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771545f0 con 0x5566770596a0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 0x556677153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34ea6df640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 0x7f33d0039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c00 tx=0x7f34e00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 0x556677153fd0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1890489043 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34e400a4a0 con 0x5566770596a0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.740+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677151580 con 0x5566770596a0 2024-09-21T08:53:42.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.741+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1890489043 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34e400a4a0 con 0x5566770596a0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.741+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 0x556677158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.741+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677159370 con 0x5566771568e0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.741+0000 7f34eaee0640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 0x556677158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.741+0000 7f34eaee0640 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 0x556677158cd0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34eaee0640 1 -- 172.21.15.196:0/1890489043 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771568e0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677155780 con 0x5566770596a0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1890489043 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34e400a4a0 con 0x5566770596a0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677155c20 con 0x5566770596a0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1890489043 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34e400a4a0 con 0x5566770596a0 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.742+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34ef124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34ef124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556676ef1580 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35288/0 (socket says 172.21.15.196:35288) 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1999273736 learned_addr learned my addr 172.21.15.196:0/1999273736 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1999273736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556677056f50 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55667714e010 tx=0x7f34e40188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.743+0000 7f33d4e01640 1 -- 172.21.15.196:0/1999273736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4014450 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.744+0000 7f33d4e01640 1 -- 172.21.15.196:0/1999273736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e40145f0 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.744+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556677055780 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.744+0000 7f33d4e01640 1 -- 172.21.15.196:0/1999273736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e40148d0 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.744+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556677055c80 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.744+0000 7f33d4e01640 1 -- 172.21.15.196:0/1999273736 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34e4011040 con 0x556677056b30 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f33d4e01640 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 0x7f33c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f33d4e01640 1 -- 172.21.15.196:0/1999273736 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f34e401e070 con 0x556677056b30 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34eaee0640 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 0x7f33c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34eaee0640 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 0x7f33c4039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556677154a20 tx=0x7f34dc00a2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34ef124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34ef124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556677145de0 con 0x556677176ba0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35302/0 (socket says 172.21.15.196:35302) 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.745+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1023679703 learned_addr learned my addr 172.21.15.196:0/1023679703 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34eb6e1640 1 -- 172.21.15.196:0/1023679703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566771774e0 con 0x556677176ba0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/1023679703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f34e404cb90 tx=0x7f34e4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db90bcd2889ad2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f33ce7fc640 1 -- 172.21.15.196:0/1023679703 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4044070 con 0x556677176ba0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f33ce7fc640 1 -- 172.21.15.196:0/1023679703 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e4013c90 con 0x556677176ba0 2024-09-21T08:53:42.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f33ce7fc640 1 -- 172.21.15.196:0/1023679703 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e402ba60 con 0x556677176ba0 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 -- 172.21.15.196:0/1023679703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 msgr2=0x556677176fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 --2- 172.21.15.196:0/1023679703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f34e404cb90 tx=0x7f34e4011700 comp rx=0 tx=0).stop 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 -- 172.21.15.196:0/1023679703 shutdown_connections 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 --2- 172.21.15.196:0/1023679703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x556677176fa0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 -- 172.21.15.196:0/1023679703 >> 172.21.15.196:0/1023679703 conn(0x556677172f50 msgr2=0x556677171050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 -- 172.21.15.196:0/1023679703 shutdown_connections 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.746+0000 7f34ef124800 1 -- 172.21.15.196:0/1023679703 wait complete. 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34ef124800 1 Processor -- start 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34ef124800 1 -- start start 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34ef124800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34ef124800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556677177b80 con 0x556677176ba0 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34eb6e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35318/0 (socket says 172.21.15.196:35318) 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 learned_addr learned my addr 172.21.15.196:0/355658628 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.752 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667717e4c0 con 0x556677176ba0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.747+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f34e402f040 tx=0x7f34e404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f33ccff9640 1 -- 172.21.15.196:0/355658628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e402b560 con 0x556677176ba0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f33ccff9640 1 -- 172.21.15.196:0/355658628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e402b700 con 0x556677176ba0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55667717e750 con 0x556677176ba0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f33ccff9640 1 -- 172.21.15.196:0/355658628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e404e070 con 0x556677176ba0 2024-09-21T08:53:42.753 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556677181400 con 0x556677176ba0 2024-09-21T08:53:42.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.748+0000 7f33ccff9640 1 -- 172.21.15.196:0/355658628 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f34e403e020 con 0x556677176ba0 2024-09-21T08:53:42.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f33ccff9640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33b4036b40 0x7f33b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f33ccff9640 1 -- 172.21.15.196:0/355658628 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f34e403c020 con 0x556677176ba0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34eaee0640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33b4036b40 0x7f33b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34eaee0640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33b4036b40 0x7f33b4039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556677159770 tx=0x7f34dc097000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556677189cf0 0x55667718c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55667718c900 con 0x556677189cf0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.749+0000 7f34ea6df640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556677189cf0 0x55667718c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ea6df640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556677189cf0 0x55667718c1b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34e000f5a0 con 0x556677189cf0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 realm 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677189140 con 0x556677189cf0 2024-09-21T08:53:42.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34e000f5a0 con 0x556677189cf0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55667718d3f0 con 0x556677189cf0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34e000f5a0 con 0x556677189cf0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.750+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55667718dcc0 con 0x556677189cf0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34e000f5a0 con 0x556677189cf0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55667718e6e0 0x556677190ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677191240 con 0x55667718e6e0 2024-09-21T08:53:42.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55667718e6e0 0x556677190ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.751+0000 7f34eb6e1640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55667718e6e0 0x556677190ad0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34ef124800 20 searching for the correct realm 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566771931f0 0x5566771956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eaee0640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566771931f0 0x5566771956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eaee0640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566771931f0 0x5566771956b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eaee0640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f34dc0a8040 0x7f34dc068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.752+0000 7f34ea6df640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f34dc0a8040 0x7f34dc068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.753+0000 7f34ea6df640 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f34dc0a8040 0x7f34dc068120 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.753+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e000f5a0 con 0x7f34dc0a8040 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.753+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.753+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.753+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e000f5a0 con 0x556677189cf0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.754+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.755+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.756+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.757+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.758+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.759+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x5566771931f0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x55667718e6e0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.760+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x556677189cf0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556677195d80 con 0x7f34dc0a8040 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:42.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677191c00 con 0x556677189cf0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677191840 con 0x556677189cf0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.761+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771925a0 con 0x556677189cf0 2024-09-21T08:53:42.774 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 zone default found 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 4 Realm: () 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 zonegroup default 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677196200 con 0x55667718e6e0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771984b0 con 0x5566771931f0 2024-09-21T08:53:42.775 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.762+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677198850 con 0x5566771931f0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.763+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.763+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.763+0000 7f34ef124800 20 started sync module instance, tier type = 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.763+0000 7f34ef124800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.763+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556677197940 con 0x7f34dc0a8040 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.764+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.764+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898573184656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556677197940 con 0x7f34dc0a8040 2024-09-21T08:53:42.776 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.764+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556677199260 con 0x556677189cf0 2024-09-21T08:53:42.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.765+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898573184656] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.765+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.765+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898573182096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556677199260 con 0x556677189cf0 2024-09-21T08:53:42.780 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.765+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556677199c90 con 0x5566771931f0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.766+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.766+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898573191072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719a520 con 0x5566771931f0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.766+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719aff0 con 0x7f34dc0a8040 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.767+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898573182096] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.767+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898573191072] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.767+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.767+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898573196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719a030 con 0x7f34dc0a8040 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.767+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719b8c0 con 0x556677189cf0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.768+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898573196000] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.768+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.769+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898573188528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719b870 con 0x556677189cf0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.769+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719c2d0 con 0x55667718e6e0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.770+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.781 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.770+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898573200928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719c6f0 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.770+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719d1e0 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.770+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898573188528] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.771+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898573200928] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.771+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.771+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898573204656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719c240 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.771+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719da80 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898573204656] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898573198272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719c240 con 0x55667718e6e0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=0 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=1 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=2 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=3 2024-09-21T08:53:42.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=4 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=5 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.772+0000 7f34ef124800 20 add_watcher() i=6 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898573198272] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34ef124800 20 add_watcher() i=7 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34ef124800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771a0b60 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.773+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898573206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55667719e0b0 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.774+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898573206752] v36'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.774+0000 7f33a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.774+0000 7f34ef124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.774+0000 7f34ef124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.775+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771a9640 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.776+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.776+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771a9c90 con 0x55667718e6e0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.777+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.777+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771a9c90 con 0x5566771931f0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.778+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.778+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771aa5a0 con 0x556677189cf0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.779+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.779+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771a5310 con 0x7f34dc0a8040 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.780+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.780+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771a5310 con 0x5566771931f0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.781+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.781+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x556677189cf0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.782+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.782+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x55667718e6e0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.783+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.783+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x7f34dc0a8040 2024-09-21T08:53:42.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.784+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.784+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x5566771931f0 2024-09-21T08:53:42.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.785+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.785+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x7f34dc0a8040 2024-09-21T08:53:42.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.786+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.786+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab550 con 0x55667718e6e0 2024-09-21T08:53:42.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.787+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.787+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x7f34dc0a8040 2024-09-21T08:53:42.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.788+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.788+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x55667718e6e0 2024-09-21T08:53:42.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.790+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.790+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x556677189cf0 2024-09-21T08:53:42.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.791+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.791+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.792+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.792+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x7f34dc0a8040 2024-09-21T08:53:42.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.793+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.793+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.794+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.794+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x556677189cf0 2024-09-21T08:53:42.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.795+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.795+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x556677189cf0 2024-09-21T08:53:42.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.796+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.796+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.797+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.797+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x7f34dc0a8040 2024-09-21T08:53:42.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.798+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.798+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.799+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.799+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.800+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.800+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.801+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.801+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.802+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.802+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x55667718e6e0 2024-09-21T08:53:42.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.804+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.804+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.805+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.805+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x55667718e6e0 2024-09-21T08:53:42.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.806+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.806+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x5566771931f0 2024-09-21T08:53:42.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.807+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.807+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x55667718e6e0 2024-09-21T08:53:42.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.809+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.809+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ab570 con 0x7f34dc0a8040 2024-09-21T08:53:42.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.810+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.810+0000 7f331bfff640 20 reqs_thread_entry: start 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 20 Filter name: none 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f3319ffb640 20 reqs_thread_entry: start 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771d6900 con 0x556677189cf0 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=391 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771d68e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 : miss 2024-09-21T08:53:42.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.811+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:96 8.1f 8:f9868a10:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771d8e60 con 0x7f34dc0a8040 2024-09-21T08:53:42.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(96 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=379 2024-09-21T08:53:42.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 info.flags=0x17 2024-09-21T08:53:42.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 to cache LRU end 2024-09-21T08:53:42.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 4.1d 4:b910424d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566772565d0 con 0x5566771931f0 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(97 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.812+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 4.12 4:4b2810d5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256610 con 0x556677189cf0 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(98 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:99 4.f 4:f27a981e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256610 con 0x556677189cf0 2024-09-21T08:53:42.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(99 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:100 4.1b 4:d9058341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256610 con 0x7f34dc0a8040 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(100 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.813+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256610 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(101 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34ef124800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:102 4.36 4:6cb19ef7:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x556677189cf0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(102 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:103 4.25 4:a7949635:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(103 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.814+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:104 4.8 4:12de6291:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(104 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc07f070 con 0x5566771931f0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:105 4.11 4:88e05bf5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x55667718e6e0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(105 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:106 4.2f 4:f40d54bc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x556677189cf0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(106 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.815+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:107 4.39 4:9ebcfcaf:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677256b70 con 0x5566771931f0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(107 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 20 get_obj_state: octx=0x7f34e402d430 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556677254828 s->prefetch_data=0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:108 3.7s0 3:e2289f5e:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556677255770 con 0x5566771931f0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(108 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 10 manifest: total_size = 6 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 20 get_obj_state: setting s->obj_tag to 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.6593006285079278732 2024-09-21T08:53:42.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 20 get_obj_state: octx=0x7f34e402d430 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556677254828 s->prefetch_data=0 2024-09-21T08:53:42.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 20 prepare_atomic_modification: state is not atomic. state=0x556677254828 2024-09-21T08:53:42.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 20 bucket index object: :.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 2024-09-21T08:53:42.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.816+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:109 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771dd560 con 0x5566771931f0 2024-09-21T08:53:42.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.817+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(109 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.817+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:110 3.7s0 3:e2289f5e:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771db540 con 0x5566771931f0 2024-09-21T08:53:42.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.818+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(110 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7_15f6f8dc036519d7fe15b39338f6e5db [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.818+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:111 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771ddb40 con 0x5566771931f0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.818+0000 7f34ef124800 20 list_objects_ordered: starting attempt 1 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.818+0000 7f34ef124800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.818+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:112 4.1d 4:b910424d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771ddb20 con 0x5566771931f0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:113 4.12 4:4b2810d5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e1e00 con 0x556677189cf0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:114 4.f 4:f27a981e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771ddb20 con 0x556677189cf0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:115 4.1b 4:d9058341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x7f34dc0a8040 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:116 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e9750 con 0x5566771931f0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(114 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:117 4.36 4:6cb19ef7:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x556677189cf0 2024-09-21T08:53:42.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(113 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(112 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:118 4.25 4:a7949635:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e3820 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:119 4.8 4:12de6291:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e3820 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(115 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:120 4.11 4:88e05bf5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x55667718e6e0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:121 4.2f 4:f40d54bc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771ed030 con 0x556677189cf0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.819+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:122 4.39 4:9ebcfcaf:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(118 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(120 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(117 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(121 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(122 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(119 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(111 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f33ce7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(116 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7])"; uploads.size()=0; is_truncated=0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:123 4.1d 4:b910424d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x5566771931f0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:124 4.12 4:4b2810d5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e3260 con 0x556677189cf0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:125 4.f 4:f27a981e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x556677189cf0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:126 4.1b 4:d9058341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771ec000 con 0x7f34dc0a8040 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:127 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771df480 con 0x5566771931f0 2024-09-21T08:53:42.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:128 4.36 4:6cb19ef7:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x556677189cf0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:129 4.25 4:a7949635:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e1d80 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:130 4.8 4:12de6291:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771dceb0 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:131 4.11 4:88e05bf5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771f0980 con 0x55667718e6e0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:132 4.2f 4:f40d54bc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771f34d0 con 0x556677189cf0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.820+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:133 4.39 4:9ebcfcaf:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771f6240 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(123 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(124 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(125 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(126 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(127 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(130 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(133 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(131 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(129 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(132 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(128 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.821+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x7f34dc0a8040 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.822+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(134 foo.buckets [call] v36'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.822+0000 7f34ef124800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.822+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.822+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e6e60 con 0x7f34dc0a8040 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.823+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.823+0000 7f34ef124800 20 rados_obj.operate() r=0 bl.length=165 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.823+0000 7f34ef124800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.823+0000 7f34ef124800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-21T08:53:42.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.823+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771f34d0 con 0x7f34dc0a8040 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(136 myfoo [call,call,delete] v36'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34ef124800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93898573961936 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771f34d0 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== watch-notify(notify (1) cookie 93898573204656 notify 154618822697 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5566771abce0 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(137 notify.6 [notify cookie 93898573961936 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f33cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822697 cookie 93898573204656 notifier 4790 bl.length()=149 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f33cdffb640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f33200032c0 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== watch-notify(notify_complete (2) cookie 93898573961936 notify 154618822697 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55667717e750 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.824+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:139 8.1f 8:f9868a10:root::.bucket.meta.myfoo%3a6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.825+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(139 .bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 [call,call,delete] v36'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.825+0000 7f34ef124800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 from cache 2024-09-21T08:53:42.836 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.825+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7, ofs0, ns] 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.825+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 93898573961904 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== watch-notify(notify (1) cookie 93898573200928 notify 154618822698 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55667717e750 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f33cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822698 cookie 93898573200928 notifier 4790 bl.length()=206 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f33cdffb640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f33200032c0 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(140 notify.5 [notify cookie 93898573961904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== watch-notify(notify_complete (2) cookie 93898573961904 notify 154618822698 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55667717e4c0 con 0x55667718e6e0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:142 4.1d 4:b910424d:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x5566771931f0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:143 4.12 4:4b2810d5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771f5bf0 con 0x556677189cf0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:144 4.f 4:f27a981e:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771d7830 con 0x556677189cf0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:145 4.1b 4:d9058341:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:146 4.d 4:b1fe3965:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771f5bf0 con 0x5566771931f0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:147 4.36 4:6cb19ef7:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771d7830 con 0x556677189cf0 2024-09-21T08:53:42.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:148 4.25 4:a7949635:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771f5bf0 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:149 4.8 4:12de6291:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:150 4.11 4:88e05bf5:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771d7830 con 0x55667718e6e0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:151 4.2f 4:f40d54bc:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771f5bf0 con 0x556677189cf0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.826+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:152 4.39 4:9ebcfcaf:::.dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771d7830 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(145 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.3 [delete] v36'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(152 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.10 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(148 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.6 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(151 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.9 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(142 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.0 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.828+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(150 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.8 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(149 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.7 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(143 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(144 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.2 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(147 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.5 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 49 ==== osd_op_reply(146 .dir.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7.4 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ef124800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 : miss 2024-09-21T08:53:42.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ef124800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.830+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:153 6.f 6:f18381e1:::pubsub..bucket.myfoo%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.831+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(153 pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.831+0000 7f34ef124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.831+0000 7f34ef124800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 info.flags=0x0 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.831+0000 7f34ef124800 10 adding default.rgw.log++pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 to cache LRU end 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.831+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:154 6.f 6:f18381e1:::pubsub..bucket.myfoo%2f6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.832+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(154 pubsub..bucket.myfoo/6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.7 [delete] v36'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.832+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.833+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(155 foo.buckets [call] v36'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.833+0000 7f34ef124800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.833+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.834+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v36'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.834+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-21T08:53:42.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.834+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93898573470368 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== watch-notify(notify (1) cookie 93898573196000 notify 154618822685 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5566771d8390 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f33cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 93898573196000 notifier 4790 bl.length()=170 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f33cdffb640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3320002e50 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(157 notify.3 [notify cookie 93898573470368 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== watch-notify(notify_complete (2) cookie 93898573470368 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566771a4c40 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ef124800 10 removing email index: foo@foo.com 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.835+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(159 foo@foo.com [delete] v36'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93898573470368 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== watch-notify(notify (1) cookie 93898573196000 notify 154618822686 ret 0) ==== 204+0+0 (crc 0 0 0) 0x5566771a4c40 con 0x7f34dc0a8040 2024-09-21T08:53:42.847 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f33ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 93898573196000 notifier 4790 bl.length()=162 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(160 notify.3 [notify cookie 93898573470368 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f33ce7fc640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f33b0003d60 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.836+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== watch-notify(notify_complete (2) cookie 93898573470368 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566771a9180 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.837+0000 7f34ef124800 10 removing user buckets index 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.837+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(162 foo.buckets [delete] v36'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93898573470368 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== watch-notify(notify (1) cookie 93898573200928 notify 154618822699 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55667717e4c0 con 0x55667718e6e0 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f33cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822699 cookie 93898573200928 notifier 4790 bl.length()=160 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f33cdffb640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3320003300 con 0x55667718e6e0 2024-09-21T08:53:42.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.838+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(163 notify.5 [notify cookie 93898573470368 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.839+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== watch-notify(notify_complete (2) cookie 93898573470368 notify 154618822699 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566771774e0 con 0x55667718e6e0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.839+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.839+0000 7f34ef124800 10 removing user index: foo 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.839+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(165 foo [call,call,delete] v36'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ef124800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ef124800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93898573470368 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== watch-notify(notify (1) cookie 93898573188528 notify 154618822678 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5566771a9180 con 0x556677189cf0 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f33ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 93898573188528 notifier 4790 bl.length()=152 2024-09-21T08:53:42.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f33ce7fc640 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f33b0003d60 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(166 notify.4 [notify cookie 93898573470368 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 49 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.840+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 50 ==== watch-notify(notify_complete (2) cookie 93898573470368 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566771a8fb0 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.841+0000 7f33a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.841+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898573206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.842+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 51 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93898573206752] v36'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.842+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898573184656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.843+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93898573184656] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.843+0000 7f34ef124800 20 remove_watcher() i=0 2024-09-21T08:53:42.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.843+0000 7f34ef124800 2 removed watcher, disabling cache 2024-09-21T08:53:42.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.843+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898573182096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.844+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 52 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93898573182096] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.844+0000 7f34ef124800 20 remove_watcher() i=1 2024-09-21T08:53:42.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.844+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898573191072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x5566771931f0 2024-09-21T08:53:42.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.845+0000 7f34eaee0640 1 -- 172.21.15.196:0/355658628 <== osd.3 v2:172.21.15.196:6800/127179937 50 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93898573191072] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34dc0b5060 con 0x5566771931f0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.845+0000 7f34ef124800 20 remove_watcher() i=2 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.845+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898573196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x7f34dc0a8040 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.846+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93898573196000] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x7f34dc0a8040 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.846+0000 7f34ef124800 20 remove_watcher() i=3 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.846+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898573188528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x556677189cf0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.847+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 <== osd.1 v2:172.21.15.196:6808/2855083704 53 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93898573188528] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e002b040 con 0x556677189cf0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.847+0000 7f34ef124800 20 remove_watcher() i=4 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.847+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898573200928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.848+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93898573200928] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.848+0000 7f34ef124800 20 remove_watcher() i=5 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.848+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898573204656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.849+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93898573204656] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.849+0000 7f34ef124800 20 remove_watcher() i=6 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.849+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898573198272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566771e39e0 con 0x55667718e6e0 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34eb6e1640 1 -- 172.21.15.196:0/355658628 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93898573198272] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e402a070 con 0x55667718e6e0 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 20 remove_watcher() i=7 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55667718e6e0 msgr2=0x556677190ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55667718e6e0 0x556677190ad0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556677189cf0 msgr2=0x55667718c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x556677189cf0 0x55667718c1b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f34dc0a8040 msgr2=0x7f34dc068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f34dc0a8040 0x7f34dc068120 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566771931f0 msgr2=0x5566771956b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566771931f0 0x5566771956b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33b4036b40 msgr2=0x7f33b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33b4036b40 0x7f33b4039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556677159770 tx=0x7f34dc097000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 msgr2=0x55667717df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ea6df640 1 -- 172.21.15.196:0/355658628 reap_dead start 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f34e402f040 tx=0x7f34e404cb20 comp rx=0 tx=0).stop 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 shutdown_connections 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 --2- 172.21.15.196:0/355658628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677176ba0 0x55667717df80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.850+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 >> 172.21.15.196:0/355658628 conn(0x556677172f50 msgr2=0x5566771782e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 shutdown_connections 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/355658628 wait complete. 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 msgr2=0x7f33c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 0x7f33c4039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x556677154a20 tx=0x7f34dc00a2c0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 msgr2=0x556677055180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55667714e010 tx=0x7f34e40188f0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 shutdown_connections 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33c4036b40 0x7f33c4039000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1999273736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556677056b30 0x556677055180 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 >> 172.21.15.196:0/1999273736 conn(0x55667715cc90 msgr2=0x55667715f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 shutdown_connections 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1999273736 wait complete. 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 msgr2=0x556677158cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 0x556677158cd0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 msgr2=0x556677153fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 0x556677153fd0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 msgr2=0x7f33d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 0x7f33d0039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c00 tx=0x7f34e00013b0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 msgr2=0x55667714cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f34dc005570 tx=0x7f34dc002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 shutdown_connections 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566771568e0 0x556677158cd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566770596a0 0x556677153fd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f33d0036b90 0x7f33d0039050 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 --2- 172.21.15.196:0/1890489043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556676fc9eb0 0x55667714cf60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.851+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 >> 172.21.15.196:0/1890489043 conn(0x556677050dd0 msgr2=0x55667713f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.852+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 shutdown_connections 2024-09-21T08:53:42.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.852+0000 7f34ef124800 1 -- 172.21.15.196:0/1890489043 wait complete. 2024-09-21T08:53:42.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-21T08:53:42.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-21T08:53:42.862 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-21T08:53:42.906 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:42.906 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:42.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.905+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.905+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.905+0000 7f87fca0e800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ce4b6b5900 0x55ce4b6b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.905+0000 7f87fca0e800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce4b570b30 con 0x55ce4b624df0 2024-09-21T08:53:42.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.905+0000 7f87fca0e800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ce4b552360 con 0x55ce4b6b5900 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87effff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ce4b6b5900 0x55ce4b6b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87f811a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ce4b624df0 0x55ce4b6b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57896/0 (socket says 172.21.15.196:57896) 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87f811a640 1 -- 172.21.15.196:0/2257162486 learned_addr learned my addr 172.21.15.196:0/2257162486 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87f7919640 1 -- 172.21.15.196:0/2257162486 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186746355 0 0) 0x55ce4b570b30 con 0x55ce4b624df0 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87f7919640 1 -- 172.21.15.196:0/2257162486 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e4001e10 con 0x55ce4b624df0 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87effff640 1 -- 172.21.15.196:0/2257162486 >> v1:172.21.15.29:6789/0 conn(0x55ce4b624df0 legacy=0x55ce4b6b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.906+0000 7f87effff640 1 -- 172.21.15.196:0/2257162486 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b578e00 con 0x55ce4b6b5900 2024-09-21T08:53:42.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.908+0000 7f87effff640 1 --2- 172.21.15.196:0/2257162486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b5900 0x55ce4b6b7cf0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f87e000a470 tx=0x7f87e0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32866e656592ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.908+0000 7f87f7919640 1 -- 172.21.15.196:0/2257162486 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e0059070 con 0x55ce4b6b5900 2024-09-21T08:53:42.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.908+0000 7f87f7919640 1 -- 172.21.15.196:0/2257162486 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e0054570 con 0x55ce4b6b5900 2024-09-21T08:53:42.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.908+0000 7f87f7919640 1 -- 172.21.15.196:0/2257162486 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e0054850 con 0x55ce4b6b5900 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 -- 172.21.15.196:0/2257162486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b5900 msgr2=0x55ce4b6b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 --2- 172.21.15.196:0/2257162486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b5900 0x55ce4b6b7cf0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f87e000a470 tx=0x7f87e0045920 comp rx=0 tx=0).stop 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 -- 172.21.15.196:0/2257162486 shutdown_connections 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 --2- 172.21.15.196:0/2257162486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b5900 0x55ce4b6b7cf0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 -- 172.21.15.196:0/2257162486 >> 172.21.15.196:0/2257162486 conn(0x55ce4b6abdf0 msgr2=0x55ce4b6ae210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 -- 172.21.15.196:0/2257162486 shutdown_connections 2024-09-21T08:53:42.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.909+0000 7f87fca0e800 1 -- 172.21.15.196:0/2257162486 wait complete. 2024-09-21T08:53:42.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.922+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.922+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.922+0000 7f87fca0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.922+0000 7f87fca0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ce4b5fd330 con 0x55ce4b624df0 2024-09-21T08:53:42.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f87f811a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f87f811a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35340/0 (socket says 172.21.15.196:35340) 2024-09-21T08:53:42.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f87f811a640 1 -- 172.21.15.196:0/1937239994 learned_addr learned my addr 172.21.15.196:0/1937239994 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f87f811a640 1 -- 172.21.15.196:0/1937239994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b54abc0 con 0x55ce4b624df0 2024-09-21T08:53:42.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f87f811a640 1 --2- 172.21.15.196:0/1937239994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f87e8001db0 tx=0x7f87e800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6515e6556d6020b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f86e660c640 1 -- 172.21.15.196:0/1937239994 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e8012020 con 0x55ce4b624df0 2024-09-21T08:53:42.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f86e660c640 1 -- 172.21.15.196:0/1937239994 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e800e5a0 con 0x55ce4b624df0 2024-09-21T08:53:42.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.923+0000 7f86e660c640 1 -- 172.21.15.196:0/1937239994 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e800e940 con 0x55ce4b624df0 2024-09-21T08:53:42.927 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 -- 172.21.15.196:0/1937239994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 msgr2=0x55ce4b7a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 --2- 172.21.15.196:0/1937239994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f87e8001db0 tx=0x7f87e800b6c0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 -- 172.21.15.196:0/1937239994 shutdown_connections 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 --2- 172.21.15.196:0/1937239994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a0650 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 -- 172.21.15.196:0/1937239994 >> 172.21.15.196:0/1937239994 conn(0x55ce4b6abdf0 msgr2=0x55ce4b79c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 -- 172.21.15.196:0/1937239994 shutdown_connections 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 -- 172.21.15.196:0/1937239994 wait complete. 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.924+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87fca0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87fca0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ce4b6b85f0 con 0x55ce4b624df0 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87f811a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87f811a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35348/0 (socket says 172.21.15.196:35348) 2024-09-21T08:53:42.928 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87f811a640 1 -- 172.21.15.196:0/600052073 learned_addr learned my addr 172.21.15.196:0/600052073 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87f811a640 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b55efe0 con 0x55ce4b624df0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.925+0000 7f87f811a640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7a14b0 tx=0x7f87e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f86e4e09640 1 -- 172.21.15.196:0/600052073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e8012030 con 0x55ce4b624df0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f86e4e09640 1 -- 172.21.15.196:0/600052073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e8001430 con 0x55ce4b624df0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4b7a85b0 con 0x55ce4b624df0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f86e4e09640 1 -- 172.21.15.196:0/600052073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e801a8a0 con 0x55ce4b624df0 2024-09-21T08:53:42.929 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4b7a8ad0 con 0x55ce4b624df0 2024-09-21T08:53:42.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.926+0000 7f86e4e09640 1 -- 172.21.15.196:0/600052073 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87e8015020 con 0x55ce4b624df0 2024-09-21T08:53:42.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f86e4e09640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 0x7f86e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f86e4e09640 1 -- 172.21.15.196:0/600052073 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f87e8020030 con 0x55ce4b624df0 2024-09-21T08:53:42.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87effff640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 0x7f86e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 0x55ce4b7af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7af620 con 0x55ce4b6b5900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87f891b640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 0x55ce4b7af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87effff640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 0x7f86e0039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ce4b624530 tx=0x7f87e0050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87f891b640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 0x55ce4b7af0e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87f891b640 1 -- 172.21.15.196:0/600052073 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87f000a4a0 con 0x55ce4b6b5900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.927+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ac660 con 0x55ce4b6b5900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.928+0000 7f87f891b640 1 -- 172.21.15.196:0/600052073 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87f000a4a0 con 0x55ce4b6b5900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.928+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 0x55ce4b7b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.928+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7b4390 con 0x55ce4b7b1900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.928+0000 7f87f811a640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 0x55ce4b7b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.928+0000 7f87f811a640 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 0x55ce4b7b3cf0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87f811a640 1 -- 172.21.15.196:0/600052073 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7b1900 2024-09-21T08:53:42.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7b07a0 con 0x55ce4b6b5900 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87f891b640 1 -- 172.21.15.196:0/600052073 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87f000a4a0 con 0x55ce4b6b5900 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7b0c10 con 0x55ce4b6b5900 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87f891b640 1 -- 172.21.15.196:0/600052073 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87f000a4a0 con 0x55ce4b6b5900 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.929+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87fca0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87fca0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ce4b54c580 con 0x55ce4b7c2d90 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35354/0 (socket says 172.21.15.196:35354) 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87f891b640 1 -- 172.21.15.196:0/3476524276 learned_addr learned my addr 172.21.15.196:0/3476524276 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87f891b640 1 -- 172.21.15.196:0/3476524276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b7c36f0 con 0x55ce4b7c2d90 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f87f891b640 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7afa00 tx=0x7f87f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f86ddffb640 1 -- 172.21.15.196:0/3476524276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0014450 con 0x55ce4b7c2d90 2024-09-21T08:53:42.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.930+0000 7f86ddffb640 1 -- 172.21.15.196:0/3476524276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0014610 con 0x55ce4b7c2d90 2024-09-21T08:53:42.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4b7c3980 con 0x55ce4b7c2d90 2024-09-21T08:53:42.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f86ddffb640 1 -- 172.21.15.196:0/3476524276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0014930 con 0x55ce4b7c2d90 2024-09-21T08:53:42.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4b7c6660 con 0x55ce4b7c2d90 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f86ddffb640 1 -- 172.21.15.196:0/3476524276 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87f0011040 con 0x55ce4b7c2d90 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f86ddffb640 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 0x7f86d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.931+0000 7f86ddffb640 1 -- 172.21.15.196:0/3476524276 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f87f001e070 con 0x55ce4b7c2d90 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87f811a640 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 0x7f86d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87f811a640 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 0x7f86d0039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7afa70 tx=0x7f87e804af30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87fca0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87fca0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ce4b7a0e00 con 0x55ce4b6b1410 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35366/0 (socket says 172.21.15.196:35366) 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.932+0000 7f87f891b640 1 -- 172.21.15.196:0/2951020663 learned_addr learned my addr 172.21.15.196:0/2951020663 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87f891b640 1 -- 172.21.15.196:0/2951020663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b6b1de0 con 0x55ce4b6b1410 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87f891b640 1 --2- 172.21.15.196:0/2951020663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f87f004cb80 tx=0x7f87f003df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6237fa6d098234b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f86d77fe640 1 -- 172.21.15.196:0/2951020663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0028040 con 0x55ce4b6b1410 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f86d77fe640 1 -- 172.21.15.196:0/2951020663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0013c90 con 0x55ce4b6b1410 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f86d77fe640 1 -- 172.21.15.196:0/2951020663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0013e40 con 0x55ce4b6b1410 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 -- 172.21.15.196:0/2951020663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 msgr2=0x55ce4b6b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 --2- 172.21.15.196:0/2951020663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f87f004cb80 tx=0x7f87f003df80 comp rx=0 tx=0).stop 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 -- 172.21.15.196:0/2951020663 shutdown_connections 2024-09-21T08:53:42.943 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 --2- 172.21.15.196:0/2951020663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b6b1810 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 -- 172.21.15.196:0/2951020663 >> 172.21.15.196:0/2951020663 conn(0x55ce4b7cbd00 msgr2=0x55ce4b7c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 -- 172.21.15.196:0/2951020663 shutdown_connections 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.933+0000 7f87fca0e800 1 -- 172.21.15.196:0/2951020663 wait complete. 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87fca0e800 1 Processor -- start 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87fca0e800 1 -- start start 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87fca0e800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87fca0e800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ce4b6b0140 con 0x55ce4b6b1410 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87f891b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35372/0 (socket says 172.21.15.196:35372) 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 learned_addr learned my addr 172.21.15.196:0/3962248309 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4b7d95a0 con 0x55ce4b6b1410 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.934+0000 7f87f891b640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f87f0014f70 tx=0x7f87f004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f86d5ffb640 1 -- 172.21.15.196:0/3962248309 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0044030 con 0x55ce4b6b1410 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f86d5ffb640 1 -- 172.21.15.196:0/3962248309 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0031030 con 0x55ce4b6b1410 2024-09-21T08:53:42.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f86d5ffb640 1 -- 172.21.15.196:0/3962248309 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0028040 con 0x55ce4b6b1410 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4b7d9830 con 0x55ce4b6b1410 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4b7dc4e0 con 0x55ce4b6b1410 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.935+0000 7f86d5ffb640 1 -- 172.21.15.196:0/3962248309 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87f0022c90 con 0x55ce4b6b1410 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f86d5ffb640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86c8036b40 0x7f86c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f86d5ffb640 1 -- 172.21.15.196:0/3962248309 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f87f0045070 con 0x55ce4b6b1410 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87f811a640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86c8036b40 0x7f86c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b7e4cf0 0x55ce4b7e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7e7900 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87f811a640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86c8036b40 0x7f86c8039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87e801a6a0 tx=0x7f87e8038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.936+0000 7f87effff640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b7e4cf0 0x55ce4b7e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87effff640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b7e4cf0 0x55ce4b7e71b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.945 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 realm 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7e7d30 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7e8600 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.937+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7e89a0 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.946 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7e9700 0x55ce4b7ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ec030 con 0x55ce4b7e9700 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87f891b640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7e9700 0x55ce4b7ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87f891b640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7e9700 0x55ce4b7ebaf0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 20 searching for the correct realm 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ce4b7ee0a0 0x55ce4b7f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.938+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87f811a640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ce4b7ee0a0 0x55ce4b7f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87f811a640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ce4b7ee0a0 0x55ce4b7f0560 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.947 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87f811a640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f87e804c040 0x7f87e804c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x7f87e804c040 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87effff640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f87e804c040 0x7f87e804c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.939+0000 7f87effff640 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f87e804c040 0x7f87e804c420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7e9700 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.940+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.948 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f0c30 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x7f87e804c040 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.941+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.942+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x7f87e804c040 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.943+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.958 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.944+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x7f87e804c040 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.959 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.945+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x7f87e804c040 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.946+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e9700 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f87f005d040 con 0x7f87e804c040 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.960 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ecad0 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.947+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ecf20 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:42.961 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ecef0 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 zone default found 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 4 Realm: () 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 zonegroup default 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7ed390 con 0x55ce4b7e9700 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.962 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f2f40 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.948+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f32e0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 20 started sync module instance, tier type = 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.949+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f2380 con 0x7f87e804c040 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.950+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.950+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344518248608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f2380 con 0x7f87e804c040 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.950+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f3ca0 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.951+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344518248608] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.963 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.951+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.951+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344518246576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f3ca0 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.951+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f46f0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.952+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344518246576] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.952+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.952+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344518252528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f3c10 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.952+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f55b0 con 0x7f87e804c040 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.953+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344518252528] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.953+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.953+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344518258944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f59d0 con 0x7f87e804c040 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.954+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f6390 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.954+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344518258944] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.955+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.955+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344518260480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f6390 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.964 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.955+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f6d50 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.956+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.956+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344518264992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f71b0 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.956+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f7cb0 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.956+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344518260480] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.957+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344518264992] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.957+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.957+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344518268832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f6cc0 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.957+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f8290 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344518268832] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.969 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344518262496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f8290 con 0x55ce4b7e9700 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=0 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=1 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=2 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=3 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=4 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=5 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.958+0000 7f87fca0e800 20 add_watcher() i=6 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.959+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344518262496] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.960+0000 7f87fca0e800 20 add_watcher() i=7 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.960+0000 7f87fca0e800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.960+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7fb590 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.960+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.960+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344518270800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b7f8820 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344518270800] v36'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f86ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f87fca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f87fca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f87fca0e800 5 note: GC not initialized 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.961+0000 7f86ad7e2640 20 reqs_thread_entry: start 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87fca0e800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87fca0e800 20 Filter name: none 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f861effd640 20 reqs_thread_entry: start 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87fca0e800 20 rados->read ofs=0 len=0 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e580 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.971 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.962+0000 7f87fca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:could not fetch user info: no user info saved 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.963+0000 7f86ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.963+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344518270800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.964+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94344518270800] v36'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.964+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344518248608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82c370 con 0x7f87e804c040 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.965+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94344518248608] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.965+0000 7f87fca0e800 20 remove_watcher() i=0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.965+0000 7f87fca0e800 2 removed watcher, disabling cache 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.965+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344518246576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82c370 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.966+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94344518246576] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.966+0000 7f87fca0e800 20 remove_watcher() i=1 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.966+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344518252528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82c370 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.967+0000 7f87f811a640 1 -- 172.21.15.196:0/3962248309 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94344518252528] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e802dcf0 con 0x55ce4b7ee0a0 2024-09-21T08:53:42.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.967+0000 7f87fca0e800 20 remove_watcher() i=2 2024-09-21T08:53:42.973 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.967+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344518258944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x7f87e804c040 2024-09-21T08:53:42.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.968+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94344518258944] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x7f87e804c040 2024-09-21T08:53:42.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.968+0000 7f87fca0e800 20 remove_watcher() i=3 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.968+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344518260480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.969+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94344518260480] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e005c040 con 0x55ce4b7e4cf0 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.969+0000 7f87fca0e800 20 remove_watcher() i=4 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.969+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344518264992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.970+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94344518264992] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.970+0000 7f87fca0e800 20 remove_watcher() i=5 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.970+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344518268832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.971+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94344518268832] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.971+0000 7f87fca0e800 20 remove_watcher() i=6 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.971+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344518262496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ce4b82e540 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.972+0000 7f87f891b640 1 -- 172.21.15.196:0/3962248309 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94344518262496] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87f002a070 con 0x55ce4b7e9700 2024-09-21T08:53:42.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.972+0000 7f87fca0e800 20 remove_watcher() i=7 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7e9700 msgr2=0x55ce4b7ebaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7e9700 0x55ce4b7ebaf0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b7e4cf0 msgr2=0x55ce4b7e71b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b7e4cf0 0x55ce4b7e71b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f87e804c040 msgr2=0x7f87e804c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f87e804c040 0x7f87e804c420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ce4b7ee0a0 msgr2=0x55ce4b7f0560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ce4b7ee0a0 0x55ce4b7f0560 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86c8036b40 msgr2=0x7f86c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86c8036b40 0x7f86c8039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87e801a6a0 tx=0x7f87e8038000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 msgr2=0x55ce4b7d9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f87f0014f70 tx=0x7f87f004cb10 comp rx=0 tx=0).stop 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87effff640 1 -- 172.21.15.196:0/3962248309 reap_dead start 2024-09-21T08:53:42.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 shutdown_connections 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3962248309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b6b1410 0x55ce4b7d9060 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 >> 172.21.15.196:0/3962248309 conn(0x55ce4b7cbd00 msgr2=0x55ce4b7c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 shutdown_connections 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3962248309 wait complete. 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 msgr2=0x7f86d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 0x7f86d0039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7afa70 tx=0x7f87e804af30 comp rx=0 tx=0).stop 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 msgr2=0x55ce4b7c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7afa00 tx=0x7f87f0018830 comp rx=0 tx=0).stop 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 shutdown_connections 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86d0036b90 0x7f86d0039050 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 --2- 172.21.15.196:0/3476524276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b7c2d90 0x55ce4b7c31b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 >> 172.21.15.196:0/3476524276 conn(0x55ce4b7b7d20 msgr2=0x55ce4b7ba8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 shutdown_connections 2024-09-21T08:53:42.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.973+0000 7f87fca0e800 1 -- 172.21.15.196:0/3476524276 wait complete. 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 msgr2=0x55ce4b7b3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 0x55ce4b7b3cf0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 msgr2=0x55ce4b7af0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 0x55ce4b7af0e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 msgr2=0x7f86e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 0x7f86e0039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ce4b624530 tx=0x7f87e0050000 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 msgr2=0x55ce4b7a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55ce4b7a14b0 tx=0x7f87e8000bc0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 shutdown_connections 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ce4b7b1900 0x55ce4b7b3cf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ce4b6b5900 0x55ce4b7af0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f86e0036b90 0x7f86e0039050 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 --2- 172.21.15.196:0/600052073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ce4b624df0 0x55ce4b7a8070 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:42.980 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 >> 172.21.15.196:0/600052073 conn(0x55ce4b6abdf0 msgr2=0x55ce4b79a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:42.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 shutdown_connections 2024-09-21T08:53:42.981 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:42.974+0000 7f87fca0e800 1 -- 172.21.15.196:0/600052073 wait complete. 2024-09-21T08:53:42.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T08:53:42.984 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-21T08:53:42.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-21T08:53:42.984 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-21T08:53:43.027 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.027 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.026+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.026+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde3b298800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555c8cec79b0 0x555c8cec9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde3b298800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c8cd83b30 con 0x555c8cec3570 2024-09-21T08:53:43.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde3b298800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555c8cd65360 con 0x555c8cec79b0 2024-09-21T08:53:43.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde33fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555c8cec79b0 0x555c8cec9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde38d93640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x555c8cec3570 0x555c8cec3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57912/0 (socket says 172.21.15.196:57912) 2024-09-21T08:53:43.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde38d93640 1 -- 172.21.15.196:0/2738575454 learned_addr learned my addr 172.21.15.196:0/2738575454 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:43.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde33fff640 1 -- 172.21.15.196:0/2738575454 >> v1:172.21.15.29:6789/0 conn(0x555c8cec3570 legacy=0x555c8cec3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.029 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.027+0000 7fde33fff640 1 -- 172.21.15.196:0/2738575454 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cd8be00 con 0x555c8cec79b0 2024-09-21T08:53:43.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.029+0000 7fde33fff640 1 --2- 172.21.15.196:0/2738575454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec79b0 0x555c8cec9da0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a470 tx=0x7fde24045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d6c22d757537f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.029+0000 7fde337fe640 1 -- 172.21.15.196:0/2738575454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24053570 con 0x555c8cec79b0 2024-09-21T08:53:43.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.029+0000 7fde337fe640 1 -- 172.21.15.196:0/2738575454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24058070 con 0x555c8cec79b0 2024-09-21T08:53:43.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.029+0000 7fde337fe640 1 -- 172.21.15.196:0/2738575454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24053880 con 0x555c8cec79b0 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 -- 172.21.15.196:0/2738575454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec79b0 msgr2=0x555c8cec9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 --2- 172.21.15.196:0/2738575454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec79b0 0x555c8cec9da0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a470 tx=0x7fde24045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 -- 172.21.15.196:0/2738575454 shutdown_connections 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 --2- 172.21.15.196:0/2738575454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec79b0 0x555c8cec9da0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 -- 172.21.15.196:0/2738575454 >> 172.21.15.196:0/2738575454 conn(0x555c8cebee20 msgr2=0x555c8cec1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 -- 172.21.15.196:0/2738575454 shutdown_connections 2024-09-21T08:53:43.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.030+0000 7fde3b298800 1 -- 172.21.15.196:0/2738575454 wait complete. 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.043+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.043+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.043+0000 7fde3b298800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.043+0000 7fde3b298800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c8ce10330 con 0x555c8cec3570 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35398/0 (socket says 172.21.15.196:35398) 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fde38d93640 1 -- 172.21.15.196:0/455089365 learned_addr learned my addr 172.21.15.196:0/455089365 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fde38d93640 1 -- 172.21.15.196:0/455089365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cd5dbc0 con 0x555c8cec3570 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fde38d93640 1 --2- 172.21.15.196:0/455089365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001d80 tx=0x7fde2c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818daf0c738a0de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fdd26e05640 1 -- 172.21.15.196:0/455089365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c013030 con 0x555c8cec3570 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fdd26e05640 1 -- 172.21.15.196:0/455089365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c00e470 con 0x555c8cec3570 2024-09-21T08:53:43.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.044+0000 7fdd26e05640 1 -- 172.21.15.196:0/455089365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c00e810 con 0x555c8cec3570 2024-09-21T08:53:43.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- 172.21.15.196:0/455089365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 msgr2=0x555c8cfb2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 --2- 172.21.15.196:0/455089365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fde2c001d80 tx=0x7fde2c001e70 comp rx=0 tx=0).stop 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- 172.21.15.196:0/455089365 shutdown_connections 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 --2- 172.21.15.196:0/455089365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8cfb2870 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- 172.21.15.196:0/455089365 >> 172.21.15.196:0/455089365 conn(0x555c8cebee20 msgr2=0x555c8cfae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- 172.21.15.196:0/455089365 shutdown_connections 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- 172.21.15.196:0/455089365 wait complete. 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.045+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde3b298800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde3b298800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c8ceca5e0 con 0x555c8cec3570 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35406/0 (socket says 172.21.15.196:35406) 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde38d93640 1 -- 172.21.15.196:0/3725296041 learned_addr learned my addr 172.21.15.196:0/3725296041 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde38d93640 1 -- 172.21.15.196:0/3725296041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cd71fe0 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde38d93640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fde2c004000 tx=0x7fde2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fdd25602640 1 -- 172.21.15.196:0/3725296041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c027070 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fdd25602640 1 -- 172.21.15.196:0/3725296041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c001400 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8cfbdfd0 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fdd25602640 1 -- 172.21.15.196:0/3725296041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c019a70 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.046+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8cfbe4f0 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde3b298800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fdd25602640 1 -- 172.21.15.196:0/3725296041 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde2c02a070 con 0x555c8cec3570 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde3b298800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c8cd5f580 con 0x555c8cfc8120 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fdd25602640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 0x7fdd20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde39594640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde39594640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35422/0 (socket says 172.21.15.196:35422) 2024-09-21T08:53:43.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fde39594640 1 -- 172.21.15.196:0/1617510888 learned_addr learned my addr 172.21.15.196:0/1617510888 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.047+0000 7fdd25602640 1 -- 172.21.15.196:0/3725296041 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde2c01f070 con 0x555c8cec3570 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde38d93640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 0x7fdd20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde39594640 1 -- 172.21.15.196:0/1617510888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cfc8a60 con 0x555c8cfc8120 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde39594640 1 --2- 172.21.15.196:0/1617510888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a430 tx=0x7fde3400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983ed1172729df01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde38d93640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 0x7fdd20039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00df90 tx=0x7fde2c017e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fdd1effd640 1 -- 172.21.15.196:0/1617510888 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34015070 con 0x555c8cfc8120 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fdd1effd640 1 -- 172.21.15.196:0/1617510888 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde34001670 con 0x555c8cfc8120 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fdd1effd640 1 -- 172.21.15.196:0/1617510888 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34001990 con 0x555c8cfc8120 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde3b298800 1 -- 172.21.15.196:0/1617510888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 msgr2=0x555c8cfc8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde3b298800 1 --2- 172.21.15.196:0/1617510888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a430 tx=0x7fde3400a8f0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde3b298800 1 -- 172.21.15.196:0/1617510888 shutdown_connections 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde3b298800 1 --2- 172.21.15.196:0/1617510888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfc8520 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.048+0000 7fde3b298800 1 -- 172.21.15.196:0/1617510888 >> 172.21.15.196:0/1617510888 conn(0x555c8cec79b0 msgr2=0x555c8cfc38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 -- 172.21.15.196:0/1617510888 shutdown_connections 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 -- 172.21.15.196:0/1617510888 wait complete. 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde3b298800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c8cfc9410 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde39594640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde39594640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35432/0 (socket says 172.21.15.196:35432) 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.049+0000 7fde39594640 1 -- 172.21.15.196:0/1331501008 learned_addr learned my addr 172.21.15.196:0/1331501008 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fde39594640 1 -- 172.21.15.196:0/1331501008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cfcfb40 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fde39594640 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fde34013040 tx=0x7fde34003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fdd1d7fa640 1 -- 172.21.15.196:0/1331501008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34020020 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fdd1d7fa640 1 -- 172.21.15.196:0/1331501008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde340108e0 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fdd1d7fa640 1 -- 172.21.15.196:0/1331501008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34015040 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8cfcfdd0 con 0x555c8cfc8120 2024-09-21T08:53:43.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.050+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8cfd2a80 con 0x555c8cfc8120 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fdd1d7fa640 1 -- 172.21.15.196:0/1331501008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde34023020 con 0x555c8cfc8120 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fdd1d7fa640 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 0x7fdd10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fdd1d7fa640 1 -- 172.21.15.196:0/1331501008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde3404c3f0 con 0x555c8cfc8120 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fde33fff640 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 0x7fdd10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fde3b298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.051+0000 7fde3b298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde33fff640 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 0x7fdd10039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde24057000 tx=0x7fde24052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde3b298800 1 Processor -- start 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde3b298800 1 -- start start 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde3b298800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde3b298800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c8cfb3020 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde38d93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35436/0 (socket says 172.21.15.196:35436) 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde38d93640 1 -- 172.21.15.196:0/3477247576 learned_addr learned my addr 172.21.15.196:0/3477247576 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.052+0000 7fde38d93640 1 -- 172.21.15.196:0/3477247576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8cfea010 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fde38d93640 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fde2c04ad50 tx=0x7fde2c016730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fdcfdfe3640 1 -- 172.21.15.196:0/3477247576 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c046070 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fdcfdfe3640 1 -- 172.21.15.196:0/3477247576 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c02beb0 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8cfecc60 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fdcfdfe3640 1 -- 172.21.15.196:0/3477247576 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c007e60 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8cfed040 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.053+0000 7fdcfdfe3640 1 -- 172.21.15.196:0/3477247576 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde2c049070 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fdcfdfe3640 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 0x7fdc70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fdcfdfe3640 1 -- 172.21.15.196:0/3477247576 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde2c014070 con 0x555c8cfe9620 2024-09-21T08:53:43.062 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde33fff640 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 0x7fdc70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fdcf77fe640 20 reqs_thread_entry: start 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde33fff640 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 0x7fdc70039050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde24045f20 tx=0x7fde24005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 0x555c8cff9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555c8cff9b00 con 0x555c8cff7080 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde39594640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 0x555c8cff9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.054+0000 7fde39594640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 0x555c8cff9470 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.055+0000 7fde39594640 1 -- 172.21.15.196:0/3725296041 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde3400e070 con 0x555c8cff7080 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.055+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 0x555c8cffdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.055+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:2 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555c8cffe360 con 0x555c8cffb920 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.055+0000 7fde38d93640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 0x555c8cffdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.055+0000 7fde38d93640 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 0x555c8cffdd10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.056+0000 7fde38d93640 1 -- 172.21.15.196:0/3725296041 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(2 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde2c048030 con 0x555c8cffb920 2024-09-21T08:53:43.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.056+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 msgr2=0x7fdd10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.056+0000 7fde3b298800 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 0x7fdd10039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde24057000 tx=0x7fde24052000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.056+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 msgr2=0x555c8cfcf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.056+0000 7fde3b298800 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fde34013040 tx=0x7fde34003370 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 shutdown_connections 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd10036b40 0x7fdd10039000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/1331501008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfc8120 0x555c8cfcf600 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 >> 172.21.15.196:0/1331501008 conn(0x555c8cec79b0 msgr2=0x555c8cfc3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 shutdown_connections 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/1331501008 wait complete. 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 msgr2=0x7fdc70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 0x7fdc70039050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde24045f20 tx=0x7fde24005a00 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 msgr2=0x555c8cfe9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fde2c04ad50 tx=0x7fde2c016730 comp rx=0 tx=0).stop 2024-09-21T08:53:43.064 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 shutdown_connections 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdc70036b90 0x7fdc70039050 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3477247576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cfe9620 0x555c8cfe9a40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 >> 172.21.15.196:0/3477247576 conn(0x555c8cfde500 msgr2=0x555c8cfe0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 shutdown_connections 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3477247576 wait complete. 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 msgr2=0x555c8cffdd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 0x555c8cffdd10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 msgr2=0x555c8cff9470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 0x555c8cff9470 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 msgr2=0x7fdd20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 0x7fdd20039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00df90 tx=0x7fde2c017e90 comp rx=0 tx=0).stop 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 msgr2=0x555c8ce386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fde2c004000 tx=0x7fde2c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 shutdown_connections 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555c8cffb920 0x555c8cffdd10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555c8cff7080 0x555c8cff9470 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd20036b40 0x7fdd20039000 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 --2- 172.21.15.196:0/3725296041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c8cec3570 0x555c8ce386d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.057+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 >> 172.21.15.196:0/3725296041 conn(0x555c8cebee20 msgr2=0x555c8cfacb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.058+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 shutdown_connections 2024-09-21T08:53:43.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.058+0000 7fde3b298800 1 -- 172.21.15.196:0/3725296041 wait complete. 2024-09-21T08:53:43.067 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T08:53:43.067 DEBUG:tasks.util.rgw: json result: {'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T08:53:43.068 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-21T08:53:43.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-21T08:53:43.068 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-21T08:53:43.150 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.150 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d912a800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56338c225e80 0x56338c2b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d912a800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56338c171b30 con 0x56338c2b5670 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d912a800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56338c153360 con 0x56338c225e80 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d4e21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56338c225e80 0x56338c2b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d4e21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56338c225e80 0x56338c2b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35440/0 (socket says 172.21.15.196:35440) 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66d4e21640 1 -- 172.21.15.196:0/2268850501 learned_addr learned my addr 172.21.15.196:0/2268850501 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.149+0000 7f66cffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56338c2b5670 0x56338c2b7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57918/0 (socket says 172.21.15.196:57918) 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.150+0000 7f66d4e21640 1 -- 172.21.15.196:0/2268850501 >> v1:172.21.15.29:6789/0 conn(0x56338c2b5670 legacy=0x56338c2b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.150+0000 7f66cf7fe640 1 -- 172.21.15.196:0/2268850501 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575273317 0 0) 0x56338c171b30 con 0x56338c2b5670 2024-09-21T08:53:43.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.150+0000 7f66d4e21640 1 -- 172.21.15.196:0/2268850501 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c179e00 con 0x56338c225e80 2024-09-21T08:53:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.151+0000 7f66d4e21640 1 --2- 172.21.15.196:0/2268850501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c2b5130 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f66c800a520 tx=0x7f66c8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cbf7a0e2ad4e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66cf7fe640 1 -- 172.21.15.196:0/2268850501 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8055070 con 0x56338c225e80 2024-09-21T08:53:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66cf7fe640 1 -- 172.21.15.196:0/2268850501 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c80515b0 con 0x56338c225e80 2024-09-21T08:53:43.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66cf7fe640 1 -- 172.21.15.196:0/2268850501 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c80518d0 con 0x56338c225e80 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 -- 172.21.15.196:0/2268850501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 msgr2=0x56338c2b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 --2- 172.21.15.196:0/2268850501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c2b5130 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f66c800a520 tx=0x7f66c8045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 -- 172.21.15.196:0/2268850501 shutdown_connections 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 --2- 172.21.15.196:0/2268850501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c2b5130 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 -- 172.21.15.196:0/2268850501 >> 172.21.15.196:0/2268850501 conn(0x56338c2acde0 msgr2=0x56338c2af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 -- 172.21.15.196:0/2268850501 shutdown_connections 2024-09-21T08:53:43.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.152+0000 7f66d912a800 1 -- 172.21.15.196:0/2268850501 wait complete. 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d912a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d912a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56338c1fe320 con 0x56338c225e80 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35446/0 (socket says 172.21.15.196:35446) 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.166+0000 7f66d4e21640 1 -- 172.21.15.196:0/567825470 learned_addr learned my addr 172.21.15.196:0/567825470 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.167+0000 7f66d4e21640 1 -- 172.21.15.196:0/567825470 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c14bbc0 con 0x56338c225e80 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.167+0000 7f66d4e21640 1 --2- 172.21.15.196:0/567825470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f66c8025da0 tx=0x7f66c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa20a2ffe28384 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.167+0000 7f65c2e05640 1 -- 172.21.15.196:0/567825470 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8051ac0 con 0x56338c225e80 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.167+0000 7f65c2e05640 1 -- 172.21.15.196:0/567825470 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8051c60 con 0x56338c225e80 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.167+0000 7f65c2e05640 1 -- 172.21.15.196:0/567825470 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8066460 con 0x56338c225e80 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- 172.21.15.196:0/567825470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 msgr2=0x56338c3a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 --2- 172.21.15.196:0/567825470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f66c8025da0 tx=0x7f66c8051000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- 172.21.15.196:0/567825470 shutdown_connections 2024-09-21T08:53:43.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 --2- 172.21.15.196:0/567825470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a1620 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- 172.21.15.196:0/567825470 >> 172.21.15.196:0/567825470 conn(0x56338c2acde0 msgr2=0x56338c39cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- 172.21.15.196:0/567825470 shutdown_connections 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- 172.21.15.196:0/567825470 wait complete. 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.168+0000 7f66d912a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56338c2b95e0 con 0x56338c225e80 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35448/0 (socket says 172.21.15.196:35448) 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 learned_addr learned my addr 172.21.15.196:0/879283482 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c15ffe0 con 0x56338c225e80 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d4e21640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a8fa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f66c80460a0 tx=0x7f66c8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f65c1602640 1 -- 172.21.15.196:0/879283482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8066650 con 0x56338c225e80 2024-09-21T08:53:43.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f65c1602640 1 -- 172.21.15.196:0/879283482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8066810 con 0x56338c225e80 2024-09-21T08:53:43.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56338c3a94e0 con 0x56338c225e80 2024-09-21T08:53:43.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f65c1602640 1 -- 172.21.15.196:0/879283482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8066b30 con 0x56338c225e80 2024-09-21T08:53:43.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.169+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56338c3a9a00 con 0x56338c225e80 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f65c1602640 1 -- 172.21.15.196:0/879283482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66c8079060 con 0x56338c225e80 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d912a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d912a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56338c14d580 con 0x56338c2b2b70 2024-09-21T08:53:43.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f65c1602640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65bc036b40 0x7f65bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f65c1602640 1 -- 172.21.15.196:0/879283482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f66c8062070 con 0x56338c225e80 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d4e21640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65bc036b40 0x7f65bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35462/0 (socket says 172.21.15.196:35462) 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.170+0000 7f66d5622640 1 -- 172.21.15.196:0/3892072925 learned_addr learned my addr 172.21.15.196:0/3892072925 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d5622640 1 -- 172.21.15.196:0/3892072925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c2b1600 con 0x56338c2b2b70 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d4e21640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65bc036b40 0x7f65bc039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66c8051580 tx=0x7f66c8051510 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d5622640 1 --2- 172.21.15.196:0/3892072925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f66d000a430 tx=0x7f66d000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d6556047a66f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f65baffd640 1 -- 172.21.15.196:0/3892072925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d0015070 con 0x56338c2b2b70 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f65baffd640 1 -- 172.21.15.196:0/3892072925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d0001670 con 0x56338c2b2b70 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f65baffd640 1 -- 172.21.15.196:0/3892072925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d0001990 con 0x56338c2b2b70 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 -- 172.21.15.196:0/3892072925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 msgr2=0x56338c2b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 --2- 172.21.15.196:0/3892072925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f66d000a430 tx=0x7f66d000a8f0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 -- 172.21.15.196:0/3892072925 shutdown_connections 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 --2- 172.21.15.196:0/3892072925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c2b10c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 -- 172.21.15.196:0/3892072925 >> 172.21.15.196:0/3892072925 conn(0x56338c2b5670 msgr2=0x56338c3b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.171+0000 7f66d912a800 1 -- 172.21.15.196:0/3892072925 shutdown_connections 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d912a800 1 -- 172.21.15.196:0/3892072925 wait complete. 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d912a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d912a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56338c2b1920 con 0x56338c2b2b70 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35464/0 (socket says 172.21.15.196:35464) 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.172+0000 7f66d5622640 1 -- 172.21.15.196:0/4177150282 learned_addr learned my addr 172.21.15.196:0/4177150282 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f66d5622640 1 -- 172.21.15.196:0/4177150282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c3bfa60 con 0x56338c2b2b70 2024-09-21T08:53:43.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f66d5622640 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66d0013040 tx=0x7f66d0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f65b97fa640 1 -- 172.21.15.196:0/4177150282 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d0020020 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f65b97fa640 1 -- 172.21.15.196:0/4177150282 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d00108e0 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56338c3bfcf0 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f65b97fa640 1 -- 172.21.15.196:0/4177150282 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d0015040 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.173+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56338c3c29a0 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f65b97fa640 1 -- 172.21.15.196:0/4177150282 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66d0023020 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f65b97fa640 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 0x7f65ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f65b97fa640 1 -- 172.21.15.196:0/4177150282 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f66d004c3f0 con 0x56338c2b2b70 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f66cffff640 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 0x7f65ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f66d912a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f66d912a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.174+0000 7f66cffff640 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 0x7f65ac039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66c00011e0 tx=0x7f66c0001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d912a800 1 Processor -- start 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d912a800 1 -- start start 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d912a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d912a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56338c3a1d10 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d4e21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35466/0 (socket says 172.21.15.196:35466) 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d4e21640 1 -- 172.21.15.196:0/1284192535 learned_addr learned my addr 172.21.15.196:0/1284192535 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.175+0000 7f66d4e21640 1 -- 172.21.15.196:0/1284192535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56338c3d9ec0 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f66d4e21640 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f66c808e670 tx=0x7f66c805be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f65997e2640 1 -- 172.21.15.196:0/1284192535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8094020 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f65997e2640 1 -- 172.21.15.196:0/1284192535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8064360 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56338c3dcb10 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f65997e2640 1 -- 172.21.15.196:0/1284192535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c80713e0 con 0x56338c3d94d0 2024-09-21T08:53:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.176+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56338c3dcb10 con 0x56338c3d94d0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f65997e2640 1 -- 172.21.15.196:0/1284192535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66c8097020 con 0x56338c3d94d0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f65997e2640 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 0x7f650c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f65997e2640 1 -- 172.21.15.196:0/1284192535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f66c809ad10 con 0x56338c3d94d0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f66cffff640 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 0x7f650c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f66cffff640 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 0x7f650c039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66c0000f60 tx=0x7f66c0006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f652affd640 20 reqs_thread_entry: start 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56338c3e6d60 0x56338c3e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3e9770 con 0x56338c3e6d60 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.177+0000 7f66d5622640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56338c3e6d60 0x56338c3e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d5622640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56338c3e6d60 0x56338c3e9150 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3ea050 con 0x56338c3e6d60 2024-09-21T08:53:43.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56338c3eb960 0x56338c3edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3ee480 con 0x56338c3eb960 2024-09-21T08:53:43.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.178+0000 7f66d4e21640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56338c3eb960 0x56338c3edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.179+0000 7f66d4e21640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56338c3eb960 0x56338c3edd90 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.179+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.179+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3fb5c0 con 0x56338c3e6d60 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.179+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:NOTICE: set zone's realm_id= 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56338c3f2980 0x56338c3f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66cffff640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56338c3f2980 0x56338c3f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66cffff640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56338c3f2980 0x56338c3f58b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(5 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66cffff640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f66c000e8a0 0x7f66c001b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.180+0000 7f66d5622640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f66c000e8a0 0x7f66c001b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d5622640 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f66c000e8a0 0x7f66c001b3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.181+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(10 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.182+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.183+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(17 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.184+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.185+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(25 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.186+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3f2980 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c001e6e0 con 0x56338c3f2980 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.187+0000 7f66cffff640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.188+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.188+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x56338c3e6d60 2024-09-21T08:53:43.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.188+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(35 [pgnls start_epoch 36 out=178b] v27'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.188+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f5430 con 0x7f66c000e8a0 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.189+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(36 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d000e070 con 0x7f66c000e8a0 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.189+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f9490 con 0x56338c3e6d60 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.189+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.189+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:38 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56338c3eac70 con 0x56338c3eb960 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.189+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(38 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.190+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:39 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f4cc0 con 0x56338c3eb960 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.191+0000 7f66d4e21640 1 -- 172.21.15.196:0/879283482 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(39 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [create,call,writefull 0~1155] v36'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f66c8083030 con 0x56338c3eb960 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.191+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f6a60 con 0x56338c3e6d60 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.192+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v36'4 uv4 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.192+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56338c3f3f80 con 0x56338c3e6d60 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.193+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v36'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f66d000e070 con 0x56338c3e6d60 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 msgr2=0x7f65ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 0x7f65ac039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66c00011e0 tx=0x7f66c0001330 comp rx=0 tx=0).stop 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 msgr2=0x56338c3bf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66d0013040 tx=0x7f66d0003370 comp rx=0 tx=0).stop 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 shutdown_connections 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65ac036b90 0x7f65ac039050 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/4177150282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c2b2b70 0x56338c3bf520 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 >> 172.21.15.196:0/4177150282 conn(0x56338c2b5670 msgr2=0x56338c3b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 shutdown_connections 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/4177150282 wait complete. 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 msgr2=0x7f650c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 0x7f650c039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66c0000f60 tx=0x7f66c0006000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 msgr2=0x56338c3d98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f66c808e670 tx=0x7f66c805be20 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 shutdown_connections 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f650c036b90 0x7f650c039050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 --2- 172.21.15.196:0/1284192535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c3d94d0 0x56338c3d98f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 >> 172.21.15.196:0/1284192535 conn(0x56338c3ce400 msgr2=0x56338c3d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 shutdown_connections 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.194+0000 7f66d912a800 1 -- 172.21.15.196:0/1284192535 wait complete. 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56338c3eb960 msgr2=0x56338c3edd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56338c3eb960 0x56338c3edd90 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56338c3e6d60 msgr2=0x56338c3e9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56338c3e6d60 0x56338c3e9150 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f66c000e8a0 msgr2=0x7f66c001b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f66c000e8a0 0x7f66c001b3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56338c3f2980 msgr2=0x56338c3f58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56338c3f2980 0x56338c3f58b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65bc036b40 msgr2=0x7f65bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f65bc036b40 0x7f65bc039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66c8051580 tx=0x7f66c8051510 comp rx=0 tx=0).stop 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 msgr2=0x56338c3a8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 --2- 172.21.15.196:0/879283482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56338c225e80 0x56338c3a8fa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f66c80460a0 tx=0x7f66c8003020 comp rx=0 tx=0).stop 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 reap_dead start 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d5622640 1 -- 172.21.15.196:0/879283482 reap_dead start 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 shutdown_connections 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 >> 172.21.15.196:0/879283482 conn(0x56338c2acde0 msgr2=0x56338c39b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 shutdown_connections 2024-09-21T08:53:43.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.195+0000 7f66d912a800 1 -- 172.21.15.196:0/879283482 wait complete. 2024-09-21T08:53:43.205 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-21T08:53:43.205 DEBUG:tasks.util.rgw: json result: {'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-21T08:53:43.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-21T08:53:43.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-21T08:53:43.206 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-21T08:53:43.288 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.288 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.287+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.287+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.287+0000 7f0e99f39800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5580c35d4540 0x5580c35d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.287+0000 7f0e99f39800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580c3494b30 con 0x5580c35d4e80 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.287+0000 7f0e99f39800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5580c3476360 con 0x5580c35d4540 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e95bd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5580c35d4540 0x5580c35d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e95bd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5580c35d4540 0x5580c35d4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35482/0 (socket says 172.21.15.196:35482) 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e8d3d0640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5580c35d4e80 0x5580c35d9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57926/0 (socket says 172.21.15.196:57926) 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e95bd1640 1 -- 172.21.15.196:0/42193545 learned_addr learned my addr 172.21.15.196:0/42193545 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e95bd1640 1 -- 172.21.15.196:0/42193545 >> v1:172.21.15.29:6789/0 conn(0x5580c35d4e80 legacy=0x5580c35d9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e953d0640 1 -- 172.21.15.196:0/42193545 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1822942597 0 0) 0x5580c3494b30 con 0x5580c35d4e80 2024-09-21T08:53:43.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.288+0000 7f0e95bd1640 1 -- 172.21.15.196:0/42193545 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c349ce00 con 0x5580c35d4540 2024-09-21T08:53:43.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.290+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/42193545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c35d4940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800a520 tx=0x7f0e88045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfd7eee2f3bcf57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.290+0000 7f0e953d0640 1 -- 172.21.15.196:0/42193545 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88055070 con 0x5580c35d4540 2024-09-21T08:53:43.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.290+0000 7f0e953d0640 1 -- 172.21.15.196:0/42193545 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e880515b0 con 0x5580c35d4540 2024-09-21T08:53:43.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.290+0000 7f0e953d0640 1 -- 172.21.15.196:0/42193545 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e880518d0 con 0x5580c35d4540 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 -- 172.21.15.196:0/42193545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 msgr2=0x5580c35d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 --2- 172.21.15.196:0/42193545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c35d4940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800a520 tx=0x7f0e88045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 -- 172.21.15.196:0/42193545 shutdown_connections 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 --2- 172.21.15.196:0/42193545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c35d4940 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 -- 172.21.15.196:0/42193545 >> 172.21.15.196:0/42193545 conn(0x5580c35cfdd0 msgr2=0x5580c35d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 -- 172.21.15.196:0/42193545 shutdown_connections 2024-09-21T08:53:43.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.291+0000 7f0e99f39800 1 -- 172.21.15.196:0/42193545 wait complete. 2024-09-21T08:53:43.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.304+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.304+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.304+0000 7f0e99f39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.304+0000 7f0e99f39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5580c3521320 con 0x5580c35d4540 2024-09-21T08:53:43.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.305+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.305+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35498/0 (socket says 172.21.15.196:35498) 2024-09-21T08:53:43.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.305+0000 7f0e95bd1640 1 -- 172.21.15.196:0/1402446399 learned_addr learned my addr 172.21.15.196:0/1402446399 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.305+0000 7f0e95bd1640 1 -- 172.21.15.196:0/1402446399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c346ebc0 con 0x5580c35d4540 2024-09-21T08:53:43.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.305+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/1402446399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0e88025da0 tx=0x7f0e88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667110897828e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0d83e07640 1 -- 172.21.15.196:0/1402446399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88051ac0 con 0x5580c35d4540 2024-09-21T08:53:43.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0d83e07640 1 -- 172.21.15.196:0/1402446399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88051c60 con 0x5580c35d4540 2024-09-21T08:53:43.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0d83e07640 1 -- 172.21.15.196:0/1402446399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88066460 con 0x5580c35d4540 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 -- 172.21.15.196:0/1402446399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 msgr2=0x5580c3549590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1402446399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0e88025da0 tx=0x7f0e88051000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 -- 172.21.15.196:0/1402446399 shutdown_connections 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1402446399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c3549590 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 -- 172.21.15.196:0/1402446399 >> 172.21.15.196:0/1402446399 conn(0x5580c35cfdd0 msgr2=0x5580c36bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 -- 172.21.15.196:0/1402446399 shutdown_connections 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.306+0000 7f0e99f39800 1 -- 172.21.15.196:0/1402446399 wait complete. 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e99f39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e99f39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5580c35db560 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35510/0 (socket says 172.21.15.196:35510) 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e95bd1640 1 -- 172.21.15.196:0/3959056385 learned_addr learned my addr 172.21.15.196:0/3959056385 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.307+0000 7f0e95bd1640 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c3482fe0 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0e880460a0 tx=0x7f0e88003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0d82604640 1 -- 172.21.15.196:0/3959056385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88066650 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0d82604640 1 -- 172.21.15.196:0/3959056385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88066810 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0d82604640 1 -- 172.21.15.196:0/3959056385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88066b30 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c36cc540 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c36cca60 con 0x5580c35d4540 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.308+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d82604640 1 -- 172.21.15.196:0/3959056385 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e88079060 con 0x5580c35d4540 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e99f39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e99f39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5580c3470580 con 0x5580c36c4e00 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d82604640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 0x7f0d7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e963d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d82604640 1 -- 172.21.15.196:0/3959056385 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0e88062070 con 0x5580c35d4540 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e963d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35514/0 (socket says 172.21.15.196:35514) 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e963d2640 1 -- 172.21.15.196:0/852889709 learned_addr learned my addr 172.21.15.196:0/852889709 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 0x7f0d7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e963d2640 1 -- 172.21.15.196:0/852889709 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c36c3890 con 0x5580c36c4e00 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 0x7f0d7c039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0e88051580 tx=0x7f0e88051510 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0e963d2640 1 --2- 172.21.15.196:0/852889709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000a430 tx=0x7f0e9000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aea5734f25e140d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d7bfff640 1 -- 172.21.15.196:0/852889709 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90015070 con 0x5580c36c4e00 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d7bfff640 1 -- 172.21.15.196:0/852889709 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90001670 con 0x5580c36c4e00 2024-09-21T08:53:43.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.309+0000 7f0d7bfff640 1 -- 172.21.15.196:0/852889709 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90001990 con 0x5580c36c4e00 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- 172.21.15.196:0/852889709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 msgr2=0x5580c36c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 --2- 172.21.15.196:0/852889709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000a430 tx=0x7f0e9000a8f0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- 172.21.15.196:0/852889709 shutdown_connections 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 --2- 172.21.15.196:0/852889709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36c3350 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- 172.21.15.196:0/852889709 >> 172.21.15.196:0/852889709 conn(0x5580c35d4e80 msgr2=0x5580c36d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- 172.21.15.196:0/852889709 shutdown_connections 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- 172.21.15.196:0/852889709 wait complete. 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.310+0000 7f0e99f39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5580c36c3bb0 con 0x5580c36c4e00 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e963d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e963d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35526/0 (socket says 172.21.15.196:35526) 2024-09-21T08:53:43.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e963d2640 1 -- 172.21.15.196:0/1787009615 learned_addr learned my addr 172.21.15.196:0/1787009615 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e963d2640 1 -- 172.21.15.196:0/1787009615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c36e2b90 con 0x5580c36c4e00 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e963d2640 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000a930 tx=0x7f0e90003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0d7a7fc640 1 -- 172.21.15.196:0/1787009615 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90020020 con 0x5580c36c4e00 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0d7a7fc640 1 -- 172.21.15.196:0/1787009615 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e900108b0 con 0x5580c36c4e00 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0d7a7fc640 1 -- 172.21.15.196:0/1787009615 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90015040 con 0x5580c36c4e00 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c36e2e20 con 0x5580c36c4e00 2024-09-21T08:53:43.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.311+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c36e5ad0 con 0x5580c36c4e00 2024-09-21T08:53:43.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.312+0000 7f0d7a7fc640 1 -- 172.21.15.196:0/1787009615 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e90023020 con 0x5580c36c4e00 2024-09-21T08:53:43.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0d7a7fc640 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 0x7f0d70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0d7a7fc640 1 -- 172.21.15.196:0/1787009615 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0e9004c310 con 0x5580c36c4e00 2024-09-21T08:53:43.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e8d3d0640 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 0x7f0d70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e8d3d0640 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 0x7f0d70039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e800011e0 tx=0x7f0e80001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 1 Processor -- start 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 1 -- start start 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.313+0000 7f0e99f39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5580c36c7470 con 0x5580c36fc600 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e95bd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35538/0 (socket says 172.21.15.196:35538) 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e95bd1640 1 -- 172.21.15.196:0/851448572 learned_addr learned my addr 172.21.15.196:0/851448572 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e95bd1640 1 -- 172.21.15.196:0/851448572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c36fcff0 con 0x5580c36fc600 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0e8808e640 tx=0x7f0e88065d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0d5a7e4640 1 -- 172.21.15.196:0/851448572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88094020 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0d5a7e4640 1 -- 172.21.15.196:0/851448572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88065ec0 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c36ffc40 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0d5a7e4640 1 -- 172.21.15.196:0/851448572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8804e2c0 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.314+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c36ffc40 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.315+0000 7f0d5a7e4640 1 -- 172.21.15.196:0/851448572 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e88097020 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.315+0000 7f0d5a7e4640 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 0x7f0cd8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.315+0000 7f0d5a7e4640 1 -- 172.21.15.196:0/851448572 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0e8809ad10 con 0x5580c36fc600 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.315+0000 7f0e8d3d0640 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 0x7f0cd8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0ccbfff640 20 reqs_thread_entry: start 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e8d3d0640 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 0x7f0cd8039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000f60 tx=0x7f0e80006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 0x5580c370c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5580c370c8a0 con 0x5580c3709e90 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e963d2640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 0x5580c370c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e963d2640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 0x5580c370c280 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e963d2640 1 -- 172.21.15.196:0/3959056385 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e9000e070 con 0x5580c3709e90 2024-09-21T08:53:43.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5580c370d180 con 0x5580c3709e90 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.316+0000 7f0e963d2640 1 -- 172.21.15.196:0/3959056385 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e9000e070 con 0x5580c3709e90 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.317+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 0x5580c3710f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.317+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5580c3711610 con 0x5580c370ea90 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.317+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 0x5580c3710f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.317+0000 7f0e95bd1640 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 0x5580c3710f20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.317+0000 7f0e95bd1640 1 -- 172.21.15.196:0/3959056385 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f0e88083030 con 0x5580c370ea90 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 msgr2=0x7f0d70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 0x7f0d70039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e800011e0 tx=0x7f0e80001330 comp rx=0 tx=0).stop 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 msgr2=0x5580c36e2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000a930 tx=0x7f0e90003370 comp rx=0 tx=0).stop 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 shutdown_connections 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d70036b40 0x7f0d70039000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 --2- 172.21.15.196:0/1787009615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36c4e00 0x5580c36e2650 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 >> 172.21.15.196:0/1787009615 conn(0x5580c35d4e80 msgr2=0x5580c36d7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 shutdown_connections 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.318+0000 7f0e99f39800 1 -- 172.21.15.196:0/1787009615 wait complete. 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 msgr2=0x7f0cd8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 0x7f0cd8039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000f60 tx=0x7f0e80006000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 msgr2=0x5580c36fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0e8808e640 tx=0x7f0e88065d90 comp rx=0 tx=0).stop 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 shutdown_connections 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0cd8036b40 0x7f0cd8039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/851448572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c36fc600 0x5580c36fca20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 >> 172.21.15.196:0/851448572 conn(0x5580c36f1500 msgr2=0x5580c36f3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 shutdown_connections 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/851448572 wait complete. 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 msgr2=0x5580c3710f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.326 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 0x5580c3710f20 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 msgr2=0x5580c370c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 0x5580c370c280 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 msgr2=0x7f0d7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 0x7f0d7c039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0e88051580 tx=0x7f0e88051510 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 msgr2=0x5580c36cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0e880460a0 tx=0x7f0e88003020 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 shutdown_connections 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5580c370ea90 0x5580c3710f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5580c3709e90 0x5580c370c280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0d7c036b90 0x7f0d7c039050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 --2- 172.21.15.196:0/3959056385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5580c35d4540 0x5580c36cc000 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 >> 172.21.15.196:0/3959056385 conn(0x5580c35cfdd0 msgr2=0x5580c36bd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.327 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 shutdown_connections 2024-09-21T08:53:43.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.319+0000 7f0e99f39800 1 -- 172.21.15.196:0/3959056385 wait complete. 2024-09-21T08:53:43.329 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-21T08:53:43.329 DEBUG:tasks.util.rgw: json result: {'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-21T08:53:43.329 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T08:53:43.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-21T08:53:43.330 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-21T08:53:43.415 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.415 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae400d800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561be0268550 0x561be0268950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.416 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae400d800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561be0128b30 con 0x561be0268e90 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae400d800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561be010a360 con 0x561be0268550 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae1b01640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561be0268550 0x561be0268950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5adbfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x561be0268e90 0x561be026da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57938/0 (socket says 172.21.15.196:57938) 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5adbfff640 1 -- 172.21.15.196:0/734530471 learned_addr learned my addr 172.21.15.196:0/734530471 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae1b01640 1 -- 172.21.15.196:0/734530471 >> v1:172.21.15.29:6789/0 conn(0x561be0268e90 legacy=0x561be026da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.415+0000 7f5ae1b01640 1 -- 172.21.15.196:0/734530471 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be0130e00 con 0x561be0268550 2024-09-21T08:53:43.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.417+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/734530471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0268950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400a470 tx=0x7f5ad4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63e3ad5a61b9e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.417+0000 7f5ae1300640 1 -- 172.21.15.196:0/734530471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad4053570 con 0x561be0268550 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae1300640 1 -- 172.21.15.196:0/734530471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4058070 con 0x561be0268550 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae1300640 1 -- 172.21.15.196:0/734530471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad4053880 con 0x561be0268550 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 -- 172.21.15.196:0/734530471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 msgr2=0x561be0268950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 --2- 172.21.15.196:0/734530471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0268950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400a470 tx=0x7f5ad4045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 -- 172.21.15.196:0/734530471 shutdown_connections 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 --2- 172.21.15.196:0/734530471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0268950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 -- 172.21.15.196:0/734530471 >> 172.21.15.196:0/734530471 conn(0x561be0263e40 msgr2=0x561be0266260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 -- 172.21.15.196:0/734530471 shutdown_connections 2024-09-21T08:53:43.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.418+0000 7f5ae400d800 1 -- 172.21.15.196:0/734530471 wait complete. 2024-09-21T08:53:43.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.431+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae400d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae400d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561be01b5350 con 0x561be0268550 2024-09-21T08:53:43.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35556/0 (socket says 172.21.15.196:35556) 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae1b01640 1 -- 172.21.15.196:0/289501919 learned_addr learned my addr 172.21.15.196:0/289501919 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.432+0000 7f5ae1b01640 1 -- 172.21.15.196:0/289501919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be0102bc0 con 0x561be0268550 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.433+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/289501919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4025c20 tx=0x7f5ad4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91434651ea70aa40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.433+0000 7f59cfe07640 1 -- 172.21.15.196:0/289501919 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad405c580 con 0x561be0268550 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.433+0000 7f59cfe07640 1 -- 172.21.15.196:0/289501919 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4063030 con 0x561be0268550 2024-09-21T08:53:43.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.433+0000 7f59cfe07640 1 -- 172.21.15.196:0/289501919 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad405c850 con 0x561be0268550 2024-09-21T08:53:43.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- 172.21.15.196:0/289501919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 msgr2=0x561be0356790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 --2- 172.21.15.196:0/289501919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4025c20 tx=0x7f5ad4051000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- 172.21.15.196:0/289501919 shutdown_connections 2024-09-21T08:53:43.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 --2- 172.21.15.196:0/289501919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be0356790 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- 172.21.15.196:0/289501919 >> 172.21.15.196:0/289501919 conn(0x561be0263e40 msgr2=0x561be0352150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- 172.21.15.196:0/289501919 shutdown_connections 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- 172.21.15.196:0/289501919 wait complete. 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae400d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561be026f570 con 0x561be0268550 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35564/0 (socket says 172.21.15.196:35564) 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.434+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2632862605 learned_addr learned my addr 172.21.15.196:0/2632862605 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be0116fe0 con 0x561be0268550 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x561be03575f0 tx=0x7f5ad4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f59ce604640 1 -- 172.21.15.196:0/2632862605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad4054ad0 con 0x561be0268550 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f59ce604640 1 -- 172.21.15.196:0/2632862605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4054c70 con 0x561be0268550 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be035e630 con 0x561be0268550 2024-09-21T08:53:43.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f59ce604640 1 -- 172.21.15.196:0/2632862605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad4068420 con 0x561be0268550 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.435+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be035eb50 con 0x561be0268550 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae400d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae400d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561be0104580 con 0x561be036aed0 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f59ce604640 1 -- 172.21.15.196:0/2632862605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ad40685c0 con 0x561be0268550 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae2302640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae2302640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35572/0 (socket says 172.21.15.196:35572) 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae2302640 1 -- 172.21.15.196:0/3081786912 learned_addr learned my addr 172.21.15.196:0/3081786912 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f59ce604640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 0x7f59c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f59ce604640 1 -- 172.21.15.196:0/2632862605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5ad4070030 con 0x561be0268550 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 0x7f59c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.436+0000 7f5ae2302640 1 -- 172.21.15.196:0/3081786912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be036b810 con 0x561be036aed0 2024-09-21T08:53:43.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae2302640 1 --2- 172.21.15.196:0/3081786912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a430 tx=0x7f5adc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6c1dc5d67f46c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 0x7f59c8039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4054830 tx=0x7f5ad405cf40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f59c7fff640 1 -- 172.21.15.196:0/3081786912 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc015070 con 0x561be036aed0 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f59c7fff640 1 -- 172.21.15.196:0/3081786912 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc001670 con 0x561be036aed0 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f59c7fff640 1 -- 172.21.15.196:0/3081786912 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc001990 con 0x561be036aed0 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 -- 172.21.15.196:0/3081786912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 msgr2=0x561be036b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 --2- 172.21.15.196:0/3081786912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a430 tx=0x7f5adc00a8f0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 -- 172.21.15.196:0/3081786912 shutdown_connections 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 --2- 172.21.15.196:0/3081786912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be036b2d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 -- 172.21.15.196:0/3081786912 >> 172.21.15.196:0/3081786912 conn(0x561be0268e90 msgr2=0x561be0366650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 -- 172.21.15.196:0/3081786912 shutdown_connections 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 -- 172.21.15.196:0/3081786912 wait complete. 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.437+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae400d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae400d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561be036c1c0 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae2302640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae2302640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35584/0 (socket says 172.21.15.196:35584) 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae2302640 1 -- 172.21.15.196:0/1963950789 learned_addr learned my addr 172.21.15.196:0/1963950789 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae2302640 1 -- 172.21.15.196:0/1963950789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be0372a10 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f5ae2302640 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a930 tx=0x7f5adc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.438+0000 7f59c67fc640 1 -- 172.21.15.196:0/1963950789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc020020 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.439+0000 7f59c67fc640 1 -- 172.21.15.196:0/1963950789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc0108b0 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.439+0000 7f59c67fc640 1 -- 172.21.15.196:0/1963950789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5adc015040 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.439+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be0372ca0 con 0x561be036aed0 2024-09-21T08:53:43.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.439+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be0375950 con 0x561be036aed0 2024-09-21T08:53:43.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.439+0000 7f59c67fc640 1 -- 172.21.15.196:0/1963950789 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5adc023020 con 0x561be036aed0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f59c67fc640 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 0x7f59bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f59c67fc640 1 -- 172.21.15.196:0/1963950789 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5adc04c410 con 0x561be036aed0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5adbfff640 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 0x7f59bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5adbfff640 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 0x7f59bc039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5acc000f60 tx=0x7f5acc001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 1 Processor -- start 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 1 -- start start 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.440+0000 7f5ae400d800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561be0356ee0 con 0x561be038c4f0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae1b01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35586/0 (socket says 172.21.15.196:35586) 2024-09-21T08:53:43.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2927997074 learned_addr learned my addr 172.21.15.196:0/2927997074 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2927997074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be038cee0 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40095d0 tx=0x7f5ad407ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f59a67e4640 1 -- 172.21.15.196:0/2927997074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad407b2f0 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f59a67e4640 1 -- 172.21.15.196:0/2927997074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4094070 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be038fb30 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.441+0000 7f59a67e4640 1 -- 172.21.15.196:0/2927997074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad405c690 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.442+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be038ff10 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.442+0000 7f59a67e4640 1 -- 172.21.15.196:0/2927997074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ad4096020 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.442+0000 7f59a67e4640 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 0x7f5924039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.442+0000 7f59a67e4640 1 -- 172.21.15.196:0/2927997074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5ad4099d20 con 0x561be038c4f0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5adbfff640 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 0x7f5924039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5917fff640 20 reqs_thread_entry: start 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 0x561be039c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5adbfff640 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 0x7f5924039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001ed0 tx=0x7f5acc00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561be039c990 con 0x561be0399ef0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5ae2302640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 0x561be039c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.443+0000 7f5ae2302640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 0x561be039c2e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae2302640 1 -- 172.21.15.196:0/2632862605 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5adc00e070 con 0x561be0399ef0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 0x561be03a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:2 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561be03a11a0 con 0x561be039e760 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 0x561be03a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae1b01640 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 0x561be03a0b50 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2632862605 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(2 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f5ad4085030 con 0x561be039e760 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.444+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561be039de30 con 0x561be039e760 2024-09-21T08:53:43.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.446+0000 7f5ae1b01640 1 -- 172.21.15.196:0/2632862605 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [stat,call,call,writefull 0~993] v36'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5ad4085030 con 0x561be039e760 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 msgr2=0x7f59bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 0x7f59bc039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5acc000f60 tx=0x7f5acc001230 comp rx=0 tx=0).stop 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 msgr2=0x561be03724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00a930 tx=0x7f5adc003370 comp rx=0 tx=0).stop 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 shutdown_connections 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59bc036b40 0x7f59bc039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/1963950789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be036aed0 0x561be03724d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 >> 172.21.15.196:0/1963950789 conn(0x561be0268e90 msgr2=0x561be0366220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 shutdown_connections 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/1963950789 wait complete. 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 msgr2=0x7f5924039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 0x7f5924039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001ed0 tx=0x7f5acc00f000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 msgr2=0x561be038c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40095d0 tx=0x7f5ad407ef60 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 shutdown_connections 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5924036b40 0x7f5924039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2927997074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be038c4f0 0x561be038c910 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 >> 172.21.15.196:0/2927997074 conn(0x561be03813d0 msgr2=0x561be0383d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 shutdown_connections 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2927997074 wait complete. 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 msgr2=0x561be03a0b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 0x561be03a0b50 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 msgr2=0x561be039c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 0x561be039c2e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 msgr2=0x7f59c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 0x7f59c8039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4054830 tx=0x7f5ad405cf40 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 msgr2=0x561be035e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.447+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x561be03575f0 tx=0x7f5ad4002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 shutdown_connections 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x561be039e760 0x561be03a0b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x561be0399ef0 0x561be039c2e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f59c8036b40 0x7f59c8039000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 --2- 172.21.15.196:0/2632862605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561be0268550 0x561be035e0f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 >> 172.21.15.196:0/2632862605 conn(0x561be0263e40 msgr2=0x561be0350a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 shutdown_connections 2024-09-21T08:53:43.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.448+0000 7f5ae400d800 1 -- 172.21.15.196:0/2632862605 wait complete. 2024-09-21T08:53:43.457 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-21T08:53:43.458 DEBUG:tasks.util.rgw: json result: {'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-21T08:53:43.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-21T08:53:43.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-21T08:53:43.458 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-21T08:53:43.500 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.500 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.499+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.499+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.499+0000 7f4a5a530800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559663ae4750 0x559663ae4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.499+0000 7f4a5a530800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596639a3b30 con 0x559663ae5090 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.499+0000 7f4a5a530800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x559663985360 con 0x559663ae4750 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a5625c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x559663ae4750 0x559663ae4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a4ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x559663ae5090 0x559663ae9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57954/0 (socket says 172.21.15.196:57954) 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a4ffff640 1 -- 172.21.15.196:0/2660472145 learned_addr learned my addr 172.21.15.196:0/2660472145 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a5625c640 1 -- 172.21.15.196:0/2660472145 >> v1:172.21.15.29:6789/0 conn(0x559663ae5090 legacy=0x559663ae9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a55a5b640 1 -- 172.21.15.196:0/2660472145 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995919455 0 0) 0x5596639a3b30 con 0x559663ae5090 2024-09-21T08:53:43.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.500+0000 7f4a5625c640 1 -- 172.21.15.196:0/2660472145 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596639abe00 con 0x559663ae4750 2024-09-21T08:53:43.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a5625c640 1 --2- 172.21.15.196:0/2660472145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663ae4b50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800a470 tx=0x7f4a48045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bf5840517a483f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a55a5b640 1 -- 172.21.15.196:0/2660472145 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a48053570 con 0x559663ae4750 2024-09-21T08:53:43.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a55a5b640 1 -- 172.21.15.196:0/2660472145 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48058070 con 0x559663ae4750 2024-09-21T08:53:43.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a55a5b640 1 -- 172.21.15.196:0/2660472145 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a48053880 con 0x559663ae4750 2024-09-21T08:53:43.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a5a530800 1 -- 172.21.15.196:0/2660472145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 msgr2=0x559663ae4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.502+0000 7f4a5a530800 1 --2- 172.21.15.196:0/2660472145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663ae4b50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800a470 tx=0x7f4a48045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.503+0000 7f4a5a530800 1 -- 172.21.15.196:0/2660472145 shutdown_connections 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.503+0000 7f4a5a530800 1 --2- 172.21.15.196:0/2660472145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663ae4b50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.503+0000 7f4a5a530800 1 -- 172.21.15.196:0/2660472145 >> 172.21.15.196:0/2660472145 conn(0x559663adffe0 msgr2=0x559663ae2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.503+0000 7f4a5a530800 1 -- 172.21.15.196:0/2660472145 shutdown_connections 2024-09-21T08:53:43.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.503+0000 7f4a5a530800 1 -- 172.21.15.196:0/2660472145 wait complete. 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.516+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.516+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.516+0000 7f4a5a530800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.516+0000 7f4a5a530800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559663a30320 con 0x559663ae4750 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35600/0 (socket says 172.21.15.196:35600) 2024-09-21T08:53:43.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4a5625c640 1 -- 172.21.15.196:0/625379173 learned_addr learned my addr 172.21.15.196:0/625379173 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4a5625c640 1 -- 172.21.15.196:0/625379173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966397dbc0 con 0x559663ae4750 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4a5625c640 1 --2- 172.21.15.196:0/625379173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a48005870 tx=0x7f4a48051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8550110285dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4944608640 1 -- 172.21.15.196:0/625379173 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a4805c580 con 0x559663ae4750 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4944608640 1 -- 172.21.15.196:0/625379173 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48063030 con 0x559663ae4750 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.517+0000 7f4944608640 1 -- 172.21.15.196:0/625379173 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a4805c850 con 0x559663ae4750 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 -- 172.21.15.196:0/625379173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 msgr2=0x559663a5a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 --2- 172.21.15.196:0/625379173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a48005870 tx=0x7f4a48051000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 -- 172.21.15.196:0/625379173 shutdown_connections 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 --2- 172.21.15.196:0/625379173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663a5a6b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 -- 172.21.15.196:0/625379173 >> 172.21.15.196:0/625379173 conn(0x559663adffe0 msgr2=0x559663bcf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 -- 172.21.15.196:0/625379173 shutdown_connections 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 -- 172.21.15.196:0/625379173 wait complete. 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.518+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.521 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5a530800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5a530800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559663aeb630 con 0x559663ae4750 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35610/0 (socket says 172.21.15.196:35610) 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5625c640 1 -- 172.21.15.196:0/1580580907 learned_addr learned my addr 172.21.15.196:0/1580580907 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5625c640 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559663991fe0 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.519+0000 7f4a5625c640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4a48045f50 tx=0x7f4a48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4942e05640 1 -- 172.21.15.196:0/1580580907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a48078070 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559663bdd6f0 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4942e05640 1 -- 172.21.15.196:0/1580580907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48054a70 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4942e05640 1 -- 172.21.15.196:0/1580580907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a48054d50 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559663bddc70 con 0x559663ae4750 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.520+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a5a530800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a5a530800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55966397f580 con 0x559663bea020 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4942e05640 1 -- 172.21.15.196:0/1580580907 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a4807b070 con 0x559663ae4750 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a56a5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a56a5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35616/0 (socket says 172.21.15.196:35616) 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a56a5d640 1 -- 172.21.15.196:0/380951370 learned_addr learned my addr 172.21.15.196:0/380951370 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4942e05640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 0x7f493c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4942e05640 1 -- 172.21.15.196:0/1580580907 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4a48070070 con 0x559663ae4750 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a5625c640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 0x7f493c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a56a5d640 1 -- 172.21.15.196:0/380951370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559663bea960 con 0x559663bea020 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a56a5d640 1 --2- 172.21.15.196:0/380951370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000a430 tx=0x7f4a5000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7df99de9265f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.521+0000 7f4a5625c640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 0x7f493c039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a4807c960 tx=0x7f4a48054f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4940e01640 1 -- 172.21.15.196:0/380951370 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a50015070 con 0x559663bea020 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4940e01640 1 -- 172.21.15.196:0/380951370 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a50001670 con 0x559663bea020 2024-09-21T08:53:43.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4940e01640 1 -- 172.21.15.196:0/380951370 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a50001990 con 0x559663bea020 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- 172.21.15.196:0/380951370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 msgr2=0x559663bea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 --2- 172.21.15.196:0/380951370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000a430 tx=0x7f4a5000a8f0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- 172.21.15.196:0/380951370 shutdown_connections 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 --2- 172.21.15.196:0/380951370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bea420 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- 172.21.15.196:0/380951370 >> 172.21.15.196:0/380951370 conn(0x559663ae5090 msgr2=0x559663be57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- 172.21.15.196:0/380951370 shutdown_connections 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- 172.21.15.196:0/380951370 wait complete. 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.522+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a5a530800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a5a530800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559663beb310 con 0x559663bea020 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a56a5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a56a5d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35630/0 (socket says 172.21.15.196:35630) 2024-09-21T08:53:43.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a56a5d640 1 -- 172.21.15.196:0/1962550933 learned_addr learned my addr 172.21.15.196:0/1962550933 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a56a5d640 1 -- 172.21.15.196:0/1962550933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559663bf1a80 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a56a5d640 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4a50013040 tx=0x7f4a50003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f493affd640 1 -- 172.21.15.196:0/1962550933 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a50020020 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559663bf1d10 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f493affd640 1 -- 172.21.15.196:0/1962550933 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a500108e0 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559663bf49c0 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.523+0000 7f493affd640 1 -- 172.21.15.196:0/1962550933 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a50015040 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.524+0000 7f493affd640 1 -- 172.21.15.196:0/1962550933 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a50023020 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.524+0000 7f493affd640 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 0x7f4930039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.524+0000 7f493affd640 1 -- 172.21.15.196:0/1962550933 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4a5004c4e0 con 0x559663bea020 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a4ffff640 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 0x7f4930039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 1 Processor -- start 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a4ffff640 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 0x7f4930039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000c00 tx=0x7f4a40001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 1 -- start start 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5a530800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x559663a58d20 con 0x559663c0b580 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5625c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35644/0 (socket says 172.21.15.196:35644) 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.525+0000 7f4a5625c640 1 -- 172.21.15.196:0/1689666136 learned_addr learned my addr 172.21.15.196:0/1689666136 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f4a5625c640 1 -- 172.21.15.196:0/1689666136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559663c0bf70 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f4a5625c640 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4a48050020 tx=0x7f4a48068f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f491afe5640 1 -- 172.21.15.196:0/1689666136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a4809d070 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f491afe5640 1 -- 172.21.15.196:0/1689666136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a48068420 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559663c0eb40 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f491afe5640 1 -- 172.21.15.196:0/1689666136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a48068720 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.526+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559663c0ef20 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f491afe5640 1 -- 172.21.15.196:0/1689666136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a480a0070 con 0x559663c0b580 2024-09-21T08:53:43.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f491afe5640 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 0x7f4898039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f491afe5640 1 -- 172.21.15.196:0/1689666136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4a480a3d50 con 0x559663c0b580 2024-09-21T08:53:43.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f4a4ffff640 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 0x7f4898039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f4a4ffff640 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 0x7f4898039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f60 tx=0x7f4a40006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f4918fe1640 20 reqs_thread_entry: start 2024-09-21T08:53:43.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 0x559663c1b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.527+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559663c1b920 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a56a5d640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 0x559663c1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a56a5d640 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 0x559663c1b350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a56a5d640 1 -- 172.21.15.196:0/1580580907 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5000e070 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559663c1bea0 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a56a5d640 1 -- 172.21.15.196:0/1580580907 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a5000e070 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.528+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559663c1d3f0 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a56a5d640 1 -- 172.21.15.196:0/1580580907 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a5000e070 con 0x559663c18f60 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 msgr2=0x7f4930039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 0x7f4930039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000c00 tx=0x7f4a40001330 comp rx=0 tx=0).stop 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 msgr2=0x559663bf1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4a50013040 tx=0x7f4a50003370 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 shutdown_connections 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4930036b40 0x7f4930039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1962550933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663bea020 0x559663bf1540 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.529+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 >> 172.21.15.196:0/1962550933 conn(0x559663ae5090 msgr2=0x559663be5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 shutdown_connections 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1962550933 wait complete. 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 msgr2=0x7f4898039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 0x7f4898039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f60 tx=0x7f4a40006000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 msgr2=0x559663c0b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4a48050020 tx=0x7f4a48068f60 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 shutdown_connections 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4898036b90 0x7f4898039050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1689666136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663c0b580 0x559663c0b9a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 >> 172.21.15.196:0/1689666136 conn(0x559663c004d0 msgr2=0x559663c02dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 shutdown_connections 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1689666136 wait complete. 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 msgr2=0x559663c1b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 0x559663c1b350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 msgr2=0x7f493c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 0x7f493c039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a4807c960 tx=0x7f4a48054f70 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 msgr2=0x559663bdd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4a48045f50 tx=0x7f4a48002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 shutdown_connections 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x559663c18f60 0x559663c1b350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f493c036b40 0x7f493c039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 --2- 172.21.15.196:0/1580580907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x559663ae4750 0x559663bdd1b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 >> 172.21.15.196:0/1580580907 conn(0x559663adffe0 msgr2=0x559663bcec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 shutdown_connections 2024-09-21T08:53:43.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.530+0000 7f4a5a530800 1 -- 172.21.15.196:0/1580580907 wait complete. 2024-09-21T08:53:43.541 INFO:teuthology.orchestra.run.smithi196.stdout:{"id":"0bf56418-c298-49e5-b663-8247e6a1b700","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","zones":[{"id":"6f304bac-6e5f-4f70-8cad-d3bf6d19cc46","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-21T08:53:43.542 DEBUG:tasks.util.rgw: json result: {'id': '0bf56418-c298-49e5-b663-8247e6a1b700', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'zones': [{'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-21T08:53:43.544 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-21T08:53:43.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-21T08:53:43.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-21T08:53:43.566 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-21T08:53:43.636 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.636 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.635+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.635+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.635+0000 7f2e64430800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564a18625950 0x564a18627d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.635+0000 7f2e64430800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a184e1b30 con 0x564a18621510 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e64430800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564a184c3360 con 0x564a18625950 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5ef5f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564a18625950 0x564a18627d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.637 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5f760640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564a18621510 0x564a18621910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57964/0 (socket says 172.21.15.196:57964) 2024-09-21T08:53:43.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5f760640 1 -- 172.21.15.196:0/102125114 learned_addr learned my addr 172.21.15.196:0/102125114 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:43.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5e75e640 1 -- 172.21.15.196:0/102125114 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023233391 0 0) 0x564a184e1b30 con 0x564a18621510 2024-09-21T08:53:43.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5e75e640 1 -- 172.21.15.196:0/102125114 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e48001e10 con 0x564a18621510 2024-09-21T08:53:43.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/102125114 >> v1:172.21.15.29:6789/0 conn(0x564a18621510 legacy=0x564a18621910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.638 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.636+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/102125114 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a184e9e00 con 0x564a18625950 2024-09-21T08:53:43.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.638+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/102125114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a18627d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400a470 tx=0x7f2e54045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4645b618fc56bce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.638+0000 7f2e5e75e640 1 -- 172.21.15.196:0/102125114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54059070 con 0x564a18625950 2024-09-21T08:53:43.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.638+0000 7f2e5e75e640 1 -- 172.21.15.196:0/102125114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54054570 con 0x564a18625950 2024-09-21T08:53:43.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.638+0000 7f2e5e75e640 1 -- 172.21.15.196:0/102125114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54054870 con 0x564a18625950 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 -- 172.21.15.196:0/102125114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 msgr2=0x564a18627d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 --2- 172.21.15.196:0/102125114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a18627d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400a470 tx=0x7f2e54045920 comp rx=0 tx=0).stop 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 -- 172.21.15.196:0/102125114 shutdown_connections 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 --2- 172.21.15.196:0/102125114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a18627d40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 -- 172.21.15.196:0/102125114 >> 172.21.15.196:0/102125114 conn(0x564a1861cde0 msgr2=0x564a1861f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 -- 172.21.15.196:0/102125114 shutdown_connections 2024-09-21T08:53:43.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.639+0000 7f2e64430800 1 -- 172.21.15.196:0/102125114 wait complete. 2024-09-21T08:53:43.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.652+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.652+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e64430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e64430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a1856e450 con 0x564a18621510 2024-09-21T08:53:43.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e5f760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e5f760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35660/0 (socket says 172.21.15.196:35660) 2024-09-21T08:53:43.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e5f760640 1 -- 172.21.15.196:0/1863428691 learned_addr learned my addr 172.21.15.196:0/1863428691 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e5f760640 1 -- 172.21.15.196:0/1863428691 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a184bbbc0 con 0x564a18621510 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.653+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1863428691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e5000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1f9d112e846e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2d4d60a640 1 -- 172.21.15.196:0/1863428691 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e50012020 con 0x564a18621510 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2d4d60a640 1 -- 172.21.15.196:0/1863428691 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5000e5a0 con 0x564a18621510 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2d4d60a640 1 -- 172.21.15.196:0/1863428691 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5000e8e0 con 0x564a18621510 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 -- 172.21.15.196:0/1863428691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 msgr2=0x564a18713a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 --2- 172.21.15.196:0/1863428691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e5000b780 comp rx=0 tx=0).stop 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 -- 172.21.15.196:0/1863428691 shutdown_connections 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 --2- 172.21.15.196:0/1863428691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18621510 0x564a18713a70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 -- 172.21.15.196:0/1863428691 >> 172.21.15.196:0/1863428691 conn(0x564a1861cde0 msgr2=0x564a1870b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 -- 172.21.15.196:0/1863428691 shutdown_connections 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.654+0000 7f2e64430800 1 -- 172.21.15.196:0/1863428691 wait complete. 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e64430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e64430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a18628580 con 0x564a18625950 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e5f760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e5f760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35670/0 (socket says 172.21.15.196:35670) 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e5f760640 1 -- 172.21.15.196:0/1920861399 learned_addr learned my addr 172.21.15.196:0/1920861399 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.655+0000 7f2e5f760640 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a184cffe0 con 0x564a18625950 2024-09-21T08:53:43.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2d4be07640 1 -- 172.21.15.196:0/1920861399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e50012030 con 0x564a18625950 2024-09-21T08:53:43.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2d4be07640 1 -- 172.21.15.196:0/1920861399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50001490 con 0x564a18625950 2024-09-21T08:53:43.660 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a1871bbc0 con 0x564a18625950 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2d4be07640 1 -- 172.21.15.196:0/1920861399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5001a700 con 0x564a18625950 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.656+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a1871c0e0 con 0x564a18625950 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2d4be07640 1 -- 172.21.15.196:0/1920861399 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e50015020 con 0x564a18625950 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2d4be07640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 0x7f2d44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2d4be07640 1 -- 172.21.15.196:0/1920861399 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f2e50020030 con 0x564a18625950 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 0x7f2d44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 0x564a18722ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18723010 con 0x564a187206e0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.657+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 0x564a18722ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 0x7f2d44039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x564a18622310 tx=0x7f2e54050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 0x564a18722ad0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1920861399 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5800a4a0 con 0x564a187206e0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1871fc10 con 0x564a187206e0 2024-09-21T08:53:43.661 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1920861399 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e5800a4a0 con 0x564a187206e0 2024-09-21T08:53:43.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 0x564a18727600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.658+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18727d90 con 0x564a18725140 2024-09-21T08:53:43.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.659+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 0x564a18727600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.662 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.659+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 0x564a18727600 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.659+0000 7f2e5f760640 1 -- 172.21.15.196:0/1920861399 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a18725140 2024-09-21T08:53:43.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.659+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187238f0 con 0x564a187206e0 2024-09-21T08:53:43.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.659+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1920861399 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e5800a4a0 con 0x564a187206e0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18723d10 con 0x564a187206e0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1920861399 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e5800a4a0 con 0x564a187206e0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e64430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e64430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a184bd580 con 0x564a187366b0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35674/0 (socket says 172.21.15.196:35674) 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.660+0000 7f2e5ff61640 1 -- 172.21.15.196:0/4147585567 learned_addr learned my addr 172.21.15.196:0/4147585567 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2e5ff61640 1 -- 172.21.15.196:0/4147585567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a18737010 con 0x564a187366b0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x564a18723410 tx=0x7f2e58018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2d49602640 1 -- 172.21.15.196:0/4147585567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58014450 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2d49602640 1 -- 172.21.15.196:0/4147585567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58014610 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a187372a0 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2d49602640 1 -- 172.21.15.196:0/4147585567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58014930 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.661+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a18739f80 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.662+0000 7f2d49602640 1 -- 172.21.15.196:0/4147585567 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e58011040 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.662+0000 7f2d49602640 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 0x7f2d38039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.662+0000 7f2d49602640 1 -- 172.21.15.196:0/4147585567 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f2e5801e070 con 0x564a187366b0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.662+0000 7f2e5f760640 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 0x7f2d38039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.662+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5f760640 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 0x7f2d38039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x564a18724490 tx=0x7f2e5000de30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e64430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e64430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a18714220 con 0x564a18743360 2024-09-21T08:53:43.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35680/0 (socket says 172.21.15.196:35680) 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5ff61640 1 -- 172.21.15.196:0/4000490988 learned_addr learned my addr 172.21.15.196:0/4000490988 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5ff61640 1 -- 172.21.15.196:0/4000490988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a18743d30 con 0x564a18743360 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.663+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/4000490988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2e5804cbe0 tx=0x7f2e58011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78b30eaa847e2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2d42ffd640 1 -- 172.21.15.196:0/4000490988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58028040 con 0x564a18743360 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2d42ffd640 1 -- 172.21.15.196:0/4000490988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58022d90 con 0x564a18743360 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2d42ffd640 1 -- 172.21.15.196:0/4000490988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58016ab0 con 0x564a18743360 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- 172.21.15.196:0/4000490988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 msgr2=0x564a18743760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 --2- 172.21.15.196:0/4000490988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2e5804cbe0 tx=0x7f2e58011a80 comp rx=0 tx=0).stop 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- 172.21.15.196:0/4000490988 shutdown_connections 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 --2- 172.21.15.196:0/4000490988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a18743760 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- 172.21.15.196:0/4000490988 >> 172.21.15.196:0/4000490988 conn(0x564a1873f6c0 msgr2=0x564a1873d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- 172.21.15.196:0/4000490988 shutdown_connections 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- 172.21.15.196:0/4000490988 wait complete. 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 Processor -- start 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.664+0000 7f2e64430800 1 -- start start 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e64430800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a1874a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e64430800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a187443a0 con 0x564a18743360 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a1874a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e5ff61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a1874a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35694/0 (socket says 172.21.15.196:35694) 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 learned_addr learned my addr 172.21.15.196:0/1271282353 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1874adb0 con 0x564a18743360 2024-09-21T08:53:43.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a1874a870 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e5804cbe0 tx=0x7f2e5804cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2d417fa640 1 -- 172.21.15.196:0/1271282353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58028040 con 0x564a18743360 2024-09-21T08:53:43.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2d417fa640 1 -- 172.21.15.196:0/1271282353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5804b040 con 0x564a18743360 2024-09-21T08:53:43.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.665+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a1874b040 con 0x564a18743360 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.666+0000 7f2d417fa640 1 -- 172.21.15.196:0/1271282353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58016980 con 0x564a18743360 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.666+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a1874dcf0 con 0x564a18743360 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.666+0000 7f2d417fa640 1 -- 172.21.15.196:0/1271282353 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e5804e070 con 0x564a18743360 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.666+0000 7f2d417fa640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d28036b40 0x7f2d28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.666+0000 7f2d417fa640 1 -- 172.21.15.196:0/1271282353 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f2e5800e040 con 0x564a18743360 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d28036b40 0x7f2d28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d28036b40 0x7f2d28039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e50044480 tx=0x7f2e50035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a18756470 0x564a18758930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18759080 con 0x564a18756470 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.667+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a18756470 0x564a18758930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a18756470 0x564a18758930 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.680 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 realm 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187594b0 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18759d80 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.668+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1875a120 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.681 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e64430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a1875ae80 0x564a1875d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1875d8c0 con 0x564a1875ae80 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a1875ae80 0x564a1875d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e5ff61640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a1875ae80 0x564a1875d270 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.669+0000 7f2e64430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e64430800 20 searching for the correct realm 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564a1875f870 0x564a18761d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564a1875f870 0x564a18761d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564a1875f870 0x564a18761d30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.682 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5f760640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2e50017050 0x7f2e500444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.670+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2e50017050 0x7f2e500444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ef5f640 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2e50017050 0x7f2e500444f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.671+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.683 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.672+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.673+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.684 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.674+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.675+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.685 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.676+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.677+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.686 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.687 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875f870 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.678+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a1875ae80 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x564a18756470 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564a18762400 con 0x7f2e50017050 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:43.693 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1875e280 con 0x564a18756470 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.679+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1875dec0 con 0x564a18756470 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1875ded0 con 0x564a18756470 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 zone default found 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 4 Realm: () 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 zonegroup default 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187628a0 con 0x564a1875ae80 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.680+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18764b70 con 0x564a1875f870 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a18764f10 con 0x564a1875f870 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 20 started sync module instance, tier type = 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.681+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18763fb0 con 0x7f2e50017050 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.682+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.682+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876237972704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18763fb0 con 0x7f2e50017050 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.682+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18765960 con 0x564a18756470 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.683+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876237972704] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.683+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.683+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876237976656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18763fb0 con 0x564a18756470 2024-09-21T08:53:43.696 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.683+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18766420 con 0x564a1875f870 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.684+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876237976656] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.684+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.684+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876237970176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18763f20 con 0x564a1875f870 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.684+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a187672e0 con 0x7f2e50017050 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.685+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.685+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876237983760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18767a40 con 0x7f2e50017050 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.685+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18768540 con 0x564a18756470 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.686+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876237970176] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.687+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876237983760] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.687+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.687+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876237987888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18768500 con 0x564a18756470 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.687+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18768e10 con 0x564a1875ae80 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.688+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.688+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876237987888] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.688+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876237990240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18768500 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.688+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a18766830 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.689+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876237990240] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.689+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.689+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876237981744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a187697d0 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.689+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1876a210 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876237981744] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876237995232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1876a1d0 con 0x564a1875ae80 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=0 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=1 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=2 2024-09-21T08:53:43.698 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=3 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=4 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=5 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.690+0000 7f2e64430800 20 add_watcher() i=6 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.691+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876237995232] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.691+0000 7f2e64430800 20 add_watcher() i=7 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.691+0000 7f2e64430800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:43.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.691+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1876d6c0 con 0x564a18756470 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.692+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.692+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876237992368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1876ab80 con 0x564a18756470 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876237992368] v36'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2d15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e64430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e64430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e64430800 5 note: GC not initialized 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2d14fe1640 20 reqs_thread_entry: start 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e64430800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.693+0000 7f2e64430800 20 Filter name: none 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2c8e7fc640 20 reqs_thread_entry: start 2024-09-21T08:53:43.703 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187a0ba0 con 0x564a1875ae80 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a1879f1e0 con 0x564a18756470 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T08:53:43.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.694+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879fb50 con 0x564a1875ae80 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e64430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e64430800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e64430800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94876238214656 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187a4640 con 0x564a18756470 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== watch-notify(notify (1) cookie 94876237987888 notify 154618822679 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f2e54075040 con 0x564a18756470 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2d42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 94876237987888 notifier 4839 bl.length()=649 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2d42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify cookie 94876238214656 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2d42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2d42ffd640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2d24003ea0 con 0x564a18756470 2024-09-21T08:53:43.705 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.696+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== watch-notify(notify_complete (2) cookie 94876238214656 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e54068040 con 0x564a18756470 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.697+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879f600 con 0x564a18756470 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v36'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e64430800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e64430800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e64430800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94876238214656 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564a187a4640 con 0x564a1875f870 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== watch-notify(notify (1) cookie 94876237970176 notify 154618822664 ret 0) ==== 219+0+0 (crc 0 0 0) 0x564a1871c0e0 con 0x564a1875f870 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2d42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822664 cookie 94876237970176 notifier 4839 bl.length()=177 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2d42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2d42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(68 notify.2 [notify cookie 94876238214656 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2d42ffd640 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2d24003ea0 con 0x564a1875f870 2024-09-21T08:53:43.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.698+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== watch-notify(notify_complete (2) cookie 94876238214656 notify 154618822664 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a1871bbc0 con 0x564a1875f870 2024-09-21T08:53:43.707 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:43.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.699+0000 7f2d15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:43.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.699+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876237992368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a18756470 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.700+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94876237992368] v36'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.700+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876237972704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x7f2e50017050 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.701+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94876237972704] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.701+0000 7f2e64430800 20 remove_watcher() i=0 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.701+0000 7f2e64430800 2 removed watcher, disabling cache 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.701+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876237976656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a18756470 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.702+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94876237976656] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.702+0000 7f2e64430800 20 remove_watcher() i=1 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.702+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876237970176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a1875f870 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.703+0000 7f2e5f760640 1 -- 172.21.15.196:0/1271282353 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94876237970176] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5000cdb0 con 0x564a1875f870 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.703+0000 7f2e64430800 20 remove_watcher() i=2 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.703+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876237983760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x7f2e50017050 2024-09-21T08:53:43.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.704+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94876237983760] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x7f2e50017050 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.704+0000 7f2e64430800 20 remove_watcher() i=3 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.704+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876237987888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a18756470 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.705+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94876237987888] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5405c040 con 0x564a18756470 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.705+0000 7f2e64430800 20 remove_watcher() i=4 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.705+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876237990240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a1875ae80 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.706+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94876237990240] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.706+0000 7f2e64430800 20 remove_watcher() i=5 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.706+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876237981744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a1875ae80 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.708+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94876237981744] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.708+0000 7f2e64430800 20 remove_watcher() i=6 2024-09-21T08:53:43.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.708+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876237995232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564a1879e860 con 0x564a1875ae80 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e5ff61640 1 -- 172.21.15.196:0/1271282353 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94876237995232] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5803d020 con 0x564a1875ae80 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 20 remove_watcher() i=7 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a1875ae80 msgr2=0x564a1875d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a1875ae80 0x564a1875d270 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a18756470 msgr2=0x564a18758930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a18756470 0x564a18758930 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2e50017050 msgr2=0x7f2e500444f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2e50017050 0x7f2e500444f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564a1875f870 msgr2=0x564a18761d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x564a1875f870 0x564a18761d30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d28036b40 msgr2=0x7f2d28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d28036b40 0x7f2d28039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e50044480 tx=0x7f2e50035000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 msgr2=0x564a1874a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/1271282353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18743360 0x564a1874a870 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e5804cbe0 tx=0x7f2e5804cb70 comp rx=0 tx=0).stop 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 reap_dead start 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e5ef5f640 1 -- 172.21.15.196:0/1271282353 reap_dead start 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 shutdown_connections 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 >> 172.21.15.196:0/1271282353 conn(0x564a1873f6c0 msgr2=0x564a1873d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 shutdown_connections 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/1271282353 wait complete. 2024-09-21T08:53:43.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 msgr2=0x7f2d38039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 0x7f2d38039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x564a18724490 tx=0x7f2e5000de30 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 msgr2=0x564a18736ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x564a18723410 tx=0x7f2e58018830 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 shutdown_connections 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d38036b40 0x7f2d38039000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 --2- 172.21.15.196:0/4147585567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a187366b0 0x564a18736ad0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.709+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 >> 172.21.15.196:0/4147585567 conn(0x564a1872b640 msgr2=0x564a1872e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 shutdown_connections 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/4147585567 wait complete. 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 msgr2=0x564a18727600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 0x564a18727600 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 msgr2=0x564a18722ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 0x564a18722ad0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 msgr2=0x7f2d44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 0x7f2d44039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x564a18622310 tx=0x7f2e54050000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 msgr2=0x564a1871b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e50000ed0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 shutdown_connections 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x564a18725140 0x564a18727600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x564a187206e0 0x564a18722ad0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2d44036b90 0x7f2d44039050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 --2- 172.21.15.196:0/1920861399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a18625950 0x564a1871b680 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 >> 172.21.15.196:0/1920861399 conn(0x564a1861cde0 msgr2=0x564a187098d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 shutdown_connections 2024-09-21T08:53:43.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.710+0000 7f2e64430800 1 -- 172.21.15.196:0/1920861399 wait complete. 2024-09-21T08:53:43.720 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:43.720 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:43.720 ERROR:root:0 2024-09-21T08:53:43.721 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:43.726 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ef31652aeb1006ea-0066ee8997-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:53:43.727 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-21T08:53:43.737 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:43.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-21T08:53:43.749 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-21T08:53:43.749 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-21T08:53:43.764 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-21T08:53:43.764 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-21T08:53:43.772 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-21T08:53:43.772 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:43.776 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:43.776 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-21T08:53:43.780 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:43.780 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:43.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:43.781 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-21T08:53:43.827 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.827 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.826+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.826+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.826+0000 7f31d7836800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5622300d3900 0x5622300d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.826+0000 7f31d7836800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56222ff8eb30 con 0x562230043650 2024-09-21T08:53:43.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.826+0000 7f31d7836800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56222ff70360 con 0x5622300d3900 2024-09-21T08:53:43.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.827+0000 7f31d2351640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5622300d3900 0x5622300d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.827+0000 7f31d2b52640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x562230043650 0x5622300d21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57968/0 (socket says 172.21.15.196:57968) 2024-09-21T08:53:43.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.827+0000 7f31d2b52640 1 -- 172.21.15.196:0/3938675873 learned_addr learned my addr 172.21.15.196:0/3938675873 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:43.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.827+0000 7f31d2351640 1 -- 172.21.15.196:0/3938675873 >> v1:172.21.15.29:6789/0 conn(0x562230043650 legacy=0x5622300d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.827+0000 7f31d2351640 1 -- 172.21.15.196:0/3938675873 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222ff96e00 con 0x5622300d3900 2024-09-21T08:53:43.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.829+0000 7f31d2351640 1 --2- 172.21.15.196:0/3938675873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300d3900 0x5622300d5cf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f31c800a470 tx=0x7f31c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303235969ff035bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.829+0000 7f31d1b50640 1 -- 172.21.15.196:0/3938675873 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c8053570 con 0x5622300d3900 2024-09-21T08:53:43.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.829+0000 7f31d1b50640 1 -- 172.21.15.196:0/3938675873 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8058070 con 0x5622300d3900 2024-09-21T08:53:43.831 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.829+0000 7f31d1b50640 1 -- 172.21.15.196:0/3938675873 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c8053880 con 0x5622300d3900 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 -- 172.21.15.196:0/3938675873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300d3900 msgr2=0x5622300d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 --2- 172.21.15.196:0/3938675873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300d3900 0x5622300d5cf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f31c800a470 tx=0x7f31c8045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 -- 172.21.15.196:0/3938675873 shutdown_connections 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 --2- 172.21.15.196:0/3938675873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300d3900 0x5622300d5cf0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 -- 172.21.15.196:0/3938675873 >> 172.21.15.196:0/3938675873 conn(0x5622300c9db0 msgr2=0x5622300cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 -- 172.21.15.196:0/3938675873 shutdown_connections 2024-09-21T08:53:43.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.830+0000 7f31d7836800 1 -- 172.21.15.196:0/3938675873 wait complete. 2024-09-21T08:53:43.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.843+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.843+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.843+0000 7f31d7836800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.843+0000 7f31d7836800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56223001b360 con 0x562230043650 2024-09-21T08:53:43.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.844+0000 7f31d2b52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.844+0000 7f31d2b52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35710/0 (socket says 172.21.15.196:35710) 2024-09-21T08:53:43.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.844+0000 7f31d2b52640 1 -- 172.21.15.196:0/3663368612 learned_addr learned my addr 172.21.15.196:0/3663368612 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.844+0000 7f31d2b52640 1 -- 172.21.15.196:0/3663368612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222ff68bc0 con 0x562230043650 2024-09-21T08:53:43.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.844+0000 7f31d2b52640 1 --2- 172.21.15.196:0/3663368612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f31c40017a0 tx=0x7f31c4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ab1311a4382da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f30c0e09640 1 -- 172.21.15.196:0/3663368612 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c4016070 con 0x562230043650 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f30c0e09640 1 -- 172.21.15.196:0/3663368612 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c4004520 con 0x562230043650 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f30c0e09640 1 -- 172.21.15.196:0/3663368612 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c4004820 con 0x562230043650 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 -- 172.21.15.196:0/3663368612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 msgr2=0x5622301be8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 --2- 172.21.15.196:0/3663368612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f31c40017a0 tx=0x7f31c4001c60 comp rx=0 tx=0).stop 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 -- 172.21.15.196:0/3663368612 shutdown_connections 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 --2- 172.21.15.196:0/3663368612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301be8c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 -- 172.21.15.196:0/3663368612 >> 172.21.15.196:0/3663368612 conn(0x5622300c9db0 msgr2=0x5622301ba280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 -- 172.21.15.196:0/3663368612 shutdown_connections 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.845+0000 7f31d7836800 1 -- 172.21.15.196:0/3663368612 wait complete. 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d7836800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d7836800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5622300d6620 con 0x562230043650 2024-09-21T08:53:43.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d2b52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d2b52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35716/0 (socket says 172.21.15.196:35716) 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d2b52640 1 -- 172.21.15.196:0/167016519 learned_addr learned my addr 172.21.15.196:0/167016519 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.846+0000 7f31d2b52640 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222ff7cfe0 con 0x562230043650 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f31d2b52640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f31c40044f0 tx=0x7f31c4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f30bf606640 1 -- 172.21.15.196:0/167016519 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c4021020 con 0x562230043650 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f30bf606640 1 -- 172.21.15.196:0/167016519 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c4011530 con 0x562230043650 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622301c67e0 con 0x562230043650 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f30bf606640 1 -- 172.21.15.196:0/167016519 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31c4016040 con 0x562230043650 2024-09-21T08:53:43.850 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.847+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622301c6d60 con 0x562230043650 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f30bf606640 1 -- 172.21.15.196:0/167016519 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31c4024020 con 0x562230043650 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f30bf606640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 0x7f30b80390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f30bf606640 1 -- 172.21.15.196:0/167016519 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31c404c080 con 0x562230043650 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d2351640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 0x7f30b80390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 0x5622301cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622301cd820 con 0x5622300d3900 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d3353640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 0x5622301cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d2351640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 0x7f30b80390a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c8057000 tx=0x7f31c8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.848+0000 7f31d3353640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 0x5622301cd200 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d3353640 1 -- 172.21.15.196:0/167016519 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31cc0083e0 con 0x5622300d3900 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622301ca8c0 con 0x5622300d3900 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d3353640 1 -- 172.21.15.196:0/167016519 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31cc0083e0 con 0x5622300d3900 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 0x5622301d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622301d2630 con 0x5622301cfb50 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.849+0000 7f31d2b52640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 0x5622301d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.850+0000 7f31d2b52640 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 0x5622301d1f40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.850+0000 7f31d2b52640 1 -- 172.21.15.196:0/167016519 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31c400f070 con 0x5622301cfb50 2024-09-21T08:53:43.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.850+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622301ce9f0 con 0x5622300d3900 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.850+0000 7f31d3353640 1 -- 172.21.15.196:0/167016519 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31cc0083e0 con 0x5622300d3900 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.850+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622301cee70 con 0x5622300d3900 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d3353640 1 -- 172.21.15.196:0/167016519 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31cc0083e0 con 0x5622300d3900 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d7836800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d7836800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56222ff6a580 con 0x5622301e0fc0 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35732/0 (socket says 172.21.15.196:35732) 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.851+0000 7f31d3353640 1 -- 172.21.15.196:0/2351139550 learned_addr learned my addr 172.21.15.196:0/2351139550 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f31d3353640 1 -- 172.21.15.196:0/2351139550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622301e1920 con 0x5622301e0fc0 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f31d3353640 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x5622301c76a0 tx=0x7f31cc00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f30bce01640 1 -- 172.21.15.196:0/2351139550 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc007d00 con 0x5622301e0fc0 2024-09-21T08:53:43.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f30bce01640 1 -- 172.21.15.196:0/2351139550 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc01e020 con 0x5622301e0fc0 2024-09-21T08:53:43.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622301e1bb0 con 0x5622301e0fc0 2024-09-21T08:53:43.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f30bce01640 1 -- 172.21.15.196:0/2351139550 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc019420 con 0x5622301e0fc0 2024-09-21T08:53:43.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.852+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622301e4890 con 0x5622301e0fc0 2024-09-21T08:53:43.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f30bce01640 1 -- 172.21.15.196:0/2351139550 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31cc016040 con 0x5622301e0fc0 2024-09-21T08:53:43.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f30bce01640 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 0x7f30ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f30bce01640 1 -- 172.21.15.196:0/2351139550 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31cc01f030 con 0x5622301e0fc0 2024-09-21T08:53:43.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f31d2b52640 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 0x7f30ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.868 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.853+0000 7f31d2b52640 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 0x7f30ac039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5622301cdcc0 tx=0x7f31c4040040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d7836800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d7836800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5622301bf070 con 0x5622300cf460 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35734/0 (socket says 172.21.15.196:35734) 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d3353640 1 -- 172.21.15.196:0/4110279797 learned_addr learned my addr 172.21.15.196:0/4110279797 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d3353640 1 -- 172.21.15.196:0/4110279797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622300cfe30 con 0x5622300cf460 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f31d3353640 1 --2- 172.21.15.196:0/4110279797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005700 tx=0x7f31cc04ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61868c028a8b6c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f30b67fc640 1 -- 172.21.15.196:0/4110279797 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc01d040 con 0x5622300cf460 2024-09-21T08:53:43.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f30b67fc640 1 -- 172.21.15.196:0/4110279797 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc0184e0 con 0x5622300cf460 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.854+0000 7f30b67fc640 1 -- 172.21.15.196:0/4110279797 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc0144b0 con 0x5622300cf460 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- 172.21.15.196:0/4110279797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 msgr2=0x5622300cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 --2- 172.21.15.196:0/4110279797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005700 tx=0x7f31cc04ce90 comp rx=0 tx=0).stop 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- 172.21.15.196:0/4110279797 shutdown_connections 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 --2- 172.21.15.196:0/4110279797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622300cf860 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- 172.21.15.196:0/4110279797 >> 172.21.15.196:0/4110279797 conn(0x5622301e9fb0 msgr2=0x5622301e80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- 172.21.15.196:0/4110279797 shutdown_connections 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- 172.21.15.196:0/4110279797 wait complete. 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 Processor -- start 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- start start 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d7836800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5622300ce140 con 0x5622300cf460 2024-09-21T08:53:43.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d3353640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35746/0 (socket says 172.21.15.196:35746) 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.855+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 learned_addr learned my addr 172.21.15.196:0/599315850 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622301f7770 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f31d3353640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005700 tx=0x7f31cc04cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f30b4ff9640 1 -- 172.21.15.196:0/599315850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc030070 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f30b4ff9640 1 -- 172.21.15.196:0/599315850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc019650 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622301f7a00 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f30b4ff9640 1 -- 172.21.15.196:0/599315850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31cc01d070 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.856+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622301fa6b0 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.857+0000 7f30b4ff9640 1 -- 172.21.15.196:0/599315850 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31cc033070 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.857+0000 7f30b4ff9640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f309c036b40 0x7f309c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.857+0000 7f30b4ff9640 1 -- 172.21.15.196:0/599315850 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31cc036d60 con 0x5622300cf460 2024-09-21T08:53:43.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.857+0000 7f31d2b52640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f309c036b40 0x7f309c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.857+0000 7f31d2b52640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f309c036b40 0x7f309c039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31c402dfd0 tx=0x7f31c4032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562230202d40 0x562230205200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562230205950 con 0x562230202d40 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d2351640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562230202d40 0x562230205200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d2351640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562230202d40 0x562230205200 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 20 realm 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.858+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562230205d80 con 0x562230202d40 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.872 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562230206650 con 0x562230202d40 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622302069f0 con 0x562230202d40 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562230207750 0x562230209b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223020a150 con 0x562230207750 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.859+0000 7f31d3353640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562230207750 0x562230209b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d3353640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562230207750 0x562230209b40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d7836800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d7836800 20 searching for the correct realm 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56223020c0c0 0x56223020e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d2b52640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56223020c0c0 0x56223020e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.860+0000 7f31d2b52640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56223020c0c0 0x56223020e580 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2b52640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f31c4026020 0x7f31c400f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2351640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f31c4026020 0x7f31c400f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2351640 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f31c4026020 0x7f31c400f9c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.861+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.876 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.862+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.877 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.863+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.864+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.865+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.866+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.867+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x56223020c0c0 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.868+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230207750 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.869+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.869+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x562230202d40 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.869+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.869+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56223020ec50 con 0x7f31c4026020 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223020b630 con 0x562230202d40 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223020aea0 con 0x562230202d40 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223020a5e0 con 0x562230202d40 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 zone default found 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 4 Realm: () 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.870+0000 7f31d7836800 20 zonegroup default 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223020f580 con 0x562230207750 2024-09-21T08:53:43.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.871+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5622302117b0 con 0x56223020c0c0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562230211b50 con 0x56223020c0c0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 20 started sync module instance, tier type = 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.872+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230210c40 con 0x7f31c4026020 2024-09-21T08:53:43.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.873+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.873+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94704836350352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230210c40 con 0x7f31c4026020 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.873+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230212560 con 0x562230202d40 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.874+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94704836350352] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.874+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.874+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94704836354704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230210c40 con 0x562230202d40 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.874+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230212f70 con 0x56223020c0c0 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.875+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.875+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94704836354704] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.875+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94704836356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230213360 con 0x56223020c0c0 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.876+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230213d90 con 0x7f31c4026020 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.876+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94704836356800] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.877+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.877+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94704836347792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230214180 con 0x7f31c4026020 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.877+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230214b80 con 0x562230202d40 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.878+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94704836347792] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.878+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.878+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94704836360352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230214b40 con 0x562230202d40 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.878+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5622302155c0 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.879+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94704836360352] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.879+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.879+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94704836364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5622302155c0 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.879+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230215fc0 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.880+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94704836364400] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.880+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.880+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94704836369104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5622302155c0 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.880+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230216a10 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94704836369104] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94704836371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230216bf0 con 0x562230207750 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=0 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=1 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=2 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=3 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=4 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=5 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.881+0000 7f31d7836800 20 add_watcher() i=6 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.882+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94704836371744] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.882+0000 7f31d7836800 20 add_watcher() i=7 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.882+0000 7f31d7836800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.882+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562230219fc0 con 0x562230202d40 2024-09-21T08:53:43.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.883+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.883+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94704836373216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5622302173b0 con 0x562230202d40 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94704836373216] v36'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f30897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d7836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d7836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d7836800 5 note: GC not initialized 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f3003fff640 20 reqs_thread_entry: start 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d7836800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.884+0000 7f31d7836800 20 Filter name: none 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f3001ffb640 20 reqs_thread_entry: start 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 20 rados->read ofs=0 len=0 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223024d250 con 0x562230207750 2024-09-21T08:53:43.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 20 rados_obj.operate() r=0 bl.length=473 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.885+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230253bf0 con 0x562230207750 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.886+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.886+0000 7f31d7836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.886+0000 7f31d7836800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.886+0000 7f31d7836800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.886+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94704836621744 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56223024f230 con 0x562230202d40 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94704836360352 notify 154618822681 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56222ff96e00 con 0x562230202d40 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f30b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 94704836360352 notifier 4846 bl.length()=636 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94704836621744 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f30b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:43.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f30b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:43.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f30b67fc640 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3098003ea0 con 0x562230202d40 2024-09-21T08:53:43.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.887+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94704836621744 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31c805f960 con 0x562230202d40 2024-09-21T08:53:43.901 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:43.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.888+0000 7f30897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:43.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.888+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94704836373216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56223024af70 con 0x562230202d40 2024-09-21T08:53:43.906 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.889+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94704836373216] v36'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.889+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94704836350352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56223024af70 con 0x7f31c4026020 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.890+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94704836350352] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.890+0000 7f31d7836800 20 remove_watcher() i=0 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.890+0000 7f31d7836800 2 removed watcher, disabling cache 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.890+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94704836354704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56223024af70 con 0x562230202d40 2024-09-21T08:53:43.907 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.891+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94704836354704] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.891+0000 7f31d7836800 20 remove_watcher() i=1 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.891+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94704836356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56223024af70 con 0x56223020c0c0 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.892+0000 7f31d2b52640 1 -- 172.21.15.196:0/599315850 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94704836356800] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c400f070 con 0x56223020c0c0 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.892+0000 7f31d7836800 20 remove_watcher() i=2 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.892+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94704836347792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230211190 con 0x7f31c4026020 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.893+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94704836347792] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x7f31c4026020 2024-09-21T08:53:43.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.893+0000 7f31d7836800 20 remove_watcher() i=3 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.893+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94704836360352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230210790 con 0x562230202d40 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.894+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94704836360352] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c8051070 con 0x562230202d40 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.894+0000 7f31d7836800 20 remove_watcher() i=4 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.894+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94704836364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230211190 con 0x562230207750 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.895+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94704836364400] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.895+0000 7f31d7836800 20 remove_watcher() i=5 2024-09-21T08:53:43.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.895+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94704836369104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230210790 con 0x562230207750 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.896+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94704836369104] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.896+0000 7f31d7836800 20 remove_watcher() i=6 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.896+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94704836371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562230211190 con 0x562230207750 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.897+0000 7f31d3353640 1 -- 172.21.15.196:0/599315850 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94704836371744] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31cc032030 con 0x562230207750 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.897+0000 7f31d7836800 20 remove_watcher() i=7 2024-09-21T08:53:43.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562230207750 msgr2=0x562230209b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x562230207750 0x562230209b40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562230202d40 msgr2=0x562230205200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x562230202d40 0x562230205200 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f31c4026020 msgr2=0x7f31c400f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f31c4026020 0x7f31c400f9c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56223020c0c0 msgr2=0x56223020e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56223020c0c0 0x56223020e580 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f309c036b40 msgr2=0x7f309c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f309c036b40 0x7f309c039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31c402dfd0 tx=0x7f31c4032000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 msgr2=0x5622301f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d2351640 1 -- 172.21.15.196:0/599315850 reap_dead start 2024-09-21T08:53:43.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005700 tx=0x7f31cc04cb50 comp rx=0 tx=0).stop 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 shutdown_connections 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/599315850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622300cf460 0x5622301f7230 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 >> 172.21.15.196:0/599315850 conn(0x5622301e9fb0 msgr2=0x5622301e8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 shutdown_connections 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/599315850 wait complete. 2024-09-21T08:53:43.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 msgr2=0x7f30ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 0x7f30ac039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5622301cdcc0 tx=0x7f31c4040040 comp rx=0 tx=0).stop 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 msgr2=0x5622301e13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x5622301c76a0 tx=0x7f31cc00aec0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 shutdown_connections 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30ac036b40 0x7f30ac039000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 --2- 172.21.15.196:0/2351139550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5622301e0fc0 0x5622301e13e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 >> 172.21.15.196:0/2351139550 conn(0x5622301d5f50 msgr2=0x5622301d8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 shutdown_connections 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.898+0000 7f31d7836800 1 -- 172.21.15.196:0/2351139550 wait complete. 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 msgr2=0x5622301d1f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 0x5622301d1f40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 msgr2=0x5622301cd200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 0x5622301cd200 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 msgr2=0x7f30b80390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 0x7f30b80390a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c8057000 tx=0x7f31c8052000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 msgr2=0x5622301c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f31c40044f0 tx=0x7f31c4001250 comp rx=0 tx=0).stop 2024-09-21T08:53:43.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 shutdown_connections 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5622301cfb50 0x5622301d1f40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5622300d3900 0x5622301cd200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f30b8036be0 0x7f30b80390a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 --2- 172.21.15.196:0/167016519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562230043650 0x5622301c62a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 >> 172.21.15.196:0/167016519 conn(0x5622300c9db0 msgr2=0x5622301b8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 shutdown_connections 2024-09-21T08:53:43.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.899+0000 7f31d7836800 1 -- 172.21.15.196:0/167016519 wait complete. 2024-09-21T08:53:43.919 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:43.919 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:43.919 ERROR:root:0 2024-09-21T08:53:43.920 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-21T08:53:43.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-21T08:53:43.920 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-21T08:53:43.973 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:43.973 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:43.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:43.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:43.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05d82f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555a7bbbb660 0x555a7bc4a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05d82f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a7bb06b30 con 0x555a7bc4a770 2024-09-21T08:53:43.974 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05d82f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555a7bae8360 con 0x555a7bbbb660 2024-09-21T08:53:43.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05b32a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555a7bbbb660 0x555a7bc4a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05b32a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555a7bbbb660 0x555a7bc4a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35758/0 (socket says 172.21.15.196:35758) 2024-09-21T08:53:43.975 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05b32a640 1 -- 172.21.15.196:0/3157364664 learned_addr learned my addr 172.21.15.196:0/3157364664 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05ab29640 1 --1- 172.21.15.196:0/3157364664 >> v1:172.21.15.29:6789/0 conn(0x555a7bc4a770 0x555a7bc4cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57976/0 (socket says 172.21.15.196:57976) 2024-09-21T08:53:43.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05b32a640 1 -- 172.21.15.196:0/3157364664 >> v1:172.21.15.29:6789/0 conn(0x555a7bc4a770 legacy=0x555a7bc4cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.973+0000 7fa05b32a640 1 -- 172.21.15.196:0/3157364664 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7bb0ee00 con 0x555a7bbbb660 2024-09-21T08:53:43.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.975+0000 7fa05b32a640 1 --2- 172.21.15.196:0/3157364664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc4a230 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005fd0 tx=0x7fa04c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1c8aa311353f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.975+0000 7fa05a328640 1 -- 172.21.15.196:0/3157364664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c04e600 con 0x555a7bbbb660 2024-09-21T08:53:43.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05a328640 1 -- 172.21.15.196:0/3157364664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c04e7a0 con 0x555a7bbbb660 2024-09-21T08:53:43.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05a328640 1 -- 172.21.15.196:0/3157364664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c04eaa0 con 0x555a7bbbb660 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 -- 172.21.15.196:0/3157364664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 msgr2=0x555a7bc4a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3157364664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc4a230 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005fd0 tx=0x7fa04c045cf0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 -- 172.21.15.196:0/3157364664 shutdown_connections 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3157364664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc4a230 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 -- 172.21.15.196:0/3157364664 >> 172.21.15.196:0/3157364664 conn(0x555a7bc41de0 msgr2=0x555a7bc44200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 -- 172.21.15.196:0/3157364664 shutdown_connections 2024-09-21T08:53:43.978 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.976+0000 7fa05d82f800 1 -- 172.21.15.196:0/3157364664 wait complete. 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05d82f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05d82f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555a7bb93450 con 0x555a7bbbb660 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05b32a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05b32a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35764/0 (socket says 172.21.15.196:35764) 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.990+0000 7fa05b32a640 1 -- 172.21.15.196:0/4117315183 learned_addr learned my addr 172.21.15.196:0/4117315183 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.991+0000 7fa05b32a640 1 -- 172.21.15.196:0/4117315183 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7bae0bc0 con 0x555a7bbbb660 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.991+0000 7fa05b32a640 1 --2- 172.21.15.196:0/4117315183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa04c045d30 tx=0x7fa04c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcda628d97a69ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.991+0000 7f9f4960a640 1 -- 172.21.15.196:0/4117315183 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c04eb40 con 0x555a7bbbb660 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.991+0000 7f9f4960a640 1 -- 172.21.15.196:0/4117315183 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c05c040 con 0x555a7bbbb660 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.991+0000 7f9f4960a640 1 -- 172.21.15.196:0/4117315183 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c04ee10 con 0x555a7bbbb660 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- 172.21.15.196:0/4117315183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 msgr2=0x555a7bd36900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 --2- 172.21.15.196:0/4117315183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa04c045d30 tx=0x7fa04c050000 comp rx=0 tx=0).stop 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- 172.21.15.196:0/4117315183 shutdown_connections 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 --2- 172.21.15.196:0/4117315183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bd36900 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- 172.21.15.196:0/4117315183 >> 172.21.15.196:0/4117315183 conn(0x555a7bc41de0 msgr2=0x555a7bd322c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:43.995 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- 172.21.15.196:0/4117315183 shutdown_connections 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- 172.21.15.196:0/4117315183 wait complete. 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.992+0000 7fa05d82f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555a7bc4e640 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05b32a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05b32a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35780/0 (socket says 172.21.15.196:35780) 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05b32a640 1 -- 172.21.15.196:0/2924772504 learned_addr learned my addr 172.21.15.196:0/2924772504 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05b32a640 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7baf4fe0 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05b32a640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa04c045d30 tx=0x7fa04c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7f9f47e07640 1 -- 172.21.15.196:0/2924772504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c061420 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7f9f47e07640 1 -- 172.21.15.196:0/2924772504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c070070 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7f9f47e07640 1 -- 172.21.15.196:0/2924772504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c0616f0 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7bc46290 con 0x555a7bbbb660 2024-09-21T08:53:43.996 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.993+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7bc46730 con 0x555a7bbbb660 2024-09-21T08:53:43.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7f9f47e07640 1 -- 172.21.15.196:0/2924772504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa04c0618e0 con 0x555a7bbbb660 2024-09-21T08:53:43.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7f9f47e07640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 0x7f9f40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:43.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7f9f47e07640 1 -- 172.21.15.196:0/2924772504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa04c066070 con 0x555a7bbbb660 2024-09-21T08:53:43.999 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7fa05ab29640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 0x7f9f40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 0x555a7bd411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.994+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd41700 con 0x555a7bc4a770 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 0x555a7bd411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05ab29640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 0x7f9f40039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa044001e40 tx=0x7fa0440013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 0x555a7bd411c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05bb2b640 1 -- 172.21.15.196:0/2924772504 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0540083e0 con 0x555a7bc4a770 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd41b10 con 0x555a7bc4a770 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05bb2b640 1 -- 172.21.15.196:0/2924772504 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0540083e0 con 0x555a7bc4a770 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 0x555a7bd50400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.995+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd50b90 con 0x555a7bd4df40 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.996+0000 7fa05b32a640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 0x555a7bd50400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.996+0000 7fa05b32a640 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 0x555a7bd50400 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.996+0000 7fa05b32a640 1 -- 172.21.15.196:0/2924772504 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd4df40 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.996+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd4ce40 con 0x555a7bc4a770 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.997+0000 7fa05bb2b640 1 -- 172.21.15.196:0/2924772504 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0540083e0 con 0x555a7bc4a770 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.997+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd4d290 con 0x555a7bc4a770 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.997+0000 7fa05bb2b640 1 -- 172.21.15.196:0/2924772504 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0540083e0 con 0x555a7bc4a770 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.997+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.997+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05d82f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05d82f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555a7bae2580 con 0x555a7bd5f4e0 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35794/0 (socket says 172.21.15.196:35794) 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05bb2b640 1 -- 172.21.15.196:0/3647419756 learned_addr learned my addr 172.21.15.196:0/3647419756 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05bb2b640 1 -- 172.21.15.196:0/3647419756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7bd5fe40 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x555a7bc47590 tx=0x7fa05400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7f9f45602640 1 -- 172.21.15.196:0/3647419756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa054007d60 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7f9f45602640 1 -- 172.21.15.196:0/3647419756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05401e020 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.998+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7bd600d0 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.999+0000 7f9f45602640 1 -- 172.21.15.196:0/3647419756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa054019590 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.999+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7bd62db0 con 0x555a7bd5f4e0 2024-09-21T08:53:44.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.999+0000 7f9f45602640 1 -- 172.21.15.196:0/3647419756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa054016040 con 0x555a7bd5f4e0 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.999+0000 7f9f45602640 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 0x7f9f34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:43.999+0000 7f9f45602640 1 -- 172.21.15.196:0/3647419756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa05401f030 con 0x555a7bd5f4e0 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05b32a640 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 0x7f9f34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05b32a640 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 0x7f9f34039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa04c063040 tx=0x7fa04c046130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05d82f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05d82f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555a7bd36ff0 con 0x555a7bd6c210 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35810/0 (socket says 172.21.15.196:35810) 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05bb2b640 1 -- 172.21.15.196:0/766342987 learned_addr learned my addr 172.21.15.196:0/766342987 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.000+0000 7fa05bb2b640 1 -- 172.21.15.196:0/766342987 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7bd6cbe0 con 0x555a7bd6c210 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/766342987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa0540234c0 tx=0x7fa054017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891b13937cda7b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7f9f3effd640 1 -- 172.21.15.196:0/766342987 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05401d030 con 0x555a7bd6c210 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7f9f3effd640 1 -- 172.21.15.196:0/766342987 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05402b350 con 0x555a7bd6c210 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7f9f3effd640 1 -- 172.21.15.196:0/766342987 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa054015c90 con 0x555a7bd6c210 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 -- 172.21.15.196:0/766342987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 msgr2=0x555a7bd6c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 --2- 172.21.15.196:0/766342987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa0540234c0 tx=0x7fa054017fa0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 -- 172.21.15.196:0/766342987 shutdown_connections 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 --2- 172.21.15.196:0/766342987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd6c610 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 -- 172.21.15.196:0/766342987 >> 172.21.15.196:0/766342987 conn(0x555a7bd68570 msgr2=0x555a7bd66670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 -- 172.21.15.196:0/766342987 shutdown_connections 2024-09-21T08:53:44.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.001+0000 7fa05d82f800 1 -- 172.21.15.196:0/766342987 wait complete. 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05d82f800 1 Processor -- start 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05d82f800 1 -- start start 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05d82f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05d82f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555a7bd6d250 con 0x555a7bd6c210 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05bb2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35826/0 (socket says 172.21.15.196:35826) 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 learned_addr learned my addr 172.21.15.196:0/1677549742 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7bd73c20 con 0x555a7bd6c210 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.002+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa054017fe0 tx=0x7fa05404ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7f9f3d7fa640 1 -- 172.21.15.196:0/1677549742 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa054022da0 con 0x555a7bd6c210 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7f9f3d7fa640 1 -- 172.21.15.196:0/1677549742 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0540223c0 con 0x555a7bd6c210 2024-09-21T08:53:44.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7bd73eb0 con 0x555a7bd6c210 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7f9f3d7fa640 1 -- 172.21.15.196:0/1677549742 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0540226e0 con 0x555a7bd6c210 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7bd76b60 con 0x555a7bd6c210 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.003+0000 7f9f3d7fa640 1 -- 172.21.15.196:0/1677549742 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa05404ed10 con 0x555a7bd6c210 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7f9f3d7fa640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f24036b90 0x7f9f24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7f9f3d7fa640 1 -- 172.21.15.196:0/1677549742 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa054037d50 con 0x555a7bd6c210 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05b32a640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f24036b90 0x7f9f24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05b32a640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f24036b90 0x7f9f24039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa04c06cfd0 tx=0x7fa04c08d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bd7f140 0x555a7bd81600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd81d50 con 0x555a7bd7f140 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.004+0000 7fa05ab29640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bd7f140 0x555a7bd81600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05ab29640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bd7f140 0x555a7bd81600 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa04400f670 con 0x555a7bd7f140 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 realm 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd7e590 con 0x555a7bd7f140 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa04400f670 con 0x555a7bd7f140 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd82840 con 0x555a7bd7f140 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa04400f670 con 0x555a7bd7f140 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd83110 con 0x555a7bd7f140 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa04400f670 con 0x555a7bd7f140 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.005+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd83a10 0x555a7bd85e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd865d0 con 0x555a7bd83a10 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd83a10 0x555a7bd85e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05bb2b640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd83a10 0x555a7bd85e40 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05d82f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05d82f800 20 searching for the correct realm 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555a7bd883b0 0x555a7bd8a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8ad80 con 0x555a7bd883b0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.006+0000 7fa05b32a640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555a7bd883b0 0x555a7bd8a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05b32a640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555a7bd883b0 0x555a7bd8a7a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05b32a640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa04c0a2040 0x7fa04c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8ad80 con 0x7fa04c0a2040 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05ab29640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa04c0a2040 0x7fa04c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.007+0000 7fa05ab29640 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa04c0a2040 0x7fa04c06c3f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04400f670 con 0x7fa04c0a2040 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8ad80 con 0x555a7bd83a10 2024-09-21T08:53:44.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04400f670 con 0x555a7bd7f140 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.008+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x7fa04c0a2040 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.009+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x7fa04c0a2040 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.010+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c07c070 con 0x555a7bd883b0 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.011+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.012+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x7fa04c0a2040 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.013+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x7fa04c0a2040 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd883b0 2024-09-21T08:53:44.035 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd83a10 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.014+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x555a7bd7f140 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa054042030 con 0x7fa04c0a2040 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.036 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd86e90 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd87280 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.015+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd876a0 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 zone default found 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 4 Realm: () 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 zonegroup default 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8b200 con 0x555a7bd83a10 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8cf80 con 0x555a7bd883b0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.016+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8d460 con 0x555a7bd883b0 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.017+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.017+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.017+0000 7fa05d82f800 20 started sync module instance, tier type = 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.017+0000 7fa05d82f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.017+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8c420 con 0x7fa04c0a2040 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.018+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.018+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847113222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8c420 con 0x7fa04c0a2040 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.018+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8df20 con 0x555a7bd7f140 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.019+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847113222432] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.019+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.019+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847113226800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8c420 con 0x555a7bd7f140 2024-09-21T08:53:44.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.019+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8e9b0 con 0x555a7bd883b0 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.020+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847113226800] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.020+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.020+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847113219952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8c390 con 0x555a7bd883b0 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.020+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8f870 con 0x7fa04c0a2040 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.021+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.021+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847113233344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8fc90 con 0x7fa04c0a2040 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.021+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847113219952] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.021+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd90790 con 0x555a7bd7f140 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.022+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847113233344] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.022+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.022+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847113237120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8fc90 con 0x555a7bd7f140 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.022+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd90c40 con 0x555a7bd83a10 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.023+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847113237120] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.024+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.024+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847113238352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8fc90 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.024+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd91650 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.025+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.025+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847113240992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd91af0 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.025+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd925f0 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.025+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847113238352] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847113240992] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847113242048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd8f7e0 con 0x555a7bd83a10 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=0 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=1 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=2 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=3 2024-09-21T08:53:44.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=4 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=5 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.026+0000 7fa05d82f800 20 add_watcher() i=6 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847113242048] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05d82f800 20 add_watcher() i=7 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05d82f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd955e0 con 0x555a7bd7f140 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.027+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847113244896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bd92a60 con 0x555a7bd7f140 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.028+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847113244896] v36'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.028+0000 7f9f11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.028+0000 7fa05d82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.028+0000 7fa05d82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.028+0000 7fa05d82f800 5 note: GC not initialized 2024-09-21T08:53:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7f9f10fe1640 20 reqs_thread_entry: start 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 20 Filter name: none 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7f9e8a7fc640 20 reqs_thread_entry: start 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc89a0 con 0x555a7bd83a10 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.029+0000 7fa05d82f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc6fe0 con 0x555a7bd883b0 2024-09-21T08:53:44.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.030+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc7880 con 0x555a7bd83a10 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v36'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05d82f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05d82f800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05d82f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93847113462736 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdcbf90 con 0x7fa04c0a2040 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== watch-notify(notify (1) cookie 93847113222432 notify 154618822689 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7fa044018040 con 0x7fa04c0a2040 2024-09-21T08:53:44.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7f9f3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 93847113222432 notifier 4853 bl.length()=533 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7f9f3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(65 notify.0 [notify cookie 93847113462736 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7f9f3effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.031+0000 7f9f3effd640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9f20003ea0 con 0x7fa04c0a2040 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.032+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.032+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== watch-notify(notify_complete (2) cookie 93847113462736 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa044009050 con 0x7fa04c0a2040 2024-09-21T08:53:44.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.032+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc7880 con 0x555a7bd883b0 2024-09-21T08:53:44.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v36'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05d82f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05d82f800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05d82f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93847113462736 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdcc380 con 0x555a7bd7f140 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 93847113226800 notify 154618822682 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7fa044009050 con 0x555a7bd7f140 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7f9f3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 93847113226800 notifier 4853 bl.length()=176 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7f9f3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7f9f3effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-21T08:53:44.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7f9f3effd640 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9f20003ea0 con 0x555a7bd7f140 2024-09-21T08:53:44.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(68 notify.1 [notify cookie 93847113462736 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.033+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 93847113462736 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a7bb06b30 con 0x555a7bd7f140 2024-09-21T08:53:44.048 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-21T08:53:44.031055Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:44.031042Z","tags":[],"group_ids":[]} 2024-09-21T08:53:44.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.034+0000 7f9f11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.034+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847113244896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd7f140 2024-09-21T08:53:44.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.035+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93847113244896] v36'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.035+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847113222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x7fa04c0a2040 2024-09-21T08:53:44.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.036+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93847113222432] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.036+0000 7fa05d82f800 20 remove_watcher() i=0 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.036+0000 7fa05d82f800 2 removed watcher, disabling cache 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.036+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847113226800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd7f140 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.038+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93847113226800] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.038+0000 7fa05d82f800 20 remove_watcher() i=1 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.038+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847113219952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd883b0 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.039+0000 7fa05b32a640 1 -- 172.21.15.196:0/1677549742 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93847113219952] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04c0b1040 con 0x555a7bd883b0 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.039+0000 7fa05d82f800 20 remove_watcher() i=2 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.039+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847113233344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x7fa04c0a2040 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.040+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93847113233344] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x7fa04c0a2040 2024-09-21T08:53:44.054 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.040+0000 7fa05d82f800 20 remove_watcher() i=3 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.040+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847113237120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd7f140 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.041+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93847113237120] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa04402b040 con 0x555a7bd7f140 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.041+0000 7fa05d82f800 20 remove_watcher() i=4 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.041+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847113238352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.042+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93847113238352] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.042+0000 7fa05d82f800 20 remove_watcher() i=5 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.042+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847113240992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.043+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93847113240992] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.043+0000 7fa05d82f800 20 remove_watcher() i=6 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.043+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847113242048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a7bdc66c0 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05bb2b640 1 -- 172.21.15.196:0/1677549742 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93847113242048] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05402a070 con 0x555a7bd83a10 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 20 remove_watcher() i=7 2024-09-21T08:53:44.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd83a10 msgr2=0x555a7bd85e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd83a10 0x555a7bd85e40 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bd7f140 msgr2=0x555a7bd81600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bd7f140 0x555a7bd81600 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa04c0a2040 msgr2=0x7fa04c06c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fa04c0a2040 0x7fa04c06c3f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555a7bd883b0 msgr2=0x555a7bd8a7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555a7bd883b0 0x555a7bd8a7a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f24036b90 msgr2=0x7f9f24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f24036b90 0x7f9f24039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa04c06cfd0 tx=0x7fa04c08d000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 msgr2=0x555a7bd736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05ab29640 1 -- 172.21.15.196:0/1677549742 reap_dead start 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa054017fe0 tx=0x7fa05404ce00 comp rx=0 tx=0).stop 2024-09-21T08:53:44.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 shutdown_connections 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 --2- 172.21.15.196:0/1677549742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd6c210 0x555a7bd736e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 >> 172.21.15.196:0/1677549742 conn(0x555a7bd68570 msgr2=0x555a7bd66640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 shutdown_connections 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.044+0000 7fa05d82f800 1 -- 172.21.15.196:0/1677549742 wait complete. 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 msgr2=0x7f9f34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 0x7f9f34039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa04c063040 tx=0x7fa04c046130 comp rx=0 tx=0).stop 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 msgr2=0x555a7bd5f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x555a7bc47590 tx=0x7fa05400af70 comp rx=0 tx=0).stop 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 shutdown_connections 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f34036b40 0x7f9f34039000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/3647419756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bd5f4e0 0x555a7bd5f900 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 >> 172.21.15.196:0/3647419756 conn(0x555a7bd54470 msgr2=0x555a7bd56ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 shutdown_connections 2024-09-21T08:53:44.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/3647419756 wait complete. 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 msgr2=0x555a7bd50400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 0x555a7bd50400 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 msgr2=0x555a7bd411c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 0x555a7bd411c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 msgr2=0x7f9f40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 0x7f9f40039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa044001e40 tx=0x7fa0440013a0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 msgr2=0x555a7bc47ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa04c045d30 tx=0x7fa04c003330 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 shutdown_connections 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555a7bd4df40 0x555a7bd50400 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555a7bc4a770 0x555a7bd411c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f9f40036b40 0x7f9f40039000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 --2- 172.21.15.196:0/2924772504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555a7bbbb660 0x555a7bc47ba0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 >> 172.21.15.196:0/2924772504 conn(0x555a7bc41de0 msgr2=0x555a7bd30b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 shutdown_connections 2024-09-21T08:53:44.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.045+0000 7fa05d82f800 1 -- 172.21.15.196:0/2924772504 wait complete. 2024-09-21T08:53:44.060 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-21T08:53:44.031055Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:44.031042Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.060 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-21T08:53:44.031055Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:44.031042Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.060 ERROR:root:0 2024-09-21T08:53:44.060 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:44.065 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:44.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-21T08:53:44.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-21T08:53:44.065 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-21T08:53:44.109 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.110 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed36940800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dae0e04c0 0x558dae0e08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed36940800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558dadfa0b30 con 0x558dae0e0e00 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed36940800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558dadf82360 con 0x558dae0e04c0 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed326d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dae0e04c0 0x558dae0e08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed31ed0640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x558dae0e0e00 0x558dae0e5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57988/0 (socket says 172.21.15.196:57988) 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed326d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dae0e04c0 0x558dae0e08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35838/0 (socket says 172.21.15.196:35838) 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed31ed0640 1 -- 172.21.15.196:0/2634867437 learned_addr learned my addr 172.21.15.196:0/2634867437 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed326d1640 1 -- 172.21.15.196:0/2634867437 >> v1:172.21.15.29:6789/0 conn(0x558dae0e0e00 legacy=0x558dae0e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.109+0000 7fed326d1640 1 -- 172.21.15.196:0/2634867437 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dadfa8e00 con 0x558dae0e04c0 2024-09-21T08:53:44.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.111+0000 7fed326d1640 1 --2- 172.21.15.196:0/2634867437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae0e08c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a470 tx=0x7fed24045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9dc1fe2be00e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.111+0000 7fed316cf640 1 -- 172.21.15.196:0/2634867437 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed24053570 con 0x558dae0e04c0 2024-09-21T08:53:44.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.111+0000 7fed316cf640 1 -- 172.21.15.196:0/2634867437 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed24058070 con 0x558dae0e04c0 2024-09-21T08:53:44.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.111+0000 7fed316cf640 1 -- 172.21.15.196:0/2634867437 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed24053880 con 0x558dae0e04c0 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 -- 172.21.15.196:0/2634867437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 msgr2=0x558dae0e08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 --2- 172.21.15.196:0/2634867437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae0e08c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fed2400a470 tx=0x7fed24045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 -- 172.21.15.196:0/2634867437 shutdown_connections 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 --2- 172.21.15.196:0/2634867437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae0e08c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 -- 172.21.15.196:0/2634867437 >> 172.21.15.196:0/2634867437 conn(0x558dae0dbdf0 msgr2=0x558dae0de210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 -- 172.21.15.196:0/2634867437 shutdown_connections 2024-09-21T08:53:44.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.112+0000 7fed36940800 1 -- 172.21.15.196:0/2634867437 wait complete. 2024-09-21T08:53:44.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed36940800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed36940800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dae02d330 con 0x558dae0e04c0 2024-09-21T08:53:44.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed326d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed326d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35846/0 (socket says 172.21.15.196:35846) 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.126+0000 7fed326d1640 1 -- 172.21.15.196:0/2929012801 learned_addr learned my addr 172.21.15.196:0/2929012801 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.127+0000 7fed326d1640 1 -- 172.21.15.196:0/2929012801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dadf7abc0 con 0x558dae0e04c0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.127+0000 7fed326d1640 1 --2- 172.21.15.196:0/2929012801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fed24025c20 tx=0x7fed24051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed45c899cbd69009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.127+0000 7fec20608640 1 -- 172.21.15.196:0/2929012801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2405c580 con 0x558dae0e04c0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.127+0000 7fec20608640 1 -- 172.21.15.196:0/2929012801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed24063030 con 0x558dae0e04c0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.127+0000 7fec20608640 1 -- 172.21.15.196:0/2929012801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2405c850 con 0x558dae0e04c0 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- 172.21.15.196:0/2929012801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 msgr2=0x558dae054d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 --2- 172.21.15.196:0/2929012801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fed24025c20 tx=0x7fed24051000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- 172.21.15.196:0/2929012801 shutdown_connections 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 --2- 172.21.15.196:0/2929012801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e04c0 0x558dae054d80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- 172.21.15.196:0/2929012801 >> 172.21.15.196:0/2929012801 conn(0x558dae0dbdf0 msgr2=0x558dae1cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- 172.21.15.196:0/2929012801 shutdown_connections 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- 172.21.15.196:0/2929012801 wait complete. 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.128+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed36940800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed36940800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dae0e74e0 con 0x558dae0e0e00 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed326d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed326d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35858/0 (socket says 172.21.15.196:35858) 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed326d1640 1 -- 172.21.15.196:0/1458892613 learned_addr learned my addr 172.21.15.196:0/1458892613 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed326d1640 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dadf8efe0 con 0x558dae0e0e00 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed326d1640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x558dae054480 tx=0x7fed24002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fec1ee05640 1 -- 172.21.15.196:0/1458892613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed24054970 con 0x558dae0e0e00 2024-09-21T08:53:44.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fec1ee05640 1 -- 172.21.15.196:0/1458892613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed24054b10 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dae1d8940 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.129+0000 7fec1ee05640 1 -- 172.21.15.196:0/1458892613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed24054e30 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.130+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dae1d8e60 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.130+0000 7fec1ee05640 1 -- 172.21.15.196:0/1458892613 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed24068420 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.130+0000 7fec1ee05640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 0x7fec18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.130+0000 7fec1ee05640 1 -- 172.21.15.196:0/1458892613 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fed24070030 con 0x558dae0e0e00 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 0x7fec18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 0x558dae1df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae1dfde0 con 0x558dae1dd460 2024-09-21T08:53:44.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed32ed2640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 0x558dae1df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 0x7fec18039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed28000f60 tx=0x7fed280012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed32ed2640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 0x558dae1df850 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed32ed2640 1 -- 172.21.15.196:0/1458892613 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed2c00a4a0 con 0x558dae1dd460 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.131+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae1dca40 con 0x558dae1dd460 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.132+0000 7fed32ed2640 1 -- 172.21.15.196:0/1458892613 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed2c00a4a0 con 0x558dae1dd460 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.132+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 0x558dae1e4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.132+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae1e4c60 con 0x558dae1e2180 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.132+0000 7fed326d1640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 0x558dae1e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.132+0000 7fed326d1640 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 0x558dae1e4570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed326d1640 1 -- 172.21.15.196:0/1458892613 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed24051070 con 0x558dae1e2180 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae1e1020 con 0x558dae1dd460 2024-09-21T08:53:44.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed32ed2640 1 -- 172.21.15.196:0/1458892613 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed2c00a4a0 con 0x558dae1dd460 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae1e14c0 con 0x558dae1dd460 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed32ed2640 1 -- 172.21.15.196:0/1458892613 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed2c00a4a0 con 0x558dae1dd460 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.133+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed36940800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed36940800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dadf7c580 con 0x558dae1d0f50 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35868/0 (socket says 172.21.15.196:35868) 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed32ed2640 1 -- 172.21.15.196:0/3449476511 learned_addr learned my addr 172.21.15.196:0/3449476511 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed32ed2640 1 -- 172.21.15.196:0/3449476511 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dae1d1370 con 0x558dae1d0f50 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fed32ed2640 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x558dae1e01e0 tx=0x7fed2c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fec17fff640 1 -- 172.21.15.196:0/3449476511 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c014450 con 0x558dae1d0f50 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.134+0000 7fec17fff640 1 -- 172.21.15.196:0/3449476511 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c014610 con 0x558dae1d0f50 2024-09-21T08:53:44.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.135+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dae1cfba0 con 0x558dae1d0f50 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.135+0000 7fec17fff640 1 -- 172.21.15.196:0/3449476511 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c014930 con 0x558dae1d0f50 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.135+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dae1d00a0 con 0x558dae1d0f50 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.135+0000 7fec17fff640 1 -- 172.21.15.196:0/3449476511 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed2c011040 con 0x558dae1d0f50 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.135+0000 7fec17fff640 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 0x7fec0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fec17fff640 1 -- 172.21.15.196:0/3449476511 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fed2c01e070 con 0x558dae1d0f50 2024-09-21T08:53:44.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed326d1640 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 0x7fec0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed326d1640 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 0x7fec0c039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x558dae1e02d0 tx=0x7fed2405c7d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed36940800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed36940800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dae1d36f0 con 0x558dae202460 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35876/0 (socket says 172.21.15.196:35876) 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.136+0000 7fed32ed2640 1 -- 172.21.15.196:0/4219208684 learned_addr learned my addr 172.21.15.196:0/4219208684 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed32ed2640 1 -- 172.21.15.196:0/4219208684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dae202e30 con 0x558dae202460 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed32ed2640 1 --2- 172.21.15.196:0/4219208684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed2c04ccc0 tx=0x7fed2c04ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7555b795c7ba93f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fec15ffb640 1 -- 172.21.15.196:0/4219208684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c013dc0 con 0x558dae202460 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fec15ffb640 1 -- 172.21.15.196:0/4219208684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c014ad0 con 0x558dae202460 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fec15ffb640 1 -- 172.21.15.196:0/4219208684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c014dd0 con 0x558dae202460 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 -- 172.21.15.196:0/4219208684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 msgr2=0x558dae202860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 --2- 172.21.15.196:0/4219208684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed2c04ccc0 tx=0x7fed2c04ce00 comp rx=0 tx=0).stop 2024-09-21T08:53:44.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 -- 172.21.15.196:0/4219208684 shutdown_connections 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 --2- 172.21.15.196:0/4219208684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae202860 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 -- 172.21.15.196:0/4219208684 >> 172.21.15.196:0/4219208684 conn(0x558dae1fe7c0 msgr2=0x558dae1fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 -- 172.21.15.196:0/4219208684 shutdown_connections 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.137+0000 7fed36940800 1 -- 172.21.15.196:0/4219208684 wait complete. 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed36940800 1 Processor -- start 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed36940800 1 -- start start 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed36940800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed36940800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dae2034a0 con 0x558dae202460 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed32ed2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35890/0 (socket says 172.21.15.196:35890) 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 learned_addr learned my addr 172.21.15.196:0/1702234866 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dae209e70 con 0x558dae202460 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.138+0000 7fed32ed2640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0117d0 tx=0x7fed2c04cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fec03fff640 1 -- 172.21.15.196:0/1702234866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c03b070 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fec03fff640 1 -- 172.21.15.196:0/1702234866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c022dc0 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fec03fff640 1 -- 172.21.15.196:0/1702234866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed2c02b4a0 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dae20a100 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dae20cdb0 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.139+0000 7fec03fff640 1 -- 172.21.15.196:0/1702234866 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed2c044020 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fec03fff640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7febfc036b40 0x7febfc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fec03fff640 1 -- 172.21.15.196:0/1702234866 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fed2c033070 con 0x558dae202460 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed326d1640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7febfc036b40 0x7febfc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed326d1640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7febfc036b40 0x7febfc039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed2408f030 tx=0x7fed24094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.156 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae2155d0 0x558dae217a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae2181e0 con 0x558dae2155d0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.140+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae2155d0 0x558dae217a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae2155d0 0x558dae217a90 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed28009050 con 0x558dae2155d0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 realm 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae214a20 con 0x558dae2155d0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed28009050 con 0x558dae2155d0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae218cd0 con 0x558dae2155d0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed28009050 con 0x558dae2155d0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.141+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae2195a0 con 0x558dae2155d0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed28009050 con 0x558dae2155d0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae219ee0 0x558dae21c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae21ca60 con 0x558dae219ee0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed32ed2640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae219ee0 0x558dae21c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed32ed2640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae219ee0 0x558dae21c2d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 20 searching for the correct realm 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.142+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x558dae21ea30 0x558dae220ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558dae2215c0 con 0x558dae21ea30 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed326d1640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x558dae21ea30 0x558dae220ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed326d1640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x558dae21ea30 0x558dae220ef0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed326d1640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fed2408c040 0x7fed24009890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.143+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fed2408c040 0x7fed24009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed31ed0640 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fed2408c040 0x7fed24009890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28009050 con 0x7fed2408c040 2024-09-21T08:53:44.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28009050 con 0x558dae2155d0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.144+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x7fed2408c040 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.145+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.146+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fed28029040 con 0x7fed2408c040 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.147+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.148+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.149+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x7fed2408c040 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.150+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x7fed2408c040 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae21ea30 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.151+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae219ee0 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x558dae2155d0 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fed240a9040 con 0x7fed2408c040 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed28029040 con 0x7fed2408c040 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.152+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae21d420 con 0x558dae2155d0 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae21d060 con 0x558dae2155d0 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed28029040 con 0x558dae2155d0 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae21dd80 con 0x558dae2155d0 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 zone default found 2024-09-21T08:53:44.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 4 Realm: () 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 zonegroup default 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.153+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae221a40 con 0x558dae219ee0 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae223cc0 con 0x558dae21ea30 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae224060 con 0x558dae21ea30 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 started sync module instance, tier type = 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.154+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae223150 con 0x7fed2408c040 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.155+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.155+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94067000227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae223150 con 0x7fed2408c040 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.155+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae224ab0 con 0x558dae2155d0 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.156+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94067000227440] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.156+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.156+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94067000231360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae223150 con 0x558dae2155d0 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.156+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae225560 con 0x558dae21ea30 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.157+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.157+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94067000234096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae225e30 con 0x558dae21ea30 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.158+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2268f0 con 0x7fed2408c040 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.158+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94067000231360] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.159+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94067000234096] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.159+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.159+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94067000236416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae222ca0 con 0x7fed2408c040 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.159+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae227190 con 0x558dae2155d0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.160+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.160+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94067000236416] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.160+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94067000241216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2275b0 con 0x558dae2155d0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.160+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae226400 con 0x558dae219ee0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.161+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94067000241216] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.161+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.161+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94067000242272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2263c0 con 0x558dae219ee0 2024-09-21T08:53:44.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.161+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae228670 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.163+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.163+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94067000246720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae228a90 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.163+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae229560 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.163+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94067000242272] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94067000246720] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94067000250448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae229520 con 0x558dae219ee0 2024-09-21T08:53:44.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=0 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=1 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=2 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=3 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=4 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=5 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.164+0000 7fed36940800 20 add_watcher() i=6 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94067000250448] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed36940800 20 add_watcher() i=7 2024-09-21T08:53:44.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed36940800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae2285e0 con 0x558dae2155d0 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.165+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94067000245152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2285e0 con 0x558dae2155d0 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.166+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94067000245152] v36'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.166+0000 7febe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.166+0000 7fed36940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.166+0000 7fed36940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.167+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae235030 con 0x558dae2155d0 2024-09-21T08:53:44.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.168+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.168+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae235700 con 0x558dae219ee0 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.169+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.169+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae235700 con 0x558dae21ea30 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.170+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.170+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2361a0 con 0x558dae2155d0 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.171+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.171+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230c10 con 0x7fed2408c040 2024-09-21T08:53:44.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.172+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.172+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230c10 con 0x558dae21ea30 2024-09-21T08:53:44.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.173+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.173+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae236b30 con 0x558dae2155d0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.174+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.175+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230de0 con 0x558dae219ee0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.176+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.176+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230de0 con 0x7fed2408c040 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.177+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.177+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.178+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.178+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x7fed2408c040 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.179+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.179+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae219ee0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.180+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.180+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x7fed2408c040 2024-09-21T08:53:44.194 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.181+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.181+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae219ee0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.182+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.182+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae2155d0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.183+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.183+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.185+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.185+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x7fed2408c040 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.186+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.186+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.187+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.187+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae2155d0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.188+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.195 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.188+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae2155d0 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.189+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.189+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.190+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.190+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x7fed2408c040 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.191+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.191+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.192+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.192+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.192+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.193+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.193+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.193+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.194+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.194+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae219ee0 2024-09-21T08:53:44.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.196+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.196+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.197+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.197+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae219ee0 2024-09-21T08:53:44.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.198+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.198+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae21ea30 2024-09-21T08:53:44.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.199+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.199+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x558dae219ee0 2024-09-21T08:53:44.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.201+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.201+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae230e70 con 0x7fed2408c040 2024-09-21T08:53:44.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.202+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.202+0000 7feb637fe640 20 reqs_thread_entry: start 2024-09-21T08:53:44.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.202+0000 7fed36940800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 20 Filter name: none 2024-09-21T08:53:44.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7feb617fa640 20 reqs_thread_entry: start 2024-09-21T08:53:44.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-21T08:53:44.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae261fa0 con 0x558dae219ee0 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 20 rados_obj.operate() r=0 bl.length=349 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.203+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae264970 con 0x558dae219ee0 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.204+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.204+0000 7fed36940800 10 removing key index: system_akey 2024-09-21T08:53:44.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.204+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae262950 con 0x558dae21ea30 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(96 system_akey [delete] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed36940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94067000489136 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae264d90 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== watch-notify(notify (1) cookie 94067000231360 notify 154618822683 ret 0) ==== 203+0+0 (crc 0 0 0) 0x558dae230760 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fec15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94067000231360 notifier 4860 bl.length()=161 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fec15ffb640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7febf8003d60 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(97 notify.1 [notify cookie 94067000489136 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== watch-notify(notify_complete (2) cookie 94067000489136 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558dae230590 con 0x558dae2155d0 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed36940800 10 removing email index: 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed36940800 10 removing user buckets index 2024-09-21T08:53:44.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.205+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae262950 con 0x558dae219ee0 2024-09-21T08:53:44.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.207+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(99 system_user.buckets [delete] v36'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.207+0000 7fed36940800 10 removing user index: system_user 2024-09-21T08:53:44.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.207+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae266af0 con 0x558dae219ee0 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(100 system_user [call,call,delete] v36'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed36940800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed36940800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94067000501824 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558dae266a60 con 0x7fed2408c040 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== watch-notify(notify (1) cookie 94067000227440 notify 154618822690 ret 0) ==== 202+0+0 (crc 0 0 0) 0x558dae230590 con 0x7fed2408c040 2024-09-21T08:53:44.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fec157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 94067000227440 notifier 4860 bl.length()=160 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fec157fa640 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7feb680032c0 con 0x7fed2408c040 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(101 notify.0 [notify cookie 94067000501824 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== watch-notify(notify_complete (2) cookie 94067000501824 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558dae234b60 con 0x7fed2408c040 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.208+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.209+0000 7febe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.209+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94067000245152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae22f9e0 con 0x558dae2155d0 2024-09-21T08:53:44.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.210+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94067000245152] v36'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.210+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94067000227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae227ba0 con 0x7fed2408c040 2024-09-21T08:53:44.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.211+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94067000227440] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.211+0000 7fed36940800 20 remove_watcher() i=0 2024-09-21T08:53:44.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.211+0000 7fed36940800 2 removed watcher, disabling cache 2024-09-21T08:53:44.213 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.211+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94067000231360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae227ba0 con 0x558dae2155d0 2024-09-21T08:53:44.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.213+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94067000231360] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.213+0000 7fed36940800 20 remove_watcher() i=1 2024-09-21T08:53:44.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.213+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94067000234096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2245c0 con 0x558dae21ea30 2024-09-21T08:53:44.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.214+0000 7fed326d1640 1 -- 172.21.15.196:0/1702234866 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94067000234096] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2409a040 con 0x558dae21ea30 2024-09-21T08:53:44.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.214+0000 7fed36940800 20 remove_watcher() i=2 2024-09-21T08:53:44.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.214+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94067000236416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae227ba0 con 0x7fed2408c040 2024-09-21T08:53:44.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.215+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94067000236416] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x7fed2408c040 2024-09-21T08:53:44.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.215+0000 7fed36940800 20 remove_watcher() i=3 2024-09-21T08:53:44.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.215+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94067000241216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2245c0 con 0x558dae2155d0 2024-09-21T08:53:44.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.216+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94067000241216] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed280391c0 con 0x558dae2155d0 2024-09-21T08:53:44.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.216+0000 7fed36940800 20 remove_watcher() i=4 2024-09-21T08:53:44.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.216+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94067000242272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae225980 con 0x558dae219ee0 2024-09-21T08:53:44.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.217+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94067000242272] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.217+0000 7fed36940800 20 remove_watcher() i=5 2024-09-21T08:53:44.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.217+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94067000246720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae227ba0 con 0x558dae219ee0 2024-09-21T08:53:44.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.218+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94067000246720] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.218+0000 7fed36940800 20 remove_watcher() i=6 2024-09-21T08:53:44.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.218+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94067000250448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558dae2245c0 con 0x558dae219ee0 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed32ed2640 1 -- 172.21.15.196:0/1702234866 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94067000250448] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed2c055070 con 0x558dae219ee0 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 20 remove_watcher() i=7 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae219ee0 msgr2=0x558dae21c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae219ee0 0x558dae21c2d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae2155d0 msgr2=0x558dae217a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae2155d0 0x558dae217a90 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fed2408c040 msgr2=0x7fed24009890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fed2408c040 0x7fed24009890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x558dae21ea30 msgr2=0x558dae220ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x558dae21ea30 0x558dae220ef0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7febfc036b40 msgr2=0x7febfc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7febfc036b40 0x7febfc039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed2408f030 tx=0x7fed24094000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 msgr2=0x558dae209930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed31ed0640 1 -- 172.21.15.196:0/1702234866 reap_dead start 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0117d0 tx=0x7fed2c04cc50 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 shutdown_connections 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 --2- 172.21.15.196:0/1702234866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae202460 0x558dae209930 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 >> 172.21.15.196:0/1702234866 conn(0x558dae1fe7c0 msgr2=0x558dae1fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 shutdown_connections 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.219+0000 7fed36940800 1 -- 172.21.15.196:0/1702234866 wait complete. 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 msgr2=0x7fec0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 0x7fec0c039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x558dae1e02d0 tx=0x7fed2405c7d0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 msgr2=0x558dae1cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x558dae1e01e0 tx=0x7fed2c018830 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 shutdown_connections 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec0c036b40 0x7fec0c039000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/3449476511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae1d0f50 0x558dae1cf5a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 >> 172.21.15.196:0/3449476511 conn(0x558dae1e8540 msgr2=0x558dae1eb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 shutdown_connections 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/3449476511 wait complete. 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 msgr2=0x558dae1e4570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 0x558dae1e4570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 msgr2=0x558dae1df850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 0x558dae1df850 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 msgr2=0x7fec18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 0x7fec18039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed28000f60 tx=0x7fed280012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 msgr2=0x558dae1d8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x558dae054480 tx=0x7fed24002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 shutdown_connections 2024-09-21T08:53:44.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x558dae1e2180 0x558dae1e4570 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x558dae1dd460 0x558dae1df850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fec18036b40 0x7fec18039000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 --2- 172.21.15.196:0/1458892613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dae0e0e00 0x558dae1d8400 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 >> 172.21.15.196:0/1458892613 conn(0x558dae0dbdf0 msgr2=0x558dae1c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 shutdown_connections 2024-09-21T08:53:44.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.220+0000 7fed36940800 1 -- 172.21.15.196:0/1458892613 wait complete. 2024-09-21T08:53:44.230 ERROR:root:None 2024-09-21T08:53:44.231 ERROR:root:0 2024-09-21T08:53:44.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-21T08:53:44.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-21T08:53:44.231 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-21T08:53:44.285 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.285 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d8baf800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5640ff85b620 0x5640ff85ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d8baf800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640ff71ab30 con 0x5640ff85bf60 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d8baf800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5640ff6fc360 con 0x5640ff85b620 2024-09-21T08:53:44.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d66a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5640ff85b620 0x5640ff85ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d66a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5640ff85b620 0x5640ff85ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35900/0 (socket says 172.21.15.196:35900) 2024-09-21T08:53:44.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24d66a3640 1 -- 172.21.15.196:0/1191432821 learned_addr learned my addr 172.21.15.196:0/1191432821 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.284+0000 7f24cffff640 1 --1- 172.21.15.196:0/1191432821 >> v1:172.21.15.29:6789/0 conn(0x5640ff85bf60 0x5640ff860ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:57992/0 (socket says 172.21.15.196:57992) 2024-09-21T08:53:44.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.285+0000 7f24d66a3640 1 -- 172.21.15.196:0/1191432821 >> v1:172.21.15.29:6789/0 conn(0x5640ff85bf60 legacy=0x5640ff860ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.285+0000 7f24d66a3640 1 -- 172.21.15.196:0/1191432821 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff722e00 con 0x5640ff85b620 2024-09-21T08:53:44.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.286+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1191432821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff85ba20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a520 tx=0x7f24c8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee2ebc9cc445dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.286+0000 7f24d5ea2640 1 -- 172.21.15.196:0/1191432821 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8055070 con 0x5640ff85b620 2024-09-21T08:53:44.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.286+0000 7f24d5ea2640 1 -- 172.21.15.196:0/1191432821 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80515b0 con 0x5640ff85b620 2024-09-21T08:53:44.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.286+0000 7f24d5ea2640 1 -- 172.21.15.196:0/1191432821 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c80518d0 con 0x5640ff85b620 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 -- 172.21.15.196:0/1191432821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 msgr2=0x5640ff85ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1191432821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff85ba20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a520 tx=0x7f24c8045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 -- 172.21.15.196:0/1191432821 shutdown_connections 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1191432821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff85ba20 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 -- 172.21.15.196:0/1191432821 >> 172.21.15.196:0/1191432821 conn(0x5640ff856f50 msgr2=0x5640ff859370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 -- 172.21.15.196:0/1191432821 shutdown_connections 2024-09-21T08:53:44.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.287+0000 7f24d8baf800 1 -- 172.21.15.196:0/1191432821 wait complete. 2024-09-21T08:53:44.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d8baf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d8baf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5640ff7a7450 con 0x5640ff85b620 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d66a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d66a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35904/0 (socket says 172.21.15.196:35904) 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d66a3640 1 -- 172.21.15.196:0/3929545109 learned_addr learned my addr 172.21.15.196:0/3929545109 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.301+0000 7f24d66a3640 1 -- 172.21.15.196:0/3929545109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff6f4bc0 con 0x5640ff85b620 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d66a3640 1 --2- 172.21.15.196:0/3929545109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f24c8025da0 tx=0x7f24c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec336f72991acf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f23c4608640 1 -- 172.21.15.196:0/3929545109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8051890 con 0x5640ff85b620 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f23c4608640 1 -- 172.21.15.196:0/3929545109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c8051ac0 con 0x5640ff85b620 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f23c4608640 1 -- 172.21.15.196:0/3929545109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8051da0 con 0x5640ff85b620 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d8baf800 1 -- 172.21.15.196:0/3929545109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 msgr2=0x5640ff94a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3929545109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f24c8025da0 tx=0x7f24c8051000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d8baf800 1 -- 172.21.15.196:0/3929545109 shutdown_connections 2024-09-21T08:53:44.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3929545109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff94a940 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.302+0000 7f24d8baf800 1 -- 172.21.15.196:0/3929545109 >> 172.21.15.196:0/3929545109 conn(0x5640ff856f50 msgr2=0x5640ff946300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 -- 172.21.15.196:0/3929545109 shutdown_connections 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 -- 172.21.15.196:0/3929545109 wait complete. 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d8baf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5640ff862640 con 0x5640ff85b620 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d66a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d66a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35910/0 (socket says 172.21.15.196:35910) 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d66a3640 1 -- 172.21.15.196:0/1786238529 learned_addr learned my addr 172.21.15.196:0/1786238529 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.303+0000 7f24d66a3640 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff708fe0 con 0x5640ff85b620 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f24c8025da0 tx=0x7f24c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f23c2e05640 1 -- 172.21.15.196:0/1786238529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8073070 con 0x5640ff85b620 2024-09-21T08:53:44.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f23c2e05640 1 -- 172.21.15.196:0/1786238529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c805a580 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f23c2e05640 1 -- 172.21.15.196:0/1786238529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c805a860 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640ff952720 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.304+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ff952ca0 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f23c2e05640 1 -- 172.21.15.196:0/1786238529 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f24c8076070 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f23c2e05640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 0x7f23bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f23c2e05640 1 -- 172.21.15.196:0/1786238529 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f24c8062070 con 0x5640ff85b620 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24cffff640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 0x7f23bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 0x5640ff959250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9598c0 con 0x5640ff85bf60 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 0x5640ff959250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24cffff640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 0x7f23bc039050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24c0000f60 tx=0x7f24c0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.305+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 0x5640ff959250 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1786238529 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24d000a4a0 con 0x5640ff85bf60 2024-09-21T08:53:44.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff956800 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1786238529 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24d000a4a0 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 0x5640ff95dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff95e6d0 con 0x5640ff95bbf0 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.306+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 0x5640ff95dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 0x5640ff95dfe0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d66a3640 1 -- 172.21.15.196:0/1786238529 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff95bbf0 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff95aa90 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1786238529 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24d000a4a0 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff95aec0 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.307+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1786238529 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24d000a4a0 con 0x5640ff85bf60 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d8baf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.319 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d8baf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5640ff6f6580 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35920/0 (socket says 172.21.15.196:35920) 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d6ea4640 1 -- 172.21.15.196:0/3053247815 learned_addr learned my addr 172.21.15.196:0/3053247815 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.308+0000 7f24d6ea4640 1 -- 172.21.15.196:0/3053247815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff96d9b0 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x5640ff953400 tx=0x7f24d0012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f23bbfff640 1 -- 172.21.15.196:0/3053247815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0014450 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f23bbfff640 1 -- 172.21.15.196:0/3053247815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0014610 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640ff96dc40 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f23bbfff640 1 -- 172.21.15.196:0/3053247815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0014930 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.309+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ff970920 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f23bbfff640 1 -- 172.21.15.196:0/3053247815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f24d0011040 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f23bbfff640 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 0x7f23b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f23bbfff640 1 -- 172.21.15.196:0/3053247815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f24d001e070 con 0x5640ff96d050 2024-09-21T08:53:44.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d66a3640 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 0x7f23b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d66a3640 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 0x7f23b0039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24c806eea0 tx=0x7f24c806ecd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d8baf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d8baf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5640ff94b030 con 0x5640ff979d20 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35924/0 (socket says 172.21.15.196:35924) 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.310+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1990915646 learned_addr learned my addr 172.21.15.196:0/1990915646 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1990915646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff97a6f0 con 0x5640ff979d20 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1990915646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f24d004cd40 tx=0x7f24d0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fe61323f45f8be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f23b9ffb640 1 -- 172.21.15.196:0/1990915646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0011c50 con 0x5640ff979d20 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f23b9ffb640 1 -- 172.21.15.196:0/1990915646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0011df0 con 0x5640ff979d20 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f23b9ffb640 1 -- 172.21.15.196:0/1990915646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0046b30 con 0x5640ff979d20 2024-09-21T08:53:44.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 -- 172.21.15.196:0/1990915646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 msgr2=0x5640ff97a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1990915646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f24d004cd40 tx=0x7f24d0011700 comp rx=0 tx=0).stop 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 -- 172.21.15.196:0/1990915646 shutdown_connections 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1990915646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff97a120 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 -- 172.21.15.196:0/1990915646 >> 172.21.15.196:0/1990915646 conn(0x5640ff976080 msgr2=0x5640ff974180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.311+0000 7f24d8baf800 1 -- 172.21.15.196:0/1990915646 shutdown_connections 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d8baf800 1 -- 172.21.15.196:0/1990915646 wait complete. 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d8baf800 1 Processor -- start 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d8baf800 1 -- start start 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d8baf800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff9811e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d8baf800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5640ff97ad60 con 0x5640ff979d20 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff9811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d6ea4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff9811e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35934/0 (socket says 172.21.15.196:35934) 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 learned_addr learned my addr 172.21.15.196:0/1294738285 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.312+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ff981720 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff9811e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f24d0013c40 tx=0x7f24d004ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f23a7fff640 1 -- 172.21.15.196:0/1294738285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0011c50 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f23a7fff640 1 -- 172.21.15.196:0/1294738285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0022c90 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640ff9819b0 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f23a7fff640 1 -- 172.21.15.196:0/1294738285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d0011a20 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ff984660 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.313+0000 7f23a7fff640 1 -- 172.21.15.196:0/1294738285 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f24d004eba0 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f23a7fff640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a0036b90 0x7f23a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f23a7fff640 1 -- 172.21.15.196:0/1294738285 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f24d000e040 con 0x5640ff979d20 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a0036b90 0x7f23a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a0036b90 0x7f23a0039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5640ff959d60 tx=0x7f24c8095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff98ce70 0x5640ff98f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff98fa80 con 0x5640ff98ce70 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.314+0000 7f24cffff640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff98ce70 0x5640ff98f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24cffff640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff98ce70 0x5640ff98f330 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24c000f610 con 0x5640ff98ce70 2024-09-21T08:53:44.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 realm 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff98c2c0 con 0x5640ff98ce70 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24c000f610 con 0x5640ff98ce70 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff990570 con 0x5640ff98ce70 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24c000f610 con 0x5640ff98ce70 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.338 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.315+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff990e40 con 0x5640ff98ce70 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24c000f610 con 0x5640ff98ce70 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff991860 0x5640ff993c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff994340 con 0x5640ff991860 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff991860 0x5640ff993c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d6ea4640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff991860 0x5640ff993c50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 20 searching for the correct realm 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5640ff996310 0x5640ff9987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.316+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.339 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5640ff996310 0x5640ff9987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5640ff996310 0x5640ff9987d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24d66a3640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f24c80aa040 0x7f24c806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.317+0000 7f24cffff640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f24c80aa040 0x7f24c806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24cffff640 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f24c80aa040 0x7f24c806e3c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c000f610 con 0x7f24c80aa040 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.340 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c000f610 con 0x5640ff98ce70 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.318+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.319+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.320+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.321+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.322+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.323+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff996310 2024-09-21T08:53:44.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.324+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff991860 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x5640ff98ce70 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5640ff998ea0 con 0x7f24c80aa040 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff994d00 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.325+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff994940 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9956a0 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 zone default found 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 4 Realm: () 2024-09-21T08:53:44.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 zonegroup default 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff999360 con 0x5640ff991860 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.326+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99b630 con 0x5640ff996310 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99b9d0 con 0x5640ff996310 2024-09-21T08:53:44.347 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 20 started sync module instance, tier type = 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.327+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99aac0 con 0x7f24c80aa040 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.328+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.328+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837166157840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99aac0 con 0x7f24c80aa040 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.328+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99c3e0 con 0x5640ff98ce70 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.329+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837166157840] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.329+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.329+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837166155760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99c3e0 con 0x5640ff98ce70 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.329+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99cde0 con 0x5640ff996310 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.330+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837166155760] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.330+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.331+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837166161712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99c350 con 0x5640ff996310 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.331+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99dca0 con 0x7f24c80aa040 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.332+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.332+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837166161712] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.332+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837166168528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99d290 con 0x7f24c80aa040 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.332+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99e9f0 con 0x5640ff98ce70 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.333+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837166168528] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.333+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.333+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837166169648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99e9b0 con 0x5640ff98ce70 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.333+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99f430 con 0x5640ff991860 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.334+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837166169648] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.334+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.334+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837166171392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff99e920 con 0x5640ff991860 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.334+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a0170 con 0x5640ff991860 2024-09-21T08:53:44.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.335+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837166171392] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.335+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.335+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837166176208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a0170 con 0x5640ff991860 2024-09-21T08:53:44.350 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.335+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a0bc0 con 0x5640ff991860 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837166176208] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837166180016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a0bc0 con 0x5640ff991860 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=0 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=1 2024-09-21T08:53:44.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=2 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=3 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=4 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=5 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.336+0000 7f24d8baf800 20 add_watcher() i=6 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.337+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837166180016] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.337+0000 7f24d8baf800 20 add_watcher() i=7 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.337+0000 7f24d8baf800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.337+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a4020 con 0x5640ff98ce70 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.338+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.338+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837166177264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9a1570 con 0x5640ff98ce70 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837166177264] v36'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f238cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24d8baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24d8baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24d8baf800 5 note: GC not initialized 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f23077fe640 20 reqs_thread_entry: start 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24d8baf800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.339+0000 7f24d8baf800 20 Filter name: none 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f23057fa640 20 reqs_thread_entry: start 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d7490 con 0x5640ff996310 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-21T08:53:44.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d5f80 con 0x5640ff996310 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.340+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9daa80 con 0x5640ff996310 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.341+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v36'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.341+0000 7f24d8baf800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-21T08:53:44.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.341+0000 7f24d8baf800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.341+0000 7f24d8baf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.341+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94837166414448 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9db3d0 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== watch-notify(notify (1) cookie 94837166161712 notify 154618822665 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5640ff9d5d80 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f23b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822665 cookie 94837166161712 notifier 4867 bl.length()=542 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(65 notify.2 [notify cookie 94837166414448 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f23b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f23b9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f23b9ffb640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f239c003ea0 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== watch-notify(notify_complete (2) cookie 94837166414448 notify 154618822665 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f24c8088020 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.342+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d8f10 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v36'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.359 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d8baf800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d8baf800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d8baf800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94837166410336 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d8e80 con 0x5640ff991860 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== watch-notify(notify (1) cookie 94837166171392 notify 154618822700 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5640ff984660 con 0x5640ff991860 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f23b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822700 cookie 94837166171392 notifier 4867 bl.length()=175 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f23b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f23b9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f23b9ffb640 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f239c003ea0 con 0x5640ff991860 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.343+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(68 notify.5 [notify cookie 94837166410336 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.344+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.344+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== watch-notify(notify_complete (2) cookie 94837166410336 notify 154618822700 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640ff9819b0 con 0x5640ff991860 2024-09-21T08:53:44.361 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-21T08:53:44.341441Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:44.341431Z","tags":[],"group_ids":[]} 2024-09-21T08:53:44.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.345+0000 7f238cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.371 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.345+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837166177264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff98ce70 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.346+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94837166177264] v36'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.346+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837166157840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x7f24c80aa040 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.347+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94837166157840] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.347+0000 7f24d8baf800 20 remove_watcher() i=0 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.347+0000 7f24d8baf800 2 removed watcher, disabling cache 2024-09-21T08:53:44.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.347+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837166155760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff98ce70 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.348+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94837166155760] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.348+0000 7f24d8baf800 20 remove_watcher() i=1 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.348+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837166161712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff996310 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.349+0000 7f24d66a3640 1 -- 172.21.15.196:0/1294738285 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94837166161712] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c8090040 con 0x5640ff996310 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.349+0000 7f24d8baf800 20 remove_watcher() i=2 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.349+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837166168528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x7f24c80aa040 2024-09-21T08:53:44.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.350+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94837166168528] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x7f24c80aa040 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.350+0000 7f24d8baf800 20 remove_watcher() i=3 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.350+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837166169648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff98ce70 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.351+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94837166169648] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24c002b040 con 0x5640ff98ce70 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.351+0000 7f24d8baf800 20 remove_watcher() i=4 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.351+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837166171392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff991860 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.352+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94837166171392] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.352+0000 7f24d8baf800 20 remove_watcher() i=5 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.352+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837166176208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff991860 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.353+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94837166176208] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.353+0000 7f24d8baf800 20 remove_watcher() i=6 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.353+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837166180016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5640ff9d51b0 con 0x5640ff991860 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d6ea4640 1 -- 172.21.15.196:0/1294738285 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94837166180016] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d002a070 con 0x5640ff991860 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 20 remove_watcher() i=7 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff991860 msgr2=0x5640ff993c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff991860 0x5640ff993c50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff98ce70 msgr2=0x5640ff98f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff98ce70 0x5640ff98f330 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f24c80aa040 msgr2=0x7f24c806e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f24c80aa040 0x7f24c806e3c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5640ff996310 msgr2=0x5640ff9987d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5640ff996310 0x5640ff9987d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a0036b90 msgr2=0x7f23a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.377 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23a0036b90 0x7f23a0039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5640ff959d60 tx=0x7f24c8095000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 msgr2=0x5640ff9811e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1294738285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff979d20 0x5640ff9811e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f24d0013c40 tx=0x7f24d004ccd0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 reap_dead start 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24cffff640 1 -- 172.21.15.196:0/1294738285 reap_dead start 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 shutdown_connections 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.354+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 >> 172.21.15.196:0/1294738285 conn(0x5640ff976080 msgr2=0x5640ff974150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 shutdown_connections 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1294738285 wait complete. 2024-09-21T08:53:44.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 msgr2=0x7f23b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 0x7f23b0039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24c806eea0 tx=0x7f24c806ecd0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 msgr2=0x5640ff96d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x5640ff953400 tx=0x7f24d0012fd0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 shutdown_connections 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23b0036b40 0x7f23b0039000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/3053247815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff96d050 0x5640ff96d470 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 >> 172.21.15.196:0/3053247815 conn(0x5640ff961fe0 msgr2=0x5640ff964b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 shutdown_connections 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/3053247815 wait complete. 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 msgr2=0x5640ff95dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 0x5640ff95dfe0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 msgr2=0x5640ff959250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 0x5640ff959250 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 msgr2=0x7f23bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 0x7f23bc039050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24c0000f60 tx=0x7f24c0001370 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 msgr2=0x5640ff9521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f24c8025da0 tx=0x7f24c8002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 shutdown_connections 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5640ff95bbf0 0x5640ff95dfe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5640ff85bf60 0x5640ff959250 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f23bc036b90 0x7f23bc039050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 --2- 172.21.15.196:0/1786238529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5640ff85b620 0x5640ff9521e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 >> 172.21.15.196:0/1786238529 conn(0x5640ff856f50 msgr2=0x5640ff944b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 shutdown_connections 2024-09-21T08:53:44.380 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.355+0000 7f24d8baf800 1 -- 172.21.15.196:0/1786238529 wait complete. 2024-09-21T08:53:44.381 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-21T08:53:44.341441Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:44.341431Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.381 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-21T08:53:44.341441Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:44.341431Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.381 ERROR:root:0 2024-09-21T08:53:44.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:44.386 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:44.386 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-21T08:53:44.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-21T08:53:44.387 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-21T08:53:44.431 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.431 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.430+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.430+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.430+0000 7f3db7830800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56431bef98e0 0x56431befbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.430+0000 7f3db7830800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56431bdb4b30 con 0x56431be68e10 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.430+0000 7f3db7830800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56431bd96360 con 0x56431bef98e0 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.431+0000 7f3db2366640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56431bef98e0 0x56431befbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.431+0000 7f3db2b67640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56431be68e10 0x56431bef81c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58002/0 (socket says 172.21.15.196:58002) 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.431+0000 7f3db2b67640 1 -- 172.21.15.196:0/2750635005 learned_addr learned my addr 172.21.15.196:0/2750635005 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.431+0000 7f3db2366640 1 -- 172.21.15.196:0/2750635005 >> v1:172.21.15.29:6789/0 conn(0x56431be68e10 legacy=0x56431bef81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.431+0000 7f3db2366640 1 -- 172.21.15.196:0/2750635005 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431bdbce00 con 0x56431bef98e0 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db2366640 1 --2- 172.21.15.196:0/2750635005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431bef98e0 0x56431befbcd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3da800a470 tx=0x7f3da8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2623ca00d6b75010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db1b65640 1 -- 172.21.15.196:0/2750635005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da8053570 con 0x56431bef98e0 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db1b65640 1 -- 172.21.15.196:0/2750635005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da8058070 con 0x56431bef98e0 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db1b65640 1 -- 172.21.15.196:0/2750635005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da8053880 con 0x56431bef98e0 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 -- 172.21.15.196:0/2750635005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431bef98e0 msgr2=0x56431befbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.435 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 --2- 172.21.15.196:0/2750635005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431bef98e0 0x56431befbcd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3da800a470 tx=0x7f3da8045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:44.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 -- 172.21.15.196:0/2750635005 shutdown_connections 2024-09-21T08:53:44.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 --2- 172.21.15.196:0/2750635005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431bef98e0 0x56431befbcd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 -- 172.21.15.196:0/2750635005 >> 172.21.15.196:0/2750635005 conn(0x56431beefdf0 msgr2=0x56431bef2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.433+0000 7f3db7830800 1 -- 172.21.15.196:0/2750635005 shutdown_connections 2024-09-21T08:53:44.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.434+0000 7f3db7830800 1 -- 172.21.15.196:0/2750635005 wait complete. 2024-09-21T08:53:44.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.447+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.447+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db7830800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.449 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db7830800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56431be41330 con 0x56431be68e10 2024-09-21T08:53:44.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db2b67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db2b67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35956/0 (socket says 172.21.15.196:35956) 2024-09-21T08:53:44.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db2b67640 1 -- 172.21.15.196:0/4042215532 learned_addr learned my addr 172.21.15.196:0/4042215532 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db2b67640 1 -- 172.21.15.196:0/4042215532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431bd8ebc0 con 0x56431be68e10 2024-09-21T08:53:44.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.448+0000 7f3db2b67640 1 --2- 172.21.15.196:0/4042215532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3da40017a0 tx=0x7f3da4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b2845733546859 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3ca0e09640 1 -- 172.21.15.196:0/4042215532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4016070 con 0x56431be68e10 2024-09-21T08:53:44.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3ca0e09640 1 -- 172.21.15.196:0/4042215532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4004520 con 0x56431be68e10 2024-09-21T08:53:44.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3ca0e09640 1 -- 172.21.15.196:0/4042215532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4004820 con 0x56431be68e10 2024-09-21T08:53:44.454 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 -- 172.21.15.196:0/4042215532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 msgr2=0x56431bfe6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 --2- 172.21.15.196:0/4042215532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3da40017a0 tx=0x7f3da4001c60 comp rx=0 tx=0).stop 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 -- 172.21.15.196:0/4042215532 shutdown_connections 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 --2- 172.21.15.196:0/4042215532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfe6a40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 -- 172.21.15.196:0/4042215532 >> 172.21.15.196:0/4042215532 conn(0x56431beefdf0 msgr2=0x56431bfe2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 -- 172.21.15.196:0/4042215532 shutdown_connections 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.449+0000 7f3db7830800 1 -- 172.21.15.196:0/4042215532 wait complete. 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db7830800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db7830800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56431befc600 con 0x56431be68e10 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db2b67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db2b67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35964/0 (socket says 172.21.15.196:35964) 2024-09-21T08:53:44.455 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db2b67640 1 -- 172.21.15.196:0/2516446426 learned_addr learned my addr 172.21.15.196:0/2516446426 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db2b67640 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431bda2fe0 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db2b67640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000f80 tx=0x7f3da4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3c9f606640 1 -- 172.21.15.196:0/2516446426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4016040 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3c9f606640 1 -- 172.21.15.196:0/2516446426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4011530 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.450+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431bfee9c0 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.451+0000 7f3c9f606640 1 -- 172.21.15.196:0/2516446426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3da4011890 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.451+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431bfeef40 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.451+0000 7f3c9f606640 1 -- 172.21.15.196:0/2516446426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3da401c3f0 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.451+0000 7f3c9f606640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 0x7f3c98039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3c9f606640 1 -- 172.21.15.196:0/2516446426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3da404bcf0 con 0x56431be68e10 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db2366640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 0x7f3c98039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 0x56431bff5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431bff5aa0 con 0x56431bef98e0 2024-09-21T08:53:44.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db3368640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 0x56431bff5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db2366640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 0x7f3c98039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3da8057000 tx=0x7f3da8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db3368640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 0x56431bff5430 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db3368640 1 -- 172.21.15.196:0/2516446426 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dac0083e0 con 0x56431bef98e0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.452+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431bff2aa0 con 0x56431bef98e0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.453+0000 7f3db3368640 1 -- 172.21.15.196:0/2516446426 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3dac0083e0 con 0x56431bef98e0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.453+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 0x56431bffa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.453+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431bffa890 con 0x56431bff7db0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.453+0000 7f3db2b67640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 0x56431bffa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.453+0000 7f3db2b67640 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 0x56431bffa1a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db2b67640 1 -- 172.21.15.196:0/2516446426 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3da4019050 con 0x56431bff7db0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431bff6c50 con 0x56431bef98e0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db3368640 1 -- 172.21.15.196:0/2516446426 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3dac0083e0 con 0x56431bef98e0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431bff70b0 con 0x56431bef98e0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db3368640 1 -- 172.21.15.196:0/2516446426 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3dac0083e0 con 0x56431bef98e0 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.454+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db7830800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db7830800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56431bd90580 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35972/0 (socket says 172.21.15.196:35972) 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db3368640 1 -- 172.21.15.196:0/1756629788 learned_addr learned my addr 172.21.15.196:0/1756629788 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db3368640 1 -- 172.21.15.196:0/1756629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431c009b90 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.455+0000 7f3db3368640 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x56431bfef530 tx=0x7f3dac00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3c9ce01640 1 -- 172.21.15.196:0/1756629788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac007d00 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3c9ce01640 1 -- 172.21.15.196:0/1756629788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac01e020 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3c9ce01640 1 -- 172.21.15.196:0/1756629788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac019420 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431c009e20 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431c00cb00 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.456+0000 7f3c9ce01640 1 -- 172.21.15.196:0/1756629788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3dac016040 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3c9ce01640 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 0x7f3c8c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3c9ce01640 1 -- 172.21.15.196:0/1756629788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3dac01f030 con 0x56431c009230 2024-09-21T08:53:44.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db2b67640 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 0x7f3c8c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db2b67640 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 0x7f3c8c039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x56431bff5f20 tx=0x7f3da40193e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db7830800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db7830800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56431bfe71f0 con 0x56431c015e80 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35978/0 (socket says 172.21.15.196:35978) 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db3368640 1 -- 172.21.15.196:0/2397158108 learned_addr learned my addr 172.21.15.196:0/2397158108 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.457+0000 7f3db3368640 1 -- 172.21.15.196:0/2397158108 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431c016850 con 0x56431c015e80 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db3368640 1 --2- 172.21.15.196:0/2397158108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3dac04cf20 tx=0x7f3dac017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df39eb2f2a1abfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3c967fc640 1 -- 172.21.15.196:0/2397158108 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac01d030 con 0x56431c015e80 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3c967fc640 1 -- 172.21.15.196:0/2397158108 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac015d00 con 0x56431c015e80 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3c967fc640 1 -- 172.21.15.196:0/2397158108 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0197f0 con 0x56431c015e80 2024-09-21T08:53:44.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 -- 172.21.15.196:0/2397158108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 msgr2=0x56431c016280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 --2- 172.21.15.196:0/2397158108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3dac04cf20 tx=0x7f3dac017fa0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 -- 172.21.15.196:0/2397158108 shutdown_connections 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 --2- 172.21.15.196:0/2397158108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c016280 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 -- 172.21.15.196:0/2397158108 >> 172.21.15.196:0/2397158108 conn(0x56431c0121e0 msgr2=0x56431c0102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 -- 172.21.15.196:0/2397158108 shutdown_connections 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.458+0000 7f3db7830800 1 -- 172.21.15.196:0/2397158108 wait complete. 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db7830800 1 Processor -- start 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db7830800 1 -- start start 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db7830800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db7830800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56431c016dd0 con 0x56431c015e80 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db3368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:35986/0 (socket says 172.21.15.196:35986) 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 learned_addr learned my addr 172.21.15.196:0/458909593 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431c01d760 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db3368640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dac03d040 tx=0x7f3dac04ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3c94ff9640 1 -- 172.21.15.196:0/458909593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac03b070 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3c94ff9640 1 -- 172.21.15.196:0/458909593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac019b70 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431c01d9f0 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.459+0000 7f3c94ff9640 1 -- 172.21.15.196:0/458909593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dac0179a0 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.460+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431c0206a0 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.460+0000 7f3c94ff9640 1 -- 172.21.15.196:0/458909593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3dac0153e0 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.460+0000 7f3c94ff9640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c7c036af0 0x7f3c7c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3c94ff9640 1 -- 172.21.15.196:0/458909593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3dac037d20 con 0x56431c015e80 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db2b67640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c7c036af0 0x7f3c7c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db2b67640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c7c036af0 0x7f3c7c038fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56431bffac90 tx=0x7f3da4043000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431c028d60 0x56431c02b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c02b970 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.461+0000 7f3db2366640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431c028d60 0x56431c02b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db2366640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431c028d60 0x56431c02b220 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 realm 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c02bda0 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c02c670 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c02ca10 con 0x56431c028d60 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.462+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db7830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431c02d770 0x56431c02fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c030170 con 0x56431c02d770 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db3368640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431c02d770 0x56431c02fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db3368640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431c02d770 0x56431c02fb60 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.463+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db7830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db7830800 20 searching for the correct realm 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56431c032100 0x56431c0345c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2b67640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56431c032100 0x56431c0345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2b67640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56431c032100 0x56431c0345c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2b67640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3da403d1a0 0x7f3da400f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.464+0000 7f3db2366640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3da403d1a0 0x7f3da400f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db2366640 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3da403d1a0 0x7f3da400f300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.465+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.466+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.467+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.486 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.468+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.469+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.470+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c032100 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.471+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c02d770 2024-09-21T08:53:44.488 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x56431c028d60 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56431c034c90 con 0x7f3da403d1a0 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c031650 con 0x56431c028d60 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.472+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c0305d0 con 0x56431c028d60 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c030f50 con 0x56431c028d60 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 zone default found 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 4 Realm: () 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 zonegroup default 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.473+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c0355c0 con 0x56431c02d770 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c0377f0 con 0x56431c032100 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c037b90 con 0x56431c032100 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 started sync module instance, tier type = 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.474+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c036c30 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.475+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.475+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846232785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c036c30 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.475+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c038590 con 0x56431c028d60 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.476+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846232785232] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.476+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.476+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846232789152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c036c30 con 0x56431c028d60 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.476+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c039010 con 0x56431c032100 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.477+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846232789152] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.478+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.478+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846232782720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c036ba0 con 0x56431c032100 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.478+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c039da0 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.479+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846232782720] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.479+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.479+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846232794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03a190 con 0x7f3da403d1a0 2024-09-21T08:53:44.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.479+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03abb0 con 0x56431c028d60 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.480+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.480+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846232794112] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.480+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846232798880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03ab70 con 0x56431c028d60 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.480+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c039860 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.481+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846232798880] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.481+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.481+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846232795232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03b6a0 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.481+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03c060 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.482+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846232795232] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.482+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.482+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846232801184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03c060 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.482+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03ca70 con 0x56431c02d770 2024-09-21T08:53:44.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(58 notify.7 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846232801184] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846232806848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03ced0 con 0x56431c02d770 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=0 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=1 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=2 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=3 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=4 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=5 2024-09-21T08:53:44.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.483+0000 7f3db7830800 20 add_watcher() i=6 2024-09-21T08:53:44.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846232806848] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db7830800 20 add_watcher() i=7 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db7830800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c03bca0 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.484+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846232807904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03bca0 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.485+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846232807904] v36'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.485+0000 7f3c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.486+0000 7f3db7830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.486+0000 7f3db7830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.486+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c048970 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.487+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.487+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c049040 con 0x56431c02d770 2024-09-21T08:53:44.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.488+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.488+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c049040 con 0x56431c032100 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.489+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.489+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0498f0 con 0x56431c028d60 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.490+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.490+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0446c0 con 0x7f3da403d1a0 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.491+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.491+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c044660 con 0x56431c032100 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.492+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.492+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04a4e0 con 0x56431c028d60 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.493+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.493+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04a570 con 0x56431c02d770 2024-09-21T08:53:44.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.494+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.494+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04a650 con 0x7f3da403d1a0 2024-09-21T08:53:44.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.495+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.495+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c044260 con 0x56431c032100 2024-09-21T08:53:44.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.496+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.496+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x7f3da403d1a0 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.497+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.497+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x56431c02d770 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.498+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.498+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x7f3da403d1a0 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.499+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.499+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x56431c02d770 2024-09-21T08:53:44.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.500+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.500+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x56431c028d60 2024-09-21T08:53:44.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.501+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.501+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04ab20 con 0x56431c032100 2024-09-21T08:53:44.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.502+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.502+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x7f3da403d1a0 2024-09-21T08:53:44.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.503+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.503+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c032100 2024-09-21T08:53:44.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.504+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.504+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c028d60 2024-09-21T08:53:44.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.505+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.506 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.505+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c028d60 2024-09-21T08:53:44.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.505+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.506+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c032100 2024-09-21T08:53:44.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.506+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.506+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x7f3da403d1a0 2024-09-21T08:53:44.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.507+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.507+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c032100 2024-09-21T08:53:44.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.508+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.508+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abb0 con 0x56431c032100 2024-09-21T08:53:44.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.509+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.509+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c032100 2024-09-21T08:53:44.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.510+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.510+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c032100 2024-09-21T08:53:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.511+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.511+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c02d770 2024-09-21T08:53:44.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.512+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.512+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c032100 2024-09-21T08:53:44.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.513+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.513+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c02d770 2024-09-21T08:53:44.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.514+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.514+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c032100 2024-09-21T08:53:44.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.515+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.515+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x56431c02d770 2024-09-21T08:53:44.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.516+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.516+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c04abd0 con 0x7f3da403d1a0 2024-09-21T08:53:44.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.517+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.517+0000 7f3be3fff640 20 reqs_thread_entry: start 2024-09-21T08:53:44.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.517+0000 7f3db7830800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.517+0000 7f3db7830800 20 Filter name: none 2024-09-21T08:53:44.519 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3be1ffb640 20 reqs_thread_entry: start 2024-09-21T08:53:44.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-21T08:53:44.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.520 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c075bf0 con 0x56431c032100 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 20 rados_obj.operate() r=0 bl.length=363 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c0785c0 con 0x56431c032100 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 10 removing key index: true_admin_akey 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.518+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0765a0 con 0x56431c032100 2024-09-21T08:53:44.522 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.519+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(96 true_admin_akey [delete] v36'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.519+0000 7f3db7830800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.519+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94846233047296 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c078aa0 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== watch-notify(notify (1) cookie 94846232795232 notify 154618822701 ret 0) ==== 207+0+0 (crc 0 0 0) 0x56431c044260 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3c967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822701 cookie 94846232795232 notifier 4874 bl.length()=165 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(97 notify.5 [notify cookie 94846233047296 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3c967fc640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3c78003d60 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== watch-notify(notify_complete (2) cookie 94846233047296 notify 154618822701 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56431c01d760 con 0x56431c02d770 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db7830800 10 removing email index: 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db7830800 10 removing user buckets index 2024-09-21T08:53:44.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.520+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c078a00 con 0x56431c032100 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.521+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(99 a_user.buckets [delete] v36'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.521+0000 7f3db7830800 10 removing user index: a_user 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.521+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0785c0 con 0x56431c032100 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(100 a_user [call,call,delete] v36'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db7830800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db7830800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94846233043184 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56431c0779d0 con 0x56431c032100 2024-09-21T08:53:44.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== watch-notify(notify (1) cookie 94846232782720 notify 154618822666 ret 0) ==== 197+0+0 (crc 0 0 0) 0x56431c01d9f0 con 0x56431c032100 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3c967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822666 cookie 94846232782720 notifier 4874 bl.length()=155 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3c967fc640 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3c78003d60 con 0x56431c032100 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.522+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(101 notify.2 [notify cookie 94846233043184 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.523+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== watch-notify(notify_complete (2) cookie 94846233043184 notify 154618822666 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3da4055040 con 0x56431c032100 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.523+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.523+0000 7f3c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.523+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846232807904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c078290 con 0x56431c028d60 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.524+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94846232807904] v36'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.524+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846232785232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c077de0 con 0x7f3da403d1a0 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.525+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94846232785232] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.525+0000 7f3db7830800 20 remove_watcher() i=0 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.525+0000 7f3db7830800 2 removed watcher, disabling cache 2024-09-21T08:53:44.527 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.525+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846232789152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c037130 con 0x56431c028d60 2024-09-21T08:53:44.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94846232789152] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db7830800 20 remove_watcher() i=1 2024-09-21T08:53:44.528 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846232782720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0380a0 con 0x56431c032100 2024-09-21T08:53:44.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db2b67640 1 -- 172.21.15.196:0/458909593 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94846232782720] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da4019050 con 0x56431c032100 2024-09-21T08:53:44.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db7830800 20 remove_watcher() i=2 2024-09-21T08:53:44.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.527+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846232794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0380a0 con 0x7f3da403d1a0 2024-09-21T08:53:44.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.528+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94846232794112] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x7f3da403d1a0 2024-09-21T08:53:44.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.528+0000 7f3db7830800 20 remove_watcher() i=3 2024-09-21T08:53:44.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.528+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846232798880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c039400 con 0x56431c028d60 2024-09-21T08:53:44.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.529+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94846232798880] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3da8051070 con 0x56431c028d60 2024-09-21T08:53:44.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.529+0000 7f3db7830800 20 remove_watcher() i=4 2024-09-21T08:53:44.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.529+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846232795232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c0380a0 con 0x56431c02d770 2024-09-21T08:53:44.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.531+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94846232795232] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.531+0000 7f3db7830800 20 remove_watcher() i=5 2024-09-21T08:53:44.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.531+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846232801184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c03a6a0 con 0x56431c02d770 2024-09-21T08:53:44.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.532+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94846232801184] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.532+0000 7f3db7830800 20 remove_watcher() i=6 2024-09-21T08:53:44.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.532+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846232806848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56431c039400 con 0x56431c02d770 2024-09-21T08:53:44.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db3368640 1 -- 172.21.15.196:0/458909593 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94846232806848] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dac055070 con 0x56431c02d770 2024-09-21T08:53:44.536 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 20 remove_watcher() i=7 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431c02d770 msgr2=0x56431c02fb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431c02d770 0x56431c02fb60 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431c028d60 msgr2=0x56431c02b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431c028d60 0x56431c02b220 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3da403d1a0 msgr2=0x7f3da400f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f3da403d1a0 0x7f3da400f300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56431c032100 msgr2=0x56431c0345c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x56431c032100 0x56431c0345c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c7c036af0 msgr2=0x7f3c7c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c7c036af0 0x7f3c7c038fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56431bffac90 tx=0x7f3da4043000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 msgr2=0x56431c01d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db2366640 1 -- 172.21.15.196:0/458909593 reap_dead start 2024-09-21T08:53:44.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dac03d040 tx=0x7f3dac04ce80 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 shutdown_connections 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/458909593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c015e80 0x56431c01d220 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 >> 172.21.15.196:0/458909593 conn(0x56431c0121e0 msgr2=0x56431c0102b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 shutdown_connections 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/458909593 wait complete. 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 msgr2=0x7f3c8c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 0x7f3c8c039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x56431bff5f20 tx=0x7f3da40193e0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 msgr2=0x56431c009650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x56431bfef530 tx=0x7f3dac00aec0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 shutdown_connections 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c8c036b40 0x7f3c8c039000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 --2- 172.21.15.196:0/1756629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431c009230 0x56431c009650 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 >> 172.21.15.196:0/1756629788 conn(0x56431bffe1c0 msgr2=0x56431c000d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 shutdown_connections 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.533+0000 7f3db7830800 1 -- 172.21.15.196:0/1756629788 wait complete. 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 msgr2=0x56431bffa1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 0x56431bffa1a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 msgr2=0x56431bff5430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 0x56431bff5430 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 msgr2=0x7f3c98039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 0x7f3c98039050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3da8057000 tx=0x7f3da8052000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 msgr2=0x56431bfee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000f80 tx=0x7f3da4001250 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 shutdown_connections 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x56431bff7db0 0x56431bffa1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x56431bef98e0 0x56431bff5430 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.539 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f3c98036b90 0x7f3c98039050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 --2- 172.21.15.196:0/2516446426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56431be68e10 0x56431bfee480 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 >> 172.21.15.196:0/2516446426 conn(0x56431beefdf0 msgr2=0x56431bfe0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 shutdown_connections 2024-09-21T08:53:44.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.534+0000 7f3db7830800 1 -- 172.21.15.196:0/2516446426 wait complete. 2024-09-21T08:53:44.544 ERROR:root:None 2024-09-21T08:53:44.544 ERROR:root:0 2024-09-21T08:53:44.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-21T08:53:44.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-21T08:53:44.544 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-21T08:53:44.590 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.590 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.589+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.589+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.589+0000 7fe53db26800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f386164650 0x55f3861f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.589+0000 7fe53db26800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3860afb30 con 0x55f3861f3720 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.589+0000 7fe53db26800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f386091360 con 0x55f386164650 2024-09-21T08:53:44.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.590+0000 7fe5397e3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f386164650 0x55f3861f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.590+0000 7fe530fe2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f3861f3720 0x55f3861f5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58010/0 (socket says 172.21.15.196:58010) 2024-09-21T08:53:44.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.590+0000 7fe530fe2640 1 -- 172.21.15.196:0/1262439353 learned_addr learned my addr 172.21.15.196:0/1262439353 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.590+0000 7fe5397e3640 1 -- 172.21.15.196:0/1262439353 >> v1:172.21.15.29:6789/0 conn(0x55f3861f3720 legacy=0x55f3861f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.590+0000 7fe5397e3640 1 -- 172.21.15.196:0/1262439353 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3860b7e00 con 0x55f386164650 2024-09-21T08:53:44.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe5397e3640 1 --2- 172.21.15.196:0/1262439353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f31e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00a470 tx=0x7fe52c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae426358583dcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe538fe2640 1 -- 172.21.15.196:0/1262439353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053570 con 0x55f386164650 2024-09-21T08:53:44.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe538fe2640 1 -- 172.21.15.196:0/1262439353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c058070 con 0x55f386164650 2024-09-21T08:53:44.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe538fe2640 1 -- 172.21.15.196:0/1262439353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053880 con 0x55f386164650 2024-09-21T08:53:44.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 -- 172.21.15.196:0/1262439353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 msgr2=0x55f3861f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 --2- 172.21.15.196:0/1262439353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f31e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00a470 tx=0x7fe52c045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:44.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 -- 172.21.15.196:0/1262439353 shutdown_connections 2024-09-21T08:53:44.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 --2- 172.21.15.196:0/1262439353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f31e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 -- 172.21.15.196:0/1262439353 >> 172.21.15.196:0/1262439353 conn(0x55f3861eadb0 msgr2=0x55f3861ed1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 -- 172.21.15.196:0/1262439353 shutdown_connections 2024-09-21T08:53:44.595 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.592+0000 7fe53db26800 1 -- 172.21.15.196:0/1262439353 wait complete. 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe53db26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe53db26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f38613c360 con 0x55f386164650 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe5397e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.608 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe5397e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36006/0 (socket says 172.21.15.196:36006) 2024-09-21T08:53:44.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe5397e3640 1 -- 172.21.15.196:0/1687958736 learned_addr learned my addr 172.21.15.196:0/1687958736 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.606+0000 7fe5397e3640 1 -- 172.21.15.196:0/1687958736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f386089bc0 con 0x55f386164650 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe5397e3640 1 --2- 172.21.15.196:0/1687958736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a373795d58fef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe427606640 1 -- 172.21.15.196:0/1687958736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053ba0 con 0x55f386164650 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe427606640 1 -- 172.21.15.196:0/1687958736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c063030 con 0x55f386164650 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe427606640 1 -- 172.21.15.196:0/1687958736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053440 con 0x55f386164650 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe53db26800 1 -- 172.21.15.196:0/1687958736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 msgr2=0x55f3861f0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.607+0000 7fe53db26800 1 --2- 172.21.15.196:0/1687958736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe52c025c20 tx=0x7fe52c051000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- 172.21.15.196:0/1687958736 shutdown_connections 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 --2- 172.21.15.196:0/1687958736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3861f0b10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- 172.21.15.196:0/1687958736 >> 172.21.15.196:0/1687958736 conn(0x55f3861eadb0 msgr2=0x55f3862db270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- 172.21.15.196:0/1687958736 shutdown_connections 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- 172.21.15.196:0/1687958736 wait complete. 2024-09-21T08:53:44.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe53db26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f3861f7620 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe5397e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe5397e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36018/0 (socket says 172.21.15.196:36018) 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.608+0000 7fe5397e3640 1 -- 172.21.15.196:0/4270757689 learned_addr learned my addr 172.21.15.196:0/4270757689 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe5397e3640 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38609dfe0 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe5397e3640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55f3861f0210 tx=0x7fe52c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe425e03640 1 -- 172.21.15.196:0/4270757689 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c078070 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe425e03640 1 -- 172.21.15.196:0/4270757689 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c053570 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3862e9960 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe425e03640 1 -- 172.21.15.196:0/4270757689 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe52c053850 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.609+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3862e9ee0 con 0x55f386164650 2024-09-21T08:53:44.614 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe425e03640 1 -- 172.21.15.196:0/4270757689 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe52c07b070 con 0x55f386164650 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe425e03640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 0x7fe420039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe425e03640 1 -- 172.21.15.196:0/4270757689 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe52c070070 con 0x55f386164650 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe530fe2640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 0x7fe420039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 0x55f3862f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3862f0a60 con 0x55f3861f3720 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.610+0000 7fe539fe4640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 0x55f3862f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe530fe2640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 0x7fe420039050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe524000f60 tx=0x7fe5240012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe539fe4640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 0x55f3862f0490 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe539fe4640 1 -- 172.21.15.196:0/4270757689 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe53400a4a0 con 0x55f3861f3720 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3862eda40 con 0x55f3861f3720 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe539fe4640 1 -- 172.21.15.196:0/4270757689 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe53400a4a0 con 0x55f3861f3720 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 0x55f3862f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.615 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.611+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3862f58a0 con 0x55f3862f2dc0 2024-09-21T08:53:44.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.612+0000 7fe5397e3640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 0x55f3862f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.612+0000 7fe5397e3640 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 0x55f3862f51b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.612+0000 7fe5397e3640 1 -- 172.21.15.196:0/4270757689 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe52c07a030 con 0x55f3862f2dc0 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.612+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3862f1b70 con 0x55f3861f3720 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.612+0000 7fe539fe4640 1 -- 172.21.15.196:0/4270757689 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe53400a4a0 con 0x55f3861f3720 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3862f2010 con 0x55f3861f3720 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe539fe4640 1 -- 172.21.15.196:0/4270757689 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe53400a4a0 con 0x55f3861f3720 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe53db26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe53db26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f38608b580 con 0x55f386304100 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36024/0 (socket says 172.21.15.196:36024) 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.613+0000 7fe539fe4640 1 -- 172.21.15.196:0/2844392045 learned_addr learned my addr 172.21.15.196:0/2844392045 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe539fe4640 1 -- 172.21.15.196:0/2844392045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f386304a60 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe539fe4640 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x55f3862f0e40 tx=0x7fe534018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe41effd640 1 -- 172.21.15.196:0/2844392045 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe534014450 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe41effd640 1 -- 172.21.15.196:0/2844392045 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe534014610 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f386304cf0 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe41effd640 1 -- 172.21.15.196:0/2844392045 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe534014930 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.614+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3863079d0 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.615+0000 7fe41effd640 1 -- 172.21.15.196:0/2844392045 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe534011040 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.615+0000 7fe41effd640 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 0x7fe410039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.615+0000 7fe41effd640 1 -- 172.21.15.196:0/2844392045 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe53401e070 con 0x55f386304100 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.615+0000 7fe5397e3640 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 0x7fe410039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe5397e3640 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 0x7fe410039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe52c068fd0 tx=0x7fe52c08ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe53db26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe53db26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f3861ef180 con 0x55f386310db0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36040/0 (socket says 172.21.15.196:36040) 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe539fe4640 1 -- 172.21.15.196:0/118457845 learned_addr learned my addr 172.21.15.196:0/118457845 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.616+0000 7fe539fe4640 1 -- 172.21.15.196:0/118457845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f386311780 con 0x55f386310db0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe539fe4640 1 --2- 172.21.15.196:0/118457845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe53404ccc0 tx=0x7fe534011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d134e32689a2a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe41cff9640 1 -- 172.21.15.196:0/118457845 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe534016940 con 0x55f386310db0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe41cff9640 1 -- 172.21.15.196:0/118457845 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe534014ad0 con 0x55f386310db0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe41cff9640 1 -- 172.21.15.196:0/118457845 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe534014df0 con 0x55f386310db0 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 -- 172.21.15.196:0/118457845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 msgr2=0x55f3863111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 --2- 172.21.15.196:0/118457845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe53404ccc0 tx=0x7fe534011940 comp rx=0 tx=0).stop 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 -- 172.21.15.196:0/118457845 shutdown_connections 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 --2- 172.21.15.196:0/118457845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f3863111b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 -- 172.21.15.196:0/118457845 >> 172.21.15.196:0/118457845 conn(0x55f38630d110 msgr2=0x55f38630b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 -- 172.21.15.196:0/118457845 shutdown_connections 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 -- 172.21.15.196:0/118457845 wait complete. 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.617+0000 7fe53db26800 1 Processor -- start 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe53db26800 1 -- start start 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe53db26800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe53db26800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f386311df0 con 0x55f386310db0 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe539fe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36042/0 (socket says 172.21.15.196:36042) 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 learned_addr learned my addr 172.21.15.196:0/3396677223 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3863187a0 con 0x55f386310db0 2024-09-21T08:53:44.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe539fe4640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe534011e10 tx=0x7fe53404cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe40effd640 1 -- 172.21.15.196:0/3396677223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe534016940 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe40effd640 1 -- 172.21.15.196:0/3396677223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53402b350 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f386318a30 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.618+0000 7fe40effd640 1 -- 172.21.15.196:0/3396677223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe53402b6b0 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.619+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f38631b6e0 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.619+0000 7fe40effd640 1 -- 172.21.15.196:0/3396677223 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe534044020 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.619+0000 7fe40effd640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe404036b40 0x7fe404039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.619+0000 7fe40effd640 1 -- 172.21.15.196:0/3396677223 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe534034070 con 0x55f386310db0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe5397e3640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe404036b40 0x7fe404039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe5397e3640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe404036b40 0x7fe404039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe52c07c730 tx=0x7fe52c093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f386323e80 0x55f386326340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f386326a90 con 0x55f386323e80 2024-09-21T08:53:44.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.620+0000 7fe530fe2640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f386323e80 0x55f386326340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe530fe2640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f386323e80 0x55f386326340 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe524009050 con 0x55f386323e80 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 realm 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3863232d0 con 0x55f386323e80 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe524009050 con 0x55f386323e80 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f386327580 con 0x55f386323e80 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe524009050 con 0x55f386323e80 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f386327e50 con 0x55f386323e80 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe524009050 con 0x55f386323e80 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f386328790 0x55f38632ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.621+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38632b310 con 0x55f386328790 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe539fe4640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f386328790 0x55f38632ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe539fe4640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f386328790 0x55f38632ab80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe53db26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe53db26800 20 searching for the correct realm 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f38632d2e0 0x55f38632f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.622+0000 7fe5397e3640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f38632d2e0 0x55f38632f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe5397e3640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f38632d2e0 0x55f38632f7a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe5397e3640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe52c07d060 0x7fe52c090890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe530fe2640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe52c07d060 0x7fe52c090890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.623+0000 7fe530fe2640 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe52c07d060 0x7fe52c090890 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524009050 con 0x7fe52c07d060 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.641 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524009050 con 0x55f386323e80 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.624+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x7fe52c07d060 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.625+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.626+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe524029040 con 0x7fe52c07d060 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.627+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.628+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.644 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x7fe52c07d060 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.629+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x7fe52c07d060 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f38632d2e0 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.630+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386328790 2024-09-21T08:53:44.645 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x55f386323e80 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f38632fe70 con 0x7fe52c07d060 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe524029040 con 0x7fe52c07d060 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.646 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38632bcd0 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.631+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38632c570 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe524029040 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38632b910 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 zone default found 2024-09-21T08:53:44.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 4 Realm: () 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 zonegroup default 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f386330350 con 0x55f386328790 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f386332620 con 0x55f38632d2e0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.632+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f3863329c0 con 0x55f38632d2e0 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.633+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.633+0000 7fe53db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.633+0000 7fe53db26800 20 started sync module instance, tier type = 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.633+0000 7fe53db26800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.633+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331ab0 con 0x7fe52c07d060 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.634+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.634+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504416911328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331ab0 con 0x7fe52c07d060 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.634+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f3863333f0 con 0x55f386323e80 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.635+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504416911328] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.635+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.635+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504416915744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331ab0 con 0x55f386323e80 2024-09-21T08:53:44.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.635+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386333e60 con 0x55f38632d2e0 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.636+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504416915744] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.636+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.636+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504416908800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331a20 con 0x55f38632d2e0 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.636+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386334d20 con 0x7fe52c07d060 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.637+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504416908800] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.637+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.637+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504416921712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386335140 con 0x7fe52c07d060 2024-09-21T08:53:44.650 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.637+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386335b00 con 0x55f386323e80 2024-09-21T08:53:44.654 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.638+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.638+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504416925264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386335f20 con 0x55f386323e80 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.638+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386336980 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.638+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504416921712] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.639+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.639+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504416922768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386336980 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.639+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f3863373f0 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.639+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504416925264] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.640+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504416922768] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.640+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.640+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504416931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386336460 con 0x55f386328790 2024-09-21T08:53:44.655 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.640+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f3863379d0 con 0x55f386328790 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504416931552] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504416926320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f3863379d0 con 0x55f386328790 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=0 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=1 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=2 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=3 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=4 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=5 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.641+0000 7fe53db26800 20 add_watcher() i=6 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.642+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504416926320] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.642+0000 7fe53db26800 20 add_watcher() i=7 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.643+0000 7fe53db26800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.656 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.643+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38633ac90 con 0x55f386323e80 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.643+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.643+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504416933520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386337f60 con 0x55f386323e80 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.644+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504416933520] v36'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.644+0000 7fe3effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.644+0000 7fe53db26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.644+0000 7fe53db26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.644+0000 7fe53db26800 5 note: GC not initialized 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe3eefe5640 20 reqs_thread_entry: start 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe53db26800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe53db26800 20 Filter name: none 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe3ecfe1640 20 reqs_thread_entry: start 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe53db26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe53db26800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.657 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.645+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38636e210 con 0x55f386328790 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe53db26800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe53db26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe53db26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe53db26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.646+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f3863748d0 con 0x55f386328790 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe53db26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe53db26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe53db26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94504417182352 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f38636ff30 con 0x55f386323e80 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94504416925264 notify 154618822684 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55f3860afb30 con 0x55f386323e80 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe41cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94504416925264 notifier 4881 bl.length()=666 2024-09-21T08:53:44.658 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94504417182352 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe41cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe41cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe41cff9640 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe3fc003ea0 con 0x55f386323e80 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.647+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94504417182352 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe52402f9f0 con 0x55f386323e80 2024-09-21T08:53:44.659 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:44.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.648+0000 7fe3effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.648+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504416933520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f38636bf30 con 0x55f386323e80 2024-09-21T08:53:44.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.649+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94504416933520] v36'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.649+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504416911328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f38636bf30 con 0x7fe52c07d060 2024-09-21T08:53:44.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.650+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94504416911328] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.650+0000 7fe53db26800 20 remove_watcher() i=0 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.650+0000 7fe53db26800 2 removed watcher, disabling cache 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.651+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504416915744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f38636bf30 con 0x55f386323e80 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.652+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94504416915744] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.652+0000 7fe53db26800 20 remove_watcher() i=1 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.652+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504416908800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f38636bf30 con 0x55f38632d2e0 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.653+0000 7fe5397e3640 1 -- 172.21.15.196:0/3396677223 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94504416908800] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe52c07a030 con 0x55f38632d2e0 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.653+0000 7fe53db26800 20 remove_watcher() i=2 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.653+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504416921712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331600 con 0x7fe52c07d060 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.654+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94504416921712] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x7fe52c07d060 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.654+0000 7fe53db26800 20 remove_watcher() i=3 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.654+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504416925264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386334870 con 0x55f386323e80 2024-09-21T08:53:44.665 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.655+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94504416925264] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5240391c0 con 0x55f386323e80 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.655+0000 7fe53db26800 20 remove_watcher() i=4 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.655+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504416922768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331600 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.656+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94504416922768] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.656+0000 7fe53db26800 20 remove_watcher() i=5 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.656+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504416931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386335650 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.657+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94504416931552] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.657+0000 7fe53db26800 20 remove_watcher() i=6 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.657+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504416926320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f386331600 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe539fe4640 1 -- 172.21.15.196:0/3396677223 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94504416926320] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe53402a070 con 0x55f386328790 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 20 remove_watcher() i=7 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f386328790 msgr2=0x55f38632ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f386328790 0x55f38632ab80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f386323e80 msgr2=0x55f386326340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f386323e80 0x55f386326340 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe52c07d060 msgr2=0x7fe52c090890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fe52c07d060 0x7fe52c090890 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f38632d2e0 msgr2=0x55f38632f7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f38632d2e0 0x55f38632f7a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe404036b40 msgr2=0x7fe404039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe404036b40 0x7fe404039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe52c07c730 tx=0x7fe52c093000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 msgr2=0x55f386318260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe534011e10 tx=0x7fe53404cc50 comp rx=0 tx=0).stop 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe530fe2640 1 -- 172.21.15.196:0/3396677223 reap_dead start 2024-09-21T08:53:44.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 shutdown_connections 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 --2- 172.21.15.196:0/3396677223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386310db0 0x55f386318260 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 >> 172.21.15.196:0/3396677223 conn(0x55f38630d110 msgr2=0x55f38630b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 shutdown_connections 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.658+0000 7fe53db26800 1 -- 172.21.15.196:0/3396677223 wait complete. 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 msgr2=0x7fe410039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 0x7fe410039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe52c068fd0 tx=0x7fe52c08ec10 comp rx=0 tx=0).stop 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 msgr2=0x55f386304520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x55f3862f0e40 tx=0x7fe534018830 comp rx=0 tx=0).stop 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 shutdown_connections 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe410036b40 0x7fe410039000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/2844392045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386304100 0x55f386304520 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 >> 172.21.15.196:0/2844392045 conn(0x55f3862f9090 msgr2=0x55f3862fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 shutdown_connections 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/2844392045 wait complete. 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 msgr2=0x55f3862f51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 0x55f3862f51b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 msgr2=0x55f3862f0490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 0x55f3862f0490 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 msgr2=0x7fe420039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 0x7fe420039050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe524000f60 tx=0x7fe5240012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 msgr2=0x55f3862e9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55f3861f0210 tx=0x7fe52c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 shutdown_connections 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f3862f2dc0 0x55f3862f51b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.669 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f3861f3720 0x55f3862f0490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fe420036b90 0x7fe420039050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 --2- 172.21.15.196:0/4270757689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f386164650 0x55f3862e9420 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 >> 172.21.15.196:0/4270757689 conn(0x55f3861eadb0 msgr2=0x55f3862dae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 shutdown_connections 2024-09-21T08:53:44.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.659+0000 7fe53db26800 1 -- 172.21.15.196:0/4270757689 wait complete. 2024-09-21T08:53:44.671 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.671 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.671 ERROR:root:0 2024-09-21T08:53:44.671 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:44.675 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:44.676 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-21T08:53:44.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-21T08:53:44.676 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-21T08:53:44.722 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.722 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.723 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.721+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.721+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff010d2a800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563e9769d5b0 0x563e9769bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff010d2a800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e975e6b30 con 0x563e9769d9b0 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff010d2a800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x563e975c8360 con 0x563e9769d5b0 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff00ca21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563e9769d5b0 0x563e9769bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff00c220640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x563e9769d9b0 0x563e9769c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58018/0 (socket says 172.21.15.196:58018) 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff00c220640 1 -- 172.21.15.196:0/2430590399 learned_addr learned my addr 172.21.15.196:0/2430590399 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff00ca21640 1 -- 172.21.15.196:0/2430590399 >> v1:172.21.15.29:6789/0 conn(0x563e9769d9b0 legacy=0x563e9769c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.724 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.722+0000 7ff00ca21640 1 -- 172.21.15.196:0/2430590399 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e975eee00 con 0x563e9769d5b0 2024-09-21T08:53:44.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.724+0000 7ff00ca21640 1 --2- 172.21.15.196:0/2430590399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e9769bd90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7feffc005fd0 tx=0x7feffc045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ccdedbed4565d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.724+0000 7ff00ba1f640 1 -- 172.21.15.196:0/2430590399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc058530 con 0x563e9769d5b0 2024-09-21T08:53:44.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.724+0000 7ff00ba1f640 1 -- 172.21.15.196:0/2430590399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc0586d0 con 0x563e9769d5b0 2024-09-21T08:53:44.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.724+0000 7ff00ba1f640 1 -- 172.21.15.196:0/2430590399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc0589d0 con 0x563e9769d5b0 2024-09-21T08:53:44.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 -- 172.21.15.196:0/2430590399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 msgr2=0x563e9769bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2430590399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e9769bd90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7feffc005fd0 tx=0x7feffc045c30 comp rx=0 tx=0).stop 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 -- 172.21.15.196:0/2430590399 shutdown_connections 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2430590399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e9769bd90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 -- 172.21.15.196:0/2430590399 >> 172.21.15.196:0/2430590399 conn(0x563e97722fe0 msgr2=0x563e97725400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 -- 172.21.15.196:0/2430590399 shutdown_connections 2024-09-21T08:53:44.727 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.725+0000 7ff010d2a800 1 -- 172.21.15.196:0/2430590399 wait complete. 2024-09-21T08:53:44.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.738+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.738+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.740 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff010d2a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff010d2a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563e97673360 con 0x563e9769d5b0 2024-09-21T08:53:44.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff00ca21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff00ca21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36058/0 (socket says 172.21.15.196:36058) 2024-09-21T08:53:44.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff00ca21640 1 -- 172.21.15.196:0/2730121973 learned_addr learned my addr 172.21.15.196:0/2730121973 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff00ca21640 1 -- 172.21.15.196:0/2730121973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e975c0bc0 con 0x563e9769d5b0 2024-09-21T08:53:44.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.739+0000 7ff00ca21640 1 --2- 172.21.15.196:0/2730121973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7feffc00a3f0 tx=0x7feffc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bc39f88e15421b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7feefae0d640 1 -- 172.21.15.196:0/2730121973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc058a30 con 0x563e9769d5b0 2024-09-21T08:53:44.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7feefae0d640 1 -- 172.21.15.196:0/2730121973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc068070 con 0x563e9769d5b0 2024-09-21T08:53:44.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7feefae0d640 1 -- 172.21.15.196:0/2730121973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc058d60 con 0x563e9769d5b0 2024-09-21T08:53:44.743 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 -- 172.21.15.196:0/2730121973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 msgr2=0x563e97818b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2730121973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7feffc00a3f0 tx=0x7feffc051000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 -- 172.21.15.196:0/2730121973 shutdown_connections 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2730121973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97818b00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 -- 172.21.15.196:0/2730121973 >> 172.21.15.196:0/2730121973 conn(0x563e97722fe0 msgr2=0x563e978144c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 -- 172.21.15.196:0/2730121973 shutdown_connections 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.740+0000 7ff010d2a800 1 -- 172.21.15.196:0/2730121973 wait complete. 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff010d2a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff010d2a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563e97730950 con 0x563e9769d5b0 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff00ca21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff00ca21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36070/0 (socket says 172.21.15.196:36070) 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff00ca21640 1 -- 172.21.15.196:0/2765822312 learned_addr learned my addr 172.21.15.196:0/2765822312 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.744 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff00ca21640 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e975d4fe0 con 0x563e9769d5b0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.741+0000 7ff00ca21640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7feffc046130 tx=0x7feffc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7feef960a640 1 -- 172.21.15.196:0/2765822312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc0636b0 con 0x563e9769d5b0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7feef960a640 1 -- 172.21.15.196:0/2765822312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc063850 con 0x563e9769d5b0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e978208d0 con 0x563e9769d5b0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7feef960a640 1 -- 172.21.15.196:0/2765822312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc063b70 con 0x563e9769d5b0 2024-09-21T08:53:44.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e97820df0 con 0x563e9769d5b0 2024-09-21T08:53:44.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.742+0000 7feef960a640 1 -- 172.21.15.196:0/2765822312 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feffc075020 con 0x563e9769d5b0 2024-09-21T08:53:44.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7feef960a640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 0x7feef4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7feef960a640 1 -- 172.21.15.196:0/2765822312 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7feffc090de0 con 0x563e9769d5b0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff00c220640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 0x7feef4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 0x563e978277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97827d20 con 0x563e978253f0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff00d222640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 0x563e978277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff00c220640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 0x7feef4039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff000000f60 tx=0x7ff0000012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff00d222640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 0x563e978277e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff00d222640 1 -- 172.21.15.196:0/2765822312 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0040083e0 con 0x563e978253f0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.743+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978249b0 con 0x563e978253f0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.744+0000 7ff00d222640 1 -- 172.21.15.196:0/2765822312 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0040083e0 con 0x563e978253f0 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.744+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 0x563e9782c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.744+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e9782caf0 con 0x563e9782a010 2024-09-21T08:53:44.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.744+0000 7ff00ca21640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 0x563e9782c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff00ca21640 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 0x563e9782c400 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff00ca21640 1 -- 172.21.15.196:0/2765822312 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feffc077c60 con 0x563e9782a010 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97828eb0 con 0x563e978253f0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff00d222640 1 -- 172.21.15.196:0/2765822312 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0040083e0 con 0x563e978253f0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97829330 con 0x563e978253f0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.745+0000 7ff00d222640 1 -- 172.21.15.196:0/2765822312 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0040083e0 con 0x563e978253f0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff010d2a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff010d2a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563e975c2580 con 0x563e9783b480 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36086/0 (socket says 172.21.15.196:36086) 2024-09-21T08:53:44.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff00d222640 1 -- 172.21.15.196:0/1030434518 learned_addr learned my addr 172.21.15.196:0/1030434518 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.746+0000 7ff00d222640 1 -- 172.21.15.196:0/1030434518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9783bde0 con 0x563e9783b480 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7ff00d222640 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x563e97821790 tx=0x7ff00400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7feef27fc640 1 -- 172.21.15.196:0/1030434518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff004007d00 con 0x563e9783b480 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7feef27fc640 1 -- 172.21.15.196:0/1030434518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00401e020 con 0x563e9783b480 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e9783c070 con 0x563e9783b480 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7feef27fc640 1 -- 172.21.15.196:0/1030434518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff004019420 con 0x563e9783b480 2024-09-21T08:53:44.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.747+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9783ed50 con 0x563e9783b480 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7feef27fc640 1 -- 172.21.15.196:0/1030434518 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff004016040 con 0x563e9783b480 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7feef27fc640 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 0x7feee4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7feef27fc640 1 -- 172.21.15.196:0/1030434518 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff00401f030 con 0x563e9783b480 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff00ca21640 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 0x7feee4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff00ca21640 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 0x7feee4039000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x563e97828180 tx=0x7feffc000f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff010d2a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.748+0000 7ff010d2a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563e978191f0 con 0x563e97848150 2024-09-21T08:53:44.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36092/0 (socket says 172.21.15.196:36092) 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7ff00d222640 1 -- 172.21.15.196:0/2775400862 learned_addr learned my addr 172.21.15.196:0/2775400862 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7ff00d222640 1 -- 172.21.15.196:0/2775400862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e97848b20 con 0x563e97848150 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7ff00d222640 1 --2- 172.21.15.196:0/2775400862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff00404cba0 tx=0x7ff0040157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5a59a537fdfa1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7feee3fff640 1 -- 172.21.15.196:0/2775400862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff004045030 con 0x563e97848150 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7feee3fff640 1 -- 172.21.15.196:0/2775400862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00404a030 con 0x563e97848150 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.749+0000 7feee3fff640 1 -- 172.21.15.196:0/2775400862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff00401d040 con 0x563e97848150 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- 172.21.15.196:0/2775400862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 msgr2=0x563e97848550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2775400862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff00404cba0 tx=0x7ff0040157e0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- 172.21.15.196:0/2775400862 shutdown_connections 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2775400862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e97848550 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- 172.21.15.196:0/2775400862 >> 172.21.15.196:0/2775400862 conn(0x563e978444b0 msgr2=0x563e978425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- 172.21.15.196:0/2775400862 shutdown_connections 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- 172.21.15.196:0/2775400862 wait complete. 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 Processor -- start 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- start start 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e9784f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff010d2a800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563e97849190 con 0x563e97848150 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e9784f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff00d222640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e9784f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36100/0 (socket says 172.21.15.196:36100) 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 learned_addr learned my addr 172.21.15.196:0/515877998 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.750+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9784fb00 con 0x563e97848150 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7ff00d222640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e9784f5c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff004015a30 tx=0x7ff00404cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7feee27fc640 1 -- 172.21.15.196:0/515877998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff004045070 con 0x563e97848150 2024-09-21T08:53:44.764 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7feee27fc640 1 -- 172.21.15.196:0/515877998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff004015aa0 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e9784fd90 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7feee27fc640 1 -- 172.21.15.196:0/515877998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff00401d030 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e97852a40 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.751+0000 7feee27fc640 1 -- 172.21.15.196:0/515877998 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff00404ea10 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7feee27fc640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feed8036b40 0x7feed8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7feee27fc640 1 -- 172.21.15.196:0/515877998 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff004038d10 con 0x563e97848150 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7ff00ca21640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feed8036b40 0x7feed8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7ff00ca21640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feed8036b40 0x7feed8039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x563e9782cef0 tx=0x7feffc094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e9785b010 0x563e9785d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.752+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e9785dc20 con 0x563e9785b010 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff00c220640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e9785b010 0x563e9785d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff00c220640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e9785b010 0x563e9785d4d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.765 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff000009050 con 0x563e9785b010 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 realm 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e9785a460 con 0x563e9785b010 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff000009050 con 0x563e9785b010 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e9785e710 con 0x563e9785b010 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff000009050 con 0x563e9785b010 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.753+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e9785efe0 con 0x563e9785b010 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff000009050 con 0x563e9785b010 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff010d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9785f920 0x563e97861d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978624a0 con 0x563e9785f920 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff00d222640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9785f920 0x563e97861d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.754+0000 7ff00d222640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9785f920 0x563e97861d10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff010d2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff010d2a800 20 searching for the correct realm 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563e978644a0 0x563e97866960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00ca21640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563e978644a0 0x563e97866960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00ca21640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563e978644a0 0x563e97866960 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00ca21640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7feffc088670 0x7feffc088a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.755+0000 7ff00c220640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7feffc088670 0x7feffc088a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00c220640 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7feffc088670 0x7feffc088a90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000009050 con 0x7feffc088670 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000009050 con 0x563e9785b010 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.756+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x7feffc088670 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.757+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.758+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff000029040 con 0x7feffc088670 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.759+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.760+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.782 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x7feffc088670 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.761+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x7feffc088670 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.762+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e978644a0 2024-09-21T08:53:44.783 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785f920 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x563e9785b010 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563e97867030 con 0x7feffc088670 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff000029040 con 0x7feffc088670 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.784 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.763+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97862d60 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97863150 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff000029040 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978674b0 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 zone default found 2024-09-21T08:53:44.785 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 4 Realm: () 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 zonegroup default 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97867510 con 0x563e9785f920 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.764+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978697e0 con 0x563e978644a0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.786 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97869b80 con 0x563e978644a0 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 20 started sync module instance, tier type = 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.765+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e97868c70 con 0x7feffc088670 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.766+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.766+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94826830139792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e97868c70 con 0x7feffc088670 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.766+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786a590 con 0x563e9785b010 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.767+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94826830139792] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.767+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.767+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94826830144192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e97868c70 con 0x563e9785b010 2024-09-21T08:53:44.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.767+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786b000 con 0x563e978644a0 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.768+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.768+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94826830146288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786b8a0 con 0x563e978644a0 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.768+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786c340 con 0x7feffc088670 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.769+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94826830144192] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.769+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.769+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94826830146288] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.769+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94826830151184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978687c0 con 0x7feffc088670 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.769+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786cbe0 con 0x563e9785b010 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.770+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.770+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94826830153440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786cb00 con 0x563e9785b010 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.770+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786db00 con 0x563e9785f920 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.771+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94826830151184] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.788 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.771+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.771+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94826830157296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786dac0 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.772+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786e530 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.772+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94826830153440] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.772+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94826830157296] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.773+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.773+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94826830148592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786cfd0 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.773+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786e9e0 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94826830148592] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94826830159968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786e9e0 con 0x563e9785f920 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=0 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=1 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=2 2024-09-21T08:53:44.789 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=3 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=4 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=5 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.774+0000 7ff010d2a800 20 add_watcher() i=6 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94826830159968] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff010d2a800 20 add_watcher() i=7 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff010d2a800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e97871e40 con 0x563e9785b010 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.775+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94826830161664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786f360 con 0x563e9785b010 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94826830161664] v36'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7feec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7ff010d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7ff010d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.790 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7ff010d2a800 5 note: GC not initialized 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.776+0000 7feec27e4640 20 reqs_thread_entry: start 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 20 Filter name: none 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7feebbfff640 20 reqs_thread_entry: start 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978a52e0 con 0x563e9785f920 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.777+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978abaa0 con 0x563e9785f920 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff010d2a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff010d2a800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff010d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94826830410848 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563e978a70a0 con 0x563e9785b010 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94826830153440 notify 154618822685 ret 0) ==== 708+0+0 (crc 0 0 0) 0x563e975e6b30 con 0x563e9785b010 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7feee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94826830153440 notifier 4888 bl.length()=666 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94826830410848 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7feee3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7feee3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7feee3fff640 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7feed0003ea0 con 0x563e9785b010 2024-09-21T08:53:44.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.779+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.780+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94826830410848 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff00002fac0 con 0x563e9785b010 2024-09-21T08:53:44.793 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.780+0000 7feec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.780+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94826830161664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978a3020 con 0x563e9785b010 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.781+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94826830161664] v36'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.781+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94826830139792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978a3020 con 0x7feffc088670 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.782+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94826830139792] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.782+0000 7ff010d2a800 20 remove_watcher() i=0 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.782+0000 7ff010d2a800 2 removed watcher, disabling cache 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.782+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94826830144192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978a3020 con 0x563e9785b010 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.784+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94826830144192] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.784+0000 7ff010d2a800 20 remove_watcher() i=1 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.784+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94826830146288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e978a3020 con 0x563e978644a0 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.785+0000 7ff00ca21640 1 -- 172.21.15.196:0/515877998 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94826830146288] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feffc097050 con 0x563e978644a0 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.785+0000 7ff010d2a800 20 remove_watcher() i=2 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.785+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94826830151184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786aaf0 con 0x7feffc088670 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.786+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94826830151184] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x7feffc088670 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.786+0000 7ff010d2a800 20 remove_watcher() i=3 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.786+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94826830153440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786be10 con 0x563e9785b010 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.787+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94826830153440] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0000391c0 con 0x563e9785b010 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.787+0000 7ff010d2a800 20 remove_watcher() i=4 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.787+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94826830157296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786aaf0 con 0x563e9785f920 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.788+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94826830157296] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.788+0000 7ff010d2a800 20 remove_watcher() i=5 2024-09-21T08:53:44.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.788+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94826830148592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786c6e0 con 0x563e9785f920 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.789+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94826830148592] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.789+0000 7ff010d2a800 20 remove_watcher() i=6 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.789+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94826830159968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563e9786be10 con 0x563e9785f920 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff00d222640 1 -- 172.21.15.196:0/515877998 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94826830159968] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff00403e070 con 0x563e9785f920 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 20 remove_watcher() i=7 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9785f920 msgr2=0x563e97861d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9785f920 0x563e97861d10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e9785b010 msgr2=0x563e9785d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e9785b010 0x563e9785d4d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7feffc088670 msgr2=0x7feffc088a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7feffc088670 0x7feffc088a90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563e978644a0 msgr2=0x563e97866960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x563e978644a0 0x563e97866960 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feed8036b40 msgr2=0x7feed8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feed8036b40 0x7feed8039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x563e9782cef0 tx=0x7feffc094000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 msgr2=0x563e9784f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/515877998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e97848150 0x563e9784f5c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff004015a30 tx=0x7ff00404cb00 comp rx=0 tx=0).stop 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 reap_dead start 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff00c220640 1 -- 172.21.15.196:0/515877998 reap_dead start 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 shutdown_connections 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 >> 172.21.15.196:0/515877998 conn(0x563e978444b0 msgr2=0x563e97842580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 shutdown_connections 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/515877998 wait complete. 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 msgr2=0x7feee4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 0x7feee4039000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x563e97828180 tx=0x7feffc000f40 comp rx=0 tx=0).stop 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 msgr2=0x563e9783b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x563e97821790 tx=0x7ff00400aec0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 shutdown_connections 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feee4036b40 0x7feee4039000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 --2- 172.21.15.196:0/1030434518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9783b480 0x563e9783b8a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 >> 172.21.15.196:0/1030434518 conn(0x563e97830410 msgr2=0x563e97832f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 shutdown_connections 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.790+0000 7ff010d2a800 1 -- 172.21.15.196:0/1030434518 wait complete. 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 msgr2=0x563e9782c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 0x563e9782c400 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 msgr2=0x563e978277e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 0x563e978277e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 msgr2=0x7feef4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 0x7feef4039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff000000f60 tx=0x7ff0000012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 msgr2=0x563e97820390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7feffc046130 tx=0x7feffc003330 comp rx=0 tx=0).stop 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 shutdown_connections 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x563e9782a010 0x563e9782c400 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x563e978253f0 0x563e978277e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7feef4036b40 0x7feef4039000 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 --2- 172.21.15.196:0/2765822312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563e9769d5b0 0x563e97820390 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 >> 172.21.15.196:0/2765822312 conn(0x563e97722fe0 msgr2=0x563e97812d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 shutdown_connections 2024-09-21T08:53:44.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.791+0000 7ff010d2a800 1 -- 172.21.15.196:0/2765822312 wait complete. 2024-09-21T08:53:44.804 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.804 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.804 ERROR:root:0 2024-09-21T08:53:44.804 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:44.808 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:44.809 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:44.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:44.809 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T08:53:44.855 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.855 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.854+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.854+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbfd24800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f176734710 0x55f176734b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbfd24800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1765f3b30 con 0x55f176735050 2024-09-21T08:53:44.856 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbfd24800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f1765d5360 con 0x55f176734710 2024-09-21T08:53:44.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbbae0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f176734710 0x55f176734b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0db32df640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f176735050 0x55f176739a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58030/0 (socket says 172.21.15.196:58030) 2024-09-21T08:53:44.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0db32df640 1 -- 172.21.15.196:0/3730509551 learned_addr learned my addr 172.21.15.196:0/3730509551 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3730509551 >> v1:172.21.15.29:6789/0 conn(0x55f176735050 legacy=0x55f176739a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.855+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3730509551 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1765fbe00 con 0x55f176734710 2024-09-21T08:53:44.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.857+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3730509551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f176734b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a470 tx=0x7f0dac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ed7b7afcd7535a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.857+0000 7f0dbb2df640 1 -- 172.21.15.196:0/3730509551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac053570 con 0x55f176734710 2024-09-21T08:53:44.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.857+0000 7f0dbb2df640 1 -- 172.21.15.196:0/3730509551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac058070 con 0x55f176734710 2024-09-21T08:53:44.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.857+0000 7f0dbb2df640 1 -- 172.21.15.196:0/3730509551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac053880 con 0x55f176734710 2024-09-21T08:53:44.859 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3730509551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 msgr2=0x55f176734b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3730509551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f176734b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a470 tx=0x7f0dac045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3730509551 shutdown_connections 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3730509551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f176734b10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3730509551 >> 172.21.15.196:0/3730509551 conn(0x55f17672ffe0 msgr2=0x55f176732400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3730509551 shutdown_connections 2024-09-21T08:53:44.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.858+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3730509551 wait complete. 2024-09-21T08:53:44.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.871+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.871+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbfd24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.873 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbfd24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f176680360 con 0x55f176734710 2024-09-21T08:53:44.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbbae0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.874 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbbae0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36120/0 (socket says 172.21.15.196:36120) 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbbae0640 1 -- 172.21.15.196:0/4178501716 learned_addr learned my addr 172.21.15.196:0/4178501716 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbbae0640 1 -- 172.21.15.196:0/4178501716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1765cdbc0 con 0x55f176734710 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.872+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/4178501716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0dac025c20 tx=0x7f0dac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06d61ccd8ac9c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.873+0000 7f0ca9e0b640 1 -- 172.21.15.196:0/4178501716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac05c580 con 0x55f176734710 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.873+0000 7f0ca9e0b640 1 -- 172.21.15.196:0/4178501716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac063030 con 0x55f176734710 2024-09-21T08:53:44.875 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.873+0000 7f0ca9e0b640 1 -- 172.21.15.196:0/4178501716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac05c850 con 0x55f176734710 2024-09-21T08:53:44.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.873+0000 7f0dbfd24800 1 -- 172.21.15.196:0/4178501716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 msgr2=0x55f1766aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.878 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/4178501716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0dac025c20 tx=0x7f0dac051000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- 172.21.15.196:0/4178501716 shutdown_connections 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/4178501716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f1766aa6e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- 172.21.15.196:0/4178501716 >> 172.21.15.196:0/4178501716 conn(0x55f17672ffe0 msgr2=0x55f17681f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- 172.21.15.196:0/4178501716 shutdown_connections 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- 172.21.15.196:0/4178501716 wait complete. 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbfd24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f17673b5f0 con 0x55f176734710 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbbae0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbbae0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36136/0 (socket says 172.21.15.196:36136) 2024-09-21T08:53:44.879 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.874+0000 7f0dbbae0640 1 -- 172.21.15.196:0/737478873 learned_addr learned my addr 172.21.15.196:0/737478873 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0dbbae0640 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1765e1fe0 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a330 tx=0x7f0dac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0ca3fff640 1 -- 172.21.15.196:0/737478873 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac06c030 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0ca3fff640 1 -- 172.21.15.196:0/737478873 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac05c580 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f17682d910 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0ca3fff640 1 -- 172.21.15.196:0/737478873 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dac05c860 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.875+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17682de90 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0ca3fff640 1 -- 172.21.15.196:0/737478873 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0dac053440 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0ca3fff640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 0x7f0ca4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0ca3fff640 1 -- 172.21.15.196:0/737478873 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0dac070020 con 0x55f176734710 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0db32df640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 0x7f0ca4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 0x55f176834440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1768349c0 con 0x55f176735050 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 0x55f176834440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0db32df640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 0x7f0ca4039000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000f60 tx=0x7f0da40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.876+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 0x55f176834440 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/737478873 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0db400a4a0 con 0x55f176735050 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176831a10 con 0x55f176735050 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/737478873 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0db400a4a0 con 0x55f176735050 2024-09-21T08:53:44.881 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 0x55f176839130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176839820 con 0x55f176836d40 2024-09-21T08:53:44.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 0x55f176839130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.877+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 0x55f176839130 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.878+0000 7f0dbbae0640 1 -- 172.21.15.196:0/737478873 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0dac07b070 con 0x55f176836d40 2024-09-21T08:53:44.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.878+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176835be0 con 0x55f176735050 2024-09-21T08:53:44.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.878+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/737478873 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0db400a4a0 con 0x55f176735050 2024-09-21T08:53:44.892 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.878+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176836080 con 0x55f176735050 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.878+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/737478873 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0db400a4a0 con 0x55f176735050 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbfd24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbfd24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1765cf580 con 0x55f176848170 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36148/0 (socket says 172.21.15.196:36148) 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/383066044 learned_addr learned my addr 172.21.15.196:0/383066044 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.879+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/383066044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f176848ad0 con 0x55f176848170 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x55f176834da0 tx=0x7f0db4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0ca17fa640 1 -- 172.21.15.196:0/383066044 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db4014450 con 0x55f176848170 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0ca17fa640 1 -- 172.21.15.196:0/383066044 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4014610 con 0x55f176848170 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0ca17fa640 1 -- 172.21.15.196:0/383066044 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db4014930 con 0x55f176848170 2024-09-21T08:53:44.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f176848d60 con 0x55f176848170 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17684ba40 con 0x55f176848170 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.880+0000 7f0ca17fa640 1 -- 172.21.15.196:0/383066044 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0db4011040 con 0x55f176848170 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0ca17fa640 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 0x7f0c94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0ca17fa640 1 -- 172.21.15.196:0/383066044 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0db401e070 con 0x55f176848170 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 0x7f0c94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 0x7f0c94039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55f176834e90 tx=0x7f0dac008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbfd24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbfd24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1766a8d50 con 0x55f176854df0 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36164/0 (socket says 172.21.15.196:36164) 2024-09-21T08:53:44.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.881+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/664344511 learned_addr learned my addr 172.21.15.196:0/664344511 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/664344511 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1768557c0 con 0x55f176854df0 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/664344511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0db404ccc0 tx=0x7f0db40167c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4945221d8e7246c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0c9affd640 1 -- 172.21.15.196:0/664344511 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db4014ad0 con 0x55f176854df0 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0c9affd640 1 -- 172.21.15.196:0/664344511 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4014c70 con 0x55f176854df0 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0c9affd640 1 -- 172.21.15.196:0/664344511 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db4046ab0 con 0x55f176854df0 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 -- 172.21.15.196:0/664344511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 msgr2=0x55f1768551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/664344511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0db404ccc0 tx=0x7f0db40167c0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 -- 172.21.15.196:0/664344511 shutdown_connections 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/664344511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f1768551f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 -- 172.21.15.196:0/664344511 >> 172.21.15.196:0/664344511 conn(0x55f1768511a0 msgr2=0x55f17684f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 -- 172.21.15.196:0/664344511 shutdown_connections 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.882+0000 7f0dbfd24800 1 -- 172.21.15.196:0/664344511 wait complete. 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbfd24800 1 Processor -- start 2024-09-21T08:53:44.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbfd24800 1 -- start start 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbfd24800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbfd24800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f176855d90 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbc2e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36168/0 (socket says 172.21.15.196:36168) 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 learned_addr learned my addr 172.21.15.196:0/3804151653 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.883+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17685c7c0 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0db404ccc0 tx=0x7f0db404cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0c997fa640 1 -- 172.21.15.196:0/3804151653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db4014e20 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0c997fa640 1 -- 172.21.15.196:0/3804151653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db402b560 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f17685ca50 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0c997fa640 1 -- 172.21.15.196:0/3804151653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db402b860 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17685f700 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.884+0000 7f0c997fa640 1 -- 172.21.15.196:0/3804151653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0db404eb20 con 0x55f176854df0 2024-09-21T08:53:44.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0c997fa640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c84036b40 0x7f0c84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0c997fa640 1 -- 172.21.15.196:0/3804151653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0db4033070 con 0x55f176854df0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c84036b40 0x7f0c84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c84036b40 0x7f0c84039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009750 tx=0x7f0dac086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176867f30 0x55f17686a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686ab40 con 0x55f176867f30 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.885+0000 7f0db32df640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176867f30 0x55f17686a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0db32df640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176867f30 0x55f17686a3f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da4009050 con 0x55f176867f30 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 realm 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176867380 con 0x55f176867f30 2024-09-21T08:53:44.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da4009050 con 0x55f176867f30 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686b630 con 0x55f176867f30 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da4009050 con 0x55f176867f30 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.886+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686bf00 con 0x55f176867f30 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0da4009050 con 0x55f176867f30 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbfd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f17686c840 0x55f17686ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686f3c0 con 0x55f17686c840 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f17686c840 0x55f17686ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.887+0000 7f0dbc2e1640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f17686c840 0x55f17686ec30 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbfd24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbfd24800 20 searching for the correct realm 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f176871390 0x55f176873850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f176871390 0x55f176873850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f176871390 0x55f176873850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbbae0640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0dac05c070 0x7f0dac090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.888+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0db32df640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0dac05c070 0x7f0dac090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0db32df640 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0dac05c070 0x7f0dac090300 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4009050 con 0x7f0dac05c070 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.889+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4009050 con 0x55f176867f30 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.890+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x7f0dac05c070 2024-09-21T08:53:44.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.912 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.891+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0da4029040 con 0x7f0dac05c070 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.892+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.913 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.893+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.914 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x7f0dac05c070 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.894+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x7f0dac05c070 2024-09-21T08:53:44.915 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.895+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176871390 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f17686c840 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x55f176867f30 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f176873f20 con 0x7f0dac05c070 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da4029040 con 0x7f0dac05c070 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:44.916 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.896+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686fd80 con 0x55f176867f30 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176870620 con 0x55f176867f30 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0da4029040 con 0x55f176867f30 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17686f9c0 con 0x55f176867f30 2024-09-21T08:53:44.917 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 zone default found 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 4 Realm: () 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 zonegroup default 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1768743a0 con 0x55f17686c840 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.918 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.897+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176876670 con 0x55f176871390 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f176876a10 con 0x55f176871390 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 20 started sync module instance, tier type = 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.898+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176875b00 con 0x7f0dac05c070 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.899+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.899+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94495564062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176875b00 con 0x7f0dac05c070 2024-09-21T08:53:44.919 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.899+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768774b0 con 0x55f176867f30 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.900+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94495564062720] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.900+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.900+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94495564066720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176875b00 con 0x55f176867f30 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.900+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176877f50 con 0x55f176871390 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.901+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.901+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94495564069440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176878820 con 0x55f176871390 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.901+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768792c0 con 0x7f0dac05c070 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.901+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94495564066720] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.902+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.902+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94495564074384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768796b0 con 0x7f0dac05c070 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.902+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687a0b0 con 0x55f176867f30 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.903+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94495564069440] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.920 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.903+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.903+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94495564071792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687a070 con 0x55f176867f30 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.903+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687aac0 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.904+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94495564074384] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.904+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94495564071792] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.905+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.905+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94495564080656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687a070 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.905+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687aa90 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.906+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.906+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94495564082864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687b780 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.906+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687bfd0 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.906+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94495564080656] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94495564082864] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.921 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94495564083920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687bba0 con 0x55f17686c840 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=0 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=1 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=2 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=3 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=4 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=5 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.907+0000 7f0dbfd24800 20 add_watcher() i=6 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94495564083920] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0dbfd24800 20 add_watcher() i=7 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0dbfd24800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:44.922 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f17687ed10 con 0x55f176867f30 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.908+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94495564084976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f17687bfc0 con 0x55f176867f30 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.909+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94495564084976] v36'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.909+0000 7f0c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.909+0000 7f0dbfd24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.909+0000 7f0dbfd24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.909+0000 7f0dbfd24800 5 note: GC not initialized 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0c70fe1640 20 reqs_thread_entry: start 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0dbfd24800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0dbfd24800 20 Filter name: none 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0bea7fc640 20 reqs_thread_entry: start 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0dbfd24800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0dbfd24800 20 rados->read ofs=0 len=0 2024-09-21T08:53:44.923 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.910+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1768b21d0 con 0x55f17686c840 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbfd24800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbfd24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbfd24800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbfd24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:44.924 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.911+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768b8a20 con 0x55f17686c840 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v36'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0dbfd24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0dbfd24800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0dbfd24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94495564319200 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1768b62c0 con 0x55f176867f30 2024-09-21T08:53:44.925 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94495564071792 notify 154618822686 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55f1765f3b30 con 0x55f176867f30 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0c9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94495564071792 notifier 4895 bl.length()=679 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94495564319200 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0c9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0c9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.912+0000 7f0c9affd640 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0c80003ea0 con 0x55f176867f30 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.913+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.913+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94495564319200 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0da402fa00 con 0x55f176867f30 2024-09-21T08:53:44.926 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:44.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.914+0000 7f0c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.914+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94495564084976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768aff50 con 0x55f176867f30 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.915+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94495564084976] v36'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.915+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94495564062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768aff50 con 0x7f0dac05c070 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.916+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94495564062720] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.916+0000 7f0dbfd24800 20 remove_watcher() i=0 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.916+0000 7f0dbfd24800 2 removed watcher, disabling cache 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.916+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94495564066720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768aff50 con 0x55f176867f30 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.917+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94495564066720] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.917+0000 7f0dbfd24800 20 remove_watcher() i=1 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.917+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94495564069440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1768aff50 con 0x55f176871390 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.918+0000 7f0dbbae0640 1 -- 172.21.15.196:0/3804151653 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94495564069440] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac099070 con 0x55f176871390 2024-09-21T08:53:44.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.918+0000 7f0dbfd24800 20 remove_watcher() i=2 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.918+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94495564074384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176876000 con 0x7f0dac05c070 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.919+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94495564074384] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x7f0dac05c070 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.919+0000 7f0dbfd24800 20 remove_watcher() i=3 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.919+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94495564071792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176876fa0 con 0x55f176867f30 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.920+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94495564071792] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da40391c0 con 0x55f176867f30 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.920+0000 7f0dbfd24800 20 remove_watcher() i=4 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.920+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94495564080656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176877a40 con 0x55f17686c840 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.921+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94495564080656] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.921+0000 7f0dbfd24800 20 remove_watcher() i=5 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.921+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94495564082864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176876000 con 0x55f17686c840 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.922+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94495564082864] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.922+0000 7f0dbfd24800 20 remove_watcher() i=6 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.922+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94495564083920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f176876fa0 con 0x55f17686c840 2024-09-21T08:53:44.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.923+0000 7f0dbc2e1640 1 -- 172.21.15.196:0/3804151653 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94495564083920] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db4043020 con 0x55f17686c840 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.923+0000 7f0dbfd24800 20 remove_watcher() i=7 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f17686c840 msgr2=0x55f17686ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f17686c840 0x55f17686ec30 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176867f30 msgr2=0x55f17686a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176867f30 0x55f17686a3f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0dac05c070 msgr2=0x7f0dac090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f0dac05c070 0x7f0dac090300 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f176871390 msgr2=0x55f176873850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55f176871390 0x55f176873850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c84036b40 msgr2=0x7f0c84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c84036b40 0x7f0c84039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009750 tx=0x7f0dac086000 comp rx=0 tx=0).stop 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 msgr2=0x55f17685c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0db32df640 1 -- 172.21.15.196:0/3804151653 reap_dead start 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0db404ccc0 tx=0x7f0db404cc50 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 shutdown_connections 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/3804151653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176854df0 0x55f17685c280 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 >> 172.21.15.196:0/3804151653 conn(0x55f1768511a0 msgr2=0x55f176856500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 shutdown_connections 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/3804151653 wait complete. 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 msgr2=0x7f0c94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 0x7f0c94039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55f176834e90 tx=0x7f0dac008310 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 msgr2=0x55f176848590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x55f176834da0 tx=0x7f0db4018830 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 shutdown_connections 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0c94036b40 0x7f0c94039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/383066044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176848170 0x55f176848590 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 >> 172.21.15.196:0/383066044 conn(0x55f17683d100 msgr2=0x55f17683fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.935 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 shutdown_connections 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.924+0000 7f0dbfd24800 1 -- 172.21.15.196:0/383066044 wait complete. 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 msgr2=0x55f176839130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 0x55f176839130 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 msgr2=0x55f176834440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 0x55f176834440 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 msgr2=0x7f0ca4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 0x7f0ca4039000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000f60 tx=0x7f0da40012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 msgr2=0x55f17682d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a330 tx=0x7f0dac002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 shutdown_connections 2024-09-21T08:53:44.936 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55f176836d40 0x55f176839130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55f176735050 0x55f176834440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0ca4036b40 0x7f0ca4039000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 --2- 172.21.15.196:0/737478873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f176734710 0x55f17682d3d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 >> 172.21.15.196:0/737478873 conn(0x55f17672ffe0 msgr2=0x55f17681ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 shutdown_connections 2024-09-21T08:53:44.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.925+0000 7f0dbfd24800 1 -- 172.21.15.196:0/737478873 wait complete. 2024-09-21T08:53:44.938 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.938 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:44.938 ERROR:root:0 2024-09-21T08:53:44.938 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:44.943 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:44.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-21T08:53:44.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-21T08:53:44.943 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-21T08:53:44.989 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:44.989 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1787751800 1 -- start start 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1787751800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ebec6dd630 0x55ebec76e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1787751800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebec628b30 con 0x55ebec76eb40 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1787751800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ebec60a360 con 0x55ebec6dd630 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1785245640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ebec6dd630 0x55ebec76e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f177ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ebec76eb40 0x55ebec770f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58038/0 (socket says 172.21.15.196:58038) 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1785245640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ebec6dd630 0x55ebec76e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36172/0 (socket says 172.21.15.196:36172) 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f177ffff640 1 -- 172.21.15.196:0/2089625007 learned_addr learned my addr 172.21.15.196:0/2089625007 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:44.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1785245640 1 -- 172.21.15.196:0/2089625007 >> v1:172.21.15.29:6789/0 conn(0x55ebec76eb40 legacy=0x55ebec770f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.992 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.989+0000 7f1785245640 1 -- 172.21.15.196:0/2089625007 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec630e00 con 0x55ebec6dd630 2024-09-21T08:53:44.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.991+0000 7f1785245640 1 --2- 172.21.15.196:0/2089625007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec76e600 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f177800a470 tx=0x7f1778045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df7fa664efd304 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:44.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.991+0000 7f1784a44640 1 -- 172.21.15.196:0/2089625007 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778053570 con 0x55ebec6dd630 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.991+0000 7f1784a44640 1 -- 172.21.15.196:0/2089625007 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1778058070 con 0x55ebec6dd630 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.991+0000 7f1784a44640 1 -- 172.21.15.196:0/2089625007 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778053880 con 0x55ebec6dd630 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 -- 172.21.15.196:0/2089625007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 msgr2=0x55ebec76e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 --2- 172.21.15.196:0/2089625007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec76e600 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f177800a470 tx=0x7f1778045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 -- 172.21.15.196:0/2089625007 shutdown_connections 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 --2- 172.21.15.196:0/2089625007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec76e600 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 -- 172.21.15.196:0/2089625007 >> 172.21.15.196:0/2089625007 conn(0x55ebec763db0 msgr2=0x55ebec7661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 -- 172.21.15.196:0/2089625007 shutdown_connections 2024-09-21T08:53:44.994 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:44.992+0000 7f1787751800 1 -- 172.21.15.196:0/2089625007 wait complete. 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.005+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1787751800 1 -- start start 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1787751800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1787751800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ebec6b5360 con 0x55ebec6dd630 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1785245640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1785245640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36186/0 (socket says 172.21.15.196:36186) 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1785245640 1 -- 172.21.15.196:0/2415876895 learned_addr learned my addr 172.21.15.196:0/2415876895 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.006+0000 7f1785245640 1 -- 172.21.15.196:0/2415876895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec602bc0 con 0x55ebec6dd630 2024-09-21T08:53:45.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1785245640 1 --2- 172.21.15.196:0/2415876895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1778025c20 tx=0x7f1778051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4213cf883ceddfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1673606640 1 -- 172.21.15.196:0/2415876895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778053ba0 con 0x55ebec6dd630 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1673606640 1 -- 172.21.15.196:0/2415876895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1778063030 con 0x55ebec6dd630 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1673606640 1 -- 172.21.15.196:0/2415876895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778053440 con 0x55ebec6dd630 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 -- 172.21.15.196:0/2415876895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 msgr2=0x55ebec85aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 --2- 172.21.15.196:0/2415876895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1778025c20 tx=0x7f1778051000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 -- 172.21.15.196:0/2415876895 shutdown_connections 2024-09-21T08:53:45.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 --2- 172.21.15.196:0/2415876895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec85aaf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 -- 172.21.15.196:0/2415876895 >> 172.21.15.196:0/2415876895 conn(0x55ebec763db0 msgr2=0x55ebec8564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.007+0000 7f1787751800 1 -- 172.21.15.196:0/2415876895 shutdown_connections 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1787751800 1 -- 172.21.15.196:0/2415876895 wait complete. 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1787751800 1 -- start start 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1787751800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1787751800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ebec772920 con 0x55ebec6dd630 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1785245640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1785245640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36194/0 (socket says 172.21.15.196:36194) 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.008+0000 7f1785245640 1 -- 172.21.15.196:0/4186233421 learned_addr learned my addr 172.21.15.196:0/4186233421 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1785245640 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec616fe0 con 0x55ebec6dd630 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1785245640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55ebec85b950 tx=0x7f1778002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.013 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1671e03640 1 -- 172.21.15.196:0/4186233421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778078070 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1671e03640 1 -- 172.21.15.196:0/4186233421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1778053570 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebec862990 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1671e03640 1 -- 172.21.15.196:0/4186233421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778053850 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.009+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebec862f10 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1671e03640 1 -- 172.21.15.196:0/4186233421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f177807b070 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1671e03640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 0x7f166c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1671e03640 1 -- 172.21.15.196:0/4186233421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f1778070070 con 0x55ebec6dd630 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f177ffff640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 0x7f166c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 0x55ebec8694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec869ae0 con 0x55ebec76eb40 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1785a46640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 0x55ebec8694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f177ffff640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 0x7f166c039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1770000f60 tx=0x7f17700012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.014 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.010+0000 7f1785a46640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 0x55ebec8694c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1785a46640 1 -- 172.21.15.196:0/4186233421 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178000a4a0 con 0x55ebec76eb40 2024-09-21T08:53:45.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec866a90 con 0x55ebec76eb40 2024-09-21T08:53:45.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1785a46640 1 -- 172.21.15.196:0/4186233421 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f178000a4a0 con 0x55ebec76eb40 2024-09-21T08:53:45.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 0x55ebec86e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec86e910 con 0x55ebec86be30 2024-09-21T08:53:45.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.011+0000 7f1785245640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 0x55ebec86e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.021 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1785245640 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 0x55ebec86e220 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1785245640 1 -- 172.21.15.196:0/4186233421 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f177807a030 con 0x55ebec86be30 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec86ac10 con 0x55ebec76eb40 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1785a46640 1 -- 172.21.15.196:0/4186233421 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f178000a4a0 con 0x55ebec76eb40 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec86b0b0 con 0x55ebec76eb40 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.012+0000 7f1785a46640 1 -- 172.21.15.196:0/4186233421 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f178000a4a0 con 0x55ebec76eb40 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1787751800 1 -- start start 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1787751800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1787751800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ebec604580 con 0x55ebec87d130 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36210/0 (socket says 172.21.15.196:36210) 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1785a46640 1 -- 172.21.15.196:0/1125799722 learned_addr learned my addr 172.21.15.196:0/1125799722 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.022 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.013+0000 7f1785a46640 1 -- 172.21.15.196:0/1125799722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec87da90 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f1785a46640 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55ebec869ee0 tx=0x7f1780018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f166affd640 1 -- 172.21.15.196:0/1125799722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780014450 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f166affd640 1 -- 172.21.15.196:0/1125799722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780014610 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebec87dd20 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f166affd640 1 -- 172.21.15.196:0/1125799722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780014930 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.014+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebec880a00 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f166affd640 1 -- 172.21.15.196:0/1125799722 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1780011040 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f166affd640 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 0x7f165c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f166affd640 1 -- 172.21.15.196:0/1125799722 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f178001e070 con 0x55ebec87d130 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1785245640 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 0x7f165c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1787751800 1 -- start start 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1785245640 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 0x7f165c039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55ebec869f80 tx=0x7f177808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1787751800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.015+0000 7f1787751800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ebec85b240 con 0x55ebec889de0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36222/0 (socket says 172.21.15.196:36222) 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1785a46640 1 -- 172.21.15.196:0/726653484 learned_addr learned my addr 172.21.15.196:0/726653484 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1785a46640 1 -- 172.21.15.196:0/726653484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec88a7b0 con 0x55ebec889de0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1785a46640 1 --2- 172.21.15.196:0/726653484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f178004cbb0 tx=0x7f1780013b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb628b2cd7ed0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1668ff9640 1 -- 172.21.15.196:0/726653484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780016960 con 0x55ebec889de0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1668ff9640 1 -- 172.21.15.196:0/726653484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780016440 con 0x55ebec889de0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.016+0000 7f1668ff9640 1 -- 172.21.15.196:0/726653484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780016b00 con 0x55ebec889de0 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- 172.21.15.196:0/726653484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 msgr2=0x55ebec88a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 --2- 172.21.15.196:0/726653484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f178004cbb0 tx=0x7f1780013b40 comp rx=0 tx=0).stop 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- 172.21.15.196:0/726653484 shutdown_connections 2024-09-21T08:53:45.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 --2- 172.21.15.196:0/726653484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec88a1e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- 172.21.15.196:0/726653484 >> 172.21.15.196:0/726653484 conn(0x55ebec886140 msgr2=0x55ebec884240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- 172.21.15.196:0/726653484 shutdown_connections 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- 172.21.15.196:0/726653484 wait complete. 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 Processor -- start 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- start start 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1787751800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ebec88ae20 con 0x55ebec889de0 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1785a46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36230/0 (socket says 172.21.15.196:36230) 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.017+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 learned_addr learned my addr 172.21.15.196:0/266152277 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebec8917d0 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f1785a46640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa20 tx=0x7f178004cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f165affd640 1 -- 172.21.15.196:0/266152277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780011840 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f165affd640 1 -- 172.21.15.196:0/266152277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178000de50 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f165affd640 1 -- 172.21.15.196:0/266152277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780014e60 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebec891a60 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.018+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebec894710 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.019+0000 7f165affd640 1 -- 172.21.15.196:0/266152277 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f178004ea10 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.019+0000 7f165affd640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1650036b40 0x7f1650039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.019+0000 7f165affd640 1 -- 172.21.15.196:0/266152277 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f178000e040 con 0x55ebec889de0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.019+0000 7f1785245640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1650036b40 0x7f1650039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.019+0000 7f1785245640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1650036b40 0x7f1650039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f177805ffd0 tx=0x7f1778093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec89ccd0 0x55ebec89f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec89f8e0 con 0x55ebec89ccd0 2024-09-21T08:53:45.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f177ffff640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec89ccd0 0x55ebec89f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f177ffff640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec89ccd0 0x55ebec89f190 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1770009050 con 0x55ebec89ccd0 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 20 realm 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.020+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec89c120 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1770009050 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a03d0 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1770009050 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a0ca0 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1770009050 con 0x55ebec89ccd0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec8a15e0 0x55ebec8a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a4160 con 0x55ebec8a15e0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.021+0000 7f1785a46640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec8a15e0 0x55ebec8a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785a46640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec8a15e0 0x55ebec8a39d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1787751800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1787751800 20 searching for the correct realm 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ebec8a6130 0x55ebec8a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785245640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ebec8a6130 0x55ebec8a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785245640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ebec8a6130 0x55ebec8a85f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785245640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f177807d060 0x7f1778004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.022+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f177ffff640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f177807d060 0x7f1778004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f177ffff640 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f177807d060 0x7f1778004280 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770009050 con 0x7f177807d060 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.023+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770009050 con 0x55ebec89ccd0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.024+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x7f177807d060 2024-09-21T08:53:45.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.025+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1770029040 con 0x7f177807d060 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.026+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.027+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x7f177807d060 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.028+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x7f177807d060 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.029+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a6130 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec8a15e0 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x55ebec89ccd0 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a8cc0 con 0x7f177807d060 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770029040 con 0x7f177807d060 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.030+0000 7f1787751800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a4b20 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a53c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1770029040 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a4760 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 zone default found 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 4 Realm: () 2024-09-21T08:53:45.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 zonegroup default 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.031+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8a9160 con 0x55ebec8a15e0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ab430 con 0x55ebec8a6130 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ab7d0 con 0x55ebec8a6130 2024-09-21T08:53:45.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 started sync module instance, tier type = 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.032+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8aa8c0 con 0x7f177807d060 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.033+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.033+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471774187024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8aa8c0 con 0x7f177807d060 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.033+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ac200 con 0x55ebec89ccd0 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.034+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471774187024] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.034+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.034+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471774191408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8aa8c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.034+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8acc90 con 0x55ebec8a6130 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.035+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.036+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471774193504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ad530 con 0x55ebec8a6130 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.036+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8adfe0 con 0x7f177807d060 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.036+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471774191408] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.037+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.037+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471774193504] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.037+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471774195840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8adac0 con 0x7f177807d060 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.037+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ae880 con 0x55ebec89ccd0 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.038+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.038+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471774200704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ae7e0 con 0x55ebec89ccd0 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.038+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8af7e0 con 0x55ebec8a15e0 2024-09-21T08:53:45.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.038+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471774195840] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.040+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471774200704] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.041+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.041+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471774184464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8af2f0 con 0x55ebec8a15e0 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.041+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8b0080 con 0x55ebec8a15e0 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.041+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471774184464] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.042+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.042+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471774202992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8af2f0 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.042+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8b06a0 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471774202992] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471774208400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8b0660 con 0x55ebec8a15e0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=0 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=1 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=2 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=3 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=4 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=5 2024-09-21T08:53:45.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.043+0000 7f1787751800 20 add_watcher() i=6 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471774208400] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f1787751800 20 add_watcher() i=7 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f1787751800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8b3b20 con 0x55ebec89ccd0 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.044+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471774206608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8b0fe0 con 0x55ebec89ccd0 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.045+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471774206608] v36'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.045+0000 7f163b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.045+0000 7f1787751800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.045+0000 7f1787751800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.045+0000 7f1787751800 5 note: GC not initialized 2024-09-21T08:53:45.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f163a7e4640 20 reqs_thread_entry: start 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1787751800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1787751800 20 Filter name: none 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f15abfff640 20 reqs_thread_entry: start 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1787751800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1787751800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e7060 con 0x55ebec8a15e0 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.046+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.047+0000 7f1787751800 20 rados_obj.operate() r=0 bl.length=503 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.047+0000 7f1787751800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.047+0000 7f1787751800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.047+0000 7f1787751800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.047+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8edab0 con 0x55ebec8a15e0 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.058 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1787751800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1787751800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1787751800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94471774458992 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e9110 con 0x55ebec89ccd0 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94471774200704 notify 154618822687 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55ebec628b30 con 0x55ebec89ccd0 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1668ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94471774200704 notifier 4902 bl.length()=636 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1668ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f1668ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.048+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94471774458992 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.049+0000 7f1668ff9640 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1648003ea0 con 0x55ebec89ccd0 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.049+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.059 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.049+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94471774458992 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f177002f790 con 0x55ebec89ccd0 2024-09-21T08:53:45.060 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:45.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.050+0000 7f163b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.050+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471774206608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e4d70 con 0x55ebec89ccd0 2024-09-21T08:53:45.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.051+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94471774206608] v36'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.051+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471774187024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e4d70 con 0x7f177807d060 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.052+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94471774187024] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.052+0000 7f1787751800 20 remove_watcher() i=0 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.052+0000 7f1787751800 2 removed watcher, disabling cache 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.052+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471774191408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e4d70 con 0x55ebec89ccd0 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.053+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94471774191408] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.053+0000 7f1787751800 20 remove_watcher() i=1 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.053+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471774193504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8e4d70 con 0x55ebec8a6130 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.054+0000 7f1785245640 1 -- 172.21.15.196:0/266152277 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94471774193504] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177807a030 con 0x55ebec8a6130 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.054+0000 7f1787751800 20 remove_watcher() i=2 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.054+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471774195840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8abf30 con 0x7f177807d060 2024-09-21T08:53:45.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.055+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94471774195840] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x7f177807d060 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.055+0000 7f1787751800 20 remove_watcher() i=3 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.055+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471774200704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8ad080 con 0x55ebec89ccd0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.056+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94471774200704] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17700391c0 con 0x55ebec89ccd0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.056+0000 7f1787751800 20 remove_watcher() i=4 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.056+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471774184464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8abf30 con 0x55ebec8a15e0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.057+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94471774184464] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.057+0000 7f1787751800 20 remove_watcher() i=5 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.057+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471774202992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8aa410 con 0x55ebec8a15e0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.058+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94471774202992] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.058+0000 7f1787751800 20 remove_watcher() i=6 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.058+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471774208400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebec8abf30 con 0x55ebec8a15e0 2024-09-21T08:53:45.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1785a46640 1 -- 172.21.15.196:0/266152277 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94471774208400] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178002a070 con 0x55ebec8a15e0 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 20 remove_watcher() i=7 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec8a15e0 msgr2=0x55ebec8a39d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec8a15e0 0x55ebec8a39d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec89ccd0 msgr2=0x55ebec89f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec89ccd0 0x55ebec89f190 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f177807d060 msgr2=0x7f1778004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f177807d060 0x7f1778004280 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ebec8a6130 msgr2=0x55ebec8a85f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.059+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55ebec8a6130 0x55ebec8a85f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1650036b40 msgr2=0x7f1650039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1650036b40 0x7f1650039000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f177805ffd0 tx=0x7f1778093000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 msgr2=0x55ebec891290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f177ffff640 1 -- 172.21.15.196:0/266152277 reap_dead start 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f178000aa20 tx=0x7f178004cb40 comp rx=0 tx=0).stop 2024-09-21T08:53:45.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 shutdown_connections 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/266152277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec889de0 0x55ebec891290 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 >> 172.21.15.196:0/266152277 conn(0x55ebec886140 msgr2=0x55ebec884210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 shutdown_connections 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/266152277 wait complete. 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 msgr2=0x7f165c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 0x7f165c039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55ebec869f80 tx=0x7f177808ec10 comp rx=0 tx=0).stop 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 msgr2=0x55ebec87d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55ebec869ee0 tx=0x7f1780018830 comp rx=0 tx=0).stop 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 shutdown_connections 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f165c036b40 0x7f165c039000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 --2- 172.21.15.196:0/1125799722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec87d130 0x55ebec87d550 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 >> 172.21.15.196:0/1125799722 conn(0x55ebec8720c0 msgr2=0x55ebec874c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 shutdown_connections 2024-09-21T08:53:45.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/1125799722 wait complete. 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.060+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 msgr2=0x55ebec86e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 0x55ebec86e220 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 msgr2=0x55ebec8694c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 0x55ebec8694c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 msgr2=0x7f166c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 0x7f166c039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1770000f60 tx=0x7f17700012b0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 msgr2=0x55ebec862450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55ebec85b950 tx=0x7f1778002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 shutdown_connections 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55ebec86be30 0x55ebec86e220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55ebec76eb40 0x55ebec8694c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f166c036b40 0x7f166c039000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 --2- 172.21.15.196:0/4186233421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ebec6dd630 0x55ebec862450 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 >> 172.21.15.196:0/4186233421 conn(0x55ebec763db0 msgr2=0x55ebec854d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 shutdown_connections 2024-09-21T08:53:45.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.061+0000 7f1787751800 1 -- 172.21.15.196:0/4186233421 wait complete. 2024-09-21T08:53:45.071 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.072 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.072 ERROR:root:0 2024-09-21T08:53:45.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T08:53:45.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T08:53:45.072 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-21T08:53:45.118 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:45.118 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94fa1af800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555e3de904e0 0x555e3de908e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94fa1af800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e3dd50b30 con 0x555e3de90e20 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94fa1af800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555e3dd32360 con 0x555e3de904e0 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94f7ca3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555e3de904e0 0x555e3de908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94f74a2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x555e3de90e20 0x555e3de959a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58054/0 (socket says 172.21.15.196:58054) 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94f74a2640 1 -- 172.21.15.196:0/4146318548 learned_addr learned my addr 172.21.15.196:0/4146318548 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94f7ca3640 1 -- 172.21.15.196:0/4146318548 >> v1:172.21.15.29:6789/0 conn(0x555e3de90e20 legacy=0x555e3de959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.120 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.118+0000 7f94f7ca3640 1 -- 172.21.15.196:0/4146318548 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dd58e00 con 0x555e3de904e0 2024-09-21T08:53:45.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.120+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/4146318548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3de908e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f94e800a600 tx=0x7f94e8047b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe1fbcfdb2e9c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.120+0000 7f94f6ca1640 1 -- 172.21.15.196:0/4146318548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e800a200 con 0x555e3de904e0 2024-09-21T08:53:45.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.120+0000 7f94f6ca1640 1 -- 172.21.15.196:0/4146318548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8059070 con 0x555e3de904e0 2024-09-21T08:53:45.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.120+0000 7f94f6ca1640 1 -- 172.21.15.196:0/4146318548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8008590 con 0x555e3de904e0 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 -- 172.21.15.196:0/4146318548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 msgr2=0x555e3de908e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 --2- 172.21.15.196:0/4146318548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3de908e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f94e800a600 tx=0x7f94e8047b00 comp rx=0 tx=0).stop 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 -- 172.21.15.196:0/4146318548 shutdown_connections 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 --2- 172.21.15.196:0/4146318548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3de908e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 -- 172.21.15.196:0/4146318548 >> 172.21.15.196:0/4146318548 conn(0x555e3de8bdb0 msgr2=0x555e3de8e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 -- 172.21.15.196:0/4146318548 shutdown_connections 2024-09-21T08:53:45.123 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.121+0000 7f94fa1af800 1 -- 172.21.15.196:0/4146318548 wait complete. 2024-09-21T08:53:45.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.134+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.134+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94fa1af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94fa1af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3dddd360 con 0x555e3de904e0 2024-09-21T08:53:45.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94f7ca3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94f7ca3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36244/0 (socket says 172.21.15.196:36244) 2024-09-21T08:53:45.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2877498751 learned_addr learned my addr 172.21.15.196:0/2877498751 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2877498751 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dd2abc0 con 0x555e3de904e0 2024-09-21T08:53:45.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.135+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2877498751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f94e8027930 tx=0x7f94e8053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94da6c0b4c6f820e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f93e5e0b640 1 -- 172.21.15.196:0/2877498751 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e80086c0 con 0x555e3de904e0 2024-09-21T08:53:45.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f93e5e0b640 1 -- 172.21.15.196:0/2877498751 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8063070 con 0x555e3de904e0 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f93e5e0b640 1 -- 172.21.15.196:0/2877498751 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8008990 con 0x555e3de904e0 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 -- 172.21.15.196:0/2877498751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 msgr2=0x555e3df7e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2877498751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f94e8027930 tx=0x7f94e8053000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 -- 172.21.15.196:0/2877498751 shutdown_connections 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2877498751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df7e6a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 -- 172.21.15.196:0/2877498751 >> 172.21.15.196:0/2877498751 conn(0x555e3de8bdb0 msgr2=0x555e3df7a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 -- 172.21.15.196:0/2877498751 shutdown_connections 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.136+0000 7f94fa1af800 1 -- 172.21.15.196:0/2877498751 wait complete. 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94fa1af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94fa1af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3de974a0 con 0x555e3de904e0 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94f7ca3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94f7ca3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36256/0 (socket says 172.21.15.196:36256) 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94f7ca3640 1 -- 172.21.15.196:0/3657082208 learned_addr learned my addr 172.21.15.196:0/3657082208 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.137+0000 7f94f7ca3640 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dd3efe0 con 0x555e3de904e0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f94e8047b40 tx=0x7f94e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f93dffff640 1 -- 172.21.15.196:0/3657082208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8054480 con 0x555e3de904e0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f93dffff640 1 -- 172.21.15.196:0/3657082208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8054620 con 0x555e3de904e0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f93dffff640 1 -- 172.21.15.196:0/3657082208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8054900 con 0x555e3de904e0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3df865a0 con 0x555e3de904e0 2024-09-21T08:53:45.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.138+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3df86b20 con 0x555e3de904e0 2024-09-21T08:53:45.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f93dffff640 1 -- 172.21.15.196:0/3657082208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94e8052050 con 0x555e3de904e0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f93dffff640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 0x7f93e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f93dffff640 1 -- 172.21.15.196:0/3657082208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f94e8070030 con 0x555e3de904e0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94f74a2640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 0x7f93e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 0x555e3df8d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3df8d610 con 0x555e3de90e20 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94f84a4640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 0x555e3df8d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94f74a2640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 0x7f93e0039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b320 tx=0x7f94ec0014a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.139+0000 7f94f84a4640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 0x555e3df8d0d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94f84a4640 1 -- 172.21.15.196:0/3657082208 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4a0 con 0x555e3de90e20 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3df8a680 con 0x555e3de90e20 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94f84a4640 1 -- 172.21.15.196:0/3657082208 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94f000a4a0 con 0x555e3de90e20 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 0x555e3df91d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3df92420 con 0x555e3df8f940 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 0x555e3df91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.140+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 0x555e3df91d30 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.141+0000 7f94f7ca3640 1 -- 172.21.15.196:0/3657082208 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94e8068990 con 0x555e3df8f940 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.141+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3df8e720 con 0x555e3de90e20 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.141+0000 7f94f84a4640 1 -- 172.21.15.196:0/3657082208 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94f000a4a0 con 0x555e3de90e20 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.141+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3df8ebc0 con 0x555e3de90e20 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.141+0000 7f94f84a4640 1 -- 172.21.15.196:0/3657082208 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94f000a4a0 con 0x555e3de90e20 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94fa1af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94fa1af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3dd2c580 con 0x555e3dfa0cc0 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36258/0 (socket says 172.21.15.196:36258) 2024-09-21T08:53:45.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94f84a4640 1 -- 172.21.15.196:0/53087836 learned_addr learned my addr 172.21.15.196:0/53087836 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.142+0000 7f94f84a4640 1 -- 172.21.15.196:0/53087836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dfa1620 con 0x555e3dfa0cc0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f94f84a4640 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x555e3df8da10 tx=0x7f94f0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f93dd7fa640 1 -- 172.21.15.196:0/53087836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0014450 con 0x555e3dfa0cc0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f93dd7fa640 1 -- 172.21.15.196:0/53087836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0014610 con 0x555e3dfa0cc0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3dfa18b0 con 0x555e3dfa0cc0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f93dd7fa640 1 -- 172.21.15.196:0/53087836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0014930 con 0x555e3dfa0cc0 2024-09-21T08:53:45.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3dfa4590 con 0x555e3dfa0cc0 2024-09-21T08:53:45.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.143+0000 7f93dd7fa640 1 -- 172.21.15.196:0/53087836 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94f0011040 con 0x555e3dfa0cc0 2024-09-21T08:53:45.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f93dd7fa640 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 0x7f93d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f93dd7fa640 1 -- 172.21.15.196:0/53087836 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f94f001e070 con 0x555e3dfa0cc0 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 0x7f93d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 0x7f93d0039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x555e3df8dab0 tx=0x7f94e8068c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94fa1af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94fa1af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3df7edf0 con 0x555e3dfad940 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36260/0 (socket says 172.21.15.196:36260) 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.144+0000 7f94f84a4640 1 -- 172.21.15.196:0/3966278980 learned_addr learned my addr 172.21.15.196:0/3966278980 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94f84a4640 1 -- 172.21.15.196:0/3966278980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dfae310 con 0x555e3dfad940 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94f84a4640 1 --2- 172.21.15.196:0/3966278980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f94f004cba0 tx=0x7f94f002b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129c34364fdf4fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f93d6ffd640 1 -- 172.21.15.196:0/3966278980 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0028040 con 0x555e3dfad940 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f93d6ffd640 1 -- 172.21.15.196:0/3966278980 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f00400c0 con 0x555e3dfad940 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f93d6ffd640 1 -- 172.21.15.196:0/3966278980 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0016980 con 0x555e3dfad940 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 -- 172.21.15.196:0/3966278980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 msgr2=0x555e3dfadd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3966278980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f94f004cba0 tx=0x7f94f002b410 comp rx=0 tx=0).stop 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 -- 172.21.15.196:0/3966278980 shutdown_connections 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3966278980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfadd40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 -- 172.21.15.196:0/3966278980 >> 172.21.15.196:0/3966278980 conn(0x555e3dfa9ca0 msgr2=0x555e3dfa7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 -- 172.21.15.196:0/3966278980 shutdown_connections 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.145+0000 7f94fa1af800 1 -- 172.21.15.196:0/3966278980 wait complete. 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94fa1af800 1 Processor -- start 2024-09-21T08:53:45.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94fa1af800 1 -- start start 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94fa1af800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94fa1af800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3dfae980 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94f84a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36266/0 (socket says 172.21.15.196:36266) 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 learned_addr learned my addr 172.21.15.196:0/2811164544 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3dfb5300 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.146+0000 7f94f84a4640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f94f0011b50 tx=0x7f94f004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f93d57fa640 1 -- 172.21.15.196:0/2811164544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f0028050 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f93d57fa640 1 -- 172.21.15.196:0/2811164544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0016980 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e3dfb5590 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f93d57fa640 1 -- 172.21.15.196:0/2811164544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f004b230 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3dfb8240 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f93d57fa640 1 -- 172.21.15.196:0/2811164544 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94f004b3d0 con 0x555e3dfad940 2024-09-21T08:53:45.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.147+0000 7f93d57fa640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f93d57fa640 1 -- 172.21.15.196:0/2811164544 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f94f000e040 con 0x555e3dfad940 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x555e3df92820 tx=0x7f94e808f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3dfc0860 0x555e3dfc2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc3470 con 0x555e3dfc0860 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.148+0000 7f94f74a2640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3dfc0860 0x555e3dfc2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94f74a2640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3dfc0860 0x555e3dfc2d20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94ec00f6d0 con 0x555e3dfc0860 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 realm 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfbfcb0 con 0x555e3dfc0860 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94ec00f6d0 con 0x555e3dfc0860 2024-09-21T08:53:45.164 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc3f60 con 0x555e3dfc0860 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94ec00f6d0 con 0x555e3dfc0860 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc4830 con 0x555e3dfc0860 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94ec00f6d0 con 0x555e3dfc0860 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.149+0000 7f94fa1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3dfc5250 0x555e3dfc7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc7d80 con 0x555e3dfc5250 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94f84a4640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3dfc5250 0x555e3dfc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94f84a4640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3dfc5250 0x555e3dfc7640 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 20 searching for the correct realm 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555e3dfc9d10 0x555e3dfcc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.150+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555e3dfc9d10 0x555e3dfcc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555e3dfc9d10 0x555e3dfcc1d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f7ca3640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e806b070 0x7f94e8091650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f74a2640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e806b070 0x7f94e8091650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.151+0000 7f94f74a2640 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e806b070 0x7f94e8091650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec00f6d0 con 0x7f94e806b070 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec00f6d0 con 0x555e3dfc0860 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.152+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.167 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.153+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.154+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.168 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.155+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.169 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.156+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.157+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.158+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc5250 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x555e3dfc0860 2024-09-21T08:53:45.179 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.159+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcc8a0 con 0x7f94e806b070 2024-09-21T08:53:45.180 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:45.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:45.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc9260 con 0x555e3dfc0860 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc8ad0 con 0x555e3dfc0860 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfc8210 con 0x555e3dfc0860 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 zone default found 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 4 Realm: () 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:45.183 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 zonegroup default 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.160+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcd1d0 con 0x555e3dfc5250 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcf400 con 0x555e3dfc9d10 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcf7a0 con 0x555e3dfc9d10 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 started sync module instance, tier type = 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.161+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfce890 con 0x7f94e806b070 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.162+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.162+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93863255272848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfce890 con 0x7f94e806b070 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.162+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd01a0 con 0x555e3dfc0860 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.163+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93863255272848] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.164+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.164+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93863255276720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfce890 con 0x555e3dfc0860 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.164+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd0c20 con 0x555e3dfc9d10 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.165+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.165+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93863255279408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd14f0 con 0x555e3dfc9d10 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.165+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd1f90 con 0x7f94e806b070 2024-09-21T08:53:45.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.165+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93863255276720] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.166+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93863255279408] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.166+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.166+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93863255281728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfce3e0 con 0x7f94e806b070 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.166+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd2870 con 0x555e3dfc0860 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.167+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.167+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93863255286528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd2c60 con 0x555e3dfc0860 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.167+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd3780 con 0x555e3dfc5250 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.167+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93863255281728] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.168+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93863255286528] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.170+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.170+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93863255287584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd1a60 con 0x555e3dfc5250 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.170+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd1a60 con 0x555e3dfc5250 2024-09-21T08:53:45.186 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.171+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.171+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93863255287584] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.171+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93863255292704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd4520 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.171+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd4da0 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93863255292704] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93863255293984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd4440 con 0x555e3dfc5250 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=0 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=1 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=2 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=3 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=4 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=5 2024-09-21T08:53:45.187 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.172+0000 7f94fa1af800 20 add_watcher() i=6 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93863255293984] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94fa1af800 20 add_watcher() i=7 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94fa1af800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd7e90 con 0x555e3dfc0860 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.173+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93863255296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd5340 con 0x555e3dfc0860 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.174+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93863255296240] v36'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.174+0000 7f93adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.174+0000 7f94fa1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.174+0000 7f94fa1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.174+0000 7f94fa1af800 5 note: GC not initialized 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f93acfe1640 20 reqs_thread_entry: start 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f94fa1af800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f94fa1af800 20 Filter name: none 2024-09-21T08:53:45.188 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f93267fc640 20 reqs_thread_entry: start 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f94fa1af800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f94fa1af800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.175+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3e00b3d0 con 0x555e3dfc5250 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94fa1af800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94fa1af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94fa1af800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94fa1af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.176+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3e011a10 con 0x555e3dfc5250 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94fa1af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94fa1af800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94fa1af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:45.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93863255544784 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e3e00d050 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 93863255286528 notify 154618822688 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f94ec018040 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f93d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 93863255286528 notifier 4909 bl.length()=666 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f93d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f93d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 93863255544784 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.177+0000 7f93d6ffd640 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f93bc003ea0 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.178+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.178+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 93863255544784 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f94ec03ede0 con 0x555e3dfc0860 2024-09-21T08:53:45.190 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.179+0000 7f93adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.179+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93863255296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3e009110 con 0x555e3dfc0860 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.180+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93863255296240] v36'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.180+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93863255272848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3e009110 con 0x7f94e806b070 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.181+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93863255272848] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.181+0000 7f94fa1af800 20 remove_watcher() i=0 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.181+0000 7f94fa1af800 2 removed watcher, disabling cache 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.181+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93863255276720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3e009110 con 0x555e3dfc0860 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.182+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93863255276720] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.182+0000 7f94fa1af800 20 remove_watcher() i=1 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.182+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93863255279408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3e009110 con 0x555e3dfc9d10 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.183+0000 7f94f7ca3640 1 -- 172.21.15.196:0/2811164544 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93863255279408] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e808a040 con 0x555e3dfc9d10 2024-09-21T08:53:45.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.183+0000 7f94fa1af800 20 remove_watcher() i=2 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.183+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93863255281728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcfcb0 con 0x7f94e806b070 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.184+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93863255281728] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x7f94e806b070 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.184+0000 7f94fa1af800 20 remove_watcher() i=3 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.184+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93863255286528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd1040 con 0x555e3dfc0860 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.186+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93863255286528] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ec02b040 con 0x555e3dfc0860 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.186+0000 7f94fa1af800 20 remove_watcher() i=4 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.186+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93863255287584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcfcb0 con 0x555e3dfc5250 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.187+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93863255287584] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.187+0000 7f94fa1af800 20 remove_watcher() i=5 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.187+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93863255292704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfd1040 con 0x555e3dfc5250 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.188+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93863255292704] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.188+0000 7f94fa1af800 20 remove_watcher() i=6 2024-09-21T08:53:45.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.188+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93863255293984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e3dfcfcb0 con 0x555e3dfc5250 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94f84a4640 1 -- 172.21.15.196:0/2811164544 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93863255293984] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f002a070 con 0x555e3dfc5250 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 20 remove_watcher() i=7 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3dfc5250 msgr2=0x555e3dfc7640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3dfc5250 0x555e3dfc7640 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3dfc0860 msgr2=0x555e3dfc2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3dfc0860 0x555e3dfc2d20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e806b070 msgr2=0x7f94e8091650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f94e806b070 0x7f94e8091650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555e3dfc9d10 msgr2=0x555e3dfcc1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x555e3dfc9d10 0x555e3dfcc1d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 msgr2=0x7f93c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93c0036b90 0x7f93c0039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x555e3df92820 tx=0x7f94e808f000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94f74a2640 1 -- 172.21.15.196:0/2811164544 reap_dead start 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 msgr2=0x555e3dfb4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f94f0011b50 tx=0x7f94f004cb30 comp rx=0 tx=0).stop 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 shutdown_connections 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 --2- 172.21.15.196:0/2811164544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfad940 0x555e3dfb4dc0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 >> 172.21.15.196:0/2811164544 conn(0x555e3dfa9ca0 msgr2=0x555e3dfa7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 shutdown_connections 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.189+0000 7f94fa1af800 1 -- 172.21.15.196:0/2811164544 wait complete. 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 msgr2=0x7f93d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 0x7f93d0039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x555e3df8dab0 tx=0x7f94e8068c20 comp rx=0 tx=0).stop 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 msgr2=0x555e3dfa10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x555e3df8da10 tx=0x7f94f0018830 comp rx=0 tx=0).stop 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 shutdown_connections 2024-09-21T08:53:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93d0036b40 0x7f93d0039000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/53087836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3dfa0cc0 0x555e3dfa10e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 >> 172.21.15.196:0/53087836 conn(0x555e3df95c50 msgr2=0x555e3df987d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 shutdown_connections 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/53087836 wait complete. 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 msgr2=0x555e3df91d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 0x555e3df91d30 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 msgr2=0x555e3df8d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 0x555e3df8d0d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 msgr2=0x7f93e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 0x7f93e0039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b320 tx=0x7f94ec0014a0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 msgr2=0x555e3df86060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f94e8047b40 tx=0x7f94e8002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 shutdown_connections 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x555e3df8f940 0x555e3df91d30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x555e3de90e20 0x555e3df8d0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f93e0036b90 0x7f93e0039050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 --2- 172.21.15.196:0/3657082208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3de904e0 0x555e3df86060 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 >> 172.21.15.196:0/3657082208 conn(0x555e3de8bdb0 msgr2=0x555e3df788d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 shutdown_connections 2024-09-21T08:53:45.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.190+0000 7f94fa1af800 1 -- 172.21.15.196:0/3657082208 wait complete. 2024-09-21T08:53:45.202 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.202 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.202 ERROR:root:0 2024-09-21T08:53:45.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.206 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000082eb42e13b3cc9de-0066ee8999-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:53:45.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T08:53:45.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-21T08:53:45.207 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-21T08:53:45.253 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:45.254 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde5210c800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5566c79c2a10 0x5566c79c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde5210c800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566c787db30 con 0x5566c79be710 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde5210c800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5566c785f360 con 0x5566c79c2a10 2024-09-21T08:53:45.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde47fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5566c79c2a10 0x5566c79c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde4fc00640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5566c79be710 0x5566c79beb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58066/0 (socket says 172.21.15.196:58066) 2024-09-21T08:53:45.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde47fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5566c79c2a10 0x5566c79c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36268/0 (socket says 172.21.15.196:36268) 2024-09-21T08:53:45.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde4fc00640 1 -- 172.21.15.196:0/1355065279 learned_addr learned my addr 172.21.15.196:0/1355065279 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:45.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde47fff640 1 -- 172.21.15.196:0/1355065279 >> v1:172.21.15.29:6789/0 conn(0x5566c79be710 legacy=0x5566c79beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.253+0000 7fde47fff640 1 -- 172.21.15.196:0/1355065279 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c7885e00 con 0x5566c79c2a10 2024-09-21T08:53:45.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.255+0000 7fde47fff640 1 --2- 172.21.15.196:0/1355065279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c79c4e00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde3800a470 tx=0x7fde38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393394f9ee25bc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.255+0000 7fde4f3ff640 1 -- 172.21.15.196:0/1355065279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38053570 con 0x5566c79c2a10 2024-09-21T08:53:45.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.255+0000 7fde4f3ff640 1 -- 172.21.15.196:0/1355065279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde38058070 con 0x5566c79c2a10 2024-09-21T08:53:45.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.255+0000 7fde4f3ff640 1 -- 172.21.15.196:0/1355065279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38053880 con 0x5566c79c2a10 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 -- 172.21.15.196:0/1355065279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 msgr2=0x5566c79c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 --2- 172.21.15.196:0/1355065279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c79c4e00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde3800a470 tx=0x7fde38045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 -- 172.21.15.196:0/1355065279 shutdown_connections 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 --2- 172.21.15.196:0/1355065279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c79c4e00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 -- 172.21.15.196:0/1355065279 >> 172.21.15.196:0/1355065279 conn(0x5566c79b9fe0 msgr2=0x5566c79bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 -- 172.21.15.196:0/1355065279 shutdown_connections 2024-09-21T08:53:45.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.256+0000 7fde5210c800 1 -- 172.21.15.196:0/1355065279 wait complete. 2024-09-21T08:53:45.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde5210c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde5210c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5566c790a360 con 0x5566c79be710 2024-09-21T08:53:45.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde4fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde4fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36276/0 (socket says 172.21.15.196:36276) 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde4fc00640 1 -- 172.21.15.196:0/478646082 learned_addr learned my addr 172.21.15.196:0/478646082 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.270+0000 7fde4fc00640 1 -- 172.21.15.196:0/478646082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c7857bc0 con 0x5566c79be710 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde4fc00640 1 --2- 172.21.15.196:0/478646082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fde40001e10 tx=0x7fde4000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f200c128d7139b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fdd3de0b640 1 -- 172.21.15.196:0/478646082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde40012020 con 0x5566c79be710 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fdd3de0b640 1 -- 172.21.15.196:0/478646082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4000e5a0 con 0x5566c79be710 2024-09-21T08:53:45.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fdd3de0b640 1 -- 172.21.15.196:0/478646082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4000e8e0 con 0x5566c79be710 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde5210c800 1 -- 172.21.15.196:0/478646082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 msgr2=0x5566c79346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde5210c800 1 --2- 172.21.15.196:0/478646082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fde40001e10 tx=0x7fde4000b780 comp rx=0 tx=0).stop 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde5210c800 1 -- 172.21.15.196:0/478646082 shutdown_connections 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde5210c800 1 --2- 172.21.15.196:0/478646082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79be710 0x5566c79346e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.271+0000 7fde5210c800 1 -- 172.21.15.196:0/478646082 >> 172.21.15.196:0/478646082 conn(0x5566c79b9fe0 msgr2=0x5566c7aa9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 -- 172.21.15.196:0/478646082 shutdown_connections 2024-09-21T08:53:45.277 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 -- 172.21.15.196:0/478646082 wait complete. 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde5210c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5566c79c5640 con 0x5566c79c2a10 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde4fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde4fc00640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36292/0 (socket says 172.21.15.196:36292) 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.272+0000 7fde4fc00640 1 -- 172.21.15.196:0/3164034476 learned_addr learned my addr 172.21.15.196:0/3164034476 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fde4fc00640 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c786bfe0 con 0x5566c79c2a10 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fde4fc00640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fde40001e10 tx=0x7fde40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fdd37fff640 1 -- 172.21.15.196:0/3164034476 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde40012030 con 0x5566c79c2a10 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fdd37fff640 1 -- 172.21.15.196:0/3164034476 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4001a700 con 0x5566c79c2a10 2024-09-21T08:53:45.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c7ab7c40 con 0x5566c79c2a10 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fdd37fff640 1 -- 172.21.15.196:0/3164034476 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4001aa20 con 0x5566c79c2a10 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.273+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c7ab8160 con 0x5566c79c2a10 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fdd37fff640 1 -- 172.21.15.196:0/3164034476 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde40015020 con 0x5566c79c2a10 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fdd37fff640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 0x7fdd38039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fdd37fff640 1 -- 172.21.15.196:0/3164034476 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde40020030 con 0x5566c79c2a10 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fde47fff640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 0x7fdd38039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 0x5566c7abeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7abf090 con 0x5566c7abc760 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.274+0000 7fde50401640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 0x5566c7abeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde47fff640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 0x7fdd38039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde38057000 tx=0x7fde38052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde50401640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 0x5566c7abeb50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde50401640 1 -- 172.21.15.196:0/3164034476 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde4800a4a0 con 0x5566c7abc760 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7abbd40 con 0x5566c7abc760 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde50401640 1 -- 172.21.15.196:0/3164034476 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde4800a4a0 con 0x5566c7abc760 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 0x5566c7ac3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7ac3e30 con 0x5566c7ac1350 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.275+0000 7fde4fc00640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 0x5566c7ac3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.280 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.276+0000 7fde4fc00640 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 0x5566c7ac3740 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.276+0000 7fde4fc00640 1 -- 172.21.15.196:0/3164034476 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7ac1350 2024-09-21T08:53:45.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.276+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7ac01f0 con 0x5566c7abc760 2024-09-21T08:53:45.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.276+0000 7fde50401640 1 -- 172.21.15.196:0/3164034476 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde4800a4a0 con 0x5566c7abc760 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.276+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7ac0690 con 0x5566c7abc760 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde50401640 1 -- 172.21.15.196:0/3164034476 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde4800a4a0 con 0x5566c7abc760 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde5210c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde5210c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5566c7859580 con 0x5566c7ad2780 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36294/0 (socket says 172.21.15.196:36294) 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.277+0000 7fde50401640 1 -- 172.21.15.196:0/2877828440 learned_addr learned my addr 172.21.15.196:0/2877828440 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.278+0000 7fde50401640 1 -- 172.21.15.196:0/2877828440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c7ad30e0 con 0x5566c7ad2780 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.278+0000 7fde50401640 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x5566c7ab84f0 tx=0x7fde48018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fdd357fa640 1 -- 172.21.15.196:0/2877828440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde48014450 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fdd357fa640 1 -- 172.21.15.196:0/2877828440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48014610 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c7ad3370 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fdd357fa640 1 -- 172.21.15.196:0/2877828440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde48014930 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c7ad6050 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.279+0000 7fdd357fa640 1 -- 172.21.15.196:0/2877828440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde48011040 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fdd357fa640 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 0x7fdd28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fdd357fa640 1 -- 172.21.15.196:0/2877828440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde4801e070 con 0x5566c7ad2780 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 0x7fdd28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 0x7fdd28039050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5566c7abf4a0 tx=0x7fde4002c500 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde5210c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde5210c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5566c7932db0 con 0x5566c7adf3e0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36296/0 (socket says 172.21.15.196:36296) 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde50401640 1 -- 172.21.15.196:0/2350631133 learned_addr learned my addr 172.21.15.196:0/2350631133 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.280+0000 7fde50401640 1 -- 172.21.15.196:0/2350631133 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c7adfdb0 con 0x5566c7adf3e0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde50401640 1 --2- 172.21.15.196:0/2350631133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde4804cb90 tx=0x7fde48011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e76a72ea5d9d1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fdd2effd640 1 -- 172.21.15.196:0/2350631133 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde48044070 con 0x5566c7adf3e0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fdd2effd640 1 -- 172.21.15.196:0/2350631133 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde480167c0 con 0x5566c7adf3e0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fdd2effd640 1 -- 172.21.15.196:0/2350631133 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde48013ca0 con 0x5566c7adf3e0 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 -- 172.21.15.196:0/2350631133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 msgr2=0x5566c7adf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 --2- 172.21.15.196:0/2350631133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde4804cb90 tx=0x7fde48011700 comp rx=0 tx=0).stop 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 -- 172.21.15.196:0/2350631133 shutdown_connections 2024-09-21T08:53:45.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 --2- 172.21.15.196:0/2350631133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7adf7e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 -- 172.21.15.196:0/2350631133 >> 172.21.15.196:0/2350631133 conn(0x5566c7adb740 msgr2=0x5566c7ad9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 -- 172.21.15.196:0/2350631133 shutdown_connections 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.281+0000 7fde5210c800 1 -- 172.21.15.196:0/2350631133 wait complete. 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde5210c800 1 Processor -- start 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde5210c800 1 -- start start 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde5210c800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde5210c800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5566c7ae0330 con 0x5566c7adf3e0 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde50401640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36306/0 (socket says 172.21.15.196:36306) 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 learned_addr learned my addr 172.21.15.196:0/2792764825 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c7ae6cb0 con 0x5566c7adf3e0 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fde50401640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fde48011740 tx=0x7fde4804cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.282+0000 7fdd2d7fa640 1 -- 172.21.15.196:0/2792764825 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde48016440 con 0x5566c7adf3e0 2024-09-21T08:53:45.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fdd2d7fa640 1 -- 172.21.15.196:0/2792764825 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48022c60 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566c7ae6f40 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fdd2d7fa640 1 -- 172.21.15.196:0/2792764825 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4802b350 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c7ae9bf0 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fdd2d7fa640 1 -- 172.21.15.196:0/2792764825 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fde4803e020 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fdd2d7fa640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd18036b90 0x7fdd18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.283+0000 7fdd2d7fa640 1 -- 172.21.15.196:0/2792764825 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fde4803c020 con 0x5566c7adf3e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd18036b90 0x7fdd18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd18036b90 0x7fdd18039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde4004b110 tx=0x7fde40042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7af24e0 0x5566c7af49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af50f0 con 0x5566c7af24e0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.284+0000 7fde47fff640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7af24e0 0x5566c7af49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde47fff640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7af24e0 0x5566c7af49a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 realm 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af5520 con 0x5566c7af24e0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af5df0 con 0x5566c7af24e0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af6190 con 0x5566c7af24e0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.285+0000 7fde5210c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7af6ef0 0x5566c7af92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde50401640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7af6ef0 0x5566c7af92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde50401640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7af6ef0 0x5566c7af92e0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 20 searching for the correct realm 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566c7afb880 0x5566c7afdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.286+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afe410 con 0x5566c7afb880 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566c7afb880 0x5566c7afdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566c7afb880 0x5566c7afdd40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde4fc00640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fde40058040 0x7fde4004c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afe410 con 0x7fde40058040 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde47fff640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fde40058040 0x7fde4004c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.287+0000 7fde47fff640 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fde40058040 0x7fde4004c270 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afe410 con 0x5566c7af6ef0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.288+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x7fde40058040 2024-09-21T08:53:45.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.289+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x7fde40058040 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.290+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.291+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.292+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x7fde40058040 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.293+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x7fde40058040 2024-09-21T08:53:45.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7afb880 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.294+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x5566c7af24e0 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af98f0 con 0x7fde40058040 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:45.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7af9c90 con 0x5566c7af24e0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.295+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afa080 con 0x5566c7af24e0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afa4a0 con 0x5566c7af24e0 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 zone default found 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 4 Realm: () 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 zonegroup default 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7afe890 con 0x5566c7af6ef0 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.296+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b00640 con 0x5566c7afb880 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b00b30 con 0x5566c7afb880 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 20 started sync module instance, tier type = 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.297+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7affab0 con 0x7fde40058040 2024-09-21T08:53:45.315 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.298+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.298+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93899925225392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7affab0 con 0x7fde40058040 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.298+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b01650 con 0x5566c7af24e0 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.299+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93899925225392] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.300+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.300+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93899925229920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7affab0 con 0x5566c7af24e0 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.300+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b02120 con 0x5566c7afb880 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.301+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.301+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93899925232656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b029c0 con 0x5566c7afb880 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.301+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b03430 con 0x7fde40058040 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.301+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93899925229920] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.302+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93899925232656] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.302+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.302+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93899925234960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7aff600 con 0x7fde40058040 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.302+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b03d00 con 0x5566c7af24e0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.303+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93899925234960] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.303+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.303+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93899925237504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b03c90 con 0x5566c7af24e0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.303+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b04690 con 0x5566c7af6ef0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.304+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93899925237504] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.304+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.304+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93899925242272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b03c90 con 0x5566c7af6ef0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.304+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b050d0 con 0x5566c7af6ef0 2024-09-21T08:53:45.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.306+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93899925242272] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.306+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.306+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93899925239776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b052d0 con 0x5566c7af6ef0 2024-09-21T08:53:45.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.306+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b05b20 con 0x5566c7af6ef0 2024-09-21T08:53:45.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93899925239776] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.321 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93899925245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b059f0 con 0x5566c7af6ef0 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=0 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=1 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=2 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=3 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=4 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=5 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.307+0000 7fde5210c800 20 add_watcher() i=6 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93899925245952] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde5210c800 20 add_watcher() i=7 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde5210c800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b08f60 con 0x5566c7af24e0 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.308+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93899925247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b06480 con 0x5566c7af24e0 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.309+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93899925247136] v36'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.309+0000 7fdd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.309+0000 7fde5210c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.309+0000 7fde5210c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 5 note: GC not initialized 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fdd04fe1640 20 reqs_thread_entry: start 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 20 Filter name: none 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fdc7e7fc640 20 reqs_thread_entry: start 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.310+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3c3a0 con 0x5566c7af6ef0 2024-09-21T08:53:45.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde5210c800 20 rados_obj.operate() r=0 bl.length=490 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde5210c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde5210c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde5210c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.311+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b42b50 con 0x5566c7af6ef0 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde5210c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde5210c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde5210c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93899925497104 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3e1b0 con 0x5566c7af24e0 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 93899925237504 notify 154618822689 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5566c7885e00 con 0x5566c7af24e0 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fdd2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 93899925237504 notifier 4916 bl.length()=636 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fdd2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fdd2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 93899925497104 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fdd2effd640 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fdd14003ea0 con 0x5566c7af24e0 2024-09-21T08:53:45.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.312+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.313+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 93899925497104 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fde3806c980 con 0x5566c7af24e0 2024-09-21T08:53:45.325 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:45.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.313+0000 7fdd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.313+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93899925247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3a0e0 con 0x5566c7af24e0 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.314+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93899925247136] v36'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.315+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93899925225392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3a0e0 con 0x7fde40058040 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.316+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93899925225392] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.316+0000 7fde5210c800 20 remove_watcher() i=0 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.316+0000 7fde5210c800 2 removed watcher, disabling cache 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.316+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93899925229920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3a0e0 con 0x5566c7af24e0 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.317+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93899925229920] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.317+0000 7fde5210c800 20 remove_watcher() i=1 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.317+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93899925232656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b3a0e0 con 0x5566c7afb880 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.318+0000 7fde4fc00640 1 -- 172.21.15.196:0/2792764825 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93899925232656] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4000dcd0 con 0x5566c7afb880 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.318+0000 7fde5210c800 20 remove_watcher() i=2 2024-09-21T08:53:45.331 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.318+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93899925234960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b01160 con 0x7fde40058040 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.319+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93899925234960] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x7fde40058040 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.319+0000 7fde5210c800 20 remove_watcher() i=3 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.319+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93899925237504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b01c10 con 0x5566c7af24e0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.320+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93899925237504] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde38051070 con 0x5566c7af24e0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.320+0000 7fde5210c800 20 remove_watcher() i=4 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.320+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93899925242272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b02510 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.321+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93899925242272] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.321+0000 7fde5210c800 20 remove_watcher() i=5 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.321+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93899925239776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b01160 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.323+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93899925239776] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.323+0000 7fde5210c800 20 remove_watcher() i=6 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.323+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93899925245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5566c7b01c10 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde50401640 1 -- 172.21.15.196:0/2792764825 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93899925245952] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde4802a070 con 0x5566c7af6ef0 2024-09-21T08:53:45.332 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 20 remove_watcher() i=7 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7af6ef0 msgr2=0x5566c7af92e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7af6ef0 0x5566c7af92e0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7af24e0 msgr2=0x5566c7af49a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7af24e0 0x5566c7af49a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fde40058040 msgr2=0x7fde4004c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7fde40058040 0x7fde4004c270 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566c7afb880 msgr2=0x5566c7afdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5566c7afb880 0x5566c7afdd40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd18036b90 msgr2=0x7fdd18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd18036b90 0x7fdd18039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde4004b110 tx=0x7fde40042000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 msgr2=0x5566c7ae6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde47fff640 1 -- 172.21.15.196:0/2792764825 reap_dead start 2024-09-21T08:53:45.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fde48011740 tx=0x7fde4804cb20 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 shutdown_connections 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 --2- 172.21.15.196:0/2792764825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7adf3e0 0x5566c7ae6770 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 >> 172.21.15.196:0/2792764825 conn(0x5566c7adb740 msgr2=0x5566c7ad9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 shutdown_connections 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.324+0000 7fde5210c800 1 -- 172.21.15.196:0/2792764825 wait complete. 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 msgr2=0x7fdd28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 0x7fdd28039050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5566c7abf4a0 tx=0x7fde4002c500 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 msgr2=0x5566c7ad2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x5566c7ab84f0 tx=0x7fde48018830 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 shutdown_connections 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd28036b90 0x7fdd28039050 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/2877828440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c7ad2780 0x5566c7ad2ba0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 >> 172.21.15.196:0/2877828440 conn(0x5566c7ac7710 msgr2=0x5566c7aca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 shutdown_connections 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/2877828440 wait complete. 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 msgr2=0x5566c7ac3740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 0x5566c7ac3740 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 msgr2=0x5566c7abeb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 0x5566c7abeb50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 msgr2=0x7fdd38039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 0x7fdd38039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde38057000 tx=0x7fde38052000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 msgr2=0x5566c7ab7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fde40001e10 tx=0x7fde40000ed0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 shutdown_connections 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5566c7ac1350 0x5566c7ac3740 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5566c7abc760 0x5566c7abeb50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fdd38036b40 0x7fdd38039000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 --2- 172.21.15.196:0/3164034476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5566c79c2a10 0x5566c7ab7700 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 >> 172.21.15.196:0/3164034476 conn(0x5566c79b9fe0 msgr2=0x5566c7aa8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 shutdown_connections 2024-09-21T08:53:45.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.325+0000 7fde5210c800 1 -- 172.21.15.196:0/3164034476 wait complete. 2024-09-21T08:53:45.336 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.337 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.337 ERROR:root:0 2024-09-21T08:53:45.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:45.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:45.337 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T08:53:45.384 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:45.384 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:45.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.383+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.383+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.383+0000 7f1531d42800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557b98471a30 0x557b98473e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.383+0000 7f1531d42800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b9832cb30 con 0x557b9846d5f0 2024-09-21T08:53:45.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.383+0000 7f1531d42800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557b9830e360 con 0x557b98471a30 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f1527fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557b98471a30 0x557b98473e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f152da90640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557b9846d5f0 0x557b9846d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:58068/0 (socket says 172.21.15.196:58068) 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f152da90640 1 -- 172.21.15.196:0/55586843 learned_addr learned my addr 172.21.15.196:0/55586843 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f1527fff640 1 --2- 172.21.15.196:0/55586843 >> v2:172.21.15.29:3300/0 conn(0x557b98471a30 0x557b98473e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36318/0 (socket says 172.21.15.196:36318) 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f1527fff640 1 -- 172.21.15.196:0/55586843 >> v1:172.21.15.29:6789/0 conn(0x557b9846d5f0 legacy=0x557b9846d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.386 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.384+0000 7f1527fff640 1 -- 172.21.15.196:0/55586843 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b98334e00 con 0x557b98471a30 2024-09-21T08:53:45.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1527fff640 1 --2- 172.21.15.196:0/55586843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b98471a30 0x557b98473e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f151800a470 tx=0x7f1518045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e0a92a93ab06b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f152d28f640 1 -- 172.21.15.196:0/55586843 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1518053570 con 0x557b98471a30 2024-09-21T08:53:45.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f152d28f640 1 -- 172.21.15.196:0/55586843 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1518058070 con 0x557b98471a30 2024-09-21T08:53:45.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f152d28f640 1 -- 172.21.15.196:0/55586843 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1518053880 con 0x557b98471a30 2024-09-21T08:53:45.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 -- 172.21.15.196:0/55586843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b98471a30 msgr2=0x557b98473e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 --2- 172.21.15.196:0/55586843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b98471a30 0x557b98473e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f151800a470 tx=0x7f1518045a20 comp rx=0 tx=0).stop 2024-09-21T08:53:45.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 -- 172.21.15.196:0/55586843 shutdown_connections 2024-09-21T08:53:45.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 --2- 172.21.15.196:0/55586843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b98471a30 0x557b98473e20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 -- 172.21.15.196:0/55586843 >> 172.21.15.196:0/55586843 conn(0x557b98468f20 msgr2=0x557b9846b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 -- 172.21.15.196:0/55586843 shutdown_connections 2024-09-21T08:53:45.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.386+0000 7f1531d42800 1 -- 172.21.15.196:0/55586843 wait complete. 2024-09-21T08:53:45.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f1531d42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f1531d42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557b983b9360 con 0x557b9846d5f0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f152da90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f152da90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36330/0 (socket says 172.21.15.196:36330) 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.400+0000 7f152da90640 1 -- 172.21.15.196:0/1415652170 learned_addr learned my addr 172.21.15.196:0/1415652170 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.401+0000 7f152da90640 1 -- 172.21.15.196:0/1415652170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b98306bc0 con 0x557b9846d5f0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.401+0000 7f152da90640 1 --2- 172.21.15.196:0/1415652170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1520001e10 tx=0x7f152000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba2fa54e3363992 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.401+0000 7f141be07640 1 -- 172.21.15.196:0/1415652170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1520012020 con 0x557b9846d5f0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.401+0000 7f141be07640 1 -- 172.21.15.196:0/1415652170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152000e5a0 con 0x557b9846d5f0 2024-09-21T08:53:45.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.401+0000 7f141be07640 1 -- 172.21.15.196:0/1415652170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f152000e8e0 con 0x557b9846d5f0 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- 172.21.15.196:0/1415652170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 msgr2=0x557b9855c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 --2- 172.21.15.196:0/1415652170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1520001e10 tx=0x7f152000b780 comp rx=0 tx=0).stop 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- 172.21.15.196:0/1415652170 shutdown_connections 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 --2- 172.21.15.196:0/1415652170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b9855c8e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- 172.21.15.196:0/1415652170 >> 172.21.15.196:0/1415652170 conn(0x557b98468f20 msgr2=0x557b985582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- 172.21.15.196:0/1415652170 shutdown_connections 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- 172.21.15.196:0/1415652170 wait complete. 2024-09-21T08:53:45.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f1531d42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557b98474660 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.402+0000 7f152da90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f152da90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36346/0 (socket says 172.21.15.196:36346) 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f152da90640 1 -- 172.21.15.196:0/698329962 learned_addr learned my addr 172.21.15.196:0/698329962 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f152da90640 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9831afe0 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f152da90640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f152000b7c0 tx=0x7f1520000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f141a604640 1 -- 172.21.15.196:0/698329962 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1520012030 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f141a604640 1 -- 172.21.15.196:0/698329962 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520001470 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b98564800 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f141a604640 1 -- 172.21.15.196:0/698329962 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f152001a8d0 con 0x557b9846d5f0 2024-09-21T08:53:45.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.403+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b98564d20 con 0x557b9846d5f0 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f141a604640 1 -- 172.21.15.196:0/698329962 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1520015020 con 0x557b9846d5f0 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f141a604640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 0x7f1414039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f141a604640 1 -- 172.21.15.196:0/698329962 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f1520020030 con 0x557b9846d5f0 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f1527fff640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 0x7f1414039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 0x557b9856b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b9856b8b0 con 0x557b98471a30 2024-09-21T08:53:45.410 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.404+0000 7f152e291640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 0x557b9856b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f1527fff640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 0x7f1414039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1518057000 tx=0x7f1518052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f152e291640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 0x557b9856b330 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f152e291640 1 -- 172.21.15.196:0/698329962 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f152800a4a0 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985688e0 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f152e291640 1 -- 172.21.15.196:0/698329962 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f152800a4a0 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 0x557b9856ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.405+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b98570650 con 0x557b9856dbc0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.406+0000 7f152da90640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 0x557b9856ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.406+0000 7f152da90640 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 0x557b9856ffb0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.406+0000 7f152da90640 1 -- 172.21.15.196:0/698329962 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1520018950 con 0x557b9856dbc0 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.406+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b9856ca60 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f152e291640 1 -- 172.21.15.196:0/698329962 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f152800a4a0 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b9856cf00 con 0x557b98471a30 2024-09-21T08:53:45.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f152e291640 1 -- 172.21.15.196:0/698329962 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f152800a4a0 con 0x557b98471a30 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f1531d42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.407+0000 7f1531d42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557b98308580 con 0x557b9857efe0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36358/0 (socket says 172.21.15.196:36358) 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f152e291640 1 -- 172.21.15.196:0/862909141 learned_addr learned my addr 172.21.15.196:0/862909141 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f152e291640 1 -- 172.21.15.196:0/862909141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9857f940 con 0x557b9857efe0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f152e291640 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x557b98565370 tx=0x7f15280188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f14137fe640 1 -- 172.21.15.196:0/862909141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1528014450 con 0x557b9857efe0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f14137fe640 1 -- 172.21.15.196:0/862909141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15280145f0 con 0x557b9857efe0 2024-09-21T08:53:45.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f14137fe640 1 -- 172.21.15.196:0/862909141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15280148d0 con 0x557b9857efe0 2024-09-21T08:53:45.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b9857fbd0 con 0x557b9857efe0 2024-09-21T08:53:45.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.408+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b985828b0 con 0x557b9857efe0 2024-09-21T08:53:45.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.409+0000 7f14137fe640 1 -- 172.21.15.196:0/862909141 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1528011040 con 0x557b9857efe0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.409+0000 7f14137fe640 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 0x7f1408039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.409+0000 7f14137fe640 1 -- 172.21.15.196:0/862909141 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f152801e070 con 0x557b9857efe0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.409+0000 7f152da90640 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 0x7f1408039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f152da90640 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 0x7f1408039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x557b9856bd00 tx=0x7f1520024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f1531d42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f1531d42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557b9855d090 con 0x557b983e27c0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36372/0 (socket says 172.21.15.196:36372) 2024-09-21T08:53:45.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f152e291640 1 -- 172.21.15.196:0/2049324609 learned_addr learned my addr 172.21.15.196:0/2049324609 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.410+0000 7f152e291640 1 -- 172.21.15.196:0/2049324609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b983e3190 con 0x557b983e27c0 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f152e291640 1 --2- 172.21.15.196:0/2049324609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f152804cbb0 tx=0x7f152803bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1400491d6d7f9132 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f14117fa640 1 -- 172.21.15.196:0/2049324609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1528014a70 con 0x557b983e27c0 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f14117fa640 1 -- 172.21.15.196:0/2049324609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1528014c10 con 0x557b983e27c0 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f14117fa640 1 -- 172.21.15.196:0/2049324609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f152802ba60 con 0x557b983e27c0 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 -- 172.21.15.196:0/2049324609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 msgr2=0x557b983e2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 --2- 172.21.15.196:0/2049324609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f152804cbb0 tx=0x7f152803bf60 comp rx=0 tx=0).stop 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 -- 172.21.15.196:0/2049324609 shutdown_connections 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 --2- 172.21.15.196:0/2049324609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b983e2bc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 -- 172.21.15.196:0/2049324609 >> 172.21.15.196:0/2049324609 conn(0x557b98587fc0 msgr2=0x557b985860c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 -- 172.21.15.196:0/2049324609 shutdown_connections 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 -- 172.21.15.196:0/2049324609 wait complete. 2024-09-21T08:53:45.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.411+0000 7f1531d42800 1 Processor -- start 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f1531d42800 1 -- start start 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f1531d42800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f1531d42800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557b983e14f0 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f152e291640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36388/0 (socket says 172.21.15.196:36388) 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 learned_addr learned my addr 172.21.15.196:0/427004628 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b98595840 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f152e291640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15280403a0 tx=0x7f152804cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f13ff7fe640 1 -- 172.21.15.196:0/427004628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1528044030 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f13ff7fe640 1 -- 172.21.15.196:0/427004628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152802b350 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b98595ad0 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f13ff7fe640 1 -- 172.21.15.196:0/427004628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1528014a70 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.412+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b98598780 con 0x557b983e27c0 2024-09-21T08:53:45.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.413+0000 7f13ff7fe640 1 -- 172.21.15.196:0/427004628 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f152802b630 con 0x557b983e27c0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.413+0000 7f13ff7fe640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f13f8036b90 0x7f13f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.413+0000 7f13ff7fe640 1 -- 172.21.15.196:0/427004628 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f1528045070 con 0x557b983e27c0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.413+0000 7f152da90640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f13f8036b90 0x7f13f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f152da90640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f13f8036b90 0x7f13f8039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f152000bcd0 tx=0x7f1520038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b985a0f40 0x557b985a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a3b50 con 0x557b985a0f40 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f1527fff640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b985a0f40 0x557b985a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.414+0000 7f1527fff640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b985a0f40 0x557b985a3400 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 realm 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a3f80 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a4850 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a4bf0 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b985a5950 0x557b985a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.415+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a8350 con 0x557b985a5950 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.416+0000 7f152e291640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b985a5950 0x557b985a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.416+0000 7f152e291640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b985a5950 0x557b985a7d40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.416+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.416+0000 7f1531d42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f1531d42800 20 searching for the correct realm 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557b985aa2c0 0x557b985ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f152da90640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557b985aa2c0 0x557b985ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f152da90640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557b985aa2c0 0x557b985ac780 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f152da90640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1520059040 0x7f15200490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.417+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f1527fff640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1520059040 0x7f15200490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f1527fff640 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1520059040 0x7f15200490c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.418+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.419+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.420+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.421+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.422+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.423+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.424+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985aa2c0 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a5950 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x557b985a0f40 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b985ace50 con 0x7f1520059040 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.425+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:45.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a9830 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a90a0 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985a87e0 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 zone default found 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 4 Realm: () 2024-09-21T08:53:45.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 zonegroup default 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.426+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985ad780 con 0x557b985a5950 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985afa30 con 0x557b985aa2c0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985afdd0 con 0x557b985aa2c0 2024-09-21T08:53:45.444 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 started sync module instance, tier type = 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.427+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985aee70 con 0x7f1520059040 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.428+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.428+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989325435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985aee70 con 0x7f1520059040 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.428+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b07d0 con 0x557b985a0f40 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.429+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93989325435792] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.430+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.430+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989325439712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985aee70 con 0x557b985a0f40 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.430+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b1250 con 0x557b985aa2c0 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.431+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93989325439712] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.431+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.431+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989325433280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985aede0 con 0x557b985aa2c0 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.431+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b2110 con 0x7f1520059040 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.432+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93989325433280] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.432+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.432+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989325446240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b2080 con 0x7f1520059040 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.432+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b2fd0 con 0x557b985a0f40 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.433+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93989325446240] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.433+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.433+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989325448304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b2fd0 con 0x557b985a0f40 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.433+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b3990 con 0x557b985a5950 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.434+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93989325448304] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.434+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.434+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989325450016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b2f40 con 0x557b985a5950 2024-09-21T08:53:45.446 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.434+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b4690 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.435+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93989325450016] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.435+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.435+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989325454640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b4600 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.435+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b50b0 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.436+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93989325454640] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989325458320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b5290 con 0x557b985a5950 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=0 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=1 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=2 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=3 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=4 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=5 2024-09-21T08:53:45.447 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.437+0000 7f1531d42800 20 add_watcher() i=6 2024-09-21T08:53:45.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93989325458320] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f1531d42800 20 add_watcher() i=7 2024-09-21T08:53:45.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f1531d42800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:45.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985b8660 con 0x557b985a0f40 2024-09-21T08:53:45.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.438+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989325459840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985b5a50 con 0x557b985a0f40 2024-09-21T08:53:45.450 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93989325459840] v36'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f13df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f1531d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f1531d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f1531d42800 5 note: GC not initialized 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.439+0000 7f13de7fc640 20 reqs_thread_entry: start 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f1531d42800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f1531d42800 20 Filter name: none 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f134ffff640 20 reqs_thread_entry: start 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f1531d42800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f1531d42800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.440+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985eb960 con 0x557b985a5950 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.451 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f1531d42800 20 rados_obj.operate() r=0 bl.length=460 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f1531d42800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f1531d42800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f1531d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.441+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985f1ff0 con 0x557b985a5950 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1531d42800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1531d42800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1531d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93989325707696 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b985ed650 con 0x557b985a0f40 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 93989325448304 notify 154618822690 ret 0) ==== 691+0+0 (crc 0 0 0) 0x557b98334e00 con 0x557b985a0f40 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f14117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 93989325448304 notifier 4923 bl.length()=649 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f14117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.452 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f14117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 93989325707696 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.442+0000 7f14117fa640 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f13f0003ea0 con 0x557b985a0f40 2024-09-21T08:53:45.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.443+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.453 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.443+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 93989325707696 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f151805f970 con 0x557b985a0f40 2024-09-21T08:53:45.453 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.444+0000 7f13df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.444+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989325459840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985f1290 con 0x557b985a0f40 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.445+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93989325459840] v36'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.445+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989325435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985f1290 con 0x7f1520059040 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.446+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93989325435792] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.446+0000 7f1531d42800 20 remove_watcher() i=0 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.446+0000 7f1531d42800 2 removed watcher, disabling cache 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.446+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989325439712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985f1290 con 0x557b985a0f40 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.447+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93989325439712] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.447+0000 7f1531d42800 20 remove_watcher() i=1 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.447+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989325433280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985f1290 con 0x557b985aa2c0 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.448+0000 7f152da90640 1 -- 172.21.15.196:0/427004628 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93989325433280] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1520018950 con 0x557b985aa2c0 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.448+0000 7f1531d42800 20 remove_watcher() i=2 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.448+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989325446240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985e9680 con 0x7f1520059040 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.449+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93989325446240] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x7f1520059040 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.449+0000 7f1531d42800 20 remove_watcher() i=3 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.449+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989325448304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985e9680 con 0x557b985a0f40 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.450+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93989325448304] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1518051070 con 0x557b985a0f40 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.450+0000 7f1531d42800 20 remove_watcher() i=4 2024-09-21T08:53:45.459 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.450+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989325450016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985e9680 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.451+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93989325450016] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.451+0000 7f1531d42800 20 remove_watcher() i=5 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.451+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989325454640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985e9680 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.452+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93989325454640] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.452+0000 7f1531d42800 20 remove_watcher() i=6 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.452+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989325458320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b985e9680 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f152e291640 1 -- 172.21.15.196:0/427004628 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93989325458320] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f152802a070 con 0x557b985a5950 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 20 remove_watcher() i=7 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b985a5950 msgr2=0x557b985a7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b985a5950 0x557b985a7d40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b985a0f40 msgr2=0x557b985a3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b985a0f40 0x557b985a3400 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1520059040 msgr2=0x7f15200490c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.460 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f1520059040 0x7f15200490c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557b985aa2c0 msgr2=0x557b985ac780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x557b985aa2c0 0x557b985ac780 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f13f8036b90 msgr2=0x7f13f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f13f8036b90 0x7f13f8039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f152000bcd0 tx=0x7f1520038000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 msgr2=0x557b98595300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15280403a0 tx=0x7f152804cb10 comp rx=0 tx=0).stop 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.453+0000 7f1527fff640 1 -- 172.21.15.196:0/427004628 reap_dead start 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 shutdown_connections 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/427004628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b983e27c0 0x557b98595300 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 >> 172.21.15.196:0/427004628 conn(0x557b98587fc0 msgr2=0x557b98586090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 shutdown_connections 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/427004628 wait complete. 2024-09-21T08:53:45.461 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 msgr2=0x7f1408039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 0x7f1408039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x557b9856bd00 tx=0x7f1520024ec0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 msgr2=0x557b9857f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x557b98565370 tx=0x7f15280188f0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 shutdown_connections 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1408036b90 0x7f1408039050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/862909141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9857efe0 0x557b9857f400 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 >> 172.21.15.196:0/862909141 conn(0x557b98573f70 msgr2=0x557b98576af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 shutdown_connections 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/862909141 wait complete. 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 msgr2=0x557b9856ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 0x557b9856ffb0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 msgr2=0x557b9856b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 0x557b9856b330 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 msgr2=0x7f1414039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 0x7f1414039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1518057000 tx=0x7f1518052000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 msgr2=0x557b985642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f152000b7c0 tx=0x7f1520000ed0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 shutdown_connections 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x557b9856dbc0 0x557b9856ffb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.454+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x557b98471a30 0x557b9856b330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.455+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f1414036b90 0x7f1414039050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.455+0000 7f1531d42800 1 --2- 172.21.15.196:0/698329962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557b9846d5f0 0x557b985642c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.455+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 >> 172.21.15.196:0/698329962 conn(0x557b98468f20 msgr2=0x557b98556b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.455+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 shutdown_connections 2024-09-21T08:53:45.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.455+0000 7f1531d42800 1 -- 172.21.15.196:0/698329962 wait complete. 2024-09-21T08:53:45.465 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.465 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.465 ERROR:root:0 2024-09-21T08:53:45.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:45.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-21T08:53:45.466 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-21T08:53:45.512 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:53:45.512 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:53:45.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.511+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.511+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.511+0000 7f019e60f800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e7e43fc4e0 0x55e7e43fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019e60f800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7e42bcb30 con 0x55e7e43fce20 2024-09-21T08:53:45.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019e60f800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e7e429e360 con 0x55e7e43fc4e0 2024-09-21T08:53:45.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019c103640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e7e43fc4e0 0x55e7e43fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019c103640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e7e43fc4e0 0x55e7e43fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36396/0 (socket says 172.21.15.196:36396) 2024-09-21T08:53:45.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019c103640 1 -- 172.21.15.196:0/1604863905 learned_addr learned my addr 172.21.15.196:0/1604863905 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019c103640 1 -- 172.21.15.196:0/1604863905 >> v1:172.21.15.29:6789/0 conn(0x55e7e43fce20 legacy=0x55e7e44019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.512+0000 7f019c103640 1 -- 172.21.15.196:0/1604863905 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e42c4e00 con 0x55e7e43fc4e0 2024-09-21T08:53:45.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.514+0000 7f019c103640 1 --2- 172.21.15.196:0/1604863905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e43fc8e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f018c00a520 tx=0x7f018c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385430a8dd3d48ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.514+0000 7f019b902640 1 -- 172.21.15.196:0/1604863905 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c055070 con 0x55e7e43fc4e0 2024-09-21T08:53:45.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.514+0000 7f019b902640 1 -- 172.21.15.196:0/1604863905 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c0515b0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.516 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.514+0000 7f019b902640 1 -- 172.21.15.196:0/1604863905 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c0518d0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 -- 172.21.15.196:0/1604863905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 msgr2=0x55e7e43fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 --2- 172.21.15.196:0/1604863905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e43fc8e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f018c00a520 tx=0x7f018c045ba0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 -- 172.21.15.196:0/1604863905 shutdown_connections 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 --2- 172.21.15.196:0/1604863905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e43fc8e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 -- 172.21.15.196:0/1604863905 >> 172.21.15.196:0/1604863905 conn(0x55e7e43f7db0 msgr2=0x55e7e43fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 -- 172.21.15.196:0/1604863905 shutdown_connections 2024-09-21T08:53:45.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.515+0000 7f019e60f800 1 -- 172.21.15.196:0/1604863905 wait complete. 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.528+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019e60f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019e60f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e7e4349360 con 0x55e7e43fc4e0 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019c103640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019c103640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36408/0 (socket says 172.21.15.196:36408) 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019c103640 1 -- 172.21.15.196:0/1085539138 learned_addr learned my addr 172.21.15.196:0/1085539138 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019c103640 1 -- 172.21.15.196:0/1085539138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e4296bc0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.529+0000 7f019c103640 1 --2- 172.21.15.196:0/1085539138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f018c025da0 tx=0x7f018c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8837a969dea10c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f008a60c640 1 -- 172.21.15.196:0/1085539138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c051950 con 0x55e7e43fc4e0 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f008a60c640 1 -- 172.21.15.196:0/1085539138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c051af0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f008a60c640 1 -- 172.21.15.196:0/1085539138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c051dd0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 -- 172.21.15.196:0/1085539138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 msgr2=0x55e7e44eb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 --2- 172.21.15.196:0/1085539138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f018c025da0 tx=0x7f018c051000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 -- 172.21.15.196:0/1085539138 shutdown_connections 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 --2- 172.21.15.196:0/1085539138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44eb7f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 -- 172.21.15.196:0/1085539138 >> 172.21.15.196:0/1085539138 conn(0x55e7e43f7db0 msgr2=0x55e7e44e71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 -- 172.21.15.196:0/1085539138 shutdown_connections 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.530+0000 7f019e60f800 1 -- 172.21.15.196:0/1085539138 wait complete. 2024-09-21T08:53:45.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019e60f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019e60f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e7e4403500 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019c103640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019c103640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36410/0 (socket says 172.21.15.196:36410) 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019c103640 1 -- 172.21.15.196:0/2938194257 learned_addr learned my addr 172.21.15.196:0/2938194257 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.531+0000 7f019c103640 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e42aafe0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f019c103640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f018c067040 tx=0x7f018c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f0088e09640 1 -- 172.21.15.196:0/2938194257 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c073070 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f0088e09640 1 -- 172.21.15.196:0/2938194257 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c05a450 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f0088e09640 1 -- 172.21.15.196:0/2938194257 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018c05a730 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7e44f24f0 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e44f2a70 con 0x55e7e43fc4e0 2024-09-21T08:53:45.535 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.532+0000 7f0088e09640 1 -- 172.21.15.196:0/2938194257 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f018c076070 con 0x55e7e43fc4e0 2024-09-21T08:53:45.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f0088e09640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 0x7f008403b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f0088e09640 1 -- 172.21.15.196:0/2938194257 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f018c062070 con 0x55e7e43fc4e0 2024-09-21T08:53:45.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f0193fff640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 0x7f008403b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 0x55e7e44f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e44f95a0 con 0x55e7e43fce20 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f019c904640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 0x55e7e44f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f0193fff640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 0x7f008403b260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0184001e10 tx=0x7f0184001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f019c904640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 0x55e7e44f9020 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.533+0000 7f019c904640 1 -- 172.21.15.196:0/2938194257 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f019400a4a0 con 0x55e7e43fce20 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e44f65f0 con 0x55e7e43fce20 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019c904640 1 -- 172.21.15.196:0/2938194257 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f019400a4a0 con 0x55e7e43fce20 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 0x55e7e44fdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e44fe380 con 0x55e7e44fb8f0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019c103640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 0x55e7e44fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.534+0000 7f019c103640 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 0x55e7e44fdce0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019c103640 1 -- 172.21.15.196:0/2938194257 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f018c075030 con 0x55e7e44fb8f0 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e44fa790 con 0x55e7e43fce20 2024-09-21T08:53:45.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019c904640 1 -- 172.21.15.196:0/2938194257 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f019400a4a0 con 0x55e7e43fce20 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e44fac30 con 0x55e7e43fce20 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019c904640 1 -- 172.21.15.196:0/2938194257 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f019400a4a0 con 0x55e7e43fce20 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.535+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019e60f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019e60f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e7e4298580 con 0x55e7e450cd10 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36420/0 (socket says 172.21.15.196:36420) 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019c904640 1 -- 172.21.15.196:0/1909079246 learned_addr learned my addr 172.21.15.196:0/1909079246 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019c904640 1 -- 172.21.15.196:0/1909079246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e450d670 con 0x55e7e450cd10 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.536+0000 7f019c904640 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55e7e44f3060 tx=0x7f01940188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f0081ffb640 1 -- 172.21.15.196:0/1909079246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0194014450 con 0x55e7e450cd10 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f0081ffb640 1 -- 172.21.15.196:0/1909079246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01940145f0 con 0x55e7e450cd10 2024-09-21T08:53:45.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f0081ffb640 1 -- 172.21.15.196:0/1909079246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01940148d0 con 0x55e7e450cd10 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7e450d900 con 0x55e7e450cd10 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e45105e0 con 0x55e7e450cd10 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.537+0000 7f0081ffb640 1 -- 172.21.15.196:0/1909079246 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0194011040 con 0x55e7e450cd10 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f0081ffb640 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 0x7f0074039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f0081ffb640 1 -- 172.21.15.196:0/1909079246 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f019401e070 con 0x55e7e450cd10 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c103640 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 0x7f0074039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c103640 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 0x7f0074039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55e7e44f9a10 tx=0x7f018c08f550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019e60f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019e60f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e7e44ebeb0 con 0x55e7e451dda0 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36430/0 (socket says 172.21.15.196:36430) 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c904640 1 -- 172.21.15.196:0/1494055026 learned_addr learned my addr 172.21.15.196:0/1494055026 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.538+0000 7f019c904640 1 -- 172.21.15.196:0/1494055026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e451e770 con 0x55e7e451dda0 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019c904640 1 --2- 172.21.15.196:0/1494055026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f019404cbb0 tx=0x7f0194011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be965f300a53cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f00737fe640 1 -- 172.21.15.196:0/1494055026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0194013dc0 con 0x55e7e451dda0 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f00737fe640 1 -- 172.21.15.196:0/1494055026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194014a70 con 0x55e7e451dda0 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f00737fe640 1 -- 172.21.15.196:0/1494055026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0194014d50 con 0x55e7e451dda0 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 -- 172.21.15.196:0/1494055026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 msgr2=0x55e7e451e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 --2- 172.21.15.196:0/1494055026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f019404cbb0 tx=0x7f0194011970 comp rx=0 tx=0).stop 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 -- 172.21.15.196:0/1494055026 shutdown_connections 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 --2- 172.21.15.196:0/1494055026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e451e1a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 -- 172.21.15.196:0/1494055026 >> 172.21.15.196:0/1494055026 conn(0x55e7e4515cf0 msgr2=0x55e7e4513df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 -- 172.21.15.196:0/1494055026 shutdown_connections 2024-09-21T08:53:45.546 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.539+0000 7f019e60f800 1 -- 172.21.15.196:0/1494055026 wait complete. 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019e60f800 1 Processor -- start 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019e60f800 1 -- start start 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019e60f800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019e60f800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e7e451ede0 con 0x55e7e451dda0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019c904640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:36434/0 (socket says 172.21.15.196:36434) 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 learned_addr learned my addr 172.21.15.196:0/3740455936 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e4525740 con 0x55e7e451dda0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f019c904640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0194011be0 tx=0x7f019404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.540+0000 7f0071ffb640 1 -- 172.21.15.196:0/3740455936 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0194044030 con 0x55e7e451dda0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f0071ffb640 1 -- 172.21.15.196:0/3740455936 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194022a80 con 0x55e7e451dda0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7e45259d0 con 0x55e7e451dda0 2024-09-21T08:53:45.547 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f0071ffb640 1 -- 172.21.15.196:0/3740455936 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0194016440 con 0x55e7e451dda0 2024-09-21T08:53:45.548 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e4528680 con 0x55e7e451dda0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f0071ffb640 1 -- 172.21.15.196:0/3740455936 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f019404e9a0 con 0x55e7e451dda0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f0071ffb640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0064036b90 0x7f0064039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.541+0000 7f0071ffb640 1 -- 172.21.15.196:0/3740455936 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0194045070 con 0x55e7e451dda0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f019c103640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0064036b90 0x7f0064039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f019c103640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0064036b90 0x7f0064039050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f018c005a60 tx=0x7f018c084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e4530f40 0x55e7e4533400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4533b50 con 0x55e7e4530f40 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.542+0000 7f0193fff640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e4530f40 0x55e7e4533400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f0193fff640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e4530f40 0x55e7e4533400 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f018400bdb0 con 0x55e7e4530f40 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 realm 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4530390 con 0x55e7e4530f40 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f018400bdb0 con 0x55e7e4530f40 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4534640 con 0x55e7e4530f40 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f018400bdb0 con 0x55e7e4530f40 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.543+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4534f10 con 0x55e7e4530f40 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f018400bdb0 con 0x55e7e4530f40 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e4535850 0x55e7e4537c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4538410 con 0x55e7e4535850 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019c904640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e4535850 0x55e7e4537c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019c904640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e4535850 0x55e7e4537c80 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.544+0000 7f019e60f800 20 searching for the correct realm 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e7e453a3e0 0x55e7e453c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019c103640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e7e453a3e0 0x55e7e453c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019c103640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e7e453a3e0 0x55e7e453c8a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c075030 con 0x55e7e453a3e0 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019c103640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f018c0a0070 0x7f018c08f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.545+0000 7f0193fff640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f018c0a0070 0x7f018c08f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f0193fff640 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f018c0a0070 0x7f018c08f670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018400bdb0 con 0x7f018c0a0070 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018400bdb0 con 0x55e7e4530f40 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.546+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.564 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.547+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c075030 con 0x55e7e453a3e0 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.548+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.549+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.550+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.551+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.552+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e453a3e0 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x55e7e4530f40 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.553+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453cf70 con 0x7f018c0a0070 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4538dd0 con 0x55e7e4530f40 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4538a10 con 0x55e7e4530f40 2024-09-21T08:53:45.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4539730 con 0x55e7e4530f40 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 zone default found 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 4 Realm: () 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 zonegroup default 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.554+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453d3f0 con 0x55e7e4535850 2024-09-21T08:53:45.570 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453f6a0 con 0x55e7e453a3e0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453fa40 con 0x55e7e453a3e0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 started sync module instance, tier type = 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:53:45.571 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.555+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453eae0 con 0x7f018c0a0070 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.556+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.556+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94454456512480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453eae0 con 0x7f018c0a0070 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.556+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4540480 con 0x55e7e4530f40 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.557+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94454456512480] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.558+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.558+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94454456516432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453eae0 con 0x55e7e4530f40 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.558+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4540ef0 con 0x55e7e453a3e0 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.559+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94454456516432] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.559+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.559+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94454456510000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e453ea50 con 0x55e7e453a3e0 2024-09-21T08:53:45.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.559+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4541de0 con 0x7f018c0a0070 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.560+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94454456510000] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.560+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.560+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94454456523056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4542200 con 0x7f018c0a0070 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.560+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4542bc0 con 0x55e7e4530f40 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.561+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.561+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94454456526608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4542fe0 con 0x55e7e4530f40 2024-09-21T08:53:45.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.561+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4543a90 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.561+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94454456523056] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.562+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94454456526608] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.562+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.562+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94454456524112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4542fe0 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.562+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4544360 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.563+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94454456524112] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.563+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(56 notify.6 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.563+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94454456528144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4544360 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.563+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4544d80 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94454456528144] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94454456535152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4544f60 con 0x55e7e4535850 2024-09-21T08:53:45.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=0 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=1 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=2 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=3 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=4 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=5 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.564+0000 7f019e60f800 20 add_watcher() i=6 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.565+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94454456535152] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.565+0000 7f019e60f800 20 add_watcher() i=7 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.565+0000 7f019e60f800 2 all 8 watchers are set, enabling cache 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.566+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4548330 con 0x55e7e4530f40 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.566+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.566+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94454456536656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4545720 con 0x55e7e4530f40 2024-09-21T08:53:45.579 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94454456536656] v36'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f00527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f019e60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f019e60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f019e60f800 5 note: GC not initialized 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f00517e2640 20 reqs_thread_entry: start 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.567+0000 7f019e60f800 20 init_complete bucket index max shards: 11 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 20 Filter name: none 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7effc2ffd640 20 reqs_thread_entry: start 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 20 rados->read ofs=0 len=0 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e457b640 con 0x55e7e4535850 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 20 rados_obj.operate() r=0 bl.length=473 2024-09-21T08:53:45.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.568+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4581fd0 con 0x55e7e4535850 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f019e60f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f019e60f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f019e60f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94454456785296 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7e457d650 con 0x55e7e4530f40 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== watch-notify(notify (1) cookie 94454456526608 notify 154618822691 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55e7e42bcb30 con 0x55e7e4530f40 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f00737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 94454456526608 notifier 4930 bl.length()=649 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(64 notify.4 [notify cookie 94454456785296 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f00737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-21T08:53:45.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f00737fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-21T08:53:45.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f00737fe640 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0060003ea0 con 0x55e7e4530f40 2024-09-21T08:53:45.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.570+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== watch-notify(notify_complete (2) cookie 94454456785296 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f018403d930 con 0x55e7e4530f40 2024-09-21T08:53:45.582 INFO:teuthology.orchestra.run.smithi196.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-21T08:53:43.695520Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-21T08:53:43.695504Z","tags":[],"group_ids":[]} 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.571+0000 7f00527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.571+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94454456536656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4581230 con 0x55e7e4530f40 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.572+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94454456536656] v36'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.572+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94454456512480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4581230 con 0x7f018c0a0070 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.573+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94454456512480] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.573+0000 7f019e60f800 20 remove_watcher() i=0 2024-09-21T08:53:45.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.573+0000 7f019e60f800 2 removed watcher, disabling cache 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.573+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94454456516432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4581230 con 0x55e7e4530f40 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.574+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94454456516432] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.574+0000 7f019e60f800 20 remove_watcher() i=1 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.574+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94454456510000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4581230 con 0x55e7e453a3e0 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.575+0000 7f019c103640 1 -- 172.21.15.196:0/3740455936 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94454456510000] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018c0af040 con 0x55e7e453a3e0 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.575+0000 7f019e60f800 20 remove_watcher() i=2 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.575+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94454456523056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4579360 con 0x7f018c0a0070 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.576+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94454456523056] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x7f018c0a0070 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.576+0000 7f019e60f800 20 remove_watcher() i=3 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.576+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94454456526608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4579360 con 0x55e7e4530f40 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.577+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94454456526608] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f018402a040 con 0x55e7e4530f40 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.577+0000 7f019e60f800 20 remove_watcher() i=4 2024-09-21T08:53:45.588 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.577+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94454456524112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4579360 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.578+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94454456524112] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.578+0000 7f019e60f800 20 remove_watcher() i=5 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.578+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94454456528144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4579360 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.579+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94454456528144] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.579+0000 7f019e60f800 20 remove_watcher() i=6 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.580+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94454456535152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7e4579360 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019c904640 1 -- 172.21.15.196:0/3740455936 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94454456535152] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019402a070 con 0x55e7e4535850 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 20 remove_watcher() i=7 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e4535850 msgr2=0x55e7e4537c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e4535850 0x55e7e4537c80 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e4530f40 msgr2=0x55e7e4533400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e4530f40 0x55e7e4533400 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f018c0a0070 msgr2=0x7f018c08f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f018c0a0070 0x7f018c08f670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e7e453a3e0 msgr2=0x55e7e453c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x55e7e453a3e0 0x55e7e453c8a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0064036b90 msgr2=0x7f0064039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0064036b90 0x7f0064039050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f018c005a60 tx=0x7f018c084000 comp rx=0 tx=0).stop 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 msgr2=0x55e7e4525200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f0193fff640 1 -- 172.21.15.196:0/3740455936 reap_dead start 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0194011be0 tx=0x7f019404cb10 comp rx=0 tx=0).stop 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 shutdown_connections 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/3740455936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e451dda0 0x55e7e4525200 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 >> 172.21.15.196:0/3740455936 conn(0x55e7e4515cf0 msgr2=0x55e7e4513dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 shutdown_connections 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/3740455936 wait complete. 2024-09-21T08:53:45.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 msgr2=0x7f0074039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 0x7f0074039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55e7e44f9a10 tx=0x7f018c08f550 comp rx=0 tx=0).stop 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 msgr2=0x55e7e450d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55e7e44f3060 tx=0x7f01940188f0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 shutdown_connections 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0074036b90 0x7f0074039050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 --2- 172.21.15.196:0/1909079246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e450cd10 0x55e7e450d130 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 >> 172.21.15.196:0/1909079246 conn(0x55e7e4501ca0 msgr2=0x55e7e4504820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 shutdown_connections 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.581+0000 7f019e60f800 1 -- 172.21.15.196:0/1909079246 wait complete. 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 msgr2=0x55e7e44fdce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 0x55e7e44fdce0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 msgr2=0x55e7e44f9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 0x55e7e44f9020 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 msgr2=0x7f008403b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 0x7f008403b260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0184001e10 tx=0x7f0184001390 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 msgr2=0x55e7e44f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f018c067040 tx=0x7f018c002fb0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 shutdown_connections 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x55e7e44fb8f0 0x55e7e44fdce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x55e7e43fce20 0x55e7e44f9020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f0084038da0 0x7f008403b260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 --2- 172.21.15.196:0/2938194257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e7e43fc4e0 0x55e7e44f1fb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 >> 172.21.15.196:0/2938194257 conn(0x55e7e43f7db0 msgr2=0x55e7e44e5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 shutdown_connections 2024-09-21T08:53:45.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:53:45.582+0000 7f019e60f800 1 -- 172.21.15.196:0/2938194257 wait complete. 2024-09-21T08:53:45.594 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.594 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-21T08:53:43.695520Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-21T08:53:43.695504Z', 'tags': [], 'group_ids': []} 2024-09-21T08:53:45.594 ERROR:root:0 2024-09-21T08:53:45.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-21T08:53:45.601 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.601 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.604 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-21T08:53:45.610 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.610 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.613 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-21T08:53:45.622 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-21T08:53:45.622 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.625 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-21T08:53:45.633 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.633 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.637 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-21T08:53:45.644 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-21T08:53:45.645 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.648 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.648 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-21T08:53:45.655 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-21T08:53:45.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.659 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-21T08:53:45.666 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.666 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.669 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-21T08:53:45.674 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.675 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.678 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.679 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-21T08:53:45.685 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.685 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.688 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.689 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.692 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T08:53:45.693 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-21T08:53:45.696 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T08:53:45.707 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-21T08:53:45.711 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-21T08:53:45.712 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T08:53:45.716 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:53:45.702434Z', 'creation_time': '2024-09-21T08:53:45.699991Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:53:45.717 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-21T08:53:45.721 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:53:45.702434Z', 'creation_time': '2024-09-21T08:53:45.699991Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-21T08:53:45.725 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T08:53:45.730 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:53:45.702434Z', 'creation_time': '2024-09-21T08:53:45.699991Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:53:45.730 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-21T08:53:45.734 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000207e7ebb9f6b3953-0066ee8999-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:53:45.738 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-21T08:53:45.824 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.825 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-21T08:53:45.834 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:53:45.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11'} 2024-09-21T08:53:45.852 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.857 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11'} 2024-09-21T08:53:45.867 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-21T08:53:45.876 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.882 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-21T08:53:45.889 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:53:45.889 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-21T08:53:45.895 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0bf56418-c298-49e5-b663-8247e6a1b700', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'marker': '6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-21T08:53:45.861702Z', 'creation_time': '2024-09-21T08:53:45.699991Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-21T08:54:45.941 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-21T08:54:45.959 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-21T08:54:45.960 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-21T08:54:45.975 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-21T08:54:45.975 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-21T08:54:45.980 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-21T08:54:45.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-21T08:54:45.985 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-21T08:54:45.985 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-21T08:54:45.990 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-21T08:54:45.990 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-21T08:54:45.994 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-21T08:54:45.995 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-21T08:54:45.999 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-21T08:00:00.000000Z', 'epoch': 1726905600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-21T08:54:45.999 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-21T08:54:46.006 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.006 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-21T08:54:46.011 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-21T08:54:46.011 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-21T08:54:46.020 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:54:46.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-21T08:54:46.033 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:54:46.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-21T08:54:46.285 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000781dbd6ef08a5289-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-21T08:54:46.388 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-21T08:54:46.392 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-21T08:54:46.396 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-21T08:54:46.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-21T08:54:46.547 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.547 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-21T08:54:46.553 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-21T08:54:46.553 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-21T08:54:46.561 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-21T08:54:46.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-21T08:54:46.574 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000004e551a78312665a1-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.591 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-21T08:54:46.619 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.620 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-21T08:54:46.624 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002207c7815157547d-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-21T08:54:46.628 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a'}]}} 2024-09-21T08:54:46.628 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-21T08:54:46.638 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-21T08:54:46.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-21T08:54:46.642 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T08:54:46.642 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-21T08:54:46.647 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000003451bb887297c7eb-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.647 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-21T08:54:46.651 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000374bbe3c3e3eaf01-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.662 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-21T08:54:46.665 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T08:54:46.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-21T08:54:46.669 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000115f7f30e3b12aa2-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-21T08:54:46.673 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bc8aac27f6310a25-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.673 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-21T08:54:46.677 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-21T08:54:46.677 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-21T08:54:46.680 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000004e2f0a08abbf68e-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.681 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-21T08:54:46.683 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000088e06da7e8ff0281-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.684 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-21T08:54:46.687 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009220ad6976317e6d-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.687 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-21T08:54:46.690 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000dca46350665a5994-0066ee89d6-4237-default', 'HostId': '4237-default-default'} 2024-09-21T08:54:46.691 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-21T08:54:46.700 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.700 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-21T08:54:46.704 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-21T08:54:46.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-21T08:54:46.709 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-21T08:54:46.713 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-21T08:54:46.713 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-21T08:54:46.718 INFO:tasks.radosgw_admin_rest: empty result 2024-09-21T08:54:46.723 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-21T08:54:46.733 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-21T08:54:46.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:54:46.734 INFO:tasks.rgw.client.0.smithi196.stdout:2024-09-21T08:54:46.732+0000 7f93a75bc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35855) UID: 0 2024-09-21T08:54:46.734 INFO:tasks.rgw.client.0.smithi196.stdout:2024-09-21T08:54:46.732+0000 7f93ad62f880 -1 shutting down 2024-09-21T08:54:52.836 INFO:tasks.rgw.client.0:Stopped 2024-09-21T08:54:52.836 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-21T08:54:52.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/vault-root-token 2024-09-21T08:54:52.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-21T08:54:52.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-21T08:54:52.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-21T08:54:52.993 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-21T08:54:53.080 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setuser ceph since I am not root 2024-09-21T08:54:53.081 INFO:teuthology.orchestra.run.smithi196.stderr:ignoring --setgroup ceph since I am not root 2024-09-21T08:54:53.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.080+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.080+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.080+0000 7f7c28b39800 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568ef848900 0x5568ef84acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.080+0000 7f7c28b39800 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568ef704b30 con 0x5568ef8444c0 2024-09-21T08:54:53.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.080+0000 7f7c28b39800 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5568ef6e6360 con 0x5568ef848900 2024-09-21T08:54:53.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.081+0000 7f7c1bfd0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568ef848900 0x5568ef84acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.081+0000 7f7c247d1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5568ef8444c0 0x5568ef8448c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.196:44146/0 (socket says 172.21.15.196:44146) 2024-09-21T08:54:53.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.081+0000 7f7c247d1640 1 -- 172.21.15.196:0/1009970400 learned_addr learned my addr 172.21.15.196:0/1009970400 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-09-21T08:54:53.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.081+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/1009970400 >> v1:172.21.15.29:6789/0 conn(0x5568ef8444c0 legacy=0x5568ef8448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.083 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.081+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/1009970400 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef70ce00 con 0x5568ef848900 2024-09-21T08:54:53.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.083+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/1009970400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef848900 0x5568ef84acf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00a470 tx=0x7f7c0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49313672d717a645 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.083+0000 7f7c23fd0640 1 -- 172.21.15.196:0/1009970400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c053570 con 0x5568ef848900 2024-09-21T08:54:53.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.083+0000 7f7c23fd0640 1 -- 172.21.15.196:0/1009970400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c058070 con 0x5568ef848900 2024-09-21T08:54:53.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.083+0000 7f7c23fd0640 1 -- 172.21.15.196:0/1009970400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c053880 con 0x5568ef848900 2024-09-21T08:54:53.085 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 -- 172.21.15.196:0/1009970400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef848900 msgr2=0x5568ef84acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1009970400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef848900 0x5568ef84acf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00a470 tx=0x7f7c0c045a20 comp rx=0 tx=0).stop 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 -- 172.21.15.196:0/1009970400 shutdown_connections 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1009970400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef848900 0x5568ef84acf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 -- 172.21.15.196:0/1009970400 >> 172.21.15.196:0/1009970400 conn(0x5568ef83fdf0 msgr2=0x5568ef842210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 -- 172.21.15.196:0/1009970400 shutdown_connections 2024-09-21T08:54:53.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.084+0000 7f7c28b39800 1 -- 172.21.15.196:0/1009970400 wait complete. 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c28b39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c28b39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568ef791330 con 0x5568ef8444c0 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c247d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c247d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:41412/0 (socket says 172.21.15.196:41412) 2024-09-21T08:54:53.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.099+0000 7f7c247d1640 1 -- 172.21.15.196:0/355122412 learned_addr learned my addr 172.21.15.196:0/355122412 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:54:53.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.100+0000 7f7c247d1640 1 -- 172.21.15.196:0/355122412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef6debc0 con 0x5568ef8444c0 2024-09-21T08:54:53.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.100+0000 7f7c247d1640 1 --2- 172.21.15.196:0/355122412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001e10 tx=0x7f7c1400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44265a4453483028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.100+0000 7f7b1260c640 1 -- 172.21.15.196:0/355122412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1400b200 con 0x5568ef8444c0 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.100+0000 7f7b1260c640 1 -- 172.21.15.196:0/355122412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14009460 con 0x5568ef8444c0 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.100+0000 7f7b1260c640 1 -- 172.21.15.196:0/355122412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14009760 con 0x5568ef8444c0 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- 172.21.15.196:0/355122412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 msgr2=0x5568ef933750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 --2- 172.21.15.196:0/355122412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001e10 tx=0x7f7c1400b910 comp rx=0 tx=0).stop 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- 172.21.15.196:0/355122412 shutdown_connections 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 --2- 172.21.15.196:0/355122412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef933750 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- 172.21.15.196:0/355122412 >> 172.21.15.196:0/355122412 conn(0x5568ef83fdf0 msgr2=0x5568ef92f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- 172.21.15.196:0/355122412 shutdown_connections 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- 172.21.15.196:0/355122412 wait complete. 2024-09-21T08:54:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.101+0000 7f7c28b39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568ef84b530 con 0x5568ef8444c0 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.102+0000 7f7c247d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.102+0000 7f7c247d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:41428/0 (socket says 172.21.15.196:41428) 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.102+0000 7f7c247d1640 1 -- 172.21.15.196:0/3683080811 learned_addr learned my addr 172.21.15.196:0/3683080811 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:54:53.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.102+0000 7f7c247d1640 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef6f2fe0 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.102+0000 7f7c247d1640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000fd0 tx=0x7f7c14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.103+0000 7f7b10e09640 1 -- 172.21.15.196:0/3683080811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1401b040 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.103+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ef93a580 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.103+0000 7f7b10e09640 1 -- 172.21.15.196:0/3683080811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14009ce0 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.103+0000 7f7b10e09640 1 -- 172.21.15.196:0/3683080811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14016430 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.103+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ef93aaa0 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7b10e09640 1 -- 172.21.15.196:0/3683080811 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c14027020 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7b10e09640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 0x7f7b0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7b10e09640 1 -- 172.21.15.196:0/3683080811 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7c14025020 con 0x5568ef8444c0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 0x7f7b0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 0x5568ef9410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9415f0 con 0x5568ef848900 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 0x5568ef9410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.104+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 0x7f7b0c039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c057000 tx=0x7f7c0c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 0x5568ef9410b0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c24fd2640 1 -- 172.21.15.196:0/3683080811 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c1c00a4a0 con 0x5568ef848900 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef93e680 con 0x5568ef848900 2024-09-21T08:54:53.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c24fd2640 1 -- 172.21.15.196:0/3683080811 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c1c00a4a0 con 0x5568ef848900 2024-09-21T08:54:53.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 0x5568ef945d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.105+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:3 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9463d0 con 0x5568ef943910 2024-09-21T08:54:53.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.106+0000 7f7c247d1640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 0x5568ef945d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.110 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.106+0000 7f7c247d1640 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 0x5568ef945d00 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.106+0000 7f7c247d1640 1 -- 172.21.15.196:0/3683080811 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(3 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c1401e040 con 0x5568ef943910 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef942780 con 0x5568ef848900 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c24fd2640 1 -- 172.21.15.196:0/3683080811 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c1c00a4a0 con 0x5568ef848900 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:5 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef942c10 con 0x5568ef848900 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c24fd2640 1 -- 172.21.15.196:0/3683080811 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(5 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c1c00a4a0 con 0x5568ef848900 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.107+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c28b39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c28b39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568ef6e0580 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:41438/0 (socket says 172.21.15.196:41438) 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c24fd2640 1 -- 172.21.15.196:0/1142288325 learned_addr learned my addr 172.21.15.196:0/1142288325 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c24fd2640 1 -- 172.21.15.196:0/1142288325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef955650 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.108+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x5568ef92ffc0 tx=0x7f7c1c012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.109+0000 7f7b09ffb640 1 -- 172.21.15.196:0/1142288325 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c014450 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.109+0000 7f7b09ffb640 1 -- 172.21.15.196:0/1142288325 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0145f0 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.109+0000 7f7b09ffb640 1 -- 172.21.15.196:0/1142288325 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c014910 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.109+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ef9558e0 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.109+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ef9585c0 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7b09ffb640 1 -- 172.21.15.196:0/1142288325 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c1c011040 con 0x5568ef954cf0 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7b09ffb640 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 0x7f7afc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.116 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7b09ffb640 1 -- 172.21.15.196:0/1142288325 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7c1c01e070 con 0x5568ef954cf0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c247d1640 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 0x7f7afc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c247d1640 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 0x7f7afc039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404c230 tx=0x7f7c1404c100 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c28b39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.110+0000 7f7c28b39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568ef933f00 con 0x5568ef965dd0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:41446/0 (socket says 172.21.15.196:41446) 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7c24fd2640 1 -- 172.21.15.196:0/2571157629 learned_addr learned my addr 172.21.15.196:0/2571157629 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7c24fd2640 1 -- 172.21.15.196:0/2571157629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef9667a0 con 0x5568ef965dd0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/2571157629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c04ccf0 tx=0x7f7c1c0404b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdf4cd932e09626 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7afb7fe640 1 -- 172.21.15.196:0/2571157629 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c046ae0 con 0x5568ef965dd0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7afb7fe640 1 -- 172.21.15.196:0/2571157629 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c046c80 con 0x5568ef965dd0 2024-09-21T08:54:53.117 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.111+0000 7f7afb7fe640 1 -- 172.21.15.196:0/2571157629 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c014ab0 con 0x5568ef965dd0 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- 172.21.15.196:0/2571157629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 msgr2=0x5568ef9661d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 --2- 172.21.15.196:0/2571157629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c04ccf0 tx=0x7f7c1c0404b0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- 172.21.15.196:0/2571157629 shutdown_connections 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 --2- 172.21.15.196:0/2571157629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef9661d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- 172.21.15.196:0/2571157629 >> 172.21.15.196:0/2571157629 conn(0x5568ef95dd20 msgr2=0x5568ef95be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- 172.21.15.196:0/2571157629 shutdown_connections 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- 172.21.15.196:0/2571157629 wait complete. 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 Processor -- start 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- start start 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c28b39800 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568ef966e10 con 0x5568ef965dd0 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c24fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.196:41452/0 (socket says 172.21.15.196:41452) 2024-09-21T08:54:53.118 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.112+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 learned_addr learned my addr 172.21.15.196:0/876058957 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ef96d710 con 0x5568ef965dd0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0117d0 tx=0x7f7c1c04cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7af9ffb640 1 -- 172.21.15.196:0/876058957 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c046e30 con 0x5568ef965dd0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7af9ffb640 1 -- 172.21.15.196:0/876058957 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c022c60 con 0x5568ef965dd0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ef96d9a0 con 0x5568ef965dd0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7af9ffb640 1 -- 172.21.15.196:0/876058957 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c0133b0 con 0x5568ef965dd0 2024-09-21T08:54:53.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.113+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ef970650 con 0x5568ef965dd0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.114+0000 7f7af9ffb640 1 -- 172.21.15.196:0/876058957 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c1c013620 con 0x5568ef965dd0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.114+0000 7f7af9ffb640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7aec036b40 0x7f7aec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.114+0000 7f7af9ffb640 1 -- 172.21.15.196:0/876058957 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7c1c00e040 con 0x5568ef965dd0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.114+0000 7f7c247d1640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7aec036b40 0x7f7aec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c247d1640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7aec036b40 0x7f7aec039000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c140017f0 tx=0x7f7c14039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef978cd0 0x5568ef97b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef97b8e0 con 0x5568ef978cd0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef978cd0 0x5568ef97b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.115+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef978cd0 0x5568ef97b190 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.132 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 realm 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef97bd10 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef97c5e0 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef97c980 con 0x5568ef978cd0 2024-09-21T08:54:53.133 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef97d6e0 0x5568ef97fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.116+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:5 5.14 5:29b7e856:::zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9800e0 con 0x5568ef97d6e0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef97d6e0 0x5568ef97fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c24fd2640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef97d6e0 0x5568ef97fad0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== osd_op_reply(5 zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c28b39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c28b39800 20 searching for the correct realm 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5568ef982050 0x5568ef984510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.117+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c247d1640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5568ef982050 0x5568ef984510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c247d1640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5568ef982050 0x5568ef984510 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c247d1640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f7c140167b0 0x7f7c14045800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.118+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f7c140167b0 0x7f7c14045800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c1bfd0640 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f7c140167b0 0x7f7c14045800 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.119+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.135 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.120+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 5 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.121+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.136 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.122+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 5 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 6 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.123+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.137 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 7 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 7 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.124+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 8 ==== osd_op_reply(30 [pgnls start_epoch 36 out=82b] v36'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 8 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.125+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 9 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.138 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 5 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef982050 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.126+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef97d6e0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x5568ef978cd0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=178b] v36'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5568ef984be0 con 0x7f7c140167b0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 6 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got zone_info.6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got period_config.default 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 2024-09-21T08:54:53.139 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9815c0 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.127+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef980570 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:40 5.f 5:f3f8af6d:::zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef980f30 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 15 ==== osd_op_reply(40 zonegroup_info.0bf56418-c298-49e5-b663-8247e6a1b700 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-21T08:54:53.140 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 zone default found 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 4 Realm: () 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 4 ZoneGroup: default (0bf56418-c298-49e5-b663-8247e6a1b700) 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 4 Zone: default (6f304bac-6e5f-4f70-8cad-d3bf6d19cc46) 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 zonegroup default 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9850c0 con 0x5568ef97d6e0 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 11 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.128+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef987390 con 0x5568ef982050 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 20 rados->read ofs=0 len=0 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef987780 con 0x5568ef982050 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 20 started sync module instance, tier type = 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 20 started zone id=6f304bac-6e5f-4f70-8cad-d3bf6d19cc46 (name=default) with tier type = 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.129+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986820 con 0x7f7c140167b0 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.130+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 7 ==== osd_op_reply(44 notify.0 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.130+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909184703776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986820 con 0x7f7c140167b0 2024-09-21T08:54:53.142 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.130+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef988290 con 0x5568ef978cd0 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.131+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909184703776] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.131+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 16 ==== osd_op_reply(46 notify.1 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.131+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909184707968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986820 con 0x5568ef978cd0 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.131+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef988ca0 con 0x5568ef982050 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.133+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909184707968] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.133+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 12 ==== osd_op_reply(48 notify.2 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.133+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909184701296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986790 con 0x5568ef982050 2024-09-21T08:54:53.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.133+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef989b10 con 0x7f7c140167b0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.134+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 9 ==== osd_op_reply(50 notify.3 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.134+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909184714336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef989f30 con 0x7f7c140167b0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.134+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98aa00 con 0x5568ef978cd0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.134+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909184701296] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.135+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 18 ==== osd_op_reply(52 notify.4 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.135+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909184718064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98a9c0 con 0x5568ef978cd0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.135+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98b410 con 0x5568ef97d6e0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.135+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909184714336] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.136+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 12 ==== osd_op_reply(54 notify.5 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.136+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909184720736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98b800 con 0x5568ef97d6e0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.136+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98c200 con 0x5568ef97d6e0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.136+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909184718064] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.137+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 13 ==== osd_op_reply(56 notify.6 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.137+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909184712768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98c1c0 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.137+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98cc30 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.138+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909184720736] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.138+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909184712768] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 16 ==== osd_op_reply(58 notify.7 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909184726784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98bd10 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=1 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=2 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=3 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=4 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=5 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.139+0000 7f7c28b39800 20 add_watcher() i=6 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909184726784] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c28b39800 20 add_watcher() i=7 2024-09-21T08:54:53.148 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c28b39800 2 all 8 watchers are set, enabling cache 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98fd30 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.140+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909184715392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98d1b0 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.142+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909184715392] v36'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.142+0000 7f7ada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.142+0000 7f7c28b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.142+0000 7f7c28b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.142+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef998440 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.143+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.143+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef998b10 con 0x5568ef97d6e0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.144+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.144+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef998b10 con 0x5568ef982050 2024-09-21T08:54:53.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.145+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.145+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef999100 con 0x5568ef978cd0 2024-09-21T08:54:53.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.146+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.146+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9995b0 con 0x7f7c140167b0 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.148+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.148+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef994180 con 0x5568ef982050 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.149+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.149+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef994180 con 0x5568ef978cd0 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.150+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.150+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef994260 con 0x5568ef97d6e0 2024-09-21T08:54:53.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.151+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.151+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef994350 con 0x7f7c140167b0 2024-09-21T08:54:53.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.152+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.152+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef994400 con 0x5568ef982050 2024-09-21T08:54:53.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.153+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.154 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.153+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef996eb0 con 0x7f7c140167b0 2024-09-21T08:54:53.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.154+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.154+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef996eb0 con 0x5568ef97d6e0 2024-09-21T08:54:53.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.155+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.157 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.155+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef996f70 con 0x7f7c140167b0 2024-09-21T08:54:53.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.156+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.158 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.156+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef996f70 con 0x5568ef97d6e0 2024-09-21T08:54:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.158+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.159 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.158+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a40 con 0x5568ef978cd0 2024-09-21T08:54:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.159+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.160 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.159+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.160+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.161 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.160+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x7f7c140167b0 2024-09-21T08:54:53.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.161+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.161+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.162+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.163 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.162+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef978cd0 2024-09-21T08:54:53.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.163+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.163+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef978cd0 2024-09-21T08:54:53.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.164+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.164+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.167+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.167+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x7f7c140167b0 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.168+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.168+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.169+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.170 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.169+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.170+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.170+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.171+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.171+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.172+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.172+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef97d6e0 2024-09-21T08:54:53.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.173+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.173+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.174+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.174+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef97d6e0 2024-09-21T08:54:53.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.175+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'58 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.175+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef982050 2024-09-21T08:54:53.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.176+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'80 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.176+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x5568ef97d6e0 2024-09-21T08:54:53.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.177+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.177+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef997a20 con 0x7f7c140167b0 2024-09-21T08:54:53.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.178+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7ad97e2640 20 reqs_thread_entry: start 2024-09-21T08:54:53.181 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7c28b39800 20 init_complete bucket index max shards: 11 2024-09-21T08:54:53.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7c28b39800 20 Filter name: none 2024-09-21T08:54:53.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7a4affd640 20 reqs_thread_entry: start 2024-09-21T08:54:53.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-21T08:54:53.182 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.179+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:94 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6340 con 0x5568ef982050 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.180+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 26 ==== osd_op_reply(94 gc.24 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.180+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:95 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6300 con 0x5568ef982050 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.180+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 27 ==== osd_op_reply(95 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.180+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.180+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:96 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.184 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 28 ==== osd_op_reply(96 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:97 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 29 ==== osd_op_reply(97 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:98 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 30 ==== osd_op_reply(98 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.181+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:99 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.182+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 31 ==== osd_op_reply(99 gc.24 [call] v36'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.182+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-21T08:54:53.185 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.182+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:100 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 32 ==== osd_op_reply(100 gc.25 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:101 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 33 ==== osd_op_reply(101 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.189 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:102 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 34 ==== osd_op_reply(102 gc.25 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.183+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:103 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 35 ==== osd_op_reply(103 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:104 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 36 ==== osd_op_reply(104 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.190 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.184+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:105 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.185+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 37 ==== osd_op_reply(105 gc.25 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.185+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.185+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:106 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.186+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 25 ==== osd_op_reply(106 gc.26 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.186+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:107 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.186+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 26 ==== osd_op_reply(107 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.186+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.186+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:108 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 27 ==== osd_op_reply(108 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:109 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 28 ==== osd_op_reply(109 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:110 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 29 ==== osd_op_reply(110 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.192 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.187+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef97d6e0 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.188+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 30 ==== osd_op_reply(111 gc.26 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.188+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.188+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:112 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 38 ==== osd_op_reply(112 gc.27 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:113 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 39 ==== osd_op_reply(113 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 40 ==== osd_op_reply(114 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.189+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 41 ==== osd_op_reply(115 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 42 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.190+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:117 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.191+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 43 ==== osd_op_reply(117 gc.27 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.191+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.191+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef97d6e0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.192+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 31 ==== osd_op_reply(118 gc.28 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.192+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6290 con 0x5568ef97d6e0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 32 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:120 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.197 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 33 ==== osd_op_reply(120 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:121 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 34 ==== osd_op_reply(121 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:122 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.193+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 35 ==== osd_op_reply(122 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.194+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.198 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.194+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:123 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef97d6e0 2024-09-21T08:54:53.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.195+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 36 ==== osd_op_reply(123 gc.28 [call] v36'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.195+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-21T08:54:53.201 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.195+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:124 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5280 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 44 ==== osd_op_reply(124 gc.29 [call] v36'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:125 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c66b0 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 45 ==== osd_op_reply(125 gc.29 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:126 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c56a0 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 46 ==== osd_op_reply(126 gc.29 [call out=24b] v0'0 uv81 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:127 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c66b0 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 47 ==== osd_op_reply(127 gc.29 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.196+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:128 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c66b0 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 48 ==== osd_op_reply(128 gc.29 [call out=1716b] v0'0 uv81 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-21T08:54:53.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 20 garbage collection: RGWGC::process iterating over entry tag='6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.12074301014590303059', time=2024-09-21T08:55:01.277889+0000, chain.objs.size()=7 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_1 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:129 3.22s0 3:47691b0b:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c6bc0 con 0x5568ef982050 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_2 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:130 3.5s0 3:a201680c:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c9850 con 0x7f7c140167b0 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_3 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:131 3.1as0 3:593ada6e:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc190 con 0x5568ef978cd0 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_4 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:132 3.2s0 3:430e33ac:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_5 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:133 3.19s0 3:99c4564b:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9d1650 con 0x5568ef978cd0 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_6 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:134 3.12s0 3:49008439:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9d3ec0 con 0x7f7c140167b0 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_7 2024-09-21T08:54:53.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.197+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:135 3.36s0 3:6ccd583f:::6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9d6730 con 0x7f7c140167b0 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.199+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 49 ==== osd_op_reply(129 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_1 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.199+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 50 ==== osd_op_reply(132 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_4 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.201+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 28 ==== osd_op_reply(131 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_3 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.202+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 18 ==== osd_op_reply(130 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_2 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.202+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 19 ==== osd_op_reply(134 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_6 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.204 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.202+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 29 ==== osd_op_reply(133 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_5 [call] v36'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.205 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.204+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 20 ==== osd_op_reply(135 6f304bac-6e5f-4f70-8cad-d3bf6d19cc46.4237.11__shadow_.GQSlRzEl5rjbu-MjEtSXh8Vox5aTRtF_7 [call] v36'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.204+0000 7f7c28b39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-21T08:54:53.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.204+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:136 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.205+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 51 ==== osd_op_reply(136 gc.29 [call] v36'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.207 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.205+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:137 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.206+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 52 ==== osd_op_reply(137 gc.29 [call] v36'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.207+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-21T08:54:53.208 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.207+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 37 ==== osd_op_reply(138 gc.30 [call] v36'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 38 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.208+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 39 ==== osd_op_reply(140 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:141 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 40 ==== osd_op_reply(141 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:142 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 41 ==== osd_op_reply(142 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.209+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:143 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.210+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 42 ==== osd_op_reply(143 gc.30 [call] v36'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.210+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-21T08:54:53.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.210+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:144 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.211+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 21 ==== osd_op_reply(144 gc.31 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.211+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:145 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.211+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 22 ==== osd_op_reply(145 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.211+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.211+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:146 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 23 ==== osd_op_reply(146 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:147 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 24 ==== osd_op_reply(147 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:148 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.214 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 25 ==== osd_op_reply(148 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.212+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:149 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x7f7c140167b0 2024-09-21T08:54:53.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.213+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 26 ==== osd_op_reply(149 gc.31 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.213+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-21T08:54:53.215 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.213+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.214+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 30 ==== osd_op_reply(150 gc.0 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.214+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 31 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 32 ==== osd_op_reply(152 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 33 ==== osd_op_reply(153 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:154 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 34 ==== osd_op_reply(154 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.215+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:155 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef978cd0 2024-09-21T08:54:53.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.217+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 35 ==== osd_op_reply(155 gc.0 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.217+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-21T08:54:53.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.217+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 43 ==== osd_op_reply(156 gc.1 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 44 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 45 ==== osd_op_reply(158 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 46 ==== osd_op_reply(159 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.218+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:160 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.219+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 47 ==== osd_op_reply(160 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.219+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.219+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:161 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef97d6e0 2024-09-21T08:54:53.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.220+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 48 ==== osd_op_reply(161 gc.1 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.220+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-21T08:54:53.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.220+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 53 ==== osd_op_reply(162 gc.2 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 54 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 55 ==== osd_op_reply(164 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.221+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cec50 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 56 ==== osd_op_reply(165 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:166 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 57 ==== osd_op_reply(166 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.222+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:167 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.223+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 58 ==== osd_op_reply(167 gc.2 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.223+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-21T08:54:53.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.223+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 36 ==== osd_op_reply(168 gc.3 [call] v36'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 37 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 38 ==== osd_op_reply(170 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 39 ==== osd_op_reply(171 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.224+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:172 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.225+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 40 ==== osd_op_reply(172 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.225+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.225+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:173 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.226+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 41 ==== osd_op_reply(173 gc.3 [call] v36'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.226+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.226+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 27 ==== osd_op_reply(174 gc.4 [call] v36'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 28 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 29 ==== osd_op_reply(176 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 30 ==== osd_op_reply(177 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.227+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:178 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.228+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 31 ==== osd_op_reply(178 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.228+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.228+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:179 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.228+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 32 ==== osd_op_reply(179 gc.4 [call] v36'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.228+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.229+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.229+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 59 ==== osd_op_reply(180 gc.5 [call] v36'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.229+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 60 ==== osd_op_reply(181 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 61 ==== osd_op_reply(182 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 62 ==== osd_op_reply(183 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:184 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 63 ==== osd_op_reply(184 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.230+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:185 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.231+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 64 ==== osd_op_reply(185 gc.5 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.231+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-21T08:54:53.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.231+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 42 ==== osd_op_reply(186 gc.6 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 43 ==== osd_op_reply(187 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.235 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 44 ==== osd_op_reply(188 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 45 ==== osd_op_reply(189 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.233+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:190 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.234+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 46 ==== osd_op_reply(190 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.234+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.236 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.234+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:191 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.235+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 47 ==== osd_op_reply(191 gc.6 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.235+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-21T08:54:53.237 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.235+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.236+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 49 ==== osd_op_reply(192 gc.7 [call] v36'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.236+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.236+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 50 ==== osd_op_reply(193 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.236+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.236+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 51 ==== osd_op_reply(194 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 52 ==== osd_op_reply(195 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:196 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 53 ==== osd_op_reply(196 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.237+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:197 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.238+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 54 ==== osd_op_reply(197 gc.7 [call] v36'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.238+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-21T08:54:53.241 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.238+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.239+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 33 ==== osd_op_reply(198 gc.8 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.239+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.239+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 34 ==== osd_op_reply(199 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.239+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.239+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 35 ==== osd_op_reply(200 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 36 ==== osd_op_reply(201 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:202 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 37 ==== osd_op_reply(202 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.240+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:203 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.241+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 38 ==== osd_op_reply(203 gc.8 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.245 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.241+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.241+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.242+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 65 ==== osd_op_reply(204 gc.9 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.242+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.242+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 66 ==== osd_op_reply(205 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.242+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 67 ==== osd_op_reply(206 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 68 ==== osd_op_reply(207 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:208 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.246 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 69 ==== osd_op_reply(208 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.243+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:209 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.244+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 70 ==== osd_op_reply(209 gc.9 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.244+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-21T08:54:53.247 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.244+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 39 ==== osd_op_reply(210 gc.10 [call] v36'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 40 ==== osd_op_reply(211 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 41 ==== osd_op_reply(212 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.245+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 42 ==== osd_op_reply(213 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:214 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 43 ==== osd_op_reply(214 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.246+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:215 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.247+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 44 ==== osd_op_reply(215 gc.10 [call] v36'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.247+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-21T08:54:53.250 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.247+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 55 ==== osd_op_reply(216 gc.11 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 56 ==== osd_op_reply(217 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.252 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 57 ==== osd_op_reply(218 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.248+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:219 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 58 ==== osd_op_reply(219 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:220 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 59 ==== osd_op_reply(220 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.249+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:221 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.250+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 60 ==== osd_op_reply(221 gc.11 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.250+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-21T08:54:53.253 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.250+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:222 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.251+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 45 ==== osd_op_reply(222 gc.12 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.251+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:223 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.251+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 46 ==== osd_op_reply(223 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.251+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.251+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:224 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 47 ==== osd_op_reply(224 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:225 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 48 ==== osd_op_reply(225 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:226 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 49 ==== osd_op_reply(226 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.252+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:227 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.253+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 50 ==== osd_op_reply(227 gc.12 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.253+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-21T08:54:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.253+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:228 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.254+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 61 ==== osd_op_reply(228 gc.13 [call] v36'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.254+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:229 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.254+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 62 ==== osd_op_reply(229 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.254+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.254+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:230 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 63 ==== osd_op_reply(230 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:231 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 64 ==== osd_op_reply(231 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:232 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 65 ==== osd_op_reply(232 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.258 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.255+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:233 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef97d6e0 2024-09-21T08:54:53.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.256+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 66 ==== osd_op_reply(233 gc.13 [call] v36'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.256+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-21T08:54:53.259 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.256+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:234 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.257+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 48 ==== osd_op_reply(234 gc.14 [call] v36'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.257+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:235 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.257+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 49 ==== osd_op_reply(235 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:236 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 50 ==== osd_op_reply(236 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:237 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 51 ==== osd_op_reply(237 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:238 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 52 ==== osd_op_reply(238 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.258+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:239 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.261 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.259+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 53 ==== osd_op_reply(239 gc.14 [call] v36'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.259+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-21T08:54:53.262 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.259+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:240 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.260+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 71 ==== osd_op_reply(240 gc.15 [call] v36'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.260+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:241 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.260+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 72 ==== osd_op_reply(241 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.263 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.260+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.260+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:242 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 73 ==== osd_op_reply(242 gc.15 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:243 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 74 ==== osd_op_reply(243 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:244 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 75 ==== osd_op_reply(244 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.261+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:245 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.262+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 76 ==== osd_op_reply(245 gc.15 [call] v36'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.262+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.262+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:246 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 51 ==== osd_op_reply(246 gc.16 [call] v36'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:247 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 52 ==== osd_op_reply(247 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:248 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 53 ==== osd_op_reply(248 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.266 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.263+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:249 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 54 ==== osd_op_reply(249 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:250 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 55 ==== osd_op_reply(250 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.267 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.264+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:251 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.265+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 56 ==== osd_op_reply(251 gc.16 [call] v36'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.265+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.265+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:252 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 77 ==== osd_op_reply(252 gc.17 [call] v36'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:253 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 78 ==== osd_op_reply(253 gc.17 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:254 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 79 ==== osd_op_reply(254 gc.17 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.266+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:255 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 80 ==== osd_op_reply(255 gc.17 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:256 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 81 ==== osd_op_reply(256 gc.17 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.270 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.267+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:257 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.268+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 82 ==== osd_op_reply(257 gc.17 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.268+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.268+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:258 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.269+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 54 ==== osd_op_reply(258 gc.18 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.269+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:259 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.269+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 55 ==== osd_op_reply(259 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.269+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.269+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:260 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 56 ==== osd_op_reply(260 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:261 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 57 ==== osd_op_reply(261 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.272 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:262 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 58 ==== osd_op_reply(262 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.273 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.270+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:263 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.271+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 59 ==== osd_op_reply(263 gc.18 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.271+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-21T08:54:53.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.271+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:264 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.274 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.272+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 60 ==== osd_op_reply(264 gc.19 [call] v36'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.272+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:265 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.272+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 61 ==== osd_op_reply(265 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.272+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.272+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:266 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 62 ==== osd_op_reply(266 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:267 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 63 ==== osd_op_reply(267 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.275 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:268 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x5568ef978cd0 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 64 ==== osd_op_reply(268 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.273+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:269 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.274+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 65 ==== osd_op_reply(269 gc.19 [call] v36'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.274+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-21T08:54:53.276 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.274+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:270 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.275+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 83 ==== osd_op_reply(270 gc.20 [call] v36'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.275+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:271 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.275+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 84 ==== osd_op_reply(271 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.275+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.275+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:272 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 85 ==== osd_op_reply(272 gc.20 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:273 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 86 ==== osd_op_reply(273 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.278 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:274 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 87 ==== osd_op_reply(274 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.279 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.276+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:275 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.277+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 88 ==== osd_op_reply(275 gc.20 [call] v36'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.277+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.277+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:276 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 57 ==== osd_op_reply(276 gc.21 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:277 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 58 ==== osd_op_reply(277 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:278 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 59 ==== osd_op_reply(278 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.278+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:279 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 60 ==== osd_op_reply(279 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.281 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:280 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9c5a60 con 0x7f7c140167b0 2024-09-21T08:54:53.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 61 ==== osd_op_reply(280 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.282 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.279+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:281 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.280+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 62 ==== osd_op_reply(281 gc.21 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.283 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.280+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.280+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:282 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 89 ==== osd_op_reply(282 gc.22 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:283 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 90 ==== osd_op_reply(283 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:284 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 91 ==== osd_op_reply(284 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:285 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 92 ==== osd_op_reply(285 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.281+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:286 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.282+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 93 ==== osd_op_reply(286 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.284 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.282+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.282+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:287 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.283+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 94 ==== osd_op_reply(287 gc.22 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.283+0000 7f7c28b39800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-21T08:54:53.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.283+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:288 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.283+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 95 ==== osd_op_reply(288 gc.23 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.283+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:289 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 96 ==== osd_op_reply(289 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:290 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 97 ==== osd_op_reply(290 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:291 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 98 ==== osd_op_reply(291 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:292 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 99 ==== osd_op_reply(292 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-21T08:54:53.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.284+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:293 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef982050 2024-09-21T08:54:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.285+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 100 ==== osd_op_reply(293 gc.23 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.286+0000 7f7ada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-21T08:54:53.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.286+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909184715392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x5568ef978cd0 2024-09-21T08:54:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.287+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93909184715392] v36'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.289 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.287+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909184703776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef9cc530 con 0x7f7c140167b0 2024-09-21T08:54:53.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.288+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93909184703776] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.288+0000 7f7c28b39800 20 remove_watcher() i=0 2024-09-21T08:54:53.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.288+0000 7f7c28b39800 2 removed watcher, disabling cache 2024-09-21T08:54:53.290 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.288+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909184707968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef989a80 con 0x5568ef978cd0 2024-09-21T08:54:53.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.290+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93909184707968] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.290+0000 7f7c28b39800 20 remove_watcher() i=1 2024-09-21T08:54:53.291 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.290+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909184701296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef989a80 con 0x5568ef982050 2024-09-21T08:54:53.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.291+0000 7f7c247d1640 1 -- 172.21.15.196:0/876058957 <== osd.3 v2:172.21.15.196:6800/127179937 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93909184701296] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c14009040 con 0x5568ef982050 2024-09-21T08:54:53.292 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.291+0000 7f7c28b39800 20 remove_watcher() i=2 2024-09-21T08:54:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.291+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909184714336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986370 con 0x7f7c140167b0 2024-09-21T08:54:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.292+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.2 v2:172.21.15.196:6816/3551232799 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93909184714336] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x7f7c140167b0 2024-09-21T08:54:53.293 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.292+0000 7f7c28b39800 20 remove_watcher() i=3 2024-09-21T08:54:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.292+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909184718064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986370 con 0x5568ef978cd0 2024-09-21T08:54:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.293+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 <== osd.1 v2:172.21.15.196:6808/2855083704 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93909184718064] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c0c051070 con 0x5568ef978cd0 2024-09-21T08:54:53.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.293+0000 7f7c28b39800 20 remove_watcher() i=4 2024-09-21T08:54:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.293+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909184720736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98a4f0 con 0x5568ef97d6e0 2024-09-21T08:54:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.294+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93909184720736] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.294+0000 7f7c28b39800 20 remove_watcher() i=5 2024-09-21T08:54:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.294+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909184712768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef986370 con 0x5568ef97d6e0 2024-09-21T08:54:53.296 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.295+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93909184712768] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.295+0000 7f7c28b39800 20 remove_watcher() i=6 2024-09-21T08:54:53.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.295+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909184726784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5568ef98af60 con 0x5568ef97d6e0 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c24fd2640 1 -- 172.21.15.196:0/876058957 <== osd.0 v2:172.21.15.29:6800/3430791726 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93909184726784] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1c02a070 con 0x5568ef97d6e0 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 20 remove_watcher() i=7 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef97d6e0 msgr2=0x5568ef97fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef97d6e0 0x5568ef97fad0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef978cd0 msgr2=0x5568ef97b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef978cd0 0x5568ef97b190 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f7c140167b0 msgr2=0x7f7c14045800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f7c140167b0 0x7f7c14045800 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5568ef982050 msgr2=0x5568ef984510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x5568ef982050 0x5568ef984510 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7aec036b40 msgr2=0x7f7aec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7aec036b40 0x7f7aec039000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c140017f0 tx=0x7f7c14039000 comp rx=0 tx=0).stop 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 msgr2=0x5568ef96d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c1bfd0640 1 -- 172.21.15.196:0/876058957 reap_dead start 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0117d0 tx=0x7f7c1c04cc80 comp rx=0 tx=0).stop 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 shutdown_connections 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 --2- 172.21.15.196:0/876058957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef965dd0 0x5568ef96d1d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 >> 172.21.15.196:0/876058957 conn(0x5568ef95dd20 msgr2=0x5568ef95bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 shutdown_connections 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.296+0000 7f7c28b39800 1 -- 172.21.15.196:0/876058957 wait complete. 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 msgr2=0x7f7afc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 0x7f7afc039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404c230 tx=0x7f7c1404c100 comp rx=0 tx=0).stop 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 msgr2=0x5568ef955110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x5568ef92ffc0 tx=0x7f7c1c012fd0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 shutdown_connections 2024-09-21T08:54:53.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7afc036b40 0x7f7afc039000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/1142288325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef954cf0 0x5568ef955110 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 >> 172.21.15.196:0/1142288325 conn(0x5568ef949c80 msgr2=0x5568ef94c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 shutdown_connections 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/1142288325 wait complete. 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 msgr2=0x5568ef945d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 0x5568ef945d00 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 msgr2=0x5568ef9410b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 0x5568ef9410b0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 msgr2=0x7f7b0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 0x7f7b0c039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c057000 tx=0x7f7c0c052000 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 msgr2=0x5568ef93a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000fd0 tx=0x7f7c14000ed0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 shutdown_connections 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x5568ef943910 0x5568ef945d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x5568ef848900 0x5568ef9410b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7b0c036b40 0x7f7b0c039000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 --2- 172.21.15.196:0/3683080811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568ef8444c0 0x5568ef93a040 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 >> 172.21.15.196:0/3683080811 conn(0x5568ef83fdf0 msgr2=0x5568ef92da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 shutdown_connections 2024-09-21T08:54:53.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-21T08:54:53.297+0000 7f7c28b39800 1 -- 172.21.15.196:0/3683080811 wait complete. 2024-09-21T08:54:53.308 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T08:54:53.317 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T08:54:53.317 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:54:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.420+0000 7fd2688f1640 1 Processor -- start 2024-09-21T08:54:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.420+0000 7fd2688f1640 1 -- start start 2024-09-21T08:54:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.420+0000 7fd2688f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd264096630 0x7fd264096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.420+0000 7fd2688f1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2640702f0 con 0x7fd26406d910 2024-09-21T08:54:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.420+0000 7fd2688f1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd26406f1f0 con 0x7fd264096630 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd26259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd264096630 0x7fd264096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd261d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd26406d910 0x7fd26406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41992/0 (socket says 172.21.15.29:41992) 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd261d9b640 1 -- 172.21.15.29:0/3236272887 learned_addr learned my addr 172.21.15.29:0/3236272887 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd26259c640 1 -- 172.21.15.29:0/3236272887 >> v1:172.21.15.29:6789/0 conn(0x7fd26406d910 legacy=0x7fd26406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd26259c640 1 -- 172.21.15.29:0/3236272887 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26406fb80 con 0x7fd264096630 2024-09-21T08:54:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.421+0000 7fd26159a640 1 -- 172.21.15.29:0/3236272887 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090393315 0 0) 0x7fd2640702f0 con 0x7fd26406d910 2024-09-21T08:54:53.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd26259c640 1 --2- 172.21.15.29:0/3236272887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd264096630 0x7fd264096a10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd254009720 tx=0x7fd25402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e1c6da3e080f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd26159a640 1 -- 172.21.15.29:0/3236272887 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254037070 con 0x7fd264096630 2024-09-21T08:54:53.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd26159a640 1 -- 172.21.15.29:0/3236272887 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25402ad90 con 0x7fd264096630 2024-09-21T08:54:53.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd26159a640 1 -- 172.21.15.29:0/3236272887 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254032590 con 0x7fd264096630 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 -- 172.21.15.29:0/3236272887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd264096630 msgr2=0x7fd264096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 --2- 172.21.15.29:0/3236272887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd264096630 0x7fd264096a10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd254009720 tx=0x7fd25402a110 comp rx=0 tx=0).stop 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 -- 172.21.15.29:0/3236272887 shutdown_connections 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 --2- 172.21.15.29:0/3236272887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd264096630 0x7fd264096a10 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 -- 172.21.15.29:0/3236272887 >> 172.21.15.29:0/3236272887 conn(0x7fd26409a890 msgr2=0x7fd26409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 -- 172.21.15.29:0/3236272887 shutdown_connections 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.422+0000 7fd2688f1640 1 -- 172.21.15.29:0/3236272887 wait complete. 2024-09-21T08:54:53.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.423+0000 7fd2688f1640 1 Processor -- start 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.423+0000 7fd2688f1640 1 -- start start 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd2688f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd2688f1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd26406d410 con 0x7fd26406d910 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd26259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd26259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35284/0 (socket says 172.21.15.29:35284) 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd26259c640 1 -- 172.21.15.29:0/1963252858 learned_addr learned my addr 172.21.15.29:0/1963252858 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd26259c640 1 -- 172.21.15.29:0/1963252858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd264132d00 con 0x7fd26406d910 2024-09-21T08:54:53.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.424+0000 7fd26259c640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd254009840 tx=0x7fd2540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254041020 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25403d550 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd254037040 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd264072ea0 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd264127470 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.425+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd254044020 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.426+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26412aa10 con 0x7fd26406d910 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.426+0000 7fd252ffd640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 0x7fd24403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.426+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd25406c3f0 con 0x7fd26406d910 2024-09-21T08:54:53.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.426+0000 7fd261d9b640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 0x7fd24403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.426+0000 7fd261d9b640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 0x7fd24403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd258007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.431+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd25404b030 con 0x7fd26406d910 2024-09-21T08:54:53.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.604+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd26406eda0 con 0x7fd2440382a0 2024-09-21T08:54:53.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.621+0000 7fd252ffd640 1 -- 172.21.15.29:0/1963252858 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665816 (secure 0 0 0) 0x7fd26406eda0 con 0x7fd2440382a0 2024-09-21T08:54:53.632 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:54:53.638 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:54:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 msgr2=0x7fd24403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 0x7fd24403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd258007910 comp rx=0 tx=0).stop 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 msgr2=0x7fd264126f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd254009840 tx=0x7fd2540046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 shutdown_connections 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd2440382a0 0x7fd24403a760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 --2- 172.21.15.29:0/1963252858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd26406d910 0x7fd264126f30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 >> 172.21.15.29:0/1963252858 conn(0x7fd26409a890 msgr2=0x7fd264070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 shutdown_connections 2024-09-21T08:54:53.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.626+0000 7fd2688f1640 1 -- 172.21.15.29:0/1963252858 wait complete. 2024-09-21T08:54:53.643 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-21T08:54:53.211270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4882,"num_read_kb":4459,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173852,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313508,"statfs":{"total":386547056640,"available":386369032192,"internally_reserved":0,"allocated":41775104,"data_stored":40535734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003859"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231353+0000","last_change":"2024-09-21T08:51:38.149131+0000","last_active":"2024-09-21T08:52:14.231353+0000","last_peered":"2024-09-21T08:52:14.231353+0000","last_clean":"2024-09-21T08:52:14.231353+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:52:14.231353+0000","last_undegraded":"2024-09-21T08:52:14.231353+0000","last_fullsized":"2024-09-21T08:52:14.231353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:33.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400047+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.400047+0000","last_peered":"2024-09-21T08:54:46.400047+0000","last_clean":"2024-09-21T08:54:46.400047+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.400047+0000","last_undegraded":"2024-09-21T08:54:46.400047+0000","last_fullsized":"2024-09-21T08:54:46.400047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227696+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:52:14.227696+0000","last_peered":"2024-09-21T08:52:14.227696+0000","last_clean":"2024-09-21T08:52:14.227696+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:52:14.227696+0000","last_undegraded":"2024-09-21T08:52:14.227696+0000","last_fullsized":"2024-09-21T08:52:14.227696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:44:26.727846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535392+0000","last_change":"2024-09-21T08:51:40.136089+0000","last_active":"2024-09-21T08:54:46.535392+0000","last_peered":"2024-09-21T08:54:46.535392+0000","last_clean":"2024-09-21T08:54:46.535392+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:54:46.535392+0000","last_undegraded":"2024-09-21T08:54:46.535392+0000","last_fullsized":"2024-09-21T08:54:46.535392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:42.691157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781340+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:52:18.781340+0000","last_peered":"2024-09-21T08:52:18.781340+0000","last_clean":"2024-09-21T08:52:18.781340+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:52:18.781340+0000","last_undegraded":"2024-09-21T08:52:18.781340+0000","last_fullsized":"2024-09-21T08:52:18.781340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:41.267539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.239510+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:52:14.239510+0000","last_peered":"2024-09-21T08:52:14.239510+0000","last_clean":"2024-09-21T08:52:14.239510+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:52:14.239510+0000","last_undegraded":"2024-09-21T08:52:14.239510+0000","last_fullsized":"2024-09-21T08:52:14.239510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.787607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231201+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:52:14.231201+0000","last_peered":"2024-09-21T08:52:14.231201+0000","last_clean":"2024-09-21T08:52:14.231201+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:52:14.231201+0000","last_undegraded":"2024-09-21T08:52:14.231201+0000","last_fullsized":"2024-09-21T08:52:14.231201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:09.428425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183972+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:10.183972+0000","last_peered":"2024-09-21T08:54:10.183972+0000","last_clean":"2024-09-21T08:54:10.183972+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:10.183972+0000","last_undegraded":"2024-09-21T08:54:10.183972+0000","last_fullsized":"2024-09-21T08:54:10.183972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:10.655450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.738181+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:53:45.738181+0000","last_peered":"2024-09-21T08:53:45.738181+0000","last_clean":"2024-09-21T08:53:45.738181+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:53:45.738181+0000","last_undegraded":"2024-09-21T08:53:45.738181+0000","last_fullsized":"2024-09-21T08:53:45.738181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:27.599255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898400+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:52:19.898400+0000","last_peered":"2024-09-21T08:52:19.898400+0000","last_clean":"2024-09-21T08:52:19.898400+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:52:19.898400+0000","last_undegraded":"2024-09-21T08:52:19.898400+0000","last_fullsized":"2024-09-21T08:52:19.898400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:22.144849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227886+0000","last_change":"2024-09-21T08:51:38.149505+0000","last_active":"2024-09-21T08:52:14.227886+0000","last_peered":"2024-09-21T08:52:14.227886+0000","last_clean":"2024-09-21T08:52:14.227886+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:52:14.227886+0000","last_undegraded":"2024-09-21T08:52:14.227886+0000","last_fullsized":"2024-09-21T08:52:14.227886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.592638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399870+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.399870+0000","last_peered":"2024-09-21T08:54:46.399870+0000","last_clean":"2024-09-21T08:54:46.399870+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.399870+0000","last_undegraded":"2024-09-21T08:54:46.399870+0000","last_fullsized":"2024-09-21T08:54:46.399870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:31.174220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225068+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:52:14.225068+0000","last_peered":"2024-09-21T08:52:14.225068+0000","last_clean":"2024-09-21T08:52:14.225068+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:52:14.225068+0000","last_undegraded":"2024-09-21T08:52:14.225068+0000","last_fullsized":"2024-09-21T08:52:14.225068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:38.320272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354111+0000","last_change":"2024-09-21T08:51:40.136615+0000","last_active":"2024-09-21T08:53:02.354111+0000","last_peered":"2024-09-21T08:53:02.354111+0000","last_clean":"2024-09-21T08:53:02.354111+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:53:02.354111+0000","last_undegraded":"2024-09-21T08:53:02.354111+0000","last_fullsized":"2024-09-21T08:53:02.354111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:01.638135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225452+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:52:14.225452+0000","last_peered":"2024-09-21T08:52:14.225452+0000","last_clean":"2024-09-21T08:52:14.225452+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:52:14.225452+0000","last_undegraded":"2024-09-21T08:52:14.225452+0000","last_fullsized":"2024-09-21T08:52:14.225452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399104+0000","last_change":"2024-09-21T08:51:40.139948+0000","last_active":"2024-09-21T08:54:46.399104+0000","last_peered":"2024-09-21T08:54:46.399104+0000","last_clean":"2024-09-21T08:54:46.399104+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:54:46.399104+0000","last_undegraded":"2024-09-21T08:54:46.399104+0000","last_fullsized":"2024-09-21T08:54:46.399104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:46.303446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182197+0000","last_change":"2024-09-21T08:51:40.135605+0000","last_active":"2024-09-21T08:54:00.182197+0000","last_peered":"2024-09-21T08:54:00.182197+0000","last_clean":"2024-09-21T08:54:00.182197+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:54:00.182197+0000","last_undegraded":"2024-09-21T08:54:00.182197+0000","last_fullsized":"2024-09-21T08:54:00.182197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:18.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227228+0000","last_change":"2024-09-21T08:51:38.140312+0000","last_active":"2024-09-21T08:52:14.227228+0000","last_peered":"2024-09-21T08:52:14.227228+0000","last_clean":"2024-09-21T08:52:14.227228+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:52:14.227228+0000","last_undegraded":"2024-09-21T08:52:14.227228+0000","last_fullsized":"2024-09-21T08:52:14.227228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:02.069891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936352+0000","last_change":"2024-09-21T08:51:40.137259+0000","last_active":"2024-09-21T08:53:45.936352+0000","last_peered":"2024-09-21T08:53:45.936352+0000","last_clean":"2024-09-21T08:53:45.936352+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:53:45.936352+0000","last_undegraded":"2024-09-21T08:53:45.936352+0000","last_fullsized":"2024-09-21T08:53:45.936352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.598144+0000","last_change":"2024-09-21T08:51:38.150225+0000","last_active":"2024-09-21T08:54:46.598144+0000","last_peered":"2024-09-21T08:54:46.598144+0000","last_clean":"2024-09-21T08:54:46.598144+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:54:46.598144+0000","last_undegraded":"2024-09-21T08:54:46.598144+0000","last_fullsized":"2024-09-21T08:54:46.598144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:58.948956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":21,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399793+0000","last_change":"2024-09-21T08:51:40.135404+0000","last_active":"2024-09-21T08:54:46.399793+0000","last_peered":"2024-09-21T08:54:46.399793+0000","last_clean":"2024-09-21T08:54:46.399793+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:54:46.399793+0000","last_undegraded":"2024-09-21T08:54:46.399793+0000","last_fullsized":"2024-09-21T08:54:46.399793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.913626+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:53:45.913626+0000","last_peered":"2024-09-21T08:53:45.913626+0000","last_clean":"2024-09-21T08:53:45.913626+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:53:45.913626+0000","last_undegraded":"2024-09-21T08:53:45.913626+0000","last_fullsized":"2024-09-21T08:53:45.913626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.085254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583271+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583271+0000","last_peered":"2024-09-21T08:54:46.583271+0000","last_clean":"2024-09-21T08:54:46.583271+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583271+0000","last_undegraded":"2024-09-21T08:54:46.583271+0000","last_fullsized":"2024-09-21T08:54:46.583271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229015+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:52:14.229015+0000","last_peered":"2024-09-21T08:52:14.229015+0000","last_clean":"2024-09-21T08:52:14.229015+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:52:14.229015+0000","last_undegraded":"2024-09-21T08:52:14.229015+0000","last_fullsized":"2024-09-21T08:52:14.229015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:48.757416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231605+0000","last_change":"2024-09-21T08:51:40.143862+0000","last_active":"2024-09-21T08:52:14.231605+0000","last_peered":"2024-09-21T08:52:14.231605+0000","last_clean":"2024-09-21T08:52:14.231605+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:52:14.231605+0000","last_undegraded":"2024-09-21T08:52:14.231605+0000","last_fullsized":"2024-09-21T08:52:14.231605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:22.460199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227756+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:52:14.227756+0000","last_peered":"2024-09-21T08:52:14.227756+0000","last_clean":"2024-09-21T08:52:14.227756+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:52:14.227756+0000","last_undegraded":"2024-09-21T08:52:14.227756+0000","last_fullsized":"2024-09-21T08:52:14.227756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:16.521067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182622+0000","last_change":"2024-09-21T08:51:40.138654+0000","last_active":"2024-09-21T08:54:05.182622+0000","last_peered":"2024-09-21T08:54:05.182622+0000","last_clean":"2024-09-21T08:54:05.182622+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:54:05.182622+0000","last_undegraded":"2024-09-21T08:54:05.182622+0000","last_fullsized":"2024-09-21T08:54:05.182622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:10.717027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225664+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:52:14.225664+0000","last_peered":"2024-09-21T08:52:14.225664+0000","last_clean":"2024-09-21T08:52:14.225664+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:52:14.225664+0000","last_undegraded":"2024-09-21T08:52:14.225664+0000","last_fullsized":"2024-09-21T08:52:14.225664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:29.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.584533+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.584533+0000","last_peered":"2024-09-21T08:54:46.584533+0000","last_clean":"2024-09-21T08:54:46.584533+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.584533+0000","last_undegraded":"2024-09-21T08:54:46.584533+0000","last_fullsized":"2024-09-21T08:54:46.584533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:48.958880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.169984+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:53:02.169984+0000","last_peered":"2024-09-21T08:53:02.169984+0000","last_clean":"2024-09-21T08:53:02.169984+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:53:02.169984+0000","last_undegraded":"2024-09-21T08:53:02.169984+0000","last_fullsized":"2024-09-21T08:53:02.169984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227035+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:52:14.227035+0000","last_peered":"2024-09-21T08:52:14.227035+0000","last_clean":"2024-09-21T08:52:14.227035+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:52:14.227035+0000","last_undegraded":"2024-09-21T08:52:14.227035+0000","last_fullsized":"2024-09-21T08:52:14.227035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:20.030105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.139486+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:58.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'35","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.545112+0000","last_change":"2024-09-21T08:51:44.149044+0000","last_active":"2024-09-21T08:54:46.545112+0000","last_peered":"2024-09-21T08:54:46.545112+0000","last_clean":"2024-09-21T08:54:46.545112+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:54:46.545112+0000","last_undegraded":"2024-09-21T08:54:46.545112+0000","last_fullsized":"2024-09-21T08:54:46.545112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:16.675629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227130+0000","last_change":"2024-09-21T08:51:46.152252+0000","last_active":"2024-09-21T08:52:14.227130+0000","last_peered":"2024-09-21T08:52:14.227130+0000","last_clean":"2024-09-21T08:52:14.227130+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:52:14.227130+0000","last_undegraded":"2024-09-21T08:52:14.227130+0000","last_fullsized":"2024-09-21T08:52:14.227130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.176311+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:53:02.176311+0000","last_peered":"2024-09-21T08:53:02.176311+0000","last_clean":"2024-09-21T08:53:02.176311+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:53:02.176311+0000","last_undegraded":"2024-09-21T08:53:02.176311+0000","last_fullsized":"2024-09-21T08:53:02.176311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:29.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534995+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.534995+0000","last_peered":"2024-09-21T08:54:46.534995+0000","last_clean":"2024-09-21T08:54:46.534995+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.534995+0000","last_undegraded":"2024-09-21T08:54:46.534995+0000","last_fullsized":"2024-09-21T08:54:46.534995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:42.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181680+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:00.181680+0000","last_peered":"2024-09-21T08:54:00.181680+0000","last_clean":"2024-09-21T08:54:00.181680+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:00.181680+0000","last_undegraded":"2024-09-21T08:54:00.181680+0000","last_fullsized":"2024-09-21T08:54:00.181680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:05.633192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.545682+0000","last_change":"2024-09-21T08:51:42.139320+0000","last_active":"2024-09-21T08:53:45.545682+0000","last_peered":"2024-09-21T08:53:45.545682+0000","last_clean":"2024-09-21T08:53:45.545682+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:53:45.545682+0000","last_undegraded":"2024-09-21T08:53:45.545682+0000","last_fullsized":"2024-09-21T08:53:45.545682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:43.645980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226057+0000","last_change":"2024-09-21T08:51:44.146522+0000","last_active":"2024-09-21T08:52:14.226057+0000","last_peered":"2024-09-21T08:52:14.226057+0000","last_clean":"2024-09-21T08:52:14.226057+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:52:14.226057+0000","last_undegraded":"2024-09-21T08:52:14.226057+0000","last_fullsized":"2024-09-21T08:52:14.226057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:14.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225937+0000","last_change":"2024-09-21T08:51:46.157301+0000","last_active":"2024-09-21T08:52:14.225937+0000","last_peered":"2024-09-21T08:52:14.225937+0000","last_clean":"2024-09-21T08:52:14.225937+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:52:14.225937+0000","last_undegraded":"2024-09-21T08:52:14.225937+0000","last_fullsized":"2024-09-21T08:52:14.225937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225151+0000","last_change":"2024-09-21T08:51:48.154173+0000","last_active":"2024-09-21T08:52:14.225151+0000","last_peered":"2024-09-21T08:52:14.225151+0000","last_clean":"2024-09-21T08:52:14.225151+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:52:14.225151+0000","last_undegraded":"2024-09-21T08:52:14.225151+0000","last_fullsized":"2024-09-21T08:52:14.225151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:16:14.347576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535149+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.535149+0000","last_peered":"2024-09-21T08:54:46.535149+0000","last_clean":"2024-09-21T08:54:46.535149+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.535149+0000","last_undegraded":"2024-09-21T08:54:46.535149+0000","last_fullsized":"2024-09-21T08:54:46.535149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:36.705710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224381+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:52:14.224381+0000","last_peered":"2024-09-21T08:52:14.224381+0000","last_clean":"2024-09-21T08:52:14.224381+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:52:14.224381+0000","last_undegraded":"2024-09-21T08:52:14.224381+0000","last_fullsized":"2024-09-21T08:52:14.224381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:09.304434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227963+0000","last_change":"2024-09-21T08:51:42.137023+0000","last_active":"2024-09-21T08:52:14.227963+0000","last_peered":"2024-09-21T08:52:14.227963+0000","last_clean":"2024-09-21T08:52:14.227963+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:52:14.227963+0000","last_undegraded":"2024-09-21T08:52:14.227963+0000","last_fullsized":"2024-09-21T08:52:14.227963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232114+0000","last_change":"2024-09-21T08:51:44.151497+0000","last_active":"2024-09-21T08:52:14.232114+0000","last_peered":"2024-09-21T08:52:14.232114+0000","last_clean":"2024-09-21T08:52:14.232114+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:52:14.232114+0000","last_undegraded":"2024-09-21T08:52:14.232114+0000","last_fullsized":"2024-09-21T08:52:14.232114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:34.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708968+0000","last_change":"2024-09-21T08:51:46.158108+0000","last_active":"2024-09-21T08:54:46.708968+0000","last_peered":"2024-09-21T08:54:46.708968+0000","last_clean":"2024-09-21T08:54:46.708968+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:54:46.708968+0000","last_undegraded":"2024-09-21T08:54:46.708968+0000","last_fullsized":"2024-09-21T08:54:46.708968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.241076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.638227+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:52:19.638227+0000","last_peered":"2024-09-21T08:52:19.638227+0000","last_clean":"2024-09-21T08:52:19.638227+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:52:19.638227+0000","last_undegraded":"2024-09-21T08:52:19.638227+0000","last_fullsized":"2024-09-21T08:52:19.638227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.204645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310855+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.310855+0000","last_peered":"2024-09-21T08:54:46.310855+0000","last_clean":"2024-09-21T08:54:46.310855+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.310855+0000","last_undegraded":"2024-09-21T08:54:46.310855+0000","last_fullsized":"2024-09-21T08:54:46.310855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.889090+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:52:19.889090+0000","last_peered":"2024-09-21T08:52:19.889090+0000","last_clean":"2024-09-21T08:52:19.889090+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:52:19.889090+0000","last_undegraded":"2024-09-21T08:52:19.889090+0000","last_fullsized":"2024-09-21T08:52:19.889090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231441+0000","last_change":"2024-09-21T08:51:42.136387+0000","last_active":"2024-09-21T08:52:14.231441+0000","last_peered":"2024-09-21T08:52:14.231441+0000","last_clean":"2024-09-21T08:52:14.231441+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:52:14.231441+0000","last_undegraded":"2024-09-21T08:52:14.231441+0000","last_fullsized":"2024-09-21T08:52:14.231441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:42.938313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.499787+0000","last_change":"2024-09-21T08:51:44.151655+0000","last_active":"2024-09-21T08:53:44.499787+0000","last_peered":"2024-09-21T08:53:44.499787+0000","last_clean":"2024-09-21T08:53:44.499787+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:53:44.499787+0000","last_undegraded":"2024-09-21T08:53:44.499787+0000","last_fullsized":"2024-09-21T08:53:44.499787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.388478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.605742+0000","last_change":"2024-09-21T08:51:46.154154+0000","last_active":"2024-09-21T08:54:46.605742+0000","last_peered":"2024-09-21T08:54:46.605742+0000","last_clean":"2024-09-21T08:54:46.605742+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:46.605742+0000","last_undegraded":"2024-09-21T08:54:46.605742+0000","last_fullsized":"2024-09-21T08:54:46.605742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.824819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534945+0000","last_change":"2024-09-21T08:51:40.141892+0000","last_active":"2024-09-21T08:54:46.534945+0000","last_peered":"2024-09-21T08:54:46.534945+0000","last_clean":"2024-09-21T08:54:46.534945+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:54:46.534945+0000","last_undegraded":"2024-09-21T08:54:46.534945+0000","last_fullsized":"2024-09-21T08:54:46.534945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:15.778333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231615+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:52:14.231615+0000","last_peered":"2024-09-21T08:52:14.231615+0000","last_clean":"2024-09-21T08:52:14.231615+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:52:14.231615+0000","last_undegraded":"2024-09-21T08:52:14.231615+0000","last_fullsized":"2024-09-21T08:52:14.231615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227856+0000","last_change":"2024-09-21T08:51:42.139818+0000","last_active":"2024-09-21T08:52:14.227856+0000","last_peered":"2024-09-21T08:52:14.227856+0000","last_clean":"2024-09-21T08:52:14.227856+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:52:14.227856+0000","last_undegraded":"2024-09-21T08:52:14.227856+0000","last_fullsized":"2024-09-21T08:52:14.227856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.508478+0000","last_change":"2024-09-21T08:51:44.148564+0000","last_active":"2024-09-21T08:53:44.508478+0000","last_peered":"2024-09-21T08:53:44.508478+0000","last_clean":"2024-09-21T08:53:44.508478+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:53:44.508478+0000","last_undegraded":"2024-09-21T08:53:44.508478+0000","last_fullsized":"2024-09-21T08:53:44.508478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:46.255459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227433+0000","last_change":"2024-09-21T08:51:46.157947+0000","last_active":"2024-09-21T08:52:14.227433+0000","last_peered":"2024-09-21T08:52:14.227433+0000","last_clean":"2024-09-21T08:52:14.227433+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:52:14.227433+0000","last_undegraded":"2024-09-21T08:52:14.227433+0000","last_fullsized":"2024-09-21T08:52:14.227433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:02.289163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.178600+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:02.178600+0000","last_peered":"2024-09-21T08:53:02.178600+0000","last_clean":"2024-09-21T08:53:02.178600+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:02.178600+0000","last_undegraded":"2024-09-21T08:53:02.178600+0000","last_fullsized":"2024-09-21T08:53:02.178600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:09.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400040+0000","last_change":"2024-09-21T08:51:40.128515+0000","last_active":"2024-09-21T08:54:46.400040+0000","last_peered":"2024-09-21T08:54:46.400040+0000","last_clean":"2024-09-21T08:54:46.400040+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:54:46.400040+0000","last_undegraded":"2024-09-21T08:54:46.400040+0000","last_fullsized":"2024-09-21T08:54:46.400040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.233575+0000","last_change":"2024-09-21T08:51:38.148403+0000","last_active":"2024-09-21T08:52:14.233575+0000","last_peered":"2024-09-21T08:52:14.233575+0000","last_clean":"2024-09-21T08:52:14.233575+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:52:14.233575+0000","last_undegraded":"2024-09-21T08:52:14.233575+0000","last_fullsized":"2024-09-21T08:52:14.233575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.872881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225711+0000","last_change":"2024-09-21T08:51:42.135619+0000","last_active":"2024-09-21T08:52:14.225711+0000","last_peered":"2024-09-21T08:52:14.225711+0000","last_clean":"2024-09-21T08:52:14.225711+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:52:14.225711+0000","last_undegraded":"2024-09-21T08:52:14.225711+0000","last_fullsized":"2024-09-21T08:52:14.225711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.062622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.490003+0000","last_change":"2024-09-21T08:51:44.144706+0000","last_active":"2024-09-21T08:53:44.490003+0000","last_peered":"2024-09-21T08:53:44.490003+0000","last_clean":"2024-09-21T08:53:44.490003+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:53:44.490003+0000","last_undegraded":"2024-09-21T08:53:44.490003+0000","last_fullsized":"2024-09-21T08:53:44.490003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:07.374743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225286+0000","last_change":"2024-09-21T08:51:46.152912+0000","last_active":"2024-09-21T08:52:14.225286+0000","last_peered":"2024-09-21T08:52:14.225286+0000","last_clean":"2024-09-21T08:52:14.225286+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:52:14.225286+0000","last_undegraded":"2024-09-21T08:52:14.225286+0000","last_fullsized":"2024-09-21T08:52:14.225286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:56.616218+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:52:56.616218+0000","last_peered":"2024-09-21T08:52:56.616218+0000","last_clean":"2024-09-21T08:52:56.616218+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:52:56.616218+0000","last_undegraded":"2024-09-21T08:52:56.616218+0000","last_fullsized":"2024-09-21T08:52:56.616218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:53.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310377+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.310377+0000","last_peered":"2024-09-21T08:54:46.310377+0000","last_clean":"2024-09-21T08:54:46.310377+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.310377+0000","last_undegraded":"2024-09-21T08:54:46.310377+0000","last_fullsized":"2024-09-21T08:54:46.310377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:09.036028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230727+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:52:14.230727+0000","last_peered":"2024-09-21T08:52:14.230727+0000","last_clean":"2024-09-21T08:52:14.230727+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:52:14.230727+0000","last_undegraded":"2024-09-21T08:52:14.230727+0000","last_fullsized":"2024-09-21T08:52:14.230727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:31.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228487+0000","last_change":"2024-09-21T08:51:42.137342+0000","last_active":"2024-09-21T08:52:14.228487+0000","last_peered":"2024-09-21T08:52:14.228487+0000","last_clean":"2024-09-21T08:52:14.228487+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:52:14.228487+0000","last_undegraded":"2024-09-21T08:52:14.228487+0000","last_fullsized":"2024-09-21T08:52:14.228487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.510274+0000","last_change":"2024-09-21T08:51:44.145486+0000","last_active":"2024-09-21T08:53:44.510274+0000","last_peered":"2024-09-21T08:53:44.510274+0000","last_clean":"2024-09-21T08:53:44.510274+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:53:44.510274+0000","last_undegraded":"2024-09-21T08:53:44.510274+0000","last_fullsized":"2024-09-21T08:53:44.510274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:45.211269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.718054+0000","last_change":"2024-09-21T08:51:46.153164+0000","last_active":"2024-09-21T08:54:46.718054+0000","last_peered":"2024-09-21T08:54:46.718054+0000","last_clean":"2024-09-21T08:54:46.718054+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:46.718054+0000","last_undegraded":"2024-09-21T08:54:46.718054+0000","last_fullsized":"2024-09-21T08:54:46.718054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:25.619586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226871+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:52:14.226871+0000","last_peered":"2024-09-21T08:52:14.226871+0000","last_clean":"2024-09-21T08:52:14.226871+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:52:14.226871+0000","last_undegraded":"2024-09-21T08:52:14.226871+0000","last_fullsized":"2024-09-21T08:52:14.226871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:41.262657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608904+0000","last_change":"2024-09-21T08:51:40.133810+0000","last_active":"2024-09-21T08:54:46.608904+0000","last_peered":"2024-09-21T08:54:46.608904+0000","last_clean":"2024-09-21T08:54:46.608904+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:54:46.608904+0000","last_undegraded":"2024-09-21T08:54:46.608904+0000","last_fullsized":"2024-09-21T08:54:46.608904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.992615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228858+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:52:14.228858+0000","last_peered":"2024-09-21T08:52:14.228858+0000","last_clean":"2024-09-21T08:52:14.228858+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:52:14.228858+0000","last_undegraded":"2024-09-21T08:52:14.228858+0000","last_fullsized":"2024-09-21T08:52:14.228858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:07.067511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226360+0000","last_change":"2024-09-21T08:51:42.136459+0000","last_active":"2024-09-21T08:52:14.226360+0000","last_peered":"2024-09-21T08:52:14.226360+0000","last_clean":"2024-09-21T08:52:14.226360+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:52:14.226360+0000","last_undegraded":"2024-09-21T08:52:14.226360+0000","last_fullsized":"2024-09-21T08:52:14.226360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.652788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.512066+0000","last_change":"2024-09-21T08:51:44.146420+0000","last_active":"2024-09-21T08:53:44.512066+0000","last_peered":"2024-09-21T08:53:44.512066+0000","last_clean":"2024-09-21T08:53:44.512066+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:53:44.512066+0000","last_undegraded":"2024-09-21T08:53:44.512066+0000","last_fullsized":"2024-09-21T08:53:44.512066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:16.779029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225340+0000","last_change":"2024-09-21T08:51:46.154347+0000","last_active":"2024-09-21T08:52:14.225340+0000","last_peered":"2024-09-21T08:52:14.225340+0000","last_clean":"2024-09-21T08:52:14.225340+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:52:14.225340+0000","last_undegraded":"2024-09-21T08:52:14.225340+0000","last_fullsized":"2024-09-21T08:52:14.225340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695069+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.695069+0000","last_peered":"2024-09-21T08:54:46.695069+0000","last_clean":"2024-09-21T08:54:46.695069+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.695069+0000","last_undegraded":"2024-09-21T08:54:46.695069+0000","last_fullsized":"2024-09-21T08:54:46.695069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:50.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.237306+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:52:14.237306+0000","last_peered":"2024-09-21T08:52:14.237306+0000","last_clean":"2024-09-21T08:52:14.237306+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:52:14.237306+0000","last_undegraded":"2024-09-21T08:52:14.237306+0000","last_fullsized":"2024-09-21T08:52:14.237306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:33.234761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226839+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:52:14.226839+0000","last_peered":"2024-09-21T08:52:14.226839+0000","last_clean":"2024-09-21T08:52:14.226839+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:52:14.226839+0000","last_undegraded":"2024-09-21T08:52:14.226839+0000","last_fullsized":"2024-09-21T08:52:14.226839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:31.835091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232438+0000","last_change":"2024-09-21T08:51:42.142191+0000","last_active":"2024-09-21T08:52:14.232438+0000","last_peered":"2024-09-21T08:52:14.232438+0000","last_clean":"2024-09-21T08:52:14.232438+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:52:14.232438+0000","last_undegraded":"2024-09-21T08:52:14.232438+0000","last_fullsized":"2024-09-21T08:52:14.232438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:06.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.494067+0000","last_change":"2024-09-21T08:51:44.146281+0000","last_active":"2024-09-21T08:53:44.494067+0000","last_peered":"2024-09-21T08:53:44.494067+0000","last_clean":"2024-09-21T08:53:44.494067+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:53:44.494067+0000","last_undegraded":"2024-09-21T08:53:44.494067+0000","last_fullsized":"2024-09-21T08:53:44.494067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231318+0000","last_change":"2024-09-21T08:51:46.150884+0000","last_active":"2024-09-21T08:52:14.231318+0000","last_peered":"2024-09-21T08:52:14.231318+0000","last_clean":"2024-09-21T08:52:14.231318+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:52:14.231318+0000","last_undegraded":"2024-09-21T08:52:14.231318+0000","last_fullsized":"2024-09-21T08:52:14.231318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:48.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180503+0000","last_change":"2024-09-21T08:51:48.161107+0000","last_active":"2024-09-21T08:53:50.180503+0000","last_peered":"2024-09-21T08:53:50.180503+0000","last_clean":"2024-09-21T08:53:50.180503+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:53:50.180503+0000","last_undegraded":"2024-09-21T08:53:50.180503+0000","last_fullsized":"2024-09-21T08:53:50.180503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:05.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.311433+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:46.311433+0000","last_peered":"2024-09-21T08:54:46.311433+0000","last_clean":"2024-09-21T08:54:46.311433+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:54:46.311433+0000","last_undegraded":"2024-09-21T08:54:46.311433+0000","last_fullsized":"2024-09-21T08:54:46.311433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:28.560398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226315+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:52:14.226315+0000","last_peered":"2024-09-21T08:52:14.226315+0000","last_clean":"2024-09-21T08:52:14.226315+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:52:14.226315+0000","last_undegraded":"2024-09-21T08:52:14.226315+0000","last_fullsized":"2024-09-21T08:52:14.226315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:24.009059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226056+0000","last_change":"2024-09-21T08:51:42.136842+0000","last_active":"2024-09-21T08:52:14.226056+0000","last_peered":"2024-09-21T08:52:14.226056+0000","last_clean":"2024-09-21T08:52:14.226056+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:52:14.226056+0000","last_undegraded":"2024-09-21T08:52:14.226056+0000","last_fullsized":"2024-09-21T08:52:14.226056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.518204+0000","last_change":"2024-09-21T08:51:44.145728+0000","last_active":"2024-09-21T08:53:44.518204+0000","last_peered":"2024-09-21T08:53:44.518204+0000","last_clean":"2024-09-21T08:53:44.518204+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:53:44.518204+0000","last_undegraded":"2024-09-21T08:53:44.518204+0000","last_fullsized":"2024-09-21T08:53:44.518204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:30.360384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":402,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.699230+0000","last_change":"2024-09-21T08:51:46.156417+0000","last_active":"2024-09-21T08:54:46.699230+0000","last_peered":"2024-09-21T08:54:46.699230+0000","last_clean":"2024-09-21T08:54:46.699230+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:46.699230+0000","last_undegraded":"2024-09-21T08:54:46.699230+0000","last_fullsized":"2024-09-21T08:54:46.699230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.289841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179175+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:53:54.179175+0000","last_peered":"2024-09-21T08:53:54.179175+0000","last_clean":"2024-09-21T08:53:54.179175+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:53:54.179175+0000","last_undegraded":"2024-09-21T08:53:54.179175+0000","last_fullsized":"2024-09-21T08:53:54.179175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:56.456030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578009+0000","last_change":"2024-09-21T08:51:40.139340+0000","last_active":"2024-09-21T08:54:46.578009+0000","last_peered":"2024-09-21T08:54:46.578009+0000","last_clean":"2024-09-21T08:54:46.578009+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:54:46.578009+0000","last_undegraded":"2024-09-21T08:54:46.578009+0000","last_fullsized":"2024-09-21T08:54:46.578009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:43.928809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225673+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:52:14.225673+0000","last_peered":"2024-09-21T08:52:14.225673+0000","last_clean":"2024-09-21T08:52:14.225673+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:52:14.225673+0000","last_undegraded":"2024-09-21T08:52:14.225673+0000","last_fullsized":"2024-09-21T08:52:14.225673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:20.136829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'4","reported_seq":602,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.555571+0000","last_change":"2024-09-21T08:51:42.134577+0000","last_active":"2024-09-21T08:53:45.555571+0000","last_peered":"2024-09-21T08:53:45.555571+0000","last_clean":"2024-09-21T08:53:45.555571+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:53:45.555571+0000","last_undegraded":"2024-09-21T08:53:45.555571+0000","last_fullsized":"2024-09-21T08:53:45.555571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230245+0000","last_change":"2024-09-21T08:51:44.144448+0000","last_active":"2024-09-21T08:52:14.230245+0000","last_peered":"2024-09-21T08:52:14.230245+0000","last_clean":"2024-09-21T08:52:14.230245+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:52:14.230245+0000","last_undegraded":"2024-09-21T08:52:14.230245+0000","last_fullsized":"2024-09-21T08:52:14.230245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:36.186338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.660323+0000","last_change":"2024-09-21T08:51:46.147009+0000","last_active":"2024-09-21T08:54:46.660323+0000","last_peered":"2024-09-21T08:54:46.660323+0000","last_clean":"2024-09-21T08:54:46.660323+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:46.660323+0000","last_undegraded":"2024-09-21T08:54:46.660323+0000","last_fullsized":"2024-09-21T08:54:46.660323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.684038+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:45.684038+0000","last_peered":"2024-09-21T08:53:45.684038+0000","last_clean":"2024-09-21T08:53:45.684038+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:45.684038+0000","last_undegraded":"2024-09-21T08:53:45.684038+0000","last_fullsized":"2024-09-21T08:53:45.684038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.217764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535001+0000","last_change":"2024-09-21T08:51:40.143685+0000","last_active":"2024-09-21T08:54:46.535001+0000","last_peered":"2024-09-21T08:54:46.535001+0000","last_clean":"2024-09-21T08:54:46.535001+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:54:46.535001+0000","last_undegraded":"2024-09-21T08:54:46.535001+0000","last_fullsized":"2024-09-21T08:54:46.535001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.644149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.518125+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.518125+0000","last_peered":"2024-09-21T08:54:46.518125+0000","last_clean":"2024-09-21T08:54:46.518125+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.518125+0000","last_undegraded":"2024-09-21T08:54:46.518125+0000","last_fullsized":"2024-09-21T08:54:46.518125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:09.410811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230923+0000","last_change":"2024-09-21T08:51:42.142788+0000","last_active":"2024-09-21T08:52:14.230923+0000","last_peered":"2024-09-21T08:52:14.230923+0000","last_clean":"2024-09-21T08:52:14.230923+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:52:14.230923+0000","last_undegraded":"2024-09-21T08:52:14.230923+0000","last_fullsized":"2024-09-21T08:52:14.230923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:28.690766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.505755+0000","last_change":"2024-09-21T08:51:44.146611+0000","last_active":"2024-09-21T08:53:44.505755+0000","last_peered":"2024-09-21T08:53:44.505755+0000","last_clean":"2024-09-21T08:53:44.505755+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:53:44.505755+0000","last_undegraded":"2024-09-21T08:53:44.505755+0000","last_fullsized":"2024-09-21T08:53:44.505755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:59.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231940+0000","last_change":"2024-09-21T08:51:46.158723+0000","last_active":"2024-09-21T08:52:14.231940+0000","last_peered":"2024-09-21T08:52:14.231940+0000","last_clean":"2024-09-21T08:52:14.231940+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:52:14.231940+0000","last_undegraded":"2024-09-21T08:52:14.231940+0000","last_fullsized":"2024-09-21T08:52:14.231940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:17.004798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.635195+0000","last_change":"2024-09-21T08:51:48.156029+0000","last_active":"2024-09-21T08:54:46.635195+0000","last_peered":"2024-09-21T08:54:46.635195+0000","last_clean":"2024-09-21T08:54:46.635195+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:54:46.635195+0000","last_undegraded":"2024-09-21T08:54:46.635195+0000","last_fullsized":"2024-09-21T08:54:46.635195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:47.978506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399786+0000","last_change":"2024-09-21T08:51:40.141982+0000","last_active":"2024-09-21T08:54:46.399786+0000","last_peered":"2024-09-21T08:54:46.399786+0000","last_clean":"2024-09-21T08:54:46.399786+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:54:46.399786+0000","last_undegraded":"2024-09-21T08:54:46.399786+0000","last_fullsized":"2024-09-21T08:54:46.399786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:59.500749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229118+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:52:14.229118+0000","last_peered":"2024-09-21T08:52:14.229118+0000","last_clean":"2024-09-21T08:52:14.229118+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:52:14.229118+0000","last_undegraded":"2024-09-21T08:52:14.229118+0000","last_fullsized":"2024-09-21T08:52:14.229118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228862+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:52:14.228862+0000","last_peered":"2024-09-21T08:52:14.228862+0000","last_clean":"2024-09-21T08:52:14.228862+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:52:14.228862+0000","last_undegraded":"2024-09-21T08:52:14.228862+0000","last_fullsized":"2024-09-21T08:52:14.228862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179869+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:53:45.179869+0000","last_peered":"2024-09-21T08:53:45.179869+0000","last_clean":"2024-09-21T08:53:45.179869+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:53:45.179869+0000","last_undegraded":"2024-09-21T08:53:45.179869+0000","last_fullsized":"2024-09-21T08:53:45.179869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:33.456799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228510+0000","last_change":"2024-09-21T08:51:42.134377+0000","last_active":"2024-09-21T08:52:14.228510+0000","last_peered":"2024-09-21T08:52:14.228510+0000","last_clean":"2024-09-21T08:52:14.228510+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:52:14.228510+0000","last_undegraded":"2024-09-21T08:52:14.228510+0000","last_fullsized":"2024-09-21T08:52:14.228510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'77","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181599+0000","last_change":"2024-09-21T08:51:44.147739+0000","last_active":"2024-09-21T08:53:55.181599+0000","last_peered":"2024-09-21T08:53:55.181599+0000","last_clean":"2024-09-21T08:53:55.181599+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:53:55.181599+0000","last_undegraded":"2024-09-21T08:53:55.181599+0000","last_fullsized":"2024-09-21T08:53:55.181599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:09.473552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227064+0000","last_change":"2024-09-21T08:51:46.152510+0000","last_active":"2024-09-21T08:52:14.227064+0000","last_peered":"2024-09-21T08:52:14.227064+0000","last_clean":"2024-09-21T08:52:14.227064+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:52:14.227064+0000","last_undegraded":"2024-09-21T08:52:14.227064+0000","last_fullsized":"2024-09-21T08:52:14.227064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:46.952503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.612082+0000","last_change":"2024-09-21T08:51:48.153950+0000","last_active":"2024-09-21T08:54:46.612082+0000","last_peered":"2024-09-21T08:54:46.612082+0000","last_clean":"2024-09-21T08:54:46.612082+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:54:46.612082+0000","last_undegraded":"2024-09-21T08:54:46.612082+0000","last_fullsized":"2024-09-21T08:54:46.612082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:39:17.944711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231327+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:52:14.231327+0000","last_peered":"2024-09-21T08:52:14.231327+0000","last_clean":"2024-09-21T08:52:14.231327+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:52:14.231327+0000","last_undegraded":"2024-09-21T08:52:14.231327+0000","last_fullsized":"2024-09-21T08:52:14.231327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:56.405706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223860+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:52:14.223860+0000","last_peered":"2024-09-21T08:52:14.223860+0000","last_clean":"2024-09-21T08:52:14.223860+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:52:14.223860+0000","last_undegraded":"2024-09-21T08:52:14.223860+0000","last_fullsized":"2024-09-21T08:52:14.223860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225233+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:52:14.225233+0000","last_peered":"2024-09-21T08:52:14.225233+0000","last_clean":"2024-09-21T08:52:14.225233+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:52:14.225233+0000","last_undegraded":"2024-09-21T08:52:14.225233+0000","last_fullsized":"2024-09-21T08:52:14.225233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.236996+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:52:14.236996+0000","last_peered":"2024-09-21T08:52:14.236996+0000","last_clean":"2024-09-21T08:52:14.236996+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:52:14.236996+0000","last_undegraded":"2024-09-21T08:52:14.236996+0000","last_fullsized":"2024-09-21T08:52:14.236996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.070327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216405+0000","last_change":"2024-09-21T08:51:44.151651+0000","last_active":"2024-09-21T08:54:42.216405+0000","last_peered":"2024-09-21T08:54:42.216405+0000","last_clean":"2024-09-21T08:54:42.216405+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:42.216405+0000","last_undegraded":"2024-09-21T08:54:42.216405+0000","last_fullsized":"2024-09-21T08:54:42.216405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229206+0000","last_change":"2024-09-21T08:51:46.151027+0000","last_active":"2024-09-21T08:52:14.229206+0000","last_peered":"2024-09-21T08:52:14.229206+0000","last_clean":"2024-09-21T08:52:14.229206+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:52:14.229206+0000","last_undegraded":"2024-09-21T08:52:14.229206+0000","last_fullsized":"2024-09-21T08:52:14.229206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:21.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.174515+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:53:02.174515+0000","last_peered":"2024-09-21T08:53:02.174515+0000","last_clean":"2024-09-21T08:53:02.174515+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:53:02.174515+0000","last_undegraded":"2024-09-21T08:53:02.174515+0000","last_fullsized":"2024-09-21T08:53:02.174515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:09.403435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535009+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.535009+0000","last_peered":"2024-09-21T08:54:46.535009+0000","last_clean":"2024-09-21T08:54:46.535009+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.535009+0000","last_undegraded":"2024-09-21T08:54:46.535009+0000","last_fullsized":"2024-09-21T08:54:46.535009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227766+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:52:14.227766+0000","last_peered":"2024-09-21T08:52:14.227766+0000","last_clean":"2024-09-21T08:52:14.227766+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:52:14.227766+0000","last_undegraded":"2024-09-21T08:52:14.227766+0000","last_fullsized":"2024-09-21T08:52:14.227766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225020+0000","last_change":"2024-09-21T08:51:38.137786+0000","last_active":"2024-09-21T08:52:14.225020+0000","last_peered":"2024-09-21T08:52:14.225020+0000","last_clean":"2024-09-21T08:52:14.225020+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:52:14.225020+0000","last_undegraded":"2024-09-21T08:52:14.225020+0000","last_fullsized":"2024-09-21T08:52:14.225020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.245255+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:52:14.245255+0000","last_peered":"2024-09-21T08:52:14.245255+0000","last_clean":"2024-09-21T08:52:14.245255+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:52:14.245255+0000","last_undegraded":"2024-09-21T08:52:14.245255+0000","last_fullsized":"2024-09-21T08:52:14.245255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.385447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216645+0000","last_change":"2024-09-21T08:51:44.143788+0000","last_active":"2024-09-21T08:54:42.216645+0000","last_peered":"2024-09-21T08:54:42.216645+0000","last_clean":"2024-09-21T08:54:42.216645+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:54:42.216645+0000","last_undegraded":"2024-09-21T08:54:42.216645+0000","last_fullsized":"2024-09-21T08:54:42.216645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:03.808346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226722+0000","last_change":"2024-09-21T08:51:46.152516+0000","last_active":"2024-09-21T08:52:14.226722+0000","last_peered":"2024-09-21T08:52:14.226722+0000","last_clean":"2024-09-21T08:52:14.226722+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:52:14.226722+0000","last_undegraded":"2024-09-21T08:52:14.226722+0000","last_fullsized":"2024-09-21T08:52:14.226722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:34.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224587+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:52:14.224587+0000","last_peered":"2024-09-21T08:52:14.224587+0000","last_clean":"2024-09-21T08:52:14.224587+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:52:14.224587+0000","last_undegraded":"2024-09-21T08:52:14.224587+0000","last_fullsized":"2024-09-21T08:52:14.224587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:11.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.897959+0000","last_change":"2024-09-21T08:51:40.136811+0000","last_active":"2024-09-21T08:52:19.897959+0000","last_peered":"2024-09-21T08:52:19.897959+0000","last_clean":"2024-09-21T08:52:19.897959+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:52:19.897959+0000","last_undegraded":"2024-09-21T08:52:19.897959+0000","last_fullsized":"2024-09-21T08:52:19.897959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224875+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:52:14.224875+0000","last_peered":"2024-09-21T08:52:14.224875+0000","last_clean":"2024-09-21T08:52:14.224875+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:52:14.224875+0000","last_undegraded":"2024-09-21T08:52:14.224875+0000","last_fullsized":"2024-09-21T08:52:14.224875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228110+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:52:14.228110+0000","last_peered":"2024-09-21T08:52:14.228110+0000","last_clean":"2024-09-21T08:52:14.228110+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:52:14.228110+0000","last_undegraded":"2024-09-21T08:52:14.228110+0000","last_fullsized":"2024-09-21T08:52:14.228110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:30.036950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227211+0000","last_change":"2024-09-21T08:51:42.141282+0000","last_active":"2024-09-21T08:52:14.227211+0000","last_peered":"2024-09-21T08:52:14.227211+0000","last_clean":"2024-09-21T08:52:14.227211+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:52:14.227211+0000","last_undegraded":"2024-09-21T08:52:14.227211+0000","last_fullsized":"2024-09-21T08:52:14.227211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.948185+0000","last_change":"2024-09-21T08:51:44.140590+0000","last_active":"2024-09-21T08:54:45.948185+0000","last_peered":"2024-09-21T08:54:45.948185+0000","last_clean":"2024-09-21T08:54:45.948185+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:45.948185+0000","last_undegraded":"2024-09-21T08:54:45.948185+0000","last_fullsized":"2024-09-21T08:54:45.948185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:35.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231632+0000","last_change":"2024-09-21T08:51:46.150420+0000","last_active":"2024-09-21T08:52:14.231632+0000","last_peered":"2024-09-21T08:52:14.231632+0000","last_clean":"2024-09-21T08:52:14.231632+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:52:14.231632+0000","last_undegraded":"2024-09-21T08:52:14.231632+0000","last_fullsized":"2024-09-21T08:52:14.231632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:59.570923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.567201+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.567201+0000","last_peered":"2024-09-21T08:54:46.567201+0000","last_clean":"2024-09-21T08:54:46.567201+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.567201+0000","last_undegraded":"2024-09-21T08:54:46.567201+0000","last_fullsized":"2024-09-21T08:54:46.567201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:38.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898484+0000","last_change":"2024-09-21T08:51:40.142809+0000","last_active":"2024-09-21T08:52:19.898484+0000","last_peered":"2024-09-21T08:52:19.898484+0000","last_clean":"2024-09-21T08:52:19.898484+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:52:19.898484+0000","last_undegraded":"2024-09-21T08:52:19.898484+0000","last_fullsized":"2024-09-21T08:52:19.898484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179133+0000","last_change":"2024-09-21T08:51:38.147128+0000","last_active":"2024-09-21T08:53:45.179133+0000","last_peered":"2024-09-21T08:53:45.179133+0000","last_clean":"2024-09-21T08:53:45.179133+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:53:45.179133+0000","last_undegraded":"2024-09-21T08:53:45.179133+0000","last_fullsized":"2024-09-21T08:53:45.179133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:04.684325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226549+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:52:14.226549+0000","last_peered":"2024-09-21T08:52:14.226549+0000","last_clean":"2024-09-21T08:52:14.226549+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:52:14.226549+0000","last_undegraded":"2024-09-21T08:52:14.226549+0000","last_fullsized":"2024-09-21T08:52:14.226549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178352+0000","last_change":"2024-09-21T08:51:42.136825+0000","last_active":"2024-09-21T08:53:49.178352+0000","last_peered":"2024-09-21T08:53:49.178352+0000","last_clean":"2024-09-21T08:53:49.178352+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:53:49.178352+0000","last_undegraded":"2024-09-21T08:53:49.178352+0000","last_fullsized":"2024-09-21T08:53:49.178352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.517295+0000","last_change":"2024-09-21T08:51:44.146959+0000","last_active":"2024-09-21T08:53:44.517295+0000","last_peered":"2024-09-21T08:53:44.517295+0000","last_clean":"2024-09-21T08:53:44.517295+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:53:44.517295+0000","last_undegraded":"2024-09-21T08:53:44.517295+0000","last_fullsized":"2024-09-21T08:53:44.517295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228236+0000","last_change":"2024-09-21T08:51:46.155541+0000","last_active":"2024-09-21T08:52:14.228236+0000","last_peered":"2024-09-21T08:52:14.228236+0000","last_clean":"2024-09-21T08:52:14.228236+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:52:14.228236+0000","last_undegraded":"2024-09-21T08:52:14.228236+0000","last_fullsized":"2024-09-21T08:52:14.228236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:24.113565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.874713+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:53:45.874713+0000","last_peered":"2024-09-21T08:53:45.874713+0000","last_clean":"2024-09-21T08:53:45.874713+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:53:45.874713+0000","last_undegraded":"2024-09-21T08:53:45.874713+0000","last_fullsized":"2024-09-21T08:53:45.874713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.827304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170271+0000","last_change":"2024-09-21T08:51:40.133246+0000","last_active":"2024-09-21T08:53:02.170271+0000","last_peered":"2024-09-21T08:53:02.170271+0000","last_clean":"2024-09-21T08:53:02.170271+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:53:02.170271+0000","last_undegraded":"2024-09-21T08:53:02.170271+0000","last_fullsized":"2024-09-21T08:53:02.170271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.576389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227037+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:52:14.227037+0000","last_peered":"2024-09-21T08:52:14.227037+0000","last_clean":"2024-09-21T08:52:14.227037+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:52:14.227037+0000","last_undegraded":"2024-09-21T08:52:14.227037+0000","last_fullsized":"2024-09-21T08:52:14.227037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:12.352985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230062+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:52:14.230062+0000","last_peered":"2024-09-21T08:52:14.230062+0000","last_clean":"2024-09-21T08:52:14.230062+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:52:14.230062+0000","last_undegraded":"2024-09-21T08:52:14.230062+0000","last_fullsized":"2024-09-21T08:52:14.230062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224660+0000","last_change":"2024-09-21T08:51:42.136553+0000","last_active":"2024-09-21T08:52:14.224660+0000","last_peered":"2024-09-21T08:52:14.224660+0000","last_clean":"2024-09-21T08:52:14.224660+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:52:14.224660+0000","last_undegraded":"2024-09-21T08:52:14.224660+0000","last_fullsized":"2024-09-21T08:52:14.224660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:23.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:44.152406+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":354,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216399+0000","last_change":"2024-09-21T08:51:46.147127+0000","last_active":"2024-09-21T08:54:42.216399+0000","last_peered":"2024-09-21T08:54:42.216399+0000","last_clean":"2024-09-21T08:54:42.216399+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:54:42.216399+0000","last_undegraded":"2024-09-21T08:54:42.216399+0000","last_fullsized":"2024-09-21T08:54:42.216399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:36.081632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230628+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:52:14.230628+0000","last_peered":"2024-09-21T08:52:14.230628+0000","last_clean":"2024-09-21T08:52:14.230628+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:52:14.230628+0000","last_undegraded":"2024-09-21T08:52:14.230628+0000","last_fullsized":"2024-09-21T08:52:14.230628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:10.942375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170054+0000","last_change":"2024-09-21T08:51:40.145001+0000","last_active":"2024-09-21T08:53:02.170054+0000","last_peered":"2024-09-21T08:53:02.170054+0000","last_clean":"2024-09-21T08:53:02.170054+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:53:02.170054+0000","last_undegraded":"2024-09-21T08:53:02.170054+0000","last_fullsized":"2024-09-21T08:53:02.170054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:09.524590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528793+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.528793+0000","last_peered":"2024-09-21T08:54:46.528793+0000","last_clean":"2024-09-21T08:54:46.528793+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.528793+0000","last_undegraded":"2024-09-21T08:54:46.528793+0000","last_fullsized":"2024-09-21T08:54:46.528793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:48.815999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227389+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:52:14.227389+0000","last_peered":"2024-09-21T08:52:14.227389+0000","last_clean":"2024-09-21T08:52:14.227389+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:52:14.227389+0000","last_undegraded":"2024-09-21T08:52:14.227389+0000","last_fullsized":"2024-09-21T08:52:14.227389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225844+0000","last_change":"2024-09-21T08:51:42.136276+0000","last_active":"2024-09-21T08:52:14.225844+0000","last_peered":"2024-09-21T08:52:14.225844+0000","last_clean":"2024-09-21T08:52:14.225844+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:52:14.225844+0000","last_undegraded":"2024-09-21T08:52:14.225844+0000","last_fullsized":"2024-09-21T08:52:14.225844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:29.036853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.172648+0000","last_change":"2024-09-21T08:51:44.146949+0000","last_active":"2024-09-21T08:53:02.172648+0000","last_peered":"2024-09-21T08:53:02.172648+0000","last_clean":"2024-09-21T08:53:02.172648+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:53:02.172648+0000","last_undegraded":"2024-09-21T08:53:02.172648+0000","last_fullsized":"2024-09-21T08:53:02.172648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:24.672757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695824+0000","last_change":"2024-09-21T08:51:46.157876+0000","last_active":"2024-09-21T08:54:46.695824+0000","last_peered":"2024-09-21T08:54:46.695824+0000","last_clean":"2024-09-21T08:54:46.695824+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:54:46.695824+0000","last_undegraded":"2024-09-21T08:54:46.695824+0000","last_fullsized":"2024-09-21T08:54:46.695824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:58.663889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227725+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:52:14.227725+0000","last_peered":"2024-09-21T08:52:14.227725+0000","last_clean":"2024-09-21T08:52:14.227725+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:52:14.227725+0000","last_undegraded":"2024-09-21T08:52:14.227725+0000","last_fullsized":"2024-09-21T08:52:14.227725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:38.232117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.928314+0000","last_change":"2024-09-21T08:51:40.139991+0000","last_active":"2024-09-21T08:53:45.928314+0000","last_peered":"2024-09-21T08:53:45.928314+0000","last_clean":"2024-09-21T08:53:45.928314+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:53:45.928314+0000","last_undegraded":"2024-09-21T08:53:45.928314+0000","last_fullsized":"2024-09-21T08:53:45.928314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:15.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226716+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:52:14.226716+0000","last_peered":"2024-09-21T08:52:14.226716+0000","last_clean":"2024-09-21T08:52:14.226716+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:52:14.226716+0000","last_undegraded":"2024-09-21T08:52:14.226716+0000","last_fullsized":"2024-09-21T08:52:14.226716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:34.648397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231442+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:52:14.231442+0000","last_peered":"2024-09-21T08:52:14.231442+0000","last_clean":"2024-09-21T08:52:14.231442+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:52:14.231442+0000","last_undegraded":"2024-09-21T08:52:14.231442+0000","last_fullsized":"2024-09-21T08:52:14.231442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.235154+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:52:14.235154+0000","last_peered":"2024-09-21T08:52:14.235154+0000","last_clean":"2024-09-21T08:52:14.235154+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:52:14.235154+0000","last_undegraded":"2024-09-21T08:52:14.235154+0000","last_fullsized":"2024-09-21T08:52:14.235154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:44.480516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.503705+0000","last_change":"2024-09-21T08:51:44.151520+0000","last_active":"2024-09-21T08:53:44.503705+0000","last_peered":"2024-09-21T08:53:44.503705+0000","last_clean":"2024-09-21T08:53:44.503705+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:53:44.503705+0000","last_undegraded":"2024-09-21T08:53:44.503705+0000","last_fullsized":"2024-09-21T08:53:44.503705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:23:27.022747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226572+0000","last_change":"2024-09-21T08:51:46.148294+0000","last_active":"2024-09-21T08:52:14.226572+0000","last_peered":"2024-09-21T08:52:14.226572+0000","last_clean":"2024-09-21T08:52:14.226572+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:52:14.226572+0000","last_undegraded":"2024-09-21T08:52:14.226572+0000","last_fullsized":"2024-09-21T08:52:14.226572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:33.051043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232595+0000","last_change":"2024-09-21T08:51:48.152691+0000","last_active":"2024-09-21T08:52:14.232595+0000","last_peered":"2024-09-21T08:52:14.232595+0000","last_clean":"2024-09-21T08:52:14.232595+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:52:14.232595+0000","last_undegraded":"2024-09-21T08:52:14.232595+0000","last_fullsized":"2024-09-21T08:52:14.232595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:38.470582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.407365+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.407365+0000","last_peered":"2024-09-21T08:54:46.407365+0000","last_clean":"2024-09-21T08:54:46.407365+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.407365+0000","last_undegraded":"2024-09-21T08:54:46.407365+0000","last_fullsized":"2024-09-21T08:54:46.407365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:16.117971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312954+0000","last_change":"2024-09-21T08:51:40.144129+0000","last_active":"2024-09-21T08:54:46.312954+0000","last_peered":"2024-09-21T08:54:46.312954+0000","last_clean":"2024-09-21T08:54:46.312954+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:54:46.312954+0000","last_undegraded":"2024-09-21T08:54:46.312954+0000","last_fullsized":"2024-09-21T08:54:46.312954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:13.975778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228951+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:52:14.228951+0000","last_peered":"2024-09-21T08:52:14.228951+0000","last_clean":"2024-09-21T08:52:14.228951+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:52:14.228951+0000","last_undegraded":"2024-09-21T08:52:14.228951+0000","last_fullsized":"2024-09-21T08:52:14.228951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:30.847013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228755+0000","last_change":"2024-09-21T08:51:42.133381+0000","last_active":"2024-09-21T08:52:14.228755+0000","last_peered":"2024-09-21T08:52:14.228755+0000","last_clean":"2024-09-21T08:52:14.228755+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:52:14.228755+0000","last_undegraded":"2024-09-21T08:52:14.228755+0000","last_fullsized":"2024-09-21T08:52:14.228755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:30.430814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.509388+0000","last_change":"2024-09-21T08:51:44.145046+0000","last_active":"2024-09-21T08:53:44.509388+0000","last_peered":"2024-09-21T08:53:44.509388+0000","last_clean":"2024-09-21T08:53:44.509388+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:53:44.509388+0000","last_undegraded":"2024-09-21T08:53:44.509388+0000","last_fullsized":"2024-09-21T08:53:44.509388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:47.801350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224610+0000","last_change":"2024-09-21T08:51:46.158200+0000","last_active":"2024-09-21T08:52:14.224610+0000","last_peered":"2024-09-21T08:52:14.224610+0000","last_clean":"2024-09-21T08:52:14.224610+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:52:14.224610+0000","last_undegraded":"2024-09-21T08:52:14.224610+0000","last_fullsized":"2024-09-21T08:52:14.224610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:37.227055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.209012+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:44.209012+0000","last_peered":"2024-09-21T08:53:44.209012+0000","last_clean":"2024-09-21T08:53:44.209012+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:44.209012+0000","last_undegraded":"2024-09-21T08:53:44.209012+0000","last_fullsized":"2024-09-21T08:53:44.209012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:31.644486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'5","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181750+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:00.181750+0000","last_peered":"2024-09-21T08:54:00.181750+0000","last_clean":"2024-09-21T08:54:00.181750+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:54:00.181750+0000","last_undegraded":"2024-09-21T08:54:00.181750+0000","last_fullsized":"2024-09-21T08:54:00.181750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.294093+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.294093+0000","last_peered":"2024-09-21T08:54:46.294093+0000","last_clean":"2024-09-21T08:54:46.294093+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.294093+0000","last_undegraded":"2024-09-21T08:54:46.294093+0000","last_fullsized":"2024-09-21T08:54:46.294093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:50.293941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.136260+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:30.066785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953028+0000","last_change":"2024-09-21T08:51:44.144365+0000","last_active":"2024-09-21T08:54:45.953028+0000","last_peered":"2024-09-21T08:54:45.953028+0000","last_clean":"2024-09-21T08:54:45.953028+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:45.953028+0000","last_undegraded":"2024-09-21T08:54:45.953028+0000","last_fullsized":"2024-09-21T08:54:45.953028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:46.704900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227983+0000","last_change":"2024-09-21T08:51:46.158835+0000","last_active":"2024-09-21T08:52:14.227983+0000","last_peered":"2024-09-21T08:52:14.227983+0000","last_clean":"2024-09-21T08:52:14.227983+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:52:14.227983+0000","last_undegraded":"2024-09-21T08:52:14.227983+0000","last_fullsized":"2024-09-21T08:52:14.227983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:32.915843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.029809+0000","last_change":"2024-09-21T08:51:48.154918+0000","last_active":"2024-09-21T08:54:46.029809+0000","last_peered":"2024-09-21T08:54:46.029809+0000","last_clean":"2024-09-21T08:54:46.029809+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:54:46.029809+0000","last_undegraded":"2024-09-21T08:54:46.029809+0000","last_fullsized":"2024-09-21T08:54:46.029809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:16.848003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583334+0000","last_change":"2024-09-21T08:51:40.122583+0000","last_active":"2024-09-21T08:54:46.583334+0000","last_peered":"2024-09-21T08:54:46.583334+0000","last_clean":"2024-09-21T08:54:46.583334+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:54:46.583334+0000","last_undegraded":"2024-09-21T08:54:46.583334+0000","last_fullsized":"2024-09-21T08:54:46.583334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:22.038126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234016+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:52:14.234016+0000","last_peered":"2024-09-21T08:52:14.234016+0000","last_clean":"2024-09-21T08:52:14.234016+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:52:14.234016+0000","last_undegraded":"2024-09-21T08:52:14.234016+0000","last_fullsized":"2024-09-21T08:52:14.234016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:48.539998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226151+0000","last_change":"2024-09-21T08:51:42.140686+0000","last_active":"2024-09-21T08:52:14.226151+0000","last_peered":"2024-09-21T08:52:14.226151+0000","last_clean":"2024-09-21T08:52:14.226151+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:52:14.226151+0000","last_undegraded":"2024-09-21T08:52:14.226151+0000","last_fullsized":"2024-09-21T08:52:14.226151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:42.691888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.010694+0000","last_change":"2024-09-21T08:51:44.143454+0000","last_active":"2024-09-21T08:54:46.010694+0000","last_peered":"2024-09-21T08:54:46.010694+0000","last_clean":"2024-09-21T08:54:46.010694+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:54:46.010694+0000","last_undegraded":"2024-09-21T08:54:46.010694+0000","last_fullsized":"2024-09-21T08:54:46.010694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226645+0000","last_change":"2024-09-21T08:51:46.147907+0000","last_active":"2024-09-21T08:52:14.226645+0000","last_peered":"2024-09-21T08:52:14.226645+0000","last_clean":"2024-09-21T08:52:14.226645+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:52:14.226645+0000","last_undegraded":"2024-09-21T08:52:14.226645+0000","last_fullsized":"2024-09-21T08:52:14.226645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:37.528413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230362+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:52:14.230362+0000","last_peered":"2024-09-21T08:52:14.230362+0000","last_clean":"2024-09-21T08:52:14.230362+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:52:14.230362+0000","last_undegraded":"2024-09-21T08:52:14.230362+0000","last_fullsized":"2024-09-21T08:52:14.230362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:39.412207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223965+0000","last_change":"2024-09-21T08:51:40.145568+0000","last_active":"2024-09-21T08:52:14.223965+0000","last_peered":"2024-09-21T08:52:14.223965+0000","last_clean":"2024-09-21T08:52:14.223965+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:52:14.223965+0000","last_undegraded":"2024-09-21T08:52:14.223965+0000","last_fullsized":"2024-09-21T08:52:14.223965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.236481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.160254+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:53:02.160254+0000","last_peered":"2024-09-21T08:53:02.160254+0000","last_clean":"2024-09-21T08:53:02.160254+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:53:02.160254+0000","last_undegraded":"2024-09-21T08:53:02.160254+0000","last_fullsized":"2024-09-21T08:53:02.160254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224272+0000","last_change":"2024-09-21T08:51:42.139408+0000","last_active":"2024-09-21T08:52:14.224272+0000","last_peered":"2024-09-21T08:52:14.224272+0000","last_clean":"2024-09-21T08:52:14.224272+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:52:14.224272+0000","last_undegraded":"2024-09-21T08:52:14.224272+0000","last_fullsized":"2024-09-21T08:52:14.224272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:32.273127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.496177+0000","last_change":"2024-09-21T08:51:44.145680+0000","last_active":"2024-09-21T08:53:44.496177+0000","last_peered":"2024-09-21T08:53:44.496177+0000","last_clean":"2024-09-21T08:53:44.496177+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:53:44.496177+0000","last_undegraded":"2024-09-21T08:53:44.496177+0000","last_fullsized":"2024-09-21T08:53:44.496177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:10.374149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227427+0000","last_change":"2024-09-21T08:51:46.153528+0000","last_active":"2024-09-21T08:52:14.227427+0000","last_peered":"2024-09-21T08:52:14.227427+0000","last_clean":"2024-09-21T08:52:14.227427+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:52:14.227427+0000","last_undegraded":"2024-09-21T08:52:14.227427+0000","last_fullsized":"2024-09-21T08:52:14.227427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:22.537802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405394+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.405394+0000","last_peered":"2024-09-21T08:54:46.405394+0000","last_clean":"2024-09-21T08:54:46.405394+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.405394+0000","last_undegraded":"2024-09-21T08:54:46.405394+0000","last_fullsized":"2024-09-21T08:54:46.405394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:27.405363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.841739+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:53:45.841739+0000","last_peered":"2024-09-21T08:53:45.841739+0000","last_clean":"2024-09-21T08:53:45.841739+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:53:45.841739+0000","last_undegraded":"2024-09-21T08:53:45.841739+0000","last_fullsized":"2024-09-21T08:53:45.841739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:23.655957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228233+0000","last_change":"2024-09-21T08:51:42.136453+0000","last_active":"2024-09-21T08:52:14.228233+0000","last_peered":"2024-09-21T08:52:14.228233+0000","last_clean":"2024-09-21T08:52:14.228233+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:52:14.228233+0000","last_undegraded":"2024-09-21T08:52:14.228233+0000","last_fullsized":"2024-09-21T08:52:14.228233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'56","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.515168+0000","last_change":"2024-09-21T08:51:44.146351+0000","last_active":"2024-09-21T08:53:44.515168+0000","last_peered":"2024-09-21T08:53:44.515168+0000","last_clean":"2024-09-21T08:53:44.515168+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:53:44.515168+0000","last_undegraded":"2024-09-21T08:53:44.515168+0000","last_fullsized":"2024-09-21T08:53:44.515168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231093+0000","last_change":"2024-09-21T08:51:46.155998+0000","last_active":"2024-09-21T08:52:14.231093+0000","last_peered":"2024-09-21T08:52:14.231093+0000","last_clean":"2024-09-21T08:52:14.231093+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:52:14.231093+0000","last_undegraded":"2024-09-21T08:52:14.231093+0000","last_fullsized":"2024-09-21T08:52:14.231093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:51.236181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.871525+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:53:45.871525+0000","last_peered":"2024-09-21T08:53:45.871525+0000","last_clean":"2024-09-21T08:53:45.871525+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:53:45.871525+0000","last_undegraded":"2024-09-21T08:53:45.871525+0000","last_fullsized":"2024-09-21T08:53:45.871525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:07.375683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.313490+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.313490+0000","last_peered":"2024-09-21T08:54:46.313490+0000","last_clean":"2024-09-21T08:54:46.313490+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.313490+0000","last_undegraded":"2024-09-21T08:54:46.313490+0000","last_fullsized":"2024-09-21T08:54:46.313490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'5","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.274711+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:46.274711+0000","last_peered":"2024-09-21T08:54:46.274711+0000","last_clean":"2024-09-21T08:54:46.274711+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:46.274711+0000","last_undegraded":"2024-09-21T08:54:46.274711+0000","last_fullsized":"2024-09-21T08:54:46.274711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231259+0000","last_change":"2024-09-21T08:51:42.139604+0000","last_active":"2024-09-21T08:52:14.231259+0000","last_peered":"2024-09-21T08:52:14.231259+0000","last_clean":"2024-09-21T08:52:14.231259+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:52:14.231259+0000","last_undegraded":"2024-09-21T08:52:14.231259+0000","last_fullsized":"2024-09-21T08:52:14.231259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.490123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.497130+0000","last_change":"2024-09-21T08:51:44.146257+0000","last_active":"2024-09-21T08:53:44.497130+0000","last_peered":"2024-09-21T08:53:44.497130+0000","last_clean":"2024-09-21T08:53:44.497130+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:53:44.497130+0000","last_undegraded":"2024-09-21T08:53:44.497130+0000","last_fullsized":"2024-09-21T08:53:44.497130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:49.195311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227189+0000","last_change":"2024-09-21T08:51:46.156505+0000","last_active":"2024-09-21T08:52:14.227189+0000","last_peered":"2024-09-21T08:52:14.227189+0000","last_clean":"2024-09-21T08:52:14.227189+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:52:14.227189+0000","last_undegraded":"2024-09-21T08:52:14.227189+0000","last_fullsized":"2024-09-21T08:52:14.227189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:06.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.934131+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:53:45.934131+0000","last_peered":"2024-09-21T08:53:45.934131+0000","last_clean":"2024-09-21T08:53:45.934131+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:53:45.934131+0000","last_undegraded":"2024-09-21T08:53:45.934131+0000","last_fullsized":"2024-09-21T08:53:45.934131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:58.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.142254+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:03.523431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183294+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:10.183294+0000","last_peered":"2024-09-21T08:54:10.183294+0000","last_clean":"2024-09-21T08:54:10.183294+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:10.183294+0000","last_undegraded":"2024-09-21T08:54:10.183294+0000","last_fullsized":"2024-09-21T08:54:10.183294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231343+0000","last_change":"2024-09-21T08:51:42.139686+0000","last_active":"2024-09-21T08:52:14.231343+0000","last_peered":"2024-09-21T08:52:14.231343+0000","last_clean":"2024-09-21T08:52:14.231343+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:52:14.231343+0000","last_undegraded":"2024-09-21T08:52:14.231343+0000","last_fullsized":"2024-09-21T08:52:14.231343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.566863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.513262+0000","last_change":"2024-09-21T08:51:44.141704+0000","last_active":"2024-09-21T08:53:44.513262+0000","last_peered":"2024-09-21T08:53:44.513262+0000","last_clean":"2024-09-21T08:53:44.513262+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:53:44.513262+0000","last_undegraded":"2024-09-21T08:53:44.513262+0000","last_fullsized":"2024-09-21T08:53:44.513262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226978+0000","last_change":"2024-09-21T08:51:46.159395+0000","last_active":"2024-09-21T08:52:14.226978+0000","last_peered":"2024-09-21T08:52:14.226978+0000","last_clean":"2024-09-21T08:52:14.226978+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:52:14.226978+0000","last_undegraded":"2024-09-21T08:52:14.226978+0000","last_fullsized":"2024-09-21T08:52:14.226978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:32.704956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.658263+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.658263+0000","last_peered":"2024-09-21T08:54:46.658263+0000","last_clean":"2024-09-21T08:54:46.658263+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.658263+0000","last_undegraded":"2024-09-21T08:54:46.658263+0000","last_fullsized":"2024-09-21T08:54:46.658263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:05.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535066+0000","last_change":"2024-09-21T08:51:40.136848+0000","last_active":"2024-09-21T08:54:46.535066+0000","last_peered":"2024-09-21T08:54:46.535066+0000","last_clean":"2024-09-21T08:54:46.535066+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:54:46.535066+0000","last_undegraded":"2024-09-21T08:54:46.535066+0000","last_fullsized":"2024-09-21T08:54:46.535066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227140+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:52:14.227140+0000","last_peered":"2024-09-21T08:52:14.227140+0000","last_clean":"2024-09-21T08:52:14.227140+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:52:14.227140+0000","last_undegraded":"2024-09-21T08:52:14.227140+0000","last_fullsized":"2024-09-21T08:52:14.227140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:52.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229052+0000","last_change":"2024-09-21T08:51:42.135155+0000","last_active":"2024-09-21T08:52:14.229052+0000","last_peered":"2024-09-21T08:52:14.229052+0000","last_clean":"2024-09-21T08:52:14.229052+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:52:14.229052+0000","last_undegraded":"2024-09-21T08:52:14.229052+0000","last_fullsized":"2024-09-21T08:52:14.229052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179980+0000","last_change":"2024-09-21T08:51:44.149082+0000","last_active":"2024-09-21T08:53:45.179980+0000","last_peered":"2024-09-21T08:53:45.179980+0000","last_clean":"2024-09-21T08:53:45.179980+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:53:45.179980+0000","last_undegraded":"2024-09-21T08:53:45.179980+0000","last_fullsized":"2024-09-21T08:53:45.179980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:33.834476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.607288+0000","last_change":"2024-09-21T08:51:46.158858+0000","last_active":"2024-09-21T08:54:46.607288+0000","last_peered":"2024-09-21T08:54:46.607288+0000","last_clean":"2024-09-21T08:54:46.607288+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:54:46.607288+0000","last_undegraded":"2024-09-21T08:54:46.607288+0000","last_fullsized":"2024-09-21T08:54:46.607288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223513+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:52:14.223513+0000","last_peered":"2024-09-21T08:52:14.223513+0000","last_clean":"2024-09-21T08:52:14.223513+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:52:14.223513+0000","last_undegraded":"2024-09-21T08:52:14.223513+0000","last_fullsized":"2024-09-21T08:52:14.223513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.887975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583055+0000","last_change":"2024-09-21T08:51:40.133956+0000","last_active":"2024-09-21T08:54:46.583055+0000","last_peered":"2024-09-21T08:54:46.583055+0000","last_clean":"2024-09-21T08:54:46.583055+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:54:46.583055+0000","last_undegraded":"2024-09-21T08:54:46.583055+0000","last_fullsized":"2024-09-21T08:54:46.583055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:08.168952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229125+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:52:14.229125+0000","last_peered":"2024-09-21T08:52:14.229125+0000","last_clean":"2024-09-21T08:52:14.229125+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:52:14.229125+0000","last_undegraded":"2024-09-21T08:52:14.229125+0000","last_fullsized":"2024-09-21T08:52:14.229125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228198+0000","last_change":"2024-09-21T08:51:42.135023+0000","last_active":"2024-09-21T08:52:14.228198+0000","last_peered":"2024-09-21T08:52:14.228198+0000","last_clean":"2024-09-21T08:52:14.228198+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:52:14.228198+0000","last_undegraded":"2024-09-21T08:52:14.228198+0000","last_fullsized":"2024-09-21T08:52:14.228198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.487830+0000","last_change":"2024-09-21T08:51:44.147321+0000","last_active":"2024-09-21T08:53:44.487830+0000","last_peered":"2024-09-21T08:53:44.487830+0000","last_clean":"2024-09-21T08:53:44.487830+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:53:44.487830+0000","last_undegraded":"2024-09-21T08:53:44.487830+0000","last_fullsized":"2024-09-21T08:53:44.487830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225095+0000","last_change":"2024-09-21T08:51:46.152903+0000","last_active":"2024-09-21T08:52:14.225095+0000","last_peered":"2024-09-21T08:52:14.225095+0000","last_clean":"2024-09-21T08:52:14.225095+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:52:14.225095+0000","last_undegraded":"2024-09-21T08:52:14.225095+0000","last_fullsized":"2024-09-21T08:52:14.225095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227463+0000","last_change":"2024-09-21T08:51:48.155963+0000","last_active":"2024-09-21T08:52:14.227463+0000","last_peered":"2024-09-21T08:52:14.227463+0000","last_clean":"2024-09-21T08:52:14.227463+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:52:14.227463+0000","last_undegraded":"2024-09-21T08:52:14.227463+0000","last_fullsized":"2024-09-21T08:52:14.227463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:26.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582875+0000","last_change":"2024-09-21T08:51:40.132727+0000","last_active":"2024-09-21T08:54:46.582875+0000","last_peered":"2024-09-21T08:54:46.582875+0000","last_clean":"2024-09-21T08:54:46.582875+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:54:46.582875+0000","last_undegraded":"2024-09-21T08:54:46.582875+0000","last_fullsized":"2024-09-21T08:54:46.582875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:05.660834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230235+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:52:14.230235+0000","last_peered":"2024-09-21T08:52:14.230235+0000","last_clean":"2024-09-21T08:52:14.230235+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:52:14.230235+0000","last_undegraded":"2024-09-21T08:52:14.230235+0000","last_fullsized":"2024-09-21T08:52:14.230235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:48.192584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230292+0000","last_change":"2024-09-21T08:51:42.142158+0000","last_active":"2024-09-21T08:52:14.230292+0000","last_peered":"2024-09-21T08:52:14.230292+0000","last_clean":"2024-09-21T08:52:14.230292+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:52:14.230292+0000","last_undegraded":"2024-09-21T08:52:14.230292+0000","last_fullsized":"2024-09-21T08:52:14.230292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:52.876334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.489064+0000","last_change":"2024-09-21T08:51:44.146900+0000","last_active":"2024-09-21T08:53:44.489064+0000","last_peered":"2024-09-21T08:53:44.489064+0000","last_clean":"2024-09-21T08:53:44.489064+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:53:44.489064+0000","last_undegraded":"2024-09-21T08:53:44.489064+0000","last_fullsized":"2024-09-21T08:53:44.489064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.326420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224021+0000","last_change":"2024-09-21T08:51:46.154489+0000","last_active":"2024-09-21T08:52:14.224021+0000","last_peered":"2024-09-21T08:52:14.224021+0000","last_clean":"2024-09-21T08:52:14.224021+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:52:14.224021+0000","last_undegraded":"2024-09-21T08:52:14.224021+0000","last_fullsized":"2024-09-21T08:52:14.224021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:28.311454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230785+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:52:14.230785+0000","last_peered":"2024-09-21T08:52:14.230785+0000","last_clean":"2024-09-21T08:52:14.230785+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:52:14.230785+0000","last_undegraded":"2024-09-21T08:52:14.230785+0000","last_fullsized":"2024-09-21T08:52:14.230785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:36:08.427260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602783+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.602783+0000","last_peered":"2024-09-21T08:54:46.602783+0000","last_clean":"2024-09-21T08:54:46.602783+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.602783+0000","last_undegraded":"2024-09-21T08:54:46.602783+0000","last_fullsized":"2024-09-21T08:54:46.602783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:40.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227596+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:52:14.227596+0000","last_peered":"2024-09-21T08:52:14.227596+0000","last_clean":"2024-09-21T08:52:14.227596+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:52:14.227596+0000","last_undegraded":"2024-09-21T08:52:14.227596+0000","last_fullsized":"2024-09-21T08:52:14.227596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:00.290251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229618+0000","last_change":"2024-09-21T08:51:42.137057+0000","last_active":"2024-09-21T08:52:14.229618+0000","last_peered":"2024-09-21T08:52:14.229618+0000","last_clean":"2024-09-21T08:52:14.229618+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:52:14.229618+0000","last_undegraded":"2024-09-21T08:52:14.229618+0000","last_fullsized":"2024-09-21T08:52:14.229618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:17.785662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'27","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.938799+0000","last_change":"2024-09-21T08:51:44.145647+0000","last_active":"2024-09-21T08:53:45.938799+0000","last_peered":"2024-09-21T08:53:45.938799+0000","last_clean":"2024-09-21T08:53:45.938799+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:53:45.938799+0000","last_undegraded":"2024-09-21T08:53:45.938799+0000","last_fullsized":"2024-09-21T08:53:45.938799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:28.199820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224769+0000","last_change":"2024-09-21T08:51:46.154674+0000","last_active":"2024-09-21T08:52:14.224769+0000","last_peered":"2024-09-21T08:52:14.224769+0000","last_clean":"2024-09-21T08:52:14.224769+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:52:14.224769+0000","last_undegraded":"2024-09-21T08:52:14.224769+0000","last_fullsized":"2024-09-21T08:52:14.224769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.520500+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:53:44.520500+0000","last_peered":"2024-09-21T08:53:44.520500+0000","last_clean":"2024-09-21T08:53:44.520500+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:53:44.520500+0000","last_undegraded":"2024-09-21T08:53:44.520500+0000","last_fullsized":"2024-09-21T08:53:44.520500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:36.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.353736+0000","last_change":"2024-09-21T08:51:40.129771+0000","last_active":"2024-09-21T08:53:02.353736+0000","last_peered":"2024-09-21T08:53:02.353736+0000","last_clean":"2024-09-21T08:53:02.353736+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:53:02.353736+0000","last_undegraded":"2024-09-21T08:53:02.353736+0000","last_fullsized":"2024-09-21T08:53:02.353736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:34.355402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227597+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:52:14.227597+0000","last_peered":"2024-09-21T08:52:14.227597+0000","last_clean":"2024-09-21T08:52:14.227597+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:52:14.227597+0000","last_undegraded":"2024-09-21T08:52:14.227597+0000","last_fullsized":"2024-09-21T08:52:14.227597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:11.497380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:43.194165+0000","last_change":"2024-09-21T08:51:42.141642+0000","last_active":"2024-09-21T08:53:43.194165+0000","last_peered":"2024-09-21T08:53:43.194165+0000","last_clean":"2024-09-21T08:53:43.194165+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:53:43.194165+0000","last_undegraded":"2024-09-21T08:53:43.194165+0000","last_fullsized":"2024-09-21T08:53:43.194165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953961+0000","last_change":"2024-09-21T08:51:44.147527+0000","last_active":"2024-09-21T08:54:45.953961+0000","last_peered":"2024-09-21T08:54:45.953961+0000","last_clean":"2024-09-21T08:54:45.953961+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:54:45.953961+0000","last_undegraded":"2024-09-21T08:54:45.953961+0000","last_fullsized":"2024-09-21T08:54:45.953961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:03.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226325+0000","last_change":"2024-09-21T08:51:46.155051+0000","last_active":"2024-09-21T08:52:14.226325+0000","last_peered":"2024-09-21T08:52:14.226325+0000","last_clean":"2024-09-21T08:52:14.226325+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:52:14.226325+0000","last_undegraded":"2024-09-21T08:52:14.226325+0000","last_fullsized":"2024-09-21T08:52:14.226325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.523078+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:53:44.523078+0000","last_peered":"2024-09-21T08:53:44.523078+0000","last_clean":"2024-09-21T08:53:44.523078+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:53:44.523078+0000","last_undegraded":"2024-09-21T08:53:44.523078+0000","last_fullsized":"2024-09-21T08:53:44.523078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:47.237579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.636811+0000","last_change":"2024-09-21T08:51:40.143086+0000","last_active":"2024-09-21T08:52:19.636811+0000","last_peered":"2024-09-21T08:52:19.636811+0000","last_clean":"2024-09-21T08:52:19.636811+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:52:19.636811+0000","last_undegraded":"2024-09-21T08:52:19.636811+0000","last_fullsized":"2024-09-21T08:52:19.636811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:10.757827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781418+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:52:18.781418+0000","last_peered":"2024-09-21T08:52:18.781418+0000","last_clean":"2024-09-21T08:52:18.781418+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:52:18.781418+0000","last_undegraded":"2024-09-21T08:52:18.781418+0000","last_fullsized":"2024-09-21T08:52:18.781418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:16.508900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354678+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:02.354678+0000","last_peered":"2024-09-21T08:53:02.354678+0000","last_clean":"2024-09-21T08:53:02.354678+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:02.354678+0000","last_undegraded":"2024-09-21T08:53:02.354678+0000","last_fullsized":"2024-09-21T08:53:02.354678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.521233+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.521233+0000","last_peered":"2024-09-21T08:54:46.521233+0000","last_clean":"2024-09-21T08:54:46.521233+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.521233+0000","last_undegraded":"2024-09-21T08:54:46.521233+0000","last_fullsized":"2024-09-21T08:54:46.521233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936501+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:45.936501+0000","last_peered":"2024-09-21T08:53:45.936501+0000","last_clean":"2024-09-21T08:53:45.936501+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:45.936501+0000","last_undegraded":"2024-09-21T08:53:45.936501+0000","last_fullsized":"2024-09-21T08:53:45.936501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:44.661851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179857+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:53:45.179857+0000","last_peered":"2024-09-21T08:53:45.179857+0000","last_clean":"2024-09-21T08:53:45.179857+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:53:45.179857+0000","last_undegraded":"2024-09-21T08:53:45.179857+0000","last_fullsized":"2024-09-21T08:53:45.179857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:26.992698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608820+0000","last_change":"2024-09-21T08:51:40.136629+0000","last_active":"2024-09-21T08:54:46.608820+0000","last_peered":"2024-09-21T08:54:46.608820+0000","last_clean":"2024-09-21T08:54:46.608820+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:54:46.608820+0000","last_undegraded":"2024-09-21T08:54:46.608820+0000","last_fullsized":"2024-09-21T08:54:46.608820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:57.025963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602613+0000","last_change":"2024-09-21T08:51:40.130372+0000","last_active":"2024-09-21T08:54:46.602613+0000","last_peered":"2024-09-21T08:54:46.602613+0000","last_clean":"2024-09-21T08:54:46.602613+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:54:46.602613+0000","last_undegraded":"2024-09-21T08:54:46.602613+0000","last_fullsized":"2024-09-21T08:54:46.602613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:32.855034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.880617+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:52:19.880617+0000","last_peered":"2024-09-21T08:52:19.880617+0000","last_clean":"2024-09-21T08:52:19.880617+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:52:19.880617+0000","last_undegraded":"2024-09-21T08:52:19.880617+0000","last_fullsized":"2024-09-21T08:52:19.880617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:53.742244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609556+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609556+0000","last_peered":"2024-09-21T08:54:46.609556+0000","last_clean":"2024-09-21T08:54:46.609556+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609556+0000","last_undegraded":"2024-09-21T08:54:46.609556+0000","last_fullsized":"2024-09-21T08:54:46.609556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:58.432631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227339+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.227339+0000","last_peered":"2024-09-21T08:52:14.227339+0000","last_clean":"2024-09-21T08:52:14.227339+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:52:14.227339+0000","last_undegraded":"2024-09-21T08:52:14.227339+0000","last_fullsized":"2024-09-21T08:52:14.227339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:08.084918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.303531+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:52:19.303531+0000","last_peered":"2024-09-21T08:52:19.303531+0000","last_clean":"2024-09-21T08:52:19.303531+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:52:19.303531+0000","last_undegraded":"2024-09-21T08:52:19.303531+0000","last_fullsized":"2024-09-21T08:52:19.303531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.883350+0000","last_change":"2024-09-21T08:51:38.145888+0000","last_active":"2024-09-21T08:52:19.883350+0000","last_peered":"2024-09-21T08:52:19.883350+0000","last_clean":"2024-09-21T08:52:19.883350+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:52:19.883350+0000","last_undegraded":"2024-09-21T08:52:19.883350+0000","last_fullsized":"2024-09-21T08:52:19.883350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:12.474475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602717+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.602717+0000","last_peered":"2024-09-21T08:54:46.602717+0000","last_clean":"2024-09-21T08:54:46.602717+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.602717+0000","last_undegraded":"2024-09-21T08:54:46.602717+0000","last_fullsized":"2024-09-21T08:54:46.602717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.886383+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:52:19.886383+0000","last_peered":"2024-09-21T08:52:19.886383+0000","last_clean":"2024-09-21T08:52:19.886383+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:52:19.886383+0000","last_undegraded":"2024-09-21T08:52:19.886383+0000","last_fullsized":"2024-09-21T08:52:19.886383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:27.938724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602644+0000","last_change":"2024-09-21T08:51:40.137071+0000","last_active":"2024-09-21T08:54:46.602644+0000","last_peered":"2024-09-21T08:54:46.602644+0000","last_clean":"2024-09-21T08:54:46.602644+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:54:46.602644+0000","last_undegraded":"2024-09-21T08:54:46.602644+0000","last_fullsized":"2024-09-21T08:54:46.602644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.480193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224082+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:52:14.224082+0000","last_peered":"2024-09-21T08:52:14.224082+0000","last_clean":"2024-09-21T08:52:14.224082+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:52:14.224082+0000","last_undegraded":"2024-09-21T08:52:14.224082+0000","last_fullsized":"2024-09-21T08:52:14.224082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:59.614757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609381+0000","last_change":"2024-09-21T08:51:40.140110+0000","last_active":"2024-09-21T08:54:46.609381+0000","last_peered":"2024-09-21T08:54:46.609381+0000","last_clean":"2024-09-21T08:54:46.609381+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:54:46.609381+0000","last_undegraded":"2024-09-21T08:54:46.609381+0000","last_fullsized":"2024-09-21T08:54:46.609381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:55.756332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.515119+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.515119+0000","last_peered":"2024-09-21T08:54:46.515119+0000","last_clean":"2024-09-21T08:54:46.515119+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.515119+0000","last_undegraded":"2024-09-21T08:54:46.515119+0000","last_fullsized":"2024-09-21T08:54:46.515119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578020+0000","last_change":"2024-09-21T08:51:40.129690+0000","last_active":"2024-09-21T08:54:46.578020+0000","last_peered":"2024-09-21T08:54:46.578020+0000","last_clean":"2024-09-21T08:54:46.578020+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:54:46.578020+0000","last_undegraded":"2024-09-21T08:54:46.578020+0000","last_fullsized":"2024-09-21T08:54:46.578020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227220+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:52:14.227220+0000","last_peered":"2024-09-21T08:52:14.227220+0000","last_clean":"2024-09-21T08:52:14.227220+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:52:14.227220+0000","last_undegraded":"2024-09-21T08:52:14.227220+0000","last_fullsized":"2024-09-21T08:52:14.227220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312075+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.312075+0000","last_peered":"2024-09-21T08:54:46.312075+0000","last_clean":"2024-09-21T08:54:46.312075+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.312075+0000","last_undegraded":"2024-09-21T08:54:46.312075+0000","last_fullsized":"2024-09-21T08:54:46.312075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225656+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:52:14.225656+0000","last_peered":"2024-09-21T08:52:14.225656+0000","last_clean":"2024-09-21T08:52:14.225656+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:52:14.225656+0000","last_undegraded":"2024-09-21T08:52:14.225656+0000","last_fullsized":"2024-09-21T08:52:14.225656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:47.826428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'11","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583270+0000","last_change":"2024-09-21T08:51:40.141700+0000","last_active":"2024-09-21T08:54:46.583270+0000","last_peered":"2024-09-21T08:54:46.583270+0000","last_clean":"2024-09-21T08:54:46.583270+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:54:46.583270+0000","last_undegraded":"2024-09-21T08:54:46.583270+0000","last_fullsized":"2024-09-21T08:54:46.583270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:11.312454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229520+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:52:14.229520+0000","last_peered":"2024-09-21T08:52:14.229520+0000","last_clean":"2024-09-21T08:52:14.229520+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:52:14.229520+0000","last_undegraded":"2024-09-21T08:52:14.229520+0000","last_fullsized":"2024-09-21T08:52:14.229520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:10.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228569+0000","last_change":"2024-09-21T08:51:40.137601+0000","last_active":"2024-09-21T08:52:14.228569+0000","last_peered":"2024-09-21T08:52:14.228569+0000","last_clean":"2024-09-21T08:52:14.228569+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:52:14.228569+0000","last_undegraded":"2024-09-21T08:52:14.228569+0000","last_fullsized":"2024-09-21T08:52:14.228569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524736+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.524736+0000","last_peered":"2024-09-21T08:54:46.524736+0000","last_clean":"2024-09-21T08:54:46.524736+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.524736+0000","last_undegraded":"2024-09-21T08:54:46.524736+0000","last_fullsized":"2024-09-21T08:54:46.524736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.740205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.577907+0000","last_change":"2024-09-21T08:51:40.139425+0000","last_active":"2024-09-21T08:54:46.577907+0000","last_peered":"2024-09-21T08:54:46.577907+0000","last_clean":"2024-09-21T08:54:46.577907+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:54:46.577907+0000","last_undegraded":"2024-09-21T08:54:46.577907+0000","last_fullsized":"2024-09-21T08:54:46.577907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.312677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234554+0000","last_change":"2024-09-21T08:51:38.149787+0000","last_active":"2024-09-21T08:52:14.234554+0000","last_peered":"2024-09-21T08:52:14.234554+0000","last_clean":"2024-09-21T08:52:14.234554+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:52:14.234554+0000","last_undegraded":"2024-09-21T08:52:14.234554+0000","last_fullsized":"2024-09-21T08:52:14.234554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:50.908268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:20.354197+0000","last_change":"2024-09-21T08:51:40.139999+0000","last_active":"2024-09-21T08:52:20.354197+0000","last_peered":"2024-09-21T08:52:20.354197+0000","last_clean":"2024-09-21T08:52:20.354197+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:52:20.354197+0000","last_undegraded":"2024-09-21T08:52:20.354197+0000","last_fullsized":"2024-09-21T08:52:20.354197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.888167+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:53:45.888167+0000","last_peered":"2024-09-21T08:53:45.888167+0000","last_clean":"2024-09-21T08:53:45.888167+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:53:45.888167+0000","last_undegraded":"2024-09-21T08:53:45.888167+0000","last_fullsized":"2024-09-21T08:53:45.888167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:58.598806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224454+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.224454+0000","last_peered":"2024-09-21T08:52:14.224454+0000","last_clean":"2024-09-21T08:52:14.224454+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:52:14.224454+0000","last_undegraded":"2024-09-21T08:52:14.224454+0000","last_fullsized":"2024-09-21T08:52:14.224454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:02.905185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399878+0000","last_change":"2024-09-21T08:51:40.136460+0000","last_active":"2024-09-21T08:54:46.399878+0000","last_peered":"2024-09-21T08:54:46.399878+0000","last_clean":"2024-09-21T08:54:46.399878+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:54:46.399878+0000","last_undegraded":"2024-09-21T08:54:46.399878+0000","last_fullsized":"2024-09-21T08:54:46.399878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225460+0000","last_change":"2024-09-21T08:51:38.149631+0000","last_active":"2024-09-21T08:52:14.225460+0000","last_peered":"2024-09-21T08:52:14.225460+0000","last_clean":"2024-09-21T08:52:14.225460+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:52:14.225460+0000","last_undegraded":"2024-09-21T08:52:14.225460+0000","last_fullsized":"2024-09-21T08:52:14.225460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936952+0000","last_change":"2024-09-21T08:51:40.144724+0000","last_active":"2024-09-21T08:53:45.936952+0000","last_peered":"2024-09-21T08:53:45.936952+0000","last_clean":"2024-09-21T08:53:45.936952+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:53:45.936952+0000","last_undegraded":"2024-09-21T08:53:45.936952+0000","last_fullsized":"2024-09-21T08:53:45.936952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44344,"kb_used_data":9000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327496,"statfs":{"total":96636764160,"available":96591355904,"internally_reserved":0,"allocated":9216000,"data_stored":8872727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48948,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322892,"statfs":{"total":96636764160,"available":96586641408,"internally_reserved":0,"allocated":13930496,"data_stored":13653978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":11272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":11542528,"data_stored":11233488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7086080,"data_stored":6775541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:54:53.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:54:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.779+0000 7f4e47267640 1 Processor -- start 2024-09-21T08:54:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.779+0000 7f4e47267640 1 -- start start 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e47267640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e4012e940 0x7f4e40130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e47267640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4006eba0 con 0x7f4e4006eda0 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e47267640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4006d2f0 con 0x7f4e4012e940 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e45003640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4e4006eda0 0x7f4e4006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41994/0 (socket says 172.21.15.29:41994) 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e45003640 1 -- 172.21.15.29:0/75341542 learned_addr learned my addr 172.21.15.29:0/75341542 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e44802640 1 --2- 172.21.15.29:0/75341542 >> v2:172.21.15.29:3300/0 conn(0x7f4e4012e940 0x7f4e40130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e37fff640 1 -- 172.21.15.29:0/75341542 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10231561 0 0) 0x7f4e4006eba0 con 0x7f4e4006eda0 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e37fff640 1 -- 172.21.15.29:0/75341542 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e2c003520 con 0x7f4e4006eda0 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e44802640 1 -- 172.21.15.29:0/75341542 >> v1:172.21.15.29:6789/0 conn(0x7f4e4006eda0 legacy=0x7f4e4006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.780+0000 7f4e44802640 1 -- 172.21.15.29:0/75341542 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e40070d50 con 0x7f4e4012e940 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.781+0000 7f4e44802640 1 --2- 172.21.15.29:0/75341542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4012e940 0x7f4e40130d30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009720 tx=0x7f4e3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b932730a599803b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.781+0000 7f4e37fff640 1 -- 172.21.15.29:0/75341542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30037070 con 0x7f4e4012e940 2024-09-21T08:54:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.781+0000 7f4e37fff640 1 -- 172.21.15.29:0/75341542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3002ae20 con 0x7f4e4012e940 2024-09-21T08:54:53.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.781+0000 7f4e37fff640 1 -- 172.21.15.29:0/75341542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30032590 con 0x7f4e4012e940 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 -- 172.21.15.29:0/75341542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4012e940 msgr2=0x7f4e40130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 --2- 172.21.15.29:0/75341542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4012e940 0x7f4e40130d30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009720 tx=0x7f4e3002a1a0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 -- 172.21.15.29:0/75341542 shutdown_connections 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 --2- 172.21.15.29:0/75341542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4012e940 0x7f4e40130d30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 -- 172.21.15.29:0/75341542 >> 172.21.15.29:0/75341542 conn(0x7f4e4009a890 msgr2=0x7f4e4009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 -- 172.21.15.29:0/75341542 shutdown_connections 2024-09-21T08:54:53.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.782+0000 7f4e47267640 1 -- 172.21.15.29:0/75341542 wait complete. 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e47267640 1 Processor -- start 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e47267640 1 -- start start 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e47267640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e47267640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4006fcd0 con 0x7f4e4006eda0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e45003640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e45003640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35304/0 (socket says 172.21.15.29:35304) 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e45003640 1 -- 172.21.15.29:0/2780371651 learned_addr learned my addr 172.21.15.29:0/2780371651 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.783+0000 7f4e45003640 1 -- 172.21.15.29:0/2780371651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e401289d0 con 0x7f4e4006eda0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e45003640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c480 tx=0x7f4e3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e4006eda0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c005c10 con 0x7f4e4006eda0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c007070 con 0x7f4e4006eda0 2024-09-21T08:54:53.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e40124b70 con 0x7f4e4006eda0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.784+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401286c0 con 0x7f4e4006eda0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.785+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e3c01a070 con 0x7f4e4006eda0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.785+0000 7f4e35ffb640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 0x7f4e2403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.785+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4006f180 con 0x7f4e4006eda0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.785+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4e3c04b070 con 0x7f4e4006eda0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.785+0000 7f4e44802640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 0x7f4e2403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:53.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.786+0000 7f4e44802640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 0x7f4e2403a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e30034000 tx=0x7f4e3002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:53.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.790+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4e3c01a790 con 0x7f4e4006eda0 2024-09-21T08:54:53.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.962+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e4006bba0 con 0x7f4e240382a0 2024-09-21T08:54:53.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.976+0000 7f4e35ffb640 1 -- 172.21.15.29:0/2780371651 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665816 (secure 0 0 0) 0x7f4e4006bba0 con 0x7f4e240382a0 2024-09-21T08:54:53.988 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:54:53.993 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:54:53.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 msgr2=0x7f4e2403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 0x7f4e2403a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e30034000 tx=0x7f4e3002e000 comp rx=0 tx=0).stop 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 msgr2=0x7f4e40096070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c480 tx=0x7f4e3c00c940 comp rx=0 tx=0).stop 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 shutdown_connections 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4e240382a0 0x7f4e2403a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 --2- 172.21.15.29:0/2780371651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e4006eda0 0x7f4e40096070 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 >> 172.21.15.29:0/2780371651 conn(0x7f4e4009a890 msgr2=0x7f4e4009ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 shutdown_connections 2024-09-21T08:54:53.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:53.981+0000 7f4e47267640 1 -- 172.21.15.29:0/2780371651 wait complete. 2024-09-21T08:54:53.997 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-21T08:54:53.211270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4882,"num_read_kb":4459,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173852,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313508,"statfs":{"total":386547056640,"available":386369032192,"internally_reserved":0,"allocated":41775104,"data_stored":40535734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003859"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231353+0000","last_change":"2024-09-21T08:51:38.149131+0000","last_active":"2024-09-21T08:52:14.231353+0000","last_peered":"2024-09-21T08:52:14.231353+0000","last_clean":"2024-09-21T08:52:14.231353+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:52:14.231353+0000","last_undegraded":"2024-09-21T08:52:14.231353+0000","last_fullsized":"2024-09-21T08:52:14.231353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:33.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400047+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.400047+0000","last_peered":"2024-09-21T08:54:46.400047+0000","last_clean":"2024-09-21T08:54:46.400047+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.400047+0000","last_undegraded":"2024-09-21T08:54:46.400047+0000","last_fullsized":"2024-09-21T08:54:46.400047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227696+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:52:14.227696+0000","last_peered":"2024-09-21T08:52:14.227696+0000","last_clean":"2024-09-21T08:52:14.227696+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:52:14.227696+0000","last_undegraded":"2024-09-21T08:52:14.227696+0000","last_fullsized":"2024-09-21T08:52:14.227696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:44:26.727846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535392+0000","last_change":"2024-09-21T08:51:40.136089+0000","last_active":"2024-09-21T08:54:46.535392+0000","last_peered":"2024-09-21T08:54:46.535392+0000","last_clean":"2024-09-21T08:54:46.535392+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:54:46.535392+0000","last_undegraded":"2024-09-21T08:54:46.535392+0000","last_fullsized":"2024-09-21T08:54:46.535392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:42.691157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781340+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:52:18.781340+0000","last_peered":"2024-09-21T08:52:18.781340+0000","last_clean":"2024-09-21T08:52:18.781340+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:52:18.781340+0000","last_undegraded":"2024-09-21T08:52:18.781340+0000","last_fullsized":"2024-09-21T08:52:18.781340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:41.267539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.239510+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:52:14.239510+0000","last_peered":"2024-09-21T08:52:14.239510+0000","last_clean":"2024-09-21T08:52:14.239510+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:52:14.239510+0000","last_undegraded":"2024-09-21T08:52:14.239510+0000","last_fullsized":"2024-09-21T08:52:14.239510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.787607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231201+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:52:14.231201+0000","last_peered":"2024-09-21T08:52:14.231201+0000","last_clean":"2024-09-21T08:52:14.231201+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:52:14.231201+0000","last_undegraded":"2024-09-21T08:52:14.231201+0000","last_fullsized":"2024-09-21T08:52:14.231201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:09.428425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183972+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:10.183972+0000","last_peered":"2024-09-21T08:54:10.183972+0000","last_clean":"2024-09-21T08:54:10.183972+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:10.183972+0000","last_undegraded":"2024-09-21T08:54:10.183972+0000","last_fullsized":"2024-09-21T08:54:10.183972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:10.655450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.738181+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:53:45.738181+0000","last_peered":"2024-09-21T08:53:45.738181+0000","last_clean":"2024-09-21T08:53:45.738181+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:53:45.738181+0000","last_undegraded":"2024-09-21T08:53:45.738181+0000","last_fullsized":"2024-09-21T08:53:45.738181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:27.599255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898400+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:52:19.898400+0000","last_peered":"2024-09-21T08:52:19.898400+0000","last_clean":"2024-09-21T08:52:19.898400+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:52:19.898400+0000","last_undegraded":"2024-09-21T08:52:19.898400+0000","last_fullsized":"2024-09-21T08:52:19.898400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:22.144849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227886+0000","last_change":"2024-09-21T08:51:38.149505+0000","last_active":"2024-09-21T08:52:14.227886+0000","last_peered":"2024-09-21T08:52:14.227886+0000","last_clean":"2024-09-21T08:52:14.227886+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:52:14.227886+0000","last_undegraded":"2024-09-21T08:52:14.227886+0000","last_fullsized":"2024-09-21T08:52:14.227886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.592638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399870+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.399870+0000","last_peered":"2024-09-21T08:54:46.399870+0000","last_clean":"2024-09-21T08:54:46.399870+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.399870+0000","last_undegraded":"2024-09-21T08:54:46.399870+0000","last_fullsized":"2024-09-21T08:54:46.399870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:31.174220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225068+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:52:14.225068+0000","last_peered":"2024-09-21T08:52:14.225068+0000","last_clean":"2024-09-21T08:52:14.225068+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:52:14.225068+0000","last_undegraded":"2024-09-21T08:52:14.225068+0000","last_fullsized":"2024-09-21T08:52:14.225068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:38.320272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354111+0000","last_change":"2024-09-21T08:51:40.136615+0000","last_active":"2024-09-21T08:53:02.354111+0000","last_peered":"2024-09-21T08:53:02.354111+0000","last_clean":"2024-09-21T08:53:02.354111+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:53:02.354111+0000","last_undegraded":"2024-09-21T08:53:02.354111+0000","last_fullsized":"2024-09-21T08:53:02.354111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:01.638135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225452+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:52:14.225452+0000","last_peered":"2024-09-21T08:52:14.225452+0000","last_clean":"2024-09-21T08:52:14.225452+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:52:14.225452+0000","last_undegraded":"2024-09-21T08:52:14.225452+0000","last_fullsized":"2024-09-21T08:52:14.225452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399104+0000","last_change":"2024-09-21T08:51:40.139948+0000","last_active":"2024-09-21T08:54:46.399104+0000","last_peered":"2024-09-21T08:54:46.399104+0000","last_clean":"2024-09-21T08:54:46.399104+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:54:46.399104+0000","last_undegraded":"2024-09-21T08:54:46.399104+0000","last_fullsized":"2024-09-21T08:54:46.399104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:46.303446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182197+0000","last_change":"2024-09-21T08:51:40.135605+0000","last_active":"2024-09-21T08:54:00.182197+0000","last_peered":"2024-09-21T08:54:00.182197+0000","last_clean":"2024-09-21T08:54:00.182197+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:54:00.182197+0000","last_undegraded":"2024-09-21T08:54:00.182197+0000","last_fullsized":"2024-09-21T08:54:00.182197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:18.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227228+0000","last_change":"2024-09-21T08:51:38.140312+0000","last_active":"2024-09-21T08:52:14.227228+0000","last_peered":"2024-09-21T08:52:14.227228+0000","last_clean":"2024-09-21T08:52:14.227228+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:52:14.227228+0000","last_undegraded":"2024-09-21T08:52:14.227228+0000","last_fullsized":"2024-09-21T08:52:14.227228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:02.069891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936352+0000","last_change":"2024-09-21T08:51:40.137259+0000","last_active":"2024-09-21T08:53:45.936352+0000","last_peered":"2024-09-21T08:53:45.936352+0000","last_clean":"2024-09-21T08:53:45.936352+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:53:45.936352+0000","last_undegraded":"2024-09-21T08:53:45.936352+0000","last_fullsized":"2024-09-21T08:53:45.936352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.598144+0000","last_change":"2024-09-21T08:51:38.150225+0000","last_active":"2024-09-21T08:54:46.598144+0000","last_peered":"2024-09-21T08:54:46.598144+0000","last_clean":"2024-09-21T08:54:46.598144+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:54:46.598144+0000","last_undegraded":"2024-09-21T08:54:46.598144+0000","last_fullsized":"2024-09-21T08:54:46.598144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:58.948956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":21,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399793+0000","last_change":"2024-09-21T08:51:40.135404+0000","last_active":"2024-09-21T08:54:46.399793+0000","last_peered":"2024-09-21T08:54:46.399793+0000","last_clean":"2024-09-21T08:54:46.399793+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:54:46.399793+0000","last_undegraded":"2024-09-21T08:54:46.399793+0000","last_fullsized":"2024-09-21T08:54:46.399793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.913626+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:53:45.913626+0000","last_peered":"2024-09-21T08:53:45.913626+0000","last_clean":"2024-09-21T08:53:45.913626+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:53:45.913626+0000","last_undegraded":"2024-09-21T08:53:45.913626+0000","last_fullsized":"2024-09-21T08:53:45.913626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.085254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583271+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583271+0000","last_peered":"2024-09-21T08:54:46.583271+0000","last_clean":"2024-09-21T08:54:46.583271+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583271+0000","last_undegraded":"2024-09-21T08:54:46.583271+0000","last_fullsized":"2024-09-21T08:54:46.583271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229015+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:52:14.229015+0000","last_peered":"2024-09-21T08:52:14.229015+0000","last_clean":"2024-09-21T08:52:14.229015+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:52:14.229015+0000","last_undegraded":"2024-09-21T08:52:14.229015+0000","last_fullsized":"2024-09-21T08:52:14.229015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:48.757416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231605+0000","last_change":"2024-09-21T08:51:40.143862+0000","last_active":"2024-09-21T08:52:14.231605+0000","last_peered":"2024-09-21T08:52:14.231605+0000","last_clean":"2024-09-21T08:52:14.231605+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:52:14.231605+0000","last_undegraded":"2024-09-21T08:52:14.231605+0000","last_fullsized":"2024-09-21T08:52:14.231605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:22.460199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227756+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:52:14.227756+0000","last_peered":"2024-09-21T08:52:14.227756+0000","last_clean":"2024-09-21T08:52:14.227756+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:52:14.227756+0000","last_undegraded":"2024-09-21T08:52:14.227756+0000","last_fullsized":"2024-09-21T08:52:14.227756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:16.521067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182622+0000","last_change":"2024-09-21T08:51:40.138654+0000","last_active":"2024-09-21T08:54:05.182622+0000","last_peered":"2024-09-21T08:54:05.182622+0000","last_clean":"2024-09-21T08:54:05.182622+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:54:05.182622+0000","last_undegraded":"2024-09-21T08:54:05.182622+0000","last_fullsized":"2024-09-21T08:54:05.182622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:10.717027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225664+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:52:14.225664+0000","last_peered":"2024-09-21T08:52:14.225664+0000","last_clean":"2024-09-21T08:52:14.225664+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:52:14.225664+0000","last_undegraded":"2024-09-21T08:52:14.225664+0000","last_fullsized":"2024-09-21T08:52:14.225664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:29.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.584533+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.584533+0000","last_peered":"2024-09-21T08:54:46.584533+0000","last_clean":"2024-09-21T08:54:46.584533+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.584533+0000","last_undegraded":"2024-09-21T08:54:46.584533+0000","last_fullsized":"2024-09-21T08:54:46.584533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:48.958880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.169984+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:53:02.169984+0000","last_peered":"2024-09-21T08:53:02.169984+0000","last_clean":"2024-09-21T08:53:02.169984+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:53:02.169984+0000","last_undegraded":"2024-09-21T08:53:02.169984+0000","last_fullsized":"2024-09-21T08:53:02.169984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227035+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:52:14.227035+0000","last_peered":"2024-09-21T08:52:14.227035+0000","last_clean":"2024-09-21T08:52:14.227035+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:52:14.227035+0000","last_undegraded":"2024-09-21T08:52:14.227035+0000","last_fullsized":"2024-09-21T08:52:14.227035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:20.030105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.139486+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:58.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'35","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.545112+0000","last_change":"2024-09-21T08:51:44.149044+0000","last_active":"2024-09-21T08:54:46.545112+0000","last_peered":"2024-09-21T08:54:46.545112+0000","last_clean":"2024-09-21T08:54:46.545112+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:54:46.545112+0000","last_undegraded":"2024-09-21T08:54:46.545112+0000","last_fullsized":"2024-09-21T08:54:46.545112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:16.675629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227130+0000","last_change":"2024-09-21T08:51:46.152252+0000","last_active":"2024-09-21T08:52:14.227130+0000","last_peered":"2024-09-21T08:52:14.227130+0000","last_clean":"2024-09-21T08:52:14.227130+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:52:14.227130+0000","last_undegraded":"2024-09-21T08:52:14.227130+0000","last_fullsized":"2024-09-21T08:52:14.227130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.176311+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:53:02.176311+0000","last_peered":"2024-09-21T08:53:02.176311+0000","last_clean":"2024-09-21T08:53:02.176311+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:53:02.176311+0000","last_undegraded":"2024-09-21T08:53:02.176311+0000","last_fullsized":"2024-09-21T08:53:02.176311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:29.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534995+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.534995+0000","last_peered":"2024-09-21T08:54:46.534995+0000","last_clean":"2024-09-21T08:54:46.534995+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.534995+0000","last_undegraded":"2024-09-21T08:54:46.534995+0000","last_fullsized":"2024-09-21T08:54:46.534995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:42.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181680+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:00.181680+0000","last_peered":"2024-09-21T08:54:00.181680+0000","last_clean":"2024-09-21T08:54:00.181680+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:00.181680+0000","last_undegraded":"2024-09-21T08:54:00.181680+0000","last_fullsized":"2024-09-21T08:54:00.181680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:05.633192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.545682+0000","last_change":"2024-09-21T08:51:42.139320+0000","last_active":"2024-09-21T08:53:45.545682+0000","last_peered":"2024-09-21T08:53:45.545682+0000","last_clean":"2024-09-21T08:53:45.545682+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:53:45.545682+0000","last_undegraded":"2024-09-21T08:53:45.545682+0000","last_fullsized":"2024-09-21T08:53:45.545682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:43.645980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226057+0000","last_change":"2024-09-21T08:51:44.146522+0000","last_active":"2024-09-21T08:52:14.226057+0000","last_peered":"2024-09-21T08:52:14.226057+0000","last_clean":"2024-09-21T08:52:14.226057+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:52:14.226057+0000","last_undegraded":"2024-09-21T08:52:14.226057+0000","last_fullsized":"2024-09-21T08:52:14.226057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:14.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225937+0000","last_change":"2024-09-21T08:51:46.157301+0000","last_active":"2024-09-21T08:52:14.225937+0000","last_peered":"2024-09-21T08:52:14.225937+0000","last_clean":"2024-09-21T08:52:14.225937+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:52:14.225937+0000","last_undegraded":"2024-09-21T08:52:14.225937+0000","last_fullsized":"2024-09-21T08:52:14.225937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225151+0000","last_change":"2024-09-21T08:51:48.154173+0000","last_active":"2024-09-21T08:52:14.225151+0000","last_peered":"2024-09-21T08:52:14.225151+0000","last_clean":"2024-09-21T08:52:14.225151+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:52:14.225151+0000","last_undegraded":"2024-09-21T08:52:14.225151+0000","last_fullsized":"2024-09-21T08:52:14.225151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:16:14.347576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535149+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.535149+0000","last_peered":"2024-09-21T08:54:46.535149+0000","last_clean":"2024-09-21T08:54:46.535149+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.535149+0000","last_undegraded":"2024-09-21T08:54:46.535149+0000","last_fullsized":"2024-09-21T08:54:46.535149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:36.705710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224381+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:52:14.224381+0000","last_peered":"2024-09-21T08:52:14.224381+0000","last_clean":"2024-09-21T08:52:14.224381+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:52:14.224381+0000","last_undegraded":"2024-09-21T08:52:14.224381+0000","last_fullsized":"2024-09-21T08:52:14.224381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:09.304434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227963+0000","last_change":"2024-09-21T08:51:42.137023+0000","last_active":"2024-09-21T08:52:14.227963+0000","last_peered":"2024-09-21T08:52:14.227963+0000","last_clean":"2024-09-21T08:52:14.227963+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:52:14.227963+0000","last_undegraded":"2024-09-21T08:52:14.227963+0000","last_fullsized":"2024-09-21T08:52:14.227963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232114+0000","last_change":"2024-09-21T08:51:44.151497+0000","last_active":"2024-09-21T08:52:14.232114+0000","last_peered":"2024-09-21T08:52:14.232114+0000","last_clean":"2024-09-21T08:52:14.232114+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:52:14.232114+0000","last_undegraded":"2024-09-21T08:52:14.232114+0000","last_fullsized":"2024-09-21T08:52:14.232114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:34.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708968+0000","last_change":"2024-09-21T08:51:46.158108+0000","last_active":"2024-09-21T08:54:46.708968+0000","last_peered":"2024-09-21T08:54:46.708968+0000","last_clean":"2024-09-21T08:54:46.708968+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:54:46.708968+0000","last_undegraded":"2024-09-21T08:54:46.708968+0000","last_fullsized":"2024-09-21T08:54:46.708968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.241076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.638227+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:52:19.638227+0000","last_peered":"2024-09-21T08:52:19.638227+0000","last_clean":"2024-09-21T08:52:19.638227+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:52:19.638227+0000","last_undegraded":"2024-09-21T08:52:19.638227+0000","last_fullsized":"2024-09-21T08:52:19.638227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.204645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310855+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.310855+0000","last_peered":"2024-09-21T08:54:46.310855+0000","last_clean":"2024-09-21T08:54:46.310855+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.310855+0000","last_undegraded":"2024-09-21T08:54:46.310855+0000","last_fullsized":"2024-09-21T08:54:46.310855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.889090+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:52:19.889090+0000","last_peered":"2024-09-21T08:52:19.889090+0000","last_clean":"2024-09-21T08:52:19.889090+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:52:19.889090+0000","last_undegraded":"2024-09-21T08:52:19.889090+0000","last_fullsized":"2024-09-21T08:52:19.889090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231441+0000","last_change":"2024-09-21T08:51:42.136387+0000","last_active":"2024-09-21T08:52:14.231441+0000","last_peered":"2024-09-21T08:52:14.231441+0000","last_clean":"2024-09-21T08:52:14.231441+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:52:14.231441+0000","last_undegraded":"2024-09-21T08:52:14.231441+0000","last_fullsized":"2024-09-21T08:52:14.231441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:42.938313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.499787+0000","last_change":"2024-09-21T08:51:44.151655+0000","last_active":"2024-09-21T08:53:44.499787+0000","last_peered":"2024-09-21T08:53:44.499787+0000","last_clean":"2024-09-21T08:53:44.499787+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:53:44.499787+0000","last_undegraded":"2024-09-21T08:53:44.499787+0000","last_fullsized":"2024-09-21T08:53:44.499787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.388478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.605742+0000","last_change":"2024-09-21T08:51:46.154154+0000","last_active":"2024-09-21T08:54:46.605742+0000","last_peered":"2024-09-21T08:54:46.605742+0000","last_clean":"2024-09-21T08:54:46.605742+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:46.605742+0000","last_undegraded":"2024-09-21T08:54:46.605742+0000","last_fullsized":"2024-09-21T08:54:46.605742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.824819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534945+0000","last_change":"2024-09-21T08:51:40.141892+0000","last_active":"2024-09-21T08:54:46.534945+0000","last_peered":"2024-09-21T08:54:46.534945+0000","last_clean":"2024-09-21T08:54:46.534945+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:54:46.534945+0000","last_undegraded":"2024-09-21T08:54:46.534945+0000","last_fullsized":"2024-09-21T08:54:46.534945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:15.778333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231615+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:52:14.231615+0000","last_peered":"2024-09-21T08:52:14.231615+0000","last_clean":"2024-09-21T08:52:14.231615+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:52:14.231615+0000","last_undegraded":"2024-09-21T08:52:14.231615+0000","last_fullsized":"2024-09-21T08:52:14.231615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227856+0000","last_change":"2024-09-21T08:51:42.139818+0000","last_active":"2024-09-21T08:52:14.227856+0000","last_peered":"2024-09-21T08:52:14.227856+0000","last_clean":"2024-09-21T08:52:14.227856+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:52:14.227856+0000","last_undegraded":"2024-09-21T08:52:14.227856+0000","last_fullsized":"2024-09-21T08:52:14.227856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.508478+0000","last_change":"2024-09-21T08:51:44.148564+0000","last_active":"2024-09-21T08:53:44.508478+0000","last_peered":"2024-09-21T08:53:44.508478+0000","last_clean":"2024-09-21T08:53:44.508478+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:53:44.508478+0000","last_undegraded":"2024-09-21T08:53:44.508478+0000","last_fullsized":"2024-09-21T08:53:44.508478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:46.255459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227433+0000","last_change":"2024-09-21T08:51:46.157947+0000","last_active":"2024-09-21T08:52:14.227433+0000","last_peered":"2024-09-21T08:52:14.227433+0000","last_clean":"2024-09-21T08:52:14.227433+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:52:14.227433+0000","last_undegraded":"2024-09-21T08:52:14.227433+0000","last_fullsized":"2024-09-21T08:52:14.227433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:02.289163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.178600+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:02.178600+0000","last_peered":"2024-09-21T08:53:02.178600+0000","last_clean":"2024-09-21T08:53:02.178600+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:02.178600+0000","last_undegraded":"2024-09-21T08:53:02.178600+0000","last_fullsized":"2024-09-21T08:53:02.178600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:09.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400040+0000","last_change":"2024-09-21T08:51:40.128515+0000","last_active":"2024-09-21T08:54:46.400040+0000","last_peered":"2024-09-21T08:54:46.400040+0000","last_clean":"2024-09-21T08:54:46.400040+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:54:46.400040+0000","last_undegraded":"2024-09-21T08:54:46.400040+0000","last_fullsized":"2024-09-21T08:54:46.400040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.233575+0000","last_change":"2024-09-21T08:51:38.148403+0000","last_active":"2024-09-21T08:52:14.233575+0000","last_peered":"2024-09-21T08:52:14.233575+0000","last_clean":"2024-09-21T08:52:14.233575+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:52:14.233575+0000","last_undegraded":"2024-09-21T08:52:14.233575+0000","last_fullsized":"2024-09-21T08:52:14.233575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.872881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225711+0000","last_change":"2024-09-21T08:51:42.135619+0000","last_active":"2024-09-21T08:52:14.225711+0000","last_peered":"2024-09-21T08:52:14.225711+0000","last_clean":"2024-09-21T08:52:14.225711+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:52:14.225711+0000","last_undegraded":"2024-09-21T08:52:14.225711+0000","last_fullsized":"2024-09-21T08:52:14.225711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.062622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.490003+0000","last_change":"2024-09-21T08:51:44.144706+0000","last_active":"2024-09-21T08:53:44.490003+0000","last_peered":"2024-09-21T08:53:44.490003+0000","last_clean":"2024-09-21T08:53:44.490003+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:53:44.490003+0000","last_undegraded":"2024-09-21T08:53:44.490003+0000","last_fullsized":"2024-09-21T08:53:44.490003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:07.374743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225286+0000","last_change":"2024-09-21T08:51:46.152912+0000","last_active":"2024-09-21T08:52:14.225286+0000","last_peered":"2024-09-21T08:52:14.225286+0000","last_clean":"2024-09-21T08:52:14.225286+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:52:14.225286+0000","last_undegraded":"2024-09-21T08:52:14.225286+0000","last_fullsized":"2024-09-21T08:52:14.225286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:56.616218+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:52:56.616218+0000","last_peered":"2024-09-21T08:52:56.616218+0000","last_clean":"2024-09-21T08:52:56.616218+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:52:56.616218+0000","last_undegraded":"2024-09-21T08:52:56.616218+0000","last_fullsized":"2024-09-21T08:52:56.616218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:53.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310377+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.310377+0000","last_peered":"2024-09-21T08:54:46.310377+0000","last_clean":"2024-09-21T08:54:46.310377+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.310377+0000","last_undegraded":"2024-09-21T08:54:46.310377+0000","last_fullsized":"2024-09-21T08:54:46.310377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:09.036028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230727+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:52:14.230727+0000","last_peered":"2024-09-21T08:52:14.230727+0000","last_clean":"2024-09-21T08:52:14.230727+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:52:14.230727+0000","last_undegraded":"2024-09-21T08:52:14.230727+0000","last_fullsized":"2024-09-21T08:52:14.230727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:31.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228487+0000","last_change":"2024-09-21T08:51:42.137342+0000","last_active":"2024-09-21T08:52:14.228487+0000","last_peered":"2024-09-21T08:52:14.228487+0000","last_clean":"2024-09-21T08:52:14.228487+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:52:14.228487+0000","last_undegraded":"2024-09-21T08:52:14.228487+0000","last_fullsized":"2024-09-21T08:52:14.228487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.510274+0000","last_change":"2024-09-21T08:51:44.145486+0000","last_active":"2024-09-21T08:53:44.510274+0000","last_peered":"2024-09-21T08:53:44.510274+0000","last_clean":"2024-09-21T08:53:44.510274+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:53:44.510274+0000","last_undegraded":"2024-09-21T08:53:44.510274+0000","last_fullsized":"2024-09-21T08:53:44.510274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:45.211269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.718054+0000","last_change":"2024-09-21T08:51:46.153164+0000","last_active":"2024-09-21T08:54:46.718054+0000","last_peered":"2024-09-21T08:54:46.718054+0000","last_clean":"2024-09-21T08:54:46.718054+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:46.718054+0000","last_undegraded":"2024-09-21T08:54:46.718054+0000","last_fullsized":"2024-09-21T08:54:46.718054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:25.619586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226871+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:52:14.226871+0000","last_peered":"2024-09-21T08:52:14.226871+0000","last_clean":"2024-09-21T08:52:14.226871+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:52:14.226871+0000","last_undegraded":"2024-09-21T08:52:14.226871+0000","last_fullsized":"2024-09-21T08:52:14.226871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:41.262657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608904+0000","last_change":"2024-09-21T08:51:40.133810+0000","last_active":"2024-09-21T08:54:46.608904+0000","last_peered":"2024-09-21T08:54:46.608904+0000","last_clean":"2024-09-21T08:54:46.608904+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:54:46.608904+0000","last_undegraded":"2024-09-21T08:54:46.608904+0000","last_fullsized":"2024-09-21T08:54:46.608904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.992615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228858+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:52:14.228858+0000","last_peered":"2024-09-21T08:52:14.228858+0000","last_clean":"2024-09-21T08:52:14.228858+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:52:14.228858+0000","last_undegraded":"2024-09-21T08:52:14.228858+0000","last_fullsized":"2024-09-21T08:52:14.228858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:07.067511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226360+0000","last_change":"2024-09-21T08:51:42.136459+0000","last_active":"2024-09-21T08:52:14.226360+0000","last_peered":"2024-09-21T08:52:14.226360+0000","last_clean":"2024-09-21T08:52:14.226360+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:52:14.226360+0000","last_undegraded":"2024-09-21T08:52:14.226360+0000","last_fullsized":"2024-09-21T08:52:14.226360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.652788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.512066+0000","last_change":"2024-09-21T08:51:44.146420+0000","last_active":"2024-09-21T08:53:44.512066+0000","last_peered":"2024-09-21T08:53:44.512066+0000","last_clean":"2024-09-21T08:53:44.512066+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:53:44.512066+0000","last_undegraded":"2024-09-21T08:53:44.512066+0000","last_fullsized":"2024-09-21T08:53:44.512066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:16.779029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225340+0000","last_change":"2024-09-21T08:51:46.154347+0000","last_active":"2024-09-21T08:52:14.225340+0000","last_peered":"2024-09-21T08:52:14.225340+0000","last_clean":"2024-09-21T08:52:14.225340+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:52:14.225340+0000","last_undegraded":"2024-09-21T08:52:14.225340+0000","last_fullsized":"2024-09-21T08:52:14.225340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695069+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.695069+0000","last_peered":"2024-09-21T08:54:46.695069+0000","last_clean":"2024-09-21T08:54:46.695069+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.695069+0000","last_undegraded":"2024-09-21T08:54:46.695069+0000","last_fullsized":"2024-09-21T08:54:46.695069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:50.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.237306+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:52:14.237306+0000","last_peered":"2024-09-21T08:52:14.237306+0000","last_clean":"2024-09-21T08:52:14.237306+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:52:14.237306+0000","last_undegraded":"2024-09-21T08:52:14.237306+0000","last_fullsized":"2024-09-21T08:52:14.237306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:33.234761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226839+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:52:14.226839+0000","last_peered":"2024-09-21T08:52:14.226839+0000","last_clean":"2024-09-21T08:52:14.226839+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:52:14.226839+0000","last_undegraded":"2024-09-21T08:52:14.226839+0000","last_fullsized":"2024-09-21T08:52:14.226839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:31.835091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232438+0000","last_change":"2024-09-21T08:51:42.142191+0000","last_active":"2024-09-21T08:52:14.232438+0000","last_peered":"2024-09-21T08:52:14.232438+0000","last_clean":"2024-09-21T08:52:14.232438+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:52:14.232438+0000","last_undegraded":"2024-09-21T08:52:14.232438+0000","last_fullsized":"2024-09-21T08:52:14.232438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:06.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.494067+0000","last_change":"2024-09-21T08:51:44.146281+0000","last_active":"2024-09-21T08:53:44.494067+0000","last_peered":"2024-09-21T08:53:44.494067+0000","last_clean":"2024-09-21T08:53:44.494067+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:53:44.494067+0000","last_undegraded":"2024-09-21T08:53:44.494067+0000","last_fullsized":"2024-09-21T08:53:44.494067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231318+0000","last_change":"2024-09-21T08:51:46.150884+0000","last_active":"2024-09-21T08:52:14.231318+0000","last_peered":"2024-09-21T08:52:14.231318+0000","last_clean":"2024-09-21T08:52:14.231318+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:52:14.231318+0000","last_undegraded":"2024-09-21T08:52:14.231318+0000","last_fullsized":"2024-09-21T08:52:14.231318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:48.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180503+0000","last_change":"2024-09-21T08:51:48.161107+0000","last_active":"2024-09-21T08:53:50.180503+0000","last_peered":"2024-09-21T08:53:50.180503+0000","last_clean":"2024-09-21T08:53:50.180503+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:53:50.180503+0000","last_undegraded":"2024-09-21T08:53:50.180503+0000","last_fullsized":"2024-09-21T08:53:50.180503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:05.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.311433+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:46.311433+0000","last_peered":"2024-09-21T08:54:46.311433+0000","last_clean":"2024-09-21T08:54:46.311433+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:54:46.311433+0000","last_undegraded":"2024-09-21T08:54:46.311433+0000","last_fullsized":"2024-09-21T08:54:46.311433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:28.560398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226315+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:52:14.226315+0000","last_peered":"2024-09-21T08:52:14.226315+0000","last_clean":"2024-09-21T08:52:14.226315+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:52:14.226315+0000","last_undegraded":"2024-09-21T08:52:14.226315+0000","last_fullsized":"2024-09-21T08:52:14.226315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:24.009059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226056+0000","last_change":"2024-09-21T08:51:42.136842+0000","last_active":"2024-09-21T08:52:14.226056+0000","last_peered":"2024-09-21T08:52:14.226056+0000","last_clean":"2024-09-21T08:52:14.226056+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:52:14.226056+0000","last_undegraded":"2024-09-21T08:52:14.226056+0000","last_fullsized":"2024-09-21T08:52:14.226056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.518204+0000","last_change":"2024-09-21T08:51:44.145728+0000","last_active":"2024-09-21T08:53:44.518204+0000","last_peered":"2024-09-21T08:53:44.518204+0000","last_clean":"2024-09-21T08:53:44.518204+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:53:44.518204+0000","last_undegraded":"2024-09-21T08:53:44.518204+0000","last_fullsized":"2024-09-21T08:53:44.518204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:30.360384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":402,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.699230+0000","last_change":"2024-09-21T08:51:46.156417+0000","last_active":"2024-09-21T08:54:46.699230+0000","last_peered":"2024-09-21T08:54:46.699230+0000","last_clean":"2024-09-21T08:54:46.699230+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:46.699230+0000","last_undegraded":"2024-09-21T08:54:46.699230+0000","last_fullsized":"2024-09-21T08:54:46.699230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.289841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179175+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:53:54.179175+0000","last_peered":"2024-09-21T08:53:54.179175+0000","last_clean":"2024-09-21T08:53:54.179175+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:53:54.179175+0000","last_undegraded":"2024-09-21T08:53:54.179175+0000","last_fullsized":"2024-09-21T08:53:54.179175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:56.456030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578009+0000","last_change":"2024-09-21T08:51:40.139340+0000","last_active":"2024-09-21T08:54:46.578009+0000","last_peered":"2024-09-21T08:54:46.578009+0000","last_clean":"2024-09-21T08:54:46.578009+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:54:46.578009+0000","last_undegraded":"2024-09-21T08:54:46.578009+0000","last_fullsized":"2024-09-21T08:54:46.578009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:43.928809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225673+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:52:14.225673+0000","last_peered":"2024-09-21T08:52:14.225673+0000","last_clean":"2024-09-21T08:52:14.225673+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:52:14.225673+0000","last_undegraded":"2024-09-21T08:52:14.225673+0000","last_fullsized":"2024-09-21T08:52:14.225673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:20.136829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'4","reported_seq":602,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.555571+0000","last_change":"2024-09-21T08:51:42.134577+0000","last_active":"2024-09-21T08:53:45.555571+0000","last_peered":"2024-09-21T08:53:45.555571+0000","last_clean":"2024-09-21T08:53:45.555571+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:53:45.555571+0000","last_undegraded":"2024-09-21T08:53:45.555571+0000","last_fullsized":"2024-09-21T08:53:45.555571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230245+0000","last_change":"2024-09-21T08:51:44.144448+0000","last_active":"2024-09-21T08:52:14.230245+0000","last_peered":"2024-09-21T08:52:14.230245+0000","last_clean":"2024-09-21T08:52:14.230245+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:52:14.230245+0000","last_undegraded":"2024-09-21T08:52:14.230245+0000","last_fullsized":"2024-09-21T08:52:14.230245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:36.186338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.660323+0000","last_change":"2024-09-21T08:51:46.147009+0000","last_active":"2024-09-21T08:54:46.660323+0000","last_peered":"2024-09-21T08:54:46.660323+0000","last_clean":"2024-09-21T08:54:46.660323+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:46.660323+0000","last_undegraded":"2024-09-21T08:54:46.660323+0000","last_fullsized":"2024-09-21T08:54:46.660323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.684038+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:45.684038+0000","last_peered":"2024-09-21T08:53:45.684038+0000","last_clean":"2024-09-21T08:53:45.684038+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:45.684038+0000","last_undegraded":"2024-09-21T08:53:45.684038+0000","last_fullsized":"2024-09-21T08:53:45.684038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.217764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535001+0000","last_change":"2024-09-21T08:51:40.143685+0000","last_active":"2024-09-21T08:54:46.535001+0000","last_peered":"2024-09-21T08:54:46.535001+0000","last_clean":"2024-09-21T08:54:46.535001+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:54:46.535001+0000","last_undegraded":"2024-09-21T08:54:46.535001+0000","last_fullsized":"2024-09-21T08:54:46.535001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.644149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.518125+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.518125+0000","last_peered":"2024-09-21T08:54:46.518125+0000","last_clean":"2024-09-21T08:54:46.518125+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.518125+0000","last_undegraded":"2024-09-21T08:54:46.518125+0000","last_fullsized":"2024-09-21T08:54:46.518125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:09.410811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230923+0000","last_change":"2024-09-21T08:51:42.142788+0000","last_active":"2024-09-21T08:52:14.230923+0000","last_peered":"2024-09-21T08:52:14.230923+0000","last_clean":"2024-09-21T08:52:14.230923+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:52:14.230923+0000","last_undegraded":"2024-09-21T08:52:14.230923+0000","last_fullsized":"2024-09-21T08:52:14.230923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:28.690766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.505755+0000","last_change":"2024-09-21T08:51:44.146611+0000","last_active":"2024-09-21T08:53:44.505755+0000","last_peered":"2024-09-21T08:53:44.505755+0000","last_clean":"2024-09-21T08:53:44.505755+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:53:44.505755+0000","last_undegraded":"2024-09-21T08:53:44.505755+0000","last_fullsized":"2024-09-21T08:53:44.505755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:59.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231940+0000","last_change":"2024-09-21T08:51:46.158723+0000","last_active":"2024-09-21T08:52:14.231940+0000","last_peered":"2024-09-21T08:52:14.231940+0000","last_clean":"2024-09-21T08:52:14.231940+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:52:14.231940+0000","last_undegraded":"2024-09-21T08:52:14.231940+0000","last_fullsized":"2024-09-21T08:52:14.231940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:17.004798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.635195+0000","last_change":"2024-09-21T08:51:48.156029+0000","last_active":"2024-09-21T08:54:46.635195+0000","last_peered":"2024-09-21T08:54:46.635195+0000","last_clean":"2024-09-21T08:54:46.635195+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:54:46.635195+0000","last_undegraded":"2024-09-21T08:54:46.635195+0000","last_fullsized":"2024-09-21T08:54:46.635195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:47.978506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399786+0000","last_change":"2024-09-21T08:51:40.141982+0000","last_active":"2024-09-21T08:54:46.399786+0000","last_peered":"2024-09-21T08:54:46.399786+0000","last_clean":"2024-09-21T08:54:46.399786+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:54:46.399786+0000","last_undegraded":"2024-09-21T08:54:46.399786+0000","last_fullsized":"2024-09-21T08:54:46.399786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:59.500749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229118+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:52:14.229118+0000","last_peered":"2024-09-21T08:52:14.229118+0000","last_clean":"2024-09-21T08:52:14.229118+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:52:14.229118+0000","last_undegraded":"2024-09-21T08:52:14.229118+0000","last_fullsized":"2024-09-21T08:52:14.229118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228862+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:52:14.228862+0000","last_peered":"2024-09-21T08:52:14.228862+0000","last_clean":"2024-09-21T08:52:14.228862+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:52:14.228862+0000","last_undegraded":"2024-09-21T08:52:14.228862+0000","last_fullsized":"2024-09-21T08:52:14.228862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179869+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:53:45.179869+0000","last_peered":"2024-09-21T08:53:45.179869+0000","last_clean":"2024-09-21T08:53:45.179869+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:53:45.179869+0000","last_undegraded":"2024-09-21T08:53:45.179869+0000","last_fullsized":"2024-09-21T08:53:45.179869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:33.456799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228510+0000","last_change":"2024-09-21T08:51:42.134377+0000","last_active":"2024-09-21T08:52:14.228510+0000","last_peered":"2024-09-21T08:52:14.228510+0000","last_clean":"2024-09-21T08:52:14.228510+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:52:14.228510+0000","last_undegraded":"2024-09-21T08:52:14.228510+0000","last_fullsized":"2024-09-21T08:52:14.228510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'77","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181599+0000","last_change":"2024-09-21T08:51:44.147739+0000","last_active":"2024-09-21T08:53:55.181599+0000","last_peered":"2024-09-21T08:53:55.181599+0000","last_clean":"2024-09-21T08:53:55.181599+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:53:55.181599+0000","last_undegraded":"2024-09-21T08:53:55.181599+0000","last_fullsized":"2024-09-21T08:53:55.181599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:09.473552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227064+0000","last_change":"2024-09-21T08:51:46.152510+0000","last_active":"2024-09-21T08:52:14.227064+0000","last_peered":"2024-09-21T08:52:14.227064+0000","last_clean":"2024-09-21T08:52:14.227064+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:52:14.227064+0000","last_undegraded":"2024-09-21T08:52:14.227064+0000","last_fullsized":"2024-09-21T08:52:14.227064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:46.952503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.612082+0000","last_change":"2024-09-21T08:51:48.153950+0000","last_active":"2024-09-21T08:54:46.612082+0000","last_peered":"2024-09-21T08:54:46.612082+0000","last_clean":"2024-09-21T08:54:46.612082+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:54:46.612082+0000","last_undegraded":"2024-09-21T08:54:46.612082+0000","last_fullsized":"2024-09-21T08:54:46.612082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:39:17.944711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231327+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:52:14.231327+0000","last_peered":"2024-09-21T08:52:14.231327+0000","last_clean":"2024-09-21T08:52:14.231327+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:52:14.231327+0000","last_undegraded":"2024-09-21T08:52:14.231327+0000","last_fullsized":"2024-09-21T08:52:14.231327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:56.405706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223860+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:52:14.223860+0000","last_peered":"2024-09-21T08:52:14.223860+0000","last_clean":"2024-09-21T08:52:14.223860+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:52:14.223860+0000","last_undegraded":"2024-09-21T08:52:14.223860+0000","last_fullsized":"2024-09-21T08:52:14.223860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225233+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:52:14.225233+0000","last_peered":"2024-09-21T08:52:14.225233+0000","last_clean":"2024-09-21T08:52:14.225233+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:52:14.225233+0000","last_undegraded":"2024-09-21T08:52:14.225233+0000","last_fullsized":"2024-09-21T08:52:14.225233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.236996+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:52:14.236996+0000","last_peered":"2024-09-21T08:52:14.236996+0000","last_clean":"2024-09-21T08:52:14.236996+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:52:14.236996+0000","last_undegraded":"2024-09-21T08:52:14.236996+0000","last_fullsized":"2024-09-21T08:52:14.236996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.070327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216405+0000","last_change":"2024-09-21T08:51:44.151651+0000","last_active":"2024-09-21T08:54:42.216405+0000","last_peered":"2024-09-21T08:54:42.216405+0000","last_clean":"2024-09-21T08:54:42.216405+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:42.216405+0000","last_undegraded":"2024-09-21T08:54:42.216405+0000","last_fullsized":"2024-09-21T08:54:42.216405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229206+0000","last_change":"2024-09-21T08:51:46.151027+0000","last_active":"2024-09-21T08:52:14.229206+0000","last_peered":"2024-09-21T08:52:14.229206+0000","last_clean":"2024-09-21T08:52:14.229206+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:52:14.229206+0000","last_undegraded":"2024-09-21T08:52:14.229206+0000","last_fullsized":"2024-09-21T08:52:14.229206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:21.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.174515+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:53:02.174515+0000","last_peered":"2024-09-21T08:53:02.174515+0000","last_clean":"2024-09-21T08:53:02.174515+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:53:02.174515+0000","last_undegraded":"2024-09-21T08:53:02.174515+0000","last_fullsized":"2024-09-21T08:53:02.174515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:09.403435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535009+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.535009+0000","last_peered":"2024-09-21T08:54:46.535009+0000","last_clean":"2024-09-21T08:54:46.535009+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.535009+0000","last_undegraded":"2024-09-21T08:54:46.535009+0000","last_fullsized":"2024-09-21T08:54:46.535009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227766+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:52:14.227766+0000","last_peered":"2024-09-21T08:52:14.227766+0000","last_clean":"2024-09-21T08:52:14.227766+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:52:14.227766+0000","last_undegraded":"2024-09-21T08:52:14.227766+0000","last_fullsized":"2024-09-21T08:52:14.227766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225020+0000","last_change":"2024-09-21T08:51:38.137786+0000","last_active":"2024-09-21T08:52:14.225020+0000","last_peered":"2024-09-21T08:52:14.225020+0000","last_clean":"2024-09-21T08:52:14.225020+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:52:14.225020+0000","last_undegraded":"2024-09-21T08:52:14.225020+0000","last_fullsized":"2024-09-21T08:52:14.225020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.245255+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:52:14.245255+0000","last_peered":"2024-09-21T08:52:14.245255+0000","last_clean":"2024-09-21T08:52:14.245255+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:52:14.245255+0000","last_undegraded":"2024-09-21T08:52:14.245255+0000","last_fullsized":"2024-09-21T08:52:14.245255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.385447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216645+0000","last_change":"2024-09-21T08:51:44.143788+0000","last_active":"2024-09-21T08:54:42.216645+0000","last_peered":"2024-09-21T08:54:42.216645+0000","last_clean":"2024-09-21T08:54:42.216645+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:54:42.216645+0000","last_undegraded":"2024-09-21T08:54:42.216645+0000","last_fullsized":"2024-09-21T08:54:42.216645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:03.808346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226722+0000","last_change":"2024-09-21T08:51:46.152516+0000","last_active":"2024-09-21T08:52:14.226722+0000","last_peered":"2024-09-21T08:52:14.226722+0000","last_clean":"2024-09-21T08:52:14.226722+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:52:14.226722+0000","last_undegraded":"2024-09-21T08:52:14.226722+0000","last_fullsized":"2024-09-21T08:52:14.226722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:34.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224587+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:52:14.224587+0000","last_peered":"2024-09-21T08:52:14.224587+0000","last_clean":"2024-09-21T08:52:14.224587+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:52:14.224587+0000","last_undegraded":"2024-09-21T08:52:14.224587+0000","last_fullsized":"2024-09-21T08:52:14.224587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:11.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.897959+0000","last_change":"2024-09-21T08:51:40.136811+0000","last_active":"2024-09-21T08:52:19.897959+0000","last_peered":"2024-09-21T08:52:19.897959+0000","last_clean":"2024-09-21T08:52:19.897959+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:52:19.897959+0000","last_undegraded":"2024-09-21T08:52:19.897959+0000","last_fullsized":"2024-09-21T08:52:19.897959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224875+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:52:14.224875+0000","last_peered":"2024-09-21T08:52:14.224875+0000","last_clean":"2024-09-21T08:52:14.224875+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:52:14.224875+0000","last_undegraded":"2024-09-21T08:52:14.224875+0000","last_fullsized":"2024-09-21T08:52:14.224875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228110+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:52:14.228110+0000","last_peered":"2024-09-21T08:52:14.228110+0000","last_clean":"2024-09-21T08:52:14.228110+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:52:14.228110+0000","last_undegraded":"2024-09-21T08:52:14.228110+0000","last_fullsized":"2024-09-21T08:52:14.228110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:30.036950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227211+0000","last_change":"2024-09-21T08:51:42.141282+0000","last_active":"2024-09-21T08:52:14.227211+0000","last_peered":"2024-09-21T08:52:14.227211+0000","last_clean":"2024-09-21T08:52:14.227211+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:52:14.227211+0000","last_undegraded":"2024-09-21T08:52:14.227211+0000","last_fullsized":"2024-09-21T08:52:14.227211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.948185+0000","last_change":"2024-09-21T08:51:44.140590+0000","last_active":"2024-09-21T08:54:45.948185+0000","last_peered":"2024-09-21T08:54:45.948185+0000","last_clean":"2024-09-21T08:54:45.948185+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:45.948185+0000","last_undegraded":"2024-09-21T08:54:45.948185+0000","last_fullsized":"2024-09-21T08:54:45.948185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:35.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231632+0000","last_change":"2024-09-21T08:51:46.150420+0000","last_active":"2024-09-21T08:52:14.231632+0000","last_peered":"2024-09-21T08:52:14.231632+0000","last_clean":"2024-09-21T08:52:14.231632+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:52:14.231632+0000","last_undegraded":"2024-09-21T08:52:14.231632+0000","last_fullsized":"2024-09-21T08:52:14.231632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:59.570923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.567201+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.567201+0000","last_peered":"2024-09-21T08:54:46.567201+0000","last_clean":"2024-09-21T08:54:46.567201+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.567201+0000","last_undegraded":"2024-09-21T08:54:46.567201+0000","last_fullsized":"2024-09-21T08:54:46.567201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:38.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898484+0000","last_change":"2024-09-21T08:51:40.142809+0000","last_active":"2024-09-21T08:52:19.898484+0000","last_peered":"2024-09-21T08:52:19.898484+0000","last_clean":"2024-09-21T08:52:19.898484+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:52:19.898484+0000","last_undegraded":"2024-09-21T08:52:19.898484+0000","last_fullsized":"2024-09-21T08:52:19.898484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179133+0000","last_change":"2024-09-21T08:51:38.147128+0000","last_active":"2024-09-21T08:53:45.179133+0000","last_peered":"2024-09-21T08:53:45.179133+0000","last_clean":"2024-09-21T08:53:45.179133+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:53:45.179133+0000","last_undegraded":"2024-09-21T08:53:45.179133+0000","last_fullsized":"2024-09-21T08:53:45.179133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:04.684325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226549+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:52:14.226549+0000","last_peered":"2024-09-21T08:52:14.226549+0000","last_clean":"2024-09-21T08:52:14.226549+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:52:14.226549+0000","last_undegraded":"2024-09-21T08:52:14.226549+0000","last_fullsized":"2024-09-21T08:52:14.226549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178352+0000","last_change":"2024-09-21T08:51:42.136825+0000","last_active":"2024-09-21T08:53:49.178352+0000","last_peered":"2024-09-21T08:53:49.178352+0000","last_clean":"2024-09-21T08:53:49.178352+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:53:49.178352+0000","last_undegraded":"2024-09-21T08:53:49.178352+0000","last_fullsized":"2024-09-21T08:53:49.178352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.517295+0000","last_change":"2024-09-21T08:51:44.146959+0000","last_active":"2024-09-21T08:53:44.517295+0000","last_peered":"2024-09-21T08:53:44.517295+0000","last_clean":"2024-09-21T08:53:44.517295+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:53:44.517295+0000","last_undegraded":"2024-09-21T08:53:44.517295+0000","last_fullsized":"2024-09-21T08:53:44.517295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228236+0000","last_change":"2024-09-21T08:51:46.155541+0000","last_active":"2024-09-21T08:52:14.228236+0000","last_peered":"2024-09-21T08:52:14.228236+0000","last_clean":"2024-09-21T08:52:14.228236+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:52:14.228236+0000","last_undegraded":"2024-09-21T08:52:14.228236+0000","last_fullsized":"2024-09-21T08:52:14.228236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:24.113565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.874713+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:53:45.874713+0000","last_peered":"2024-09-21T08:53:45.874713+0000","last_clean":"2024-09-21T08:53:45.874713+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:53:45.874713+0000","last_undegraded":"2024-09-21T08:53:45.874713+0000","last_fullsized":"2024-09-21T08:53:45.874713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.827304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170271+0000","last_change":"2024-09-21T08:51:40.133246+0000","last_active":"2024-09-21T08:53:02.170271+0000","last_peered":"2024-09-21T08:53:02.170271+0000","last_clean":"2024-09-21T08:53:02.170271+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:53:02.170271+0000","last_undegraded":"2024-09-21T08:53:02.170271+0000","last_fullsized":"2024-09-21T08:53:02.170271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.576389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227037+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:52:14.227037+0000","last_peered":"2024-09-21T08:52:14.227037+0000","last_clean":"2024-09-21T08:52:14.227037+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:52:14.227037+0000","last_undegraded":"2024-09-21T08:52:14.227037+0000","last_fullsized":"2024-09-21T08:52:14.227037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:12.352985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230062+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:52:14.230062+0000","last_peered":"2024-09-21T08:52:14.230062+0000","last_clean":"2024-09-21T08:52:14.230062+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:52:14.230062+0000","last_undegraded":"2024-09-21T08:52:14.230062+0000","last_fullsized":"2024-09-21T08:52:14.230062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224660+0000","last_change":"2024-09-21T08:51:42.136553+0000","last_active":"2024-09-21T08:52:14.224660+0000","last_peered":"2024-09-21T08:52:14.224660+0000","last_clean":"2024-09-21T08:52:14.224660+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:52:14.224660+0000","last_undegraded":"2024-09-21T08:52:14.224660+0000","last_fullsized":"2024-09-21T08:52:14.224660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:23.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:44.152406+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":354,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216399+0000","last_change":"2024-09-21T08:51:46.147127+0000","last_active":"2024-09-21T08:54:42.216399+0000","last_peered":"2024-09-21T08:54:42.216399+0000","last_clean":"2024-09-21T08:54:42.216399+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:54:42.216399+0000","last_undegraded":"2024-09-21T08:54:42.216399+0000","last_fullsized":"2024-09-21T08:54:42.216399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:36.081632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230628+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:52:14.230628+0000","last_peered":"2024-09-21T08:52:14.230628+0000","last_clean":"2024-09-21T08:52:14.230628+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:52:14.230628+0000","last_undegraded":"2024-09-21T08:52:14.230628+0000","last_fullsized":"2024-09-21T08:52:14.230628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:10.942375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170054+0000","last_change":"2024-09-21T08:51:40.145001+0000","last_active":"2024-09-21T08:53:02.170054+0000","last_peered":"2024-09-21T08:53:02.170054+0000","last_clean":"2024-09-21T08:53:02.170054+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:53:02.170054+0000","last_undegraded":"2024-09-21T08:53:02.170054+0000","last_fullsized":"2024-09-21T08:53:02.170054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:09.524590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528793+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.528793+0000","last_peered":"2024-09-21T08:54:46.528793+0000","last_clean":"2024-09-21T08:54:46.528793+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.528793+0000","last_undegraded":"2024-09-21T08:54:46.528793+0000","last_fullsized":"2024-09-21T08:54:46.528793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:48.815999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227389+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:52:14.227389+0000","last_peered":"2024-09-21T08:52:14.227389+0000","last_clean":"2024-09-21T08:52:14.227389+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:52:14.227389+0000","last_undegraded":"2024-09-21T08:52:14.227389+0000","last_fullsized":"2024-09-21T08:52:14.227389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225844+0000","last_change":"2024-09-21T08:51:42.136276+0000","last_active":"2024-09-21T08:52:14.225844+0000","last_peered":"2024-09-21T08:52:14.225844+0000","last_clean":"2024-09-21T08:52:14.225844+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:52:14.225844+0000","last_undegraded":"2024-09-21T08:52:14.225844+0000","last_fullsized":"2024-09-21T08:52:14.225844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:29.036853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.172648+0000","last_change":"2024-09-21T08:51:44.146949+0000","last_active":"2024-09-21T08:53:02.172648+0000","last_peered":"2024-09-21T08:53:02.172648+0000","last_clean":"2024-09-21T08:53:02.172648+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:53:02.172648+0000","last_undegraded":"2024-09-21T08:53:02.172648+0000","last_fullsized":"2024-09-21T08:53:02.172648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:24.672757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695824+0000","last_change":"2024-09-21T08:51:46.157876+0000","last_active":"2024-09-21T08:54:46.695824+0000","last_peered":"2024-09-21T08:54:46.695824+0000","last_clean":"2024-09-21T08:54:46.695824+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:54:46.695824+0000","last_undegraded":"2024-09-21T08:54:46.695824+0000","last_fullsized":"2024-09-21T08:54:46.695824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:58.663889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227725+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:52:14.227725+0000","last_peered":"2024-09-21T08:52:14.227725+0000","last_clean":"2024-09-21T08:52:14.227725+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:52:14.227725+0000","last_undegraded":"2024-09-21T08:52:14.227725+0000","last_fullsized":"2024-09-21T08:52:14.227725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:38.232117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.928314+0000","last_change":"2024-09-21T08:51:40.139991+0000","last_active":"2024-09-21T08:53:45.928314+0000","last_peered":"2024-09-21T08:53:45.928314+0000","last_clean":"2024-09-21T08:53:45.928314+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:53:45.928314+0000","last_undegraded":"2024-09-21T08:53:45.928314+0000","last_fullsized":"2024-09-21T08:53:45.928314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:15.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226716+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:52:14.226716+0000","last_peered":"2024-09-21T08:52:14.226716+0000","last_clean":"2024-09-21T08:52:14.226716+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:52:14.226716+0000","last_undegraded":"2024-09-21T08:52:14.226716+0000","last_fullsized":"2024-09-21T08:52:14.226716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:34.648397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231442+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:52:14.231442+0000","last_peered":"2024-09-21T08:52:14.231442+0000","last_clean":"2024-09-21T08:52:14.231442+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:52:14.231442+0000","last_undegraded":"2024-09-21T08:52:14.231442+0000","last_fullsized":"2024-09-21T08:52:14.231442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.235154+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:52:14.235154+0000","last_peered":"2024-09-21T08:52:14.235154+0000","last_clean":"2024-09-21T08:52:14.235154+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:52:14.235154+0000","last_undegraded":"2024-09-21T08:52:14.235154+0000","last_fullsized":"2024-09-21T08:52:14.235154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:44.480516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.503705+0000","last_change":"2024-09-21T08:51:44.151520+0000","last_active":"2024-09-21T08:53:44.503705+0000","last_peered":"2024-09-21T08:53:44.503705+0000","last_clean":"2024-09-21T08:53:44.503705+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:53:44.503705+0000","last_undegraded":"2024-09-21T08:53:44.503705+0000","last_fullsized":"2024-09-21T08:53:44.503705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:23:27.022747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226572+0000","last_change":"2024-09-21T08:51:46.148294+0000","last_active":"2024-09-21T08:52:14.226572+0000","last_peered":"2024-09-21T08:52:14.226572+0000","last_clean":"2024-09-21T08:52:14.226572+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:52:14.226572+0000","last_undegraded":"2024-09-21T08:52:14.226572+0000","last_fullsized":"2024-09-21T08:52:14.226572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:33.051043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232595+0000","last_change":"2024-09-21T08:51:48.152691+0000","last_active":"2024-09-21T08:52:14.232595+0000","last_peered":"2024-09-21T08:52:14.232595+0000","last_clean":"2024-09-21T08:52:14.232595+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:52:14.232595+0000","last_undegraded":"2024-09-21T08:52:14.232595+0000","last_fullsized":"2024-09-21T08:52:14.232595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:38.470582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.407365+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.407365+0000","last_peered":"2024-09-21T08:54:46.407365+0000","last_clean":"2024-09-21T08:54:46.407365+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.407365+0000","last_undegraded":"2024-09-21T08:54:46.407365+0000","last_fullsized":"2024-09-21T08:54:46.407365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:16.117971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312954+0000","last_change":"2024-09-21T08:51:40.144129+0000","last_active":"2024-09-21T08:54:46.312954+0000","last_peered":"2024-09-21T08:54:46.312954+0000","last_clean":"2024-09-21T08:54:46.312954+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:54:46.312954+0000","last_undegraded":"2024-09-21T08:54:46.312954+0000","last_fullsized":"2024-09-21T08:54:46.312954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:13.975778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228951+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:52:14.228951+0000","last_peered":"2024-09-21T08:52:14.228951+0000","last_clean":"2024-09-21T08:52:14.228951+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:52:14.228951+0000","last_undegraded":"2024-09-21T08:52:14.228951+0000","last_fullsized":"2024-09-21T08:52:14.228951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:30.847013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228755+0000","last_change":"2024-09-21T08:51:42.133381+0000","last_active":"2024-09-21T08:52:14.228755+0000","last_peered":"2024-09-21T08:52:14.228755+0000","last_clean":"2024-09-21T08:52:14.228755+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:52:14.228755+0000","last_undegraded":"2024-09-21T08:52:14.228755+0000","last_fullsized":"2024-09-21T08:52:14.228755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:30.430814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.509388+0000","last_change":"2024-09-21T08:51:44.145046+0000","last_active":"2024-09-21T08:53:44.509388+0000","last_peered":"2024-09-21T08:53:44.509388+0000","last_clean":"2024-09-21T08:53:44.509388+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:53:44.509388+0000","last_undegraded":"2024-09-21T08:53:44.509388+0000","last_fullsized":"2024-09-21T08:53:44.509388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:47.801350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224610+0000","last_change":"2024-09-21T08:51:46.158200+0000","last_active":"2024-09-21T08:52:14.224610+0000","last_peered":"2024-09-21T08:52:14.224610+0000","last_clean":"2024-09-21T08:52:14.224610+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:52:14.224610+0000","last_undegraded":"2024-09-21T08:52:14.224610+0000","last_fullsized":"2024-09-21T08:52:14.224610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:37.227055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.209012+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:44.209012+0000","last_peered":"2024-09-21T08:53:44.209012+0000","last_clean":"2024-09-21T08:53:44.209012+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:44.209012+0000","last_undegraded":"2024-09-21T08:53:44.209012+0000","last_fullsized":"2024-09-21T08:53:44.209012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:31.644486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'5","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181750+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:00.181750+0000","last_peered":"2024-09-21T08:54:00.181750+0000","last_clean":"2024-09-21T08:54:00.181750+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:54:00.181750+0000","last_undegraded":"2024-09-21T08:54:00.181750+0000","last_fullsized":"2024-09-21T08:54:00.181750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.294093+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.294093+0000","last_peered":"2024-09-21T08:54:46.294093+0000","last_clean":"2024-09-21T08:54:46.294093+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.294093+0000","last_undegraded":"2024-09-21T08:54:46.294093+0000","last_fullsized":"2024-09-21T08:54:46.294093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:50.293941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.136260+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:30.066785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953028+0000","last_change":"2024-09-21T08:51:44.144365+0000","last_active":"2024-09-21T08:54:45.953028+0000","last_peered":"2024-09-21T08:54:45.953028+0000","last_clean":"2024-09-21T08:54:45.953028+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:45.953028+0000","last_undegraded":"2024-09-21T08:54:45.953028+0000","last_fullsized":"2024-09-21T08:54:45.953028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:46.704900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227983+0000","last_change":"2024-09-21T08:51:46.158835+0000","last_active":"2024-09-21T08:52:14.227983+0000","last_peered":"2024-09-21T08:52:14.227983+0000","last_clean":"2024-09-21T08:52:14.227983+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:52:14.227983+0000","last_undegraded":"2024-09-21T08:52:14.227983+0000","last_fullsized":"2024-09-21T08:52:14.227983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:32.915843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.029809+0000","last_change":"2024-09-21T08:51:48.154918+0000","last_active":"2024-09-21T08:54:46.029809+0000","last_peered":"2024-09-21T08:54:46.029809+0000","last_clean":"2024-09-21T08:54:46.029809+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:54:46.029809+0000","last_undegraded":"2024-09-21T08:54:46.029809+0000","last_fullsized":"2024-09-21T08:54:46.029809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:16.848003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583334+0000","last_change":"2024-09-21T08:51:40.122583+0000","last_active":"2024-09-21T08:54:46.583334+0000","last_peered":"2024-09-21T08:54:46.583334+0000","last_clean":"2024-09-21T08:54:46.583334+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:54:46.583334+0000","last_undegraded":"2024-09-21T08:54:46.583334+0000","last_fullsized":"2024-09-21T08:54:46.583334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:22.038126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234016+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:52:14.234016+0000","last_peered":"2024-09-21T08:52:14.234016+0000","last_clean":"2024-09-21T08:52:14.234016+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:52:14.234016+0000","last_undegraded":"2024-09-21T08:52:14.234016+0000","last_fullsized":"2024-09-21T08:52:14.234016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:48.539998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226151+0000","last_change":"2024-09-21T08:51:42.140686+0000","last_active":"2024-09-21T08:52:14.226151+0000","last_peered":"2024-09-21T08:52:14.226151+0000","last_clean":"2024-09-21T08:52:14.226151+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:52:14.226151+0000","last_undegraded":"2024-09-21T08:52:14.226151+0000","last_fullsized":"2024-09-21T08:52:14.226151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:42.691888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.010694+0000","last_change":"2024-09-21T08:51:44.143454+0000","last_active":"2024-09-21T08:54:46.010694+0000","last_peered":"2024-09-21T08:54:46.010694+0000","last_clean":"2024-09-21T08:54:46.010694+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:54:46.010694+0000","last_undegraded":"2024-09-21T08:54:46.010694+0000","last_fullsized":"2024-09-21T08:54:46.010694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226645+0000","last_change":"2024-09-21T08:51:46.147907+0000","last_active":"2024-09-21T08:52:14.226645+0000","last_peered":"2024-09-21T08:52:14.226645+0000","last_clean":"2024-09-21T08:52:14.226645+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:52:14.226645+0000","last_undegraded":"2024-09-21T08:52:14.226645+0000","last_fullsized":"2024-09-21T08:52:14.226645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:37.528413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230362+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:52:14.230362+0000","last_peered":"2024-09-21T08:52:14.230362+0000","last_clean":"2024-09-21T08:52:14.230362+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:52:14.230362+0000","last_undegraded":"2024-09-21T08:52:14.230362+0000","last_fullsized":"2024-09-21T08:52:14.230362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:39.412207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223965+0000","last_change":"2024-09-21T08:51:40.145568+0000","last_active":"2024-09-21T08:52:14.223965+0000","last_peered":"2024-09-21T08:52:14.223965+0000","last_clean":"2024-09-21T08:52:14.223965+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:52:14.223965+0000","last_undegraded":"2024-09-21T08:52:14.223965+0000","last_fullsized":"2024-09-21T08:52:14.223965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.236481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.160254+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:53:02.160254+0000","last_peered":"2024-09-21T08:53:02.160254+0000","last_clean":"2024-09-21T08:53:02.160254+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:53:02.160254+0000","last_undegraded":"2024-09-21T08:53:02.160254+0000","last_fullsized":"2024-09-21T08:53:02.160254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224272+0000","last_change":"2024-09-21T08:51:42.139408+0000","last_active":"2024-09-21T08:52:14.224272+0000","last_peered":"2024-09-21T08:52:14.224272+0000","last_clean":"2024-09-21T08:52:14.224272+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:52:14.224272+0000","last_undegraded":"2024-09-21T08:52:14.224272+0000","last_fullsized":"2024-09-21T08:52:14.224272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:32.273127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.496177+0000","last_change":"2024-09-21T08:51:44.145680+0000","last_active":"2024-09-21T08:53:44.496177+0000","last_peered":"2024-09-21T08:53:44.496177+0000","last_clean":"2024-09-21T08:53:44.496177+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:53:44.496177+0000","last_undegraded":"2024-09-21T08:53:44.496177+0000","last_fullsized":"2024-09-21T08:53:44.496177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:10.374149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227427+0000","last_change":"2024-09-21T08:51:46.153528+0000","last_active":"2024-09-21T08:52:14.227427+0000","last_peered":"2024-09-21T08:52:14.227427+0000","last_clean":"2024-09-21T08:52:14.227427+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:52:14.227427+0000","last_undegraded":"2024-09-21T08:52:14.227427+0000","last_fullsized":"2024-09-21T08:52:14.227427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:22.537802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405394+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.405394+0000","last_peered":"2024-09-21T08:54:46.405394+0000","last_clean":"2024-09-21T08:54:46.405394+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.405394+0000","last_undegraded":"2024-09-21T08:54:46.405394+0000","last_fullsized":"2024-09-21T08:54:46.405394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:27.405363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.841739+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:53:45.841739+0000","last_peered":"2024-09-21T08:53:45.841739+0000","last_clean":"2024-09-21T08:53:45.841739+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:53:45.841739+0000","last_undegraded":"2024-09-21T08:53:45.841739+0000","last_fullsized":"2024-09-21T08:53:45.841739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:23.655957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228233+0000","last_change":"2024-09-21T08:51:42.136453+0000","last_active":"2024-09-21T08:52:14.228233+0000","last_peered":"2024-09-21T08:52:14.228233+0000","last_clean":"2024-09-21T08:52:14.228233+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:52:14.228233+0000","last_undegraded":"2024-09-21T08:52:14.228233+0000","last_fullsized":"2024-09-21T08:52:14.228233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'56","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.515168+0000","last_change":"2024-09-21T08:51:44.146351+0000","last_active":"2024-09-21T08:53:44.515168+0000","last_peered":"2024-09-21T08:53:44.515168+0000","last_clean":"2024-09-21T08:53:44.515168+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:53:44.515168+0000","last_undegraded":"2024-09-21T08:53:44.515168+0000","last_fullsized":"2024-09-21T08:53:44.515168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231093+0000","last_change":"2024-09-21T08:51:46.155998+0000","last_active":"2024-09-21T08:52:14.231093+0000","last_peered":"2024-09-21T08:52:14.231093+0000","last_clean":"2024-09-21T08:52:14.231093+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:52:14.231093+0000","last_undegraded":"2024-09-21T08:52:14.231093+0000","last_fullsized":"2024-09-21T08:52:14.231093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:51.236181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.871525+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:53:45.871525+0000","last_peered":"2024-09-21T08:53:45.871525+0000","last_clean":"2024-09-21T08:53:45.871525+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:53:45.871525+0000","last_undegraded":"2024-09-21T08:53:45.871525+0000","last_fullsized":"2024-09-21T08:53:45.871525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:07.375683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.313490+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.313490+0000","last_peered":"2024-09-21T08:54:46.313490+0000","last_clean":"2024-09-21T08:54:46.313490+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.313490+0000","last_undegraded":"2024-09-21T08:54:46.313490+0000","last_fullsized":"2024-09-21T08:54:46.313490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'5","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.274711+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:46.274711+0000","last_peered":"2024-09-21T08:54:46.274711+0000","last_clean":"2024-09-21T08:54:46.274711+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:46.274711+0000","last_undegraded":"2024-09-21T08:54:46.274711+0000","last_fullsized":"2024-09-21T08:54:46.274711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231259+0000","last_change":"2024-09-21T08:51:42.139604+0000","last_active":"2024-09-21T08:52:14.231259+0000","last_peered":"2024-09-21T08:52:14.231259+0000","last_clean":"2024-09-21T08:52:14.231259+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:52:14.231259+0000","last_undegraded":"2024-09-21T08:52:14.231259+0000","last_fullsized":"2024-09-21T08:52:14.231259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.490123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.497130+0000","last_change":"2024-09-21T08:51:44.146257+0000","last_active":"2024-09-21T08:53:44.497130+0000","last_peered":"2024-09-21T08:53:44.497130+0000","last_clean":"2024-09-21T08:53:44.497130+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:53:44.497130+0000","last_undegraded":"2024-09-21T08:53:44.497130+0000","last_fullsized":"2024-09-21T08:53:44.497130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:49.195311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227189+0000","last_change":"2024-09-21T08:51:46.156505+0000","last_active":"2024-09-21T08:52:14.227189+0000","last_peered":"2024-09-21T08:52:14.227189+0000","last_clean":"2024-09-21T08:52:14.227189+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:52:14.227189+0000","last_undegraded":"2024-09-21T08:52:14.227189+0000","last_fullsized":"2024-09-21T08:52:14.227189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:06.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.934131+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:53:45.934131+0000","last_peered":"2024-09-21T08:53:45.934131+0000","last_clean":"2024-09-21T08:53:45.934131+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:53:45.934131+0000","last_undegraded":"2024-09-21T08:53:45.934131+0000","last_fullsized":"2024-09-21T08:53:45.934131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:58.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.142254+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:03.523431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183294+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:10.183294+0000","last_peered":"2024-09-21T08:54:10.183294+0000","last_clean":"2024-09-21T08:54:10.183294+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:10.183294+0000","last_undegraded":"2024-09-21T08:54:10.183294+0000","last_fullsized":"2024-09-21T08:54:10.183294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231343+0000","last_change":"2024-09-21T08:51:42.139686+0000","last_active":"2024-09-21T08:52:14.231343+0000","last_peered":"2024-09-21T08:52:14.231343+0000","last_clean":"2024-09-21T08:52:14.231343+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:52:14.231343+0000","last_undegraded":"2024-09-21T08:52:14.231343+0000","last_fullsized":"2024-09-21T08:52:14.231343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.566863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.513262+0000","last_change":"2024-09-21T08:51:44.141704+0000","last_active":"2024-09-21T08:53:44.513262+0000","last_peered":"2024-09-21T08:53:44.513262+0000","last_clean":"2024-09-21T08:53:44.513262+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:53:44.513262+0000","last_undegraded":"2024-09-21T08:53:44.513262+0000","last_fullsized":"2024-09-21T08:53:44.513262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226978+0000","last_change":"2024-09-21T08:51:46.159395+0000","last_active":"2024-09-21T08:52:14.226978+0000","last_peered":"2024-09-21T08:52:14.226978+0000","last_clean":"2024-09-21T08:52:14.226978+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:52:14.226978+0000","last_undegraded":"2024-09-21T08:52:14.226978+0000","last_fullsized":"2024-09-21T08:52:14.226978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:32.704956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.658263+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.658263+0000","last_peered":"2024-09-21T08:54:46.658263+0000","last_clean":"2024-09-21T08:54:46.658263+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.658263+0000","last_undegraded":"2024-09-21T08:54:46.658263+0000","last_fullsized":"2024-09-21T08:54:46.658263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:05.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535066+0000","last_change":"2024-09-21T08:51:40.136848+0000","last_active":"2024-09-21T08:54:46.535066+0000","last_peered":"2024-09-21T08:54:46.535066+0000","last_clean":"2024-09-21T08:54:46.535066+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:54:46.535066+0000","last_undegraded":"2024-09-21T08:54:46.535066+0000","last_fullsized":"2024-09-21T08:54:46.535066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227140+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:52:14.227140+0000","last_peered":"2024-09-21T08:52:14.227140+0000","last_clean":"2024-09-21T08:52:14.227140+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:52:14.227140+0000","last_undegraded":"2024-09-21T08:52:14.227140+0000","last_fullsized":"2024-09-21T08:52:14.227140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:52.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229052+0000","last_change":"2024-09-21T08:51:42.135155+0000","last_active":"2024-09-21T08:52:14.229052+0000","last_peered":"2024-09-21T08:52:14.229052+0000","last_clean":"2024-09-21T08:52:14.229052+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:52:14.229052+0000","last_undegraded":"2024-09-21T08:52:14.229052+0000","last_fullsized":"2024-09-21T08:52:14.229052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179980+0000","last_change":"2024-09-21T08:51:44.149082+0000","last_active":"2024-09-21T08:53:45.179980+0000","last_peered":"2024-09-21T08:53:45.179980+0000","last_clean":"2024-09-21T08:53:45.179980+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:53:45.179980+0000","last_undegraded":"2024-09-21T08:53:45.179980+0000","last_fullsized":"2024-09-21T08:53:45.179980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:33.834476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.607288+0000","last_change":"2024-09-21T08:51:46.158858+0000","last_active":"2024-09-21T08:54:46.607288+0000","last_peered":"2024-09-21T08:54:46.607288+0000","last_clean":"2024-09-21T08:54:46.607288+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:54:46.607288+0000","last_undegraded":"2024-09-21T08:54:46.607288+0000","last_fullsized":"2024-09-21T08:54:46.607288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223513+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:52:14.223513+0000","last_peered":"2024-09-21T08:52:14.223513+0000","last_clean":"2024-09-21T08:52:14.223513+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:52:14.223513+0000","last_undegraded":"2024-09-21T08:52:14.223513+0000","last_fullsized":"2024-09-21T08:52:14.223513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.887975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583055+0000","last_change":"2024-09-21T08:51:40.133956+0000","last_active":"2024-09-21T08:54:46.583055+0000","last_peered":"2024-09-21T08:54:46.583055+0000","last_clean":"2024-09-21T08:54:46.583055+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:54:46.583055+0000","last_undegraded":"2024-09-21T08:54:46.583055+0000","last_fullsized":"2024-09-21T08:54:46.583055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:08.168952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229125+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:52:14.229125+0000","last_peered":"2024-09-21T08:52:14.229125+0000","last_clean":"2024-09-21T08:52:14.229125+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:52:14.229125+0000","last_undegraded":"2024-09-21T08:52:14.229125+0000","last_fullsized":"2024-09-21T08:52:14.229125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228198+0000","last_change":"2024-09-21T08:51:42.135023+0000","last_active":"2024-09-21T08:52:14.228198+0000","last_peered":"2024-09-21T08:52:14.228198+0000","last_clean":"2024-09-21T08:52:14.228198+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:52:14.228198+0000","last_undegraded":"2024-09-21T08:52:14.228198+0000","last_fullsized":"2024-09-21T08:52:14.228198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.487830+0000","last_change":"2024-09-21T08:51:44.147321+0000","last_active":"2024-09-21T08:53:44.487830+0000","last_peered":"2024-09-21T08:53:44.487830+0000","last_clean":"2024-09-21T08:53:44.487830+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:53:44.487830+0000","last_undegraded":"2024-09-21T08:53:44.487830+0000","last_fullsized":"2024-09-21T08:53:44.487830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225095+0000","last_change":"2024-09-21T08:51:46.152903+0000","last_active":"2024-09-21T08:52:14.225095+0000","last_peered":"2024-09-21T08:52:14.225095+0000","last_clean":"2024-09-21T08:52:14.225095+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:52:14.225095+0000","last_undegraded":"2024-09-21T08:52:14.225095+0000","last_fullsized":"2024-09-21T08:52:14.225095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227463+0000","last_change":"2024-09-21T08:51:48.155963+0000","last_active":"2024-09-21T08:52:14.227463+0000","last_peered":"2024-09-21T08:52:14.227463+0000","last_clean":"2024-09-21T08:52:14.227463+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:52:14.227463+0000","last_undegraded":"2024-09-21T08:52:14.227463+0000","last_fullsized":"2024-09-21T08:52:14.227463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:26.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582875+0000","last_change":"2024-09-21T08:51:40.132727+0000","last_active":"2024-09-21T08:54:46.582875+0000","last_peered":"2024-09-21T08:54:46.582875+0000","last_clean":"2024-09-21T08:54:46.582875+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:54:46.582875+0000","last_undegraded":"2024-09-21T08:54:46.582875+0000","last_fullsized":"2024-09-21T08:54:46.582875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:05.660834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230235+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:52:14.230235+0000","last_peered":"2024-09-21T08:52:14.230235+0000","last_clean":"2024-09-21T08:52:14.230235+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:52:14.230235+0000","last_undegraded":"2024-09-21T08:52:14.230235+0000","last_fullsized":"2024-09-21T08:52:14.230235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:48.192584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230292+0000","last_change":"2024-09-21T08:51:42.142158+0000","last_active":"2024-09-21T08:52:14.230292+0000","last_peered":"2024-09-21T08:52:14.230292+0000","last_clean":"2024-09-21T08:52:14.230292+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:52:14.230292+0000","last_undegraded":"2024-09-21T08:52:14.230292+0000","last_fullsized":"2024-09-21T08:52:14.230292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:52.876334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.489064+0000","last_change":"2024-09-21T08:51:44.146900+0000","last_active":"2024-09-21T08:53:44.489064+0000","last_peered":"2024-09-21T08:53:44.489064+0000","last_clean":"2024-09-21T08:53:44.489064+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:53:44.489064+0000","last_undegraded":"2024-09-21T08:53:44.489064+0000","last_fullsized":"2024-09-21T08:53:44.489064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.326420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224021+0000","last_change":"2024-09-21T08:51:46.154489+0000","last_active":"2024-09-21T08:52:14.224021+0000","last_peered":"2024-09-21T08:52:14.224021+0000","last_clean":"2024-09-21T08:52:14.224021+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:52:14.224021+0000","last_undegraded":"2024-09-21T08:52:14.224021+0000","last_fullsized":"2024-09-21T08:52:14.224021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:28.311454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230785+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:52:14.230785+0000","last_peered":"2024-09-21T08:52:14.230785+0000","last_clean":"2024-09-21T08:52:14.230785+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:52:14.230785+0000","last_undegraded":"2024-09-21T08:52:14.230785+0000","last_fullsized":"2024-09-21T08:52:14.230785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:36:08.427260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602783+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.602783+0000","last_peered":"2024-09-21T08:54:46.602783+0000","last_clean":"2024-09-21T08:54:46.602783+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.602783+0000","last_undegraded":"2024-09-21T08:54:46.602783+0000","last_fullsized":"2024-09-21T08:54:46.602783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:40.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227596+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:52:14.227596+0000","last_peered":"2024-09-21T08:52:14.227596+0000","last_clean":"2024-09-21T08:52:14.227596+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:52:14.227596+0000","last_undegraded":"2024-09-21T08:52:14.227596+0000","last_fullsized":"2024-09-21T08:52:14.227596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:00.290251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229618+0000","last_change":"2024-09-21T08:51:42.137057+0000","last_active":"2024-09-21T08:52:14.229618+0000","last_peered":"2024-09-21T08:52:14.229618+0000","last_clean":"2024-09-21T08:52:14.229618+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:52:14.229618+0000","last_undegraded":"2024-09-21T08:52:14.229618+0000","last_fullsized":"2024-09-21T08:52:14.229618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:17.785662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'27","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.938799+0000","last_change":"2024-09-21T08:51:44.145647+0000","last_active":"2024-09-21T08:53:45.938799+0000","last_peered":"2024-09-21T08:53:45.938799+0000","last_clean":"2024-09-21T08:53:45.938799+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:53:45.938799+0000","last_undegraded":"2024-09-21T08:53:45.938799+0000","last_fullsized":"2024-09-21T08:53:45.938799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:28.199820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224769+0000","last_change":"2024-09-21T08:51:46.154674+0000","last_active":"2024-09-21T08:52:14.224769+0000","last_peered":"2024-09-21T08:52:14.224769+0000","last_clean":"2024-09-21T08:52:14.224769+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:52:14.224769+0000","last_undegraded":"2024-09-21T08:52:14.224769+0000","last_fullsized":"2024-09-21T08:52:14.224769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.520500+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:53:44.520500+0000","last_peered":"2024-09-21T08:53:44.520500+0000","last_clean":"2024-09-21T08:53:44.520500+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:53:44.520500+0000","last_undegraded":"2024-09-21T08:53:44.520500+0000","last_fullsized":"2024-09-21T08:53:44.520500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:36.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.353736+0000","last_change":"2024-09-21T08:51:40.129771+0000","last_active":"2024-09-21T08:53:02.353736+0000","last_peered":"2024-09-21T08:53:02.353736+0000","last_clean":"2024-09-21T08:53:02.353736+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:53:02.353736+0000","last_undegraded":"2024-09-21T08:53:02.353736+0000","last_fullsized":"2024-09-21T08:53:02.353736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:34.355402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227597+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:52:14.227597+0000","last_peered":"2024-09-21T08:52:14.227597+0000","last_clean":"2024-09-21T08:52:14.227597+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:52:14.227597+0000","last_undegraded":"2024-09-21T08:52:14.227597+0000","last_fullsized":"2024-09-21T08:52:14.227597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:11.497380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:43.194165+0000","last_change":"2024-09-21T08:51:42.141642+0000","last_active":"2024-09-21T08:53:43.194165+0000","last_peered":"2024-09-21T08:53:43.194165+0000","last_clean":"2024-09-21T08:53:43.194165+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:53:43.194165+0000","last_undegraded":"2024-09-21T08:53:43.194165+0000","last_fullsized":"2024-09-21T08:53:43.194165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953961+0000","last_change":"2024-09-21T08:51:44.147527+0000","last_active":"2024-09-21T08:54:45.953961+0000","last_peered":"2024-09-21T08:54:45.953961+0000","last_clean":"2024-09-21T08:54:45.953961+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:54:45.953961+0000","last_undegraded":"2024-09-21T08:54:45.953961+0000","last_fullsized":"2024-09-21T08:54:45.953961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:03.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226325+0000","last_change":"2024-09-21T08:51:46.155051+0000","last_active":"2024-09-21T08:52:14.226325+0000","last_peered":"2024-09-21T08:52:14.226325+0000","last_clean":"2024-09-21T08:52:14.226325+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:52:14.226325+0000","last_undegraded":"2024-09-21T08:52:14.226325+0000","last_fullsized":"2024-09-21T08:52:14.226325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.523078+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:53:44.523078+0000","last_peered":"2024-09-21T08:53:44.523078+0000","last_clean":"2024-09-21T08:53:44.523078+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:53:44.523078+0000","last_undegraded":"2024-09-21T08:53:44.523078+0000","last_fullsized":"2024-09-21T08:53:44.523078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:47.237579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.636811+0000","last_change":"2024-09-21T08:51:40.143086+0000","last_active":"2024-09-21T08:52:19.636811+0000","last_peered":"2024-09-21T08:52:19.636811+0000","last_clean":"2024-09-21T08:52:19.636811+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:52:19.636811+0000","last_undegraded":"2024-09-21T08:52:19.636811+0000","last_fullsized":"2024-09-21T08:52:19.636811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:10.757827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781418+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:52:18.781418+0000","last_peered":"2024-09-21T08:52:18.781418+0000","last_clean":"2024-09-21T08:52:18.781418+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:52:18.781418+0000","last_undegraded":"2024-09-21T08:52:18.781418+0000","last_fullsized":"2024-09-21T08:52:18.781418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:16.508900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354678+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:02.354678+0000","last_peered":"2024-09-21T08:53:02.354678+0000","last_clean":"2024-09-21T08:53:02.354678+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:02.354678+0000","last_undegraded":"2024-09-21T08:53:02.354678+0000","last_fullsized":"2024-09-21T08:53:02.354678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.521233+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.521233+0000","last_peered":"2024-09-21T08:54:46.521233+0000","last_clean":"2024-09-21T08:54:46.521233+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.521233+0000","last_undegraded":"2024-09-21T08:54:46.521233+0000","last_fullsized":"2024-09-21T08:54:46.521233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936501+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:45.936501+0000","last_peered":"2024-09-21T08:53:45.936501+0000","last_clean":"2024-09-21T08:53:45.936501+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:45.936501+0000","last_undegraded":"2024-09-21T08:53:45.936501+0000","last_fullsized":"2024-09-21T08:53:45.936501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:44.661851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179857+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:53:45.179857+0000","last_peered":"2024-09-21T08:53:45.179857+0000","last_clean":"2024-09-21T08:53:45.179857+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:53:45.179857+0000","last_undegraded":"2024-09-21T08:53:45.179857+0000","last_fullsized":"2024-09-21T08:53:45.179857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:26.992698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608820+0000","last_change":"2024-09-21T08:51:40.136629+0000","last_active":"2024-09-21T08:54:46.608820+0000","last_peered":"2024-09-21T08:54:46.608820+0000","last_clean":"2024-09-21T08:54:46.608820+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:54:46.608820+0000","last_undegraded":"2024-09-21T08:54:46.608820+0000","last_fullsized":"2024-09-21T08:54:46.608820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:57.025963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602613+0000","last_change":"2024-09-21T08:51:40.130372+0000","last_active":"2024-09-21T08:54:46.602613+0000","last_peered":"2024-09-21T08:54:46.602613+0000","last_clean":"2024-09-21T08:54:46.602613+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:54:46.602613+0000","last_undegraded":"2024-09-21T08:54:46.602613+0000","last_fullsized":"2024-09-21T08:54:46.602613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:32.855034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.880617+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:52:19.880617+0000","last_peered":"2024-09-21T08:52:19.880617+0000","last_clean":"2024-09-21T08:52:19.880617+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:52:19.880617+0000","last_undegraded":"2024-09-21T08:52:19.880617+0000","last_fullsized":"2024-09-21T08:52:19.880617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:53.742244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609556+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609556+0000","last_peered":"2024-09-21T08:54:46.609556+0000","last_clean":"2024-09-21T08:54:46.609556+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609556+0000","last_undegraded":"2024-09-21T08:54:46.609556+0000","last_fullsized":"2024-09-21T08:54:46.609556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:58.432631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227339+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.227339+0000","last_peered":"2024-09-21T08:52:14.227339+0000","last_clean":"2024-09-21T08:52:14.227339+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:52:14.227339+0000","last_undegraded":"2024-09-21T08:52:14.227339+0000","last_fullsized":"2024-09-21T08:52:14.227339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:08.084918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.303531+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:52:19.303531+0000","last_peered":"2024-09-21T08:52:19.303531+0000","last_clean":"2024-09-21T08:52:19.303531+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:52:19.303531+0000","last_undegraded":"2024-09-21T08:52:19.303531+0000","last_fullsized":"2024-09-21T08:52:19.303531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.883350+0000","last_change":"2024-09-21T08:51:38.145888+0000","last_active":"2024-09-21T08:52:19.883350+0000","last_peered":"2024-09-21T08:52:19.883350+0000","last_clean":"2024-09-21T08:52:19.883350+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:52:19.883350+0000","last_undegraded":"2024-09-21T08:52:19.883350+0000","last_fullsized":"2024-09-21T08:52:19.883350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:12.474475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602717+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.602717+0000","last_peered":"2024-09-21T08:54:46.602717+0000","last_clean":"2024-09-21T08:54:46.602717+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.602717+0000","last_undegraded":"2024-09-21T08:54:46.602717+0000","last_fullsized":"2024-09-21T08:54:46.602717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.886383+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:52:19.886383+0000","last_peered":"2024-09-21T08:52:19.886383+0000","last_clean":"2024-09-21T08:52:19.886383+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:52:19.886383+0000","last_undegraded":"2024-09-21T08:52:19.886383+0000","last_fullsized":"2024-09-21T08:52:19.886383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:27.938724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602644+0000","last_change":"2024-09-21T08:51:40.137071+0000","last_active":"2024-09-21T08:54:46.602644+0000","last_peered":"2024-09-21T08:54:46.602644+0000","last_clean":"2024-09-21T08:54:46.602644+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:54:46.602644+0000","last_undegraded":"2024-09-21T08:54:46.602644+0000","last_fullsized":"2024-09-21T08:54:46.602644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.480193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224082+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:52:14.224082+0000","last_peered":"2024-09-21T08:52:14.224082+0000","last_clean":"2024-09-21T08:52:14.224082+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:52:14.224082+0000","last_undegraded":"2024-09-21T08:52:14.224082+0000","last_fullsized":"2024-09-21T08:52:14.224082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:59.614757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609381+0000","last_change":"2024-09-21T08:51:40.140110+0000","last_active":"2024-09-21T08:54:46.609381+0000","last_peered":"2024-09-21T08:54:46.609381+0000","last_clean":"2024-09-21T08:54:46.609381+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:54:46.609381+0000","last_undegraded":"2024-09-21T08:54:46.609381+0000","last_fullsized":"2024-09-21T08:54:46.609381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:55.756332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.515119+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.515119+0000","last_peered":"2024-09-21T08:54:46.515119+0000","last_clean":"2024-09-21T08:54:46.515119+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.515119+0000","last_undegraded":"2024-09-21T08:54:46.515119+0000","last_fullsized":"2024-09-21T08:54:46.515119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578020+0000","last_change":"2024-09-21T08:51:40.129690+0000","last_active":"2024-09-21T08:54:46.578020+0000","last_peered":"2024-09-21T08:54:46.578020+0000","last_clean":"2024-09-21T08:54:46.578020+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:54:46.578020+0000","last_undegraded":"2024-09-21T08:54:46.578020+0000","last_fullsized":"2024-09-21T08:54:46.578020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227220+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:52:14.227220+0000","last_peered":"2024-09-21T08:52:14.227220+0000","last_clean":"2024-09-21T08:52:14.227220+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:52:14.227220+0000","last_undegraded":"2024-09-21T08:52:14.227220+0000","last_fullsized":"2024-09-21T08:52:14.227220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312075+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.312075+0000","last_peered":"2024-09-21T08:54:46.312075+0000","last_clean":"2024-09-21T08:54:46.312075+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.312075+0000","last_undegraded":"2024-09-21T08:54:46.312075+0000","last_fullsized":"2024-09-21T08:54:46.312075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225656+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:52:14.225656+0000","last_peered":"2024-09-21T08:52:14.225656+0000","last_clean":"2024-09-21T08:52:14.225656+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:52:14.225656+0000","last_undegraded":"2024-09-21T08:52:14.225656+0000","last_fullsized":"2024-09-21T08:52:14.225656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:47.826428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'11","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583270+0000","last_change":"2024-09-21T08:51:40.141700+0000","last_active":"2024-09-21T08:54:46.583270+0000","last_peered":"2024-09-21T08:54:46.583270+0000","last_clean":"2024-09-21T08:54:46.583270+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:54:46.583270+0000","last_undegraded":"2024-09-21T08:54:46.583270+0000","last_fullsized":"2024-09-21T08:54:46.583270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:11.312454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229520+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:52:14.229520+0000","last_peered":"2024-09-21T08:52:14.229520+0000","last_clean":"2024-09-21T08:52:14.229520+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:52:14.229520+0000","last_undegraded":"2024-09-21T08:52:14.229520+0000","last_fullsized":"2024-09-21T08:52:14.229520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:10.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228569+0000","last_change":"2024-09-21T08:51:40.137601+0000","last_active":"2024-09-21T08:52:14.228569+0000","last_peered":"2024-09-21T08:52:14.228569+0000","last_clean":"2024-09-21T08:52:14.228569+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:52:14.228569+0000","last_undegraded":"2024-09-21T08:52:14.228569+0000","last_fullsized":"2024-09-21T08:52:14.228569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524736+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.524736+0000","last_peered":"2024-09-21T08:54:46.524736+0000","last_clean":"2024-09-21T08:54:46.524736+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.524736+0000","last_undegraded":"2024-09-21T08:54:46.524736+0000","last_fullsized":"2024-09-21T08:54:46.524736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.740205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.577907+0000","last_change":"2024-09-21T08:51:40.139425+0000","last_active":"2024-09-21T08:54:46.577907+0000","last_peered":"2024-09-21T08:54:46.577907+0000","last_clean":"2024-09-21T08:54:46.577907+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:54:46.577907+0000","last_undegraded":"2024-09-21T08:54:46.577907+0000","last_fullsized":"2024-09-21T08:54:46.577907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.312677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234554+0000","last_change":"2024-09-21T08:51:38.149787+0000","last_active":"2024-09-21T08:52:14.234554+0000","last_peered":"2024-09-21T08:52:14.234554+0000","last_clean":"2024-09-21T08:52:14.234554+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:52:14.234554+0000","last_undegraded":"2024-09-21T08:52:14.234554+0000","last_fullsized":"2024-09-21T08:52:14.234554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:50.908268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:20.354197+0000","last_change":"2024-09-21T08:51:40.139999+0000","last_active":"2024-09-21T08:52:20.354197+0000","last_peered":"2024-09-21T08:52:20.354197+0000","last_clean":"2024-09-21T08:52:20.354197+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:52:20.354197+0000","last_undegraded":"2024-09-21T08:52:20.354197+0000","last_fullsized":"2024-09-21T08:52:20.354197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.888167+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:53:45.888167+0000","last_peered":"2024-09-21T08:53:45.888167+0000","last_clean":"2024-09-21T08:53:45.888167+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:53:45.888167+0000","last_undegraded":"2024-09-21T08:53:45.888167+0000","last_fullsized":"2024-09-21T08:53:45.888167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:58.598806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224454+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.224454+0000","last_peered":"2024-09-21T08:52:14.224454+0000","last_clean":"2024-09-21T08:52:14.224454+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:52:14.224454+0000","last_undegraded":"2024-09-21T08:52:14.224454+0000","last_fullsized":"2024-09-21T08:52:14.224454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:02.905185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399878+0000","last_change":"2024-09-21T08:51:40.136460+0000","last_active":"2024-09-21T08:54:46.399878+0000","last_peered":"2024-09-21T08:54:46.399878+0000","last_clean":"2024-09-21T08:54:46.399878+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:54:46.399878+0000","last_undegraded":"2024-09-21T08:54:46.399878+0000","last_fullsized":"2024-09-21T08:54:46.399878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225460+0000","last_change":"2024-09-21T08:51:38.149631+0000","last_active":"2024-09-21T08:52:14.225460+0000","last_peered":"2024-09-21T08:52:14.225460+0000","last_clean":"2024-09-21T08:52:14.225460+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:52:14.225460+0000","last_undegraded":"2024-09-21T08:52:14.225460+0000","last_fullsized":"2024-09-21T08:52:14.225460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936952+0000","last_change":"2024-09-21T08:51:40.144724+0000","last_active":"2024-09-21T08:53:45.936952+0000","last_peered":"2024-09-21T08:53:45.936952+0000","last_clean":"2024-09-21T08:53:45.936952+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:53:45.936952+0000","last_undegraded":"2024-09-21T08:53:45.936952+0000","last_fullsized":"2024-09-21T08:53:45.936952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44344,"kb_used_data":9000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327496,"statfs":{"total":96636764160,"available":96591355904,"internally_reserved":0,"allocated":9216000,"data_stored":8872727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48948,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322892,"statfs":{"total":96636764160,"available":96586641408,"internally_reserved":0,"allocated":13930496,"data_stored":13653978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":11272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":11542528,"data_stored":11233488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7086080,"data_stored":6775541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:54:54.006 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T08:54:54.006 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:54:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f88701a1640 1 Processor -- start 2024-09-21T08:54:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f88701a1640 1 -- start start 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f88701a1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f886806eb70 0x7f8868133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f88701a1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f886806c740 con 0x7f886806e080 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f88701a1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f886806fca0 con 0x7f886806eb70 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f886df3d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f886806e080 0x7f886806e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42002/0 (socket says 172.21.15.29:42002) 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f886df3d640 1 -- 172.21.15.29:0/4132756594 learned_addr learned my addr 172.21.15.29:0/4132756594 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.133+0000 7f886d73c640 1 --2- 172.21.15.29:0/4132756594 >> v2:172.21.15.29:3300/0 conn(0x7f886806eb70 0x7f8868133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.134+0000 7f886cf3b640 1 -- 172.21.15.29:0/4132756594 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956696482 0 0) 0x7f886806c740 con 0x7f886806e080 2024-09-21T08:54:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.134+0000 7f886cf3b640 1 -- 172.21.15.29:0/4132756594 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8850003520 con 0x7f886806e080 2024-09-21T08:54:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.134+0000 7f886d73c640 1 -- 172.21.15.29:0/4132756594 >> v1:172.21.15.29:6789/0 conn(0x7f886806e080 legacy=0x7f886806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.134+0000 7f886d73c640 1 -- 172.21.15.29:0/4132756594 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886806bd80 con 0x7f886806eb70 2024-09-21T08:54:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.134+0000 7f886d73c640 1 --2- 172.21.15.29:0/4132756594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806eb70 0x7f8868133d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f885c009d90 tx=0x7f885c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246acbbdad2185ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f886cf3b640 1 -- 172.21.15.29:0/4132756594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c007670 con 0x7f886806eb70 2024-09-21T08:54:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f886cf3b640 1 -- 172.21.15.29:0/4132756594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c007810 con 0x7f886806eb70 2024-09-21T08:54:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f886cf3b640 1 -- 172.21.15.29:0/4132756594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c007b10 con 0x7f886806eb70 2024-09-21T08:54:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 -- 172.21.15.29:0/4132756594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806eb70 msgr2=0x7f8868133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 --2- 172.21.15.29:0/4132756594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806eb70 0x7f8868133d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f885c009d90 tx=0x7f885c02a660 comp rx=0 tx=0).stop 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 -- 172.21.15.29:0/4132756594 shutdown_connections 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 --2- 172.21.15.29:0/4132756594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806eb70 0x7f8868133d10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 -- 172.21.15.29:0/4132756594 >> 172.21.15.29:0/4132756594 conn(0x7f886809dd40 msgr2=0x7f886809e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 -- 172.21.15.29:0/4132756594 shutdown_connections 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.135+0000 7f88701a1640 1 -- 172.21.15.29:0/4132756594 wait complete. 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.136+0000 7f88701a1640 1 Processor -- start 2024-09-21T08:54:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.136+0000 7f88701a1640 1 -- start start 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.136+0000 7f88701a1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.136+0000 7f88701a1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f886806f130 con 0x7f886806e080 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.136+0000 7f886df3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f886df3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35310/0 (socket says 172.21.15.29:35310) 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f886df3d640 1 -- 172.21.15.29:0/3737903253 learned_addr learned my addr 172.21.15.29:0/3737903253 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f886df3d640 1 -- 172.21.15.29:0/3737903253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8868096ea0 con 0x7f886806e080 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f886df3d640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f885800c480 tx=0x7f885800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8858017070 con 0x7f886806e080 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8858005c10 con 0x7f886806e080 2024-09-21T08:54:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8858007070 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8868123950 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.137+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88681243b0 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.138+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f885801a070 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.138+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8868123b20 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.139+0000 7f88667fc640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 0x7f885403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.139+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f885804b120 con 0x7f886806e080 2024-09-21T08:54:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.139+0000 7f886d73c640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 0x7f885403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.139+0000 7f886d73c640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 0x7f885403a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f885c034000 tx=0x7f885c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.144+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f885801b9c0 con 0x7f886806e080 2024-09-21T08:54:54.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.313+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88681341d0 con 0x7f88540382a0 2024-09-21T08:54:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.329+0000 7f88667fc640 1 -- 172.21.15.29:0/3737903253 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665816 (secure 0 0 0) 0x7f88681341d0 con 0x7f88540382a0 2024-09-21T08:54:54.343 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:54:54.349 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:54:54.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 msgr2=0x7f885403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 0x7f885403a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f885c034000 tx=0x7f885c02f000 comp rx=0 tx=0).stop 2024-09-21T08:54:54.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 msgr2=0x7f8868130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f885800c480 tx=0x7f885800c940 comp rx=0 tx=0).stop 2024-09-21T08:54:54.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 shutdown_connections 2024-09-21T08:54:54.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.333+0000 7f88701a1640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f88540382a0 0x7f885403a760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.334+0000 7f88701a1640 1 --2- 172.21.15.29:0/3737903253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f886806e080 0x7f8868130c80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.334+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 >> 172.21.15.29:0/3737903253 conn(0x7f886809dd40 msgr2=0x7f88680993f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:54.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.334+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 shutdown_connections 2024-09-21T08:54:54.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.334+0000 7f88701a1640 1 -- 172.21.15.29:0/3737903253 wait complete. 2024-09-21T08:54:54.354 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-21T08:54:53.211270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4882,"num_read_kb":4459,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173852,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313508,"statfs":{"total":386547056640,"available":386369032192,"internally_reserved":0,"allocated":41775104,"data_stored":40535734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003859"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231353+0000","last_change":"2024-09-21T08:51:38.149131+0000","last_active":"2024-09-21T08:52:14.231353+0000","last_peered":"2024-09-21T08:52:14.231353+0000","last_clean":"2024-09-21T08:52:14.231353+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:52:14.231353+0000","last_undegraded":"2024-09-21T08:52:14.231353+0000","last_fullsized":"2024-09-21T08:52:14.231353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:33.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400047+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.400047+0000","last_peered":"2024-09-21T08:54:46.400047+0000","last_clean":"2024-09-21T08:54:46.400047+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.400047+0000","last_undegraded":"2024-09-21T08:54:46.400047+0000","last_fullsized":"2024-09-21T08:54:46.400047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227696+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:52:14.227696+0000","last_peered":"2024-09-21T08:52:14.227696+0000","last_clean":"2024-09-21T08:52:14.227696+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:52:14.227696+0000","last_undegraded":"2024-09-21T08:52:14.227696+0000","last_fullsized":"2024-09-21T08:52:14.227696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:44:26.727846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535392+0000","last_change":"2024-09-21T08:51:40.136089+0000","last_active":"2024-09-21T08:54:46.535392+0000","last_peered":"2024-09-21T08:54:46.535392+0000","last_clean":"2024-09-21T08:54:46.535392+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:54:46.535392+0000","last_undegraded":"2024-09-21T08:54:46.535392+0000","last_fullsized":"2024-09-21T08:54:46.535392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:42.691157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781340+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:52:18.781340+0000","last_peered":"2024-09-21T08:52:18.781340+0000","last_clean":"2024-09-21T08:52:18.781340+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:52:18.781340+0000","last_undegraded":"2024-09-21T08:52:18.781340+0000","last_fullsized":"2024-09-21T08:52:18.781340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:41.267539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.239510+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:52:14.239510+0000","last_peered":"2024-09-21T08:52:14.239510+0000","last_clean":"2024-09-21T08:52:14.239510+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:52:14.239510+0000","last_undegraded":"2024-09-21T08:52:14.239510+0000","last_fullsized":"2024-09-21T08:52:14.239510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.787607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231201+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:52:14.231201+0000","last_peered":"2024-09-21T08:52:14.231201+0000","last_clean":"2024-09-21T08:52:14.231201+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:52:14.231201+0000","last_undegraded":"2024-09-21T08:52:14.231201+0000","last_fullsized":"2024-09-21T08:52:14.231201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:09.428425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183972+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:10.183972+0000","last_peered":"2024-09-21T08:54:10.183972+0000","last_clean":"2024-09-21T08:54:10.183972+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:10.183972+0000","last_undegraded":"2024-09-21T08:54:10.183972+0000","last_fullsized":"2024-09-21T08:54:10.183972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:10.655450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.738181+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:53:45.738181+0000","last_peered":"2024-09-21T08:53:45.738181+0000","last_clean":"2024-09-21T08:53:45.738181+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:53:45.738181+0000","last_undegraded":"2024-09-21T08:53:45.738181+0000","last_fullsized":"2024-09-21T08:53:45.738181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:27.599255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898400+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:52:19.898400+0000","last_peered":"2024-09-21T08:52:19.898400+0000","last_clean":"2024-09-21T08:52:19.898400+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:52:19.898400+0000","last_undegraded":"2024-09-21T08:52:19.898400+0000","last_fullsized":"2024-09-21T08:52:19.898400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:22.144849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227886+0000","last_change":"2024-09-21T08:51:38.149505+0000","last_active":"2024-09-21T08:52:14.227886+0000","last_peered":"2024-09-21T08:52:14.227886+0000","last_clean":"2024-09-21T08:52:14.227886+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:52:14.227886+0000","last_undegraded":"2024-09-21T08:52:14.227886+0000","last_fullsized":"2024-09-21T08:52:14.227886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.592638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399870+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.399870+0000","last_peered":"2024-09-21T08:54:46.399870+0000","last_clean":"2024-09-21T08:54:46.399870+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.399870+0000","last_undegraded":"2024-09-21T08:54:46.399870+0000","last_fullsized":"2024-09-21T08:54:46.399870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:31.174220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225068+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:52:14.225068+0000","last_peered":"2024-09-21T08:52:14.225068+0000","last_clean":"2024-09-21T08:52:14.225068+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:52:14.225068+0000","last_undegraded":"2024-09-21T08:52:14.225068+0000","last_fullsized":"2024-09-21T08:52:14.225068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:38.320272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354111+0000","last_change":"2024-09-21T08:51:40.136615+0000","last_active":"2024-09-21T08:53:02.354111+0000","last_peered":"2024-09-21T08:53:02.354111+0000","last_clean":"2024-09-21T08:53:02.354111+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:53:02.354111+0000","last_undegraded":"2024-09-21T08:53:02.354111+0000","last_fullsized":"2024-09-21T08:53:02.354111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:01.638135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225452+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:52:14.225452+0000","last_peered":"2024-09-21T08:52:14.225452+0000","last_clean":"2024-09-21T08:52:14.225452+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:52:14.225452+0000","last_undegraded":"2024-09-21T08:52:14.225452+0000","last_fullsized":"2024-09-21T08:52:14.225452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399104+0000","last_change":"2024-09-21T08:51:40.139948+0000","last_active":"2024-09-21T08:54:46.399104+0000","last_peered":"2024-09-21T08:54:46.399104+0000","last_clean":"2024-09-21T08:54:46.399104+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:54:46.399104+0000","last_undegraded":"2024-09-21T08:54:46.399104+0000","last_fullsized":"2024-09-21T08:54:46.399104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:46.303446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182197+0000","last_change":"2024-09-21T08:51:40.135605+0000","last_active":"2024-09-21T08:54:00.182197+0000","last_peered":"2024-09-21T08:54:00.182197+0000","last_clean":"2024-09-21T08:54:00.182197+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:54:00.182197+0000","last_undegraded":"2024-09-21T08:54:00.182197+0000","last_fullsized":"2024-09-21T08:54:00.182197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:18.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227228+0000","last_change":"2024-09-21T08:51:38.140312+0000","last_active":"2024-09-21T08:52:14.227228+0000","last_peered":"2024-09-21T08:52:14.227228+0000","last_clean":"2024-09-21T08:52:14.227228+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:52:14.227228+0000","last_undegraded":"2024-09-21T08:52:14.227228+0000","last_fullsized":"2024-09-21T08:52:14.227228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:02.069891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936352+0000","last_change":"2024-09-21T08:51:40.137259+0000","last_active":"2024-09-21T08:53:45.936352+0000","last_peered":"2024-09-21T08:53:45.936352+0000","last_clean":"2024-09-21T08:53:45.936352+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:53:45.936352+0000","last_undegraded":"2024-09-21T08:53:45.936352+0000","last_fullsized":"2024-09-21T08:53:45.936352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.598144+0000","last_change":"2024-09-21T08:51:38.150225+0000","last_active":"2024-09-21T08:54:46.598144+0000","last_peered":"2024-09-21T08:54:46.598144+0000","last_clean":"2024-09-21T08:54:46.598144+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:54:46.598144+0000","last_undegraded":"2024-09-21T08:54:46.598144+0000","last_fullsized":"2024-09-21T08:54:46.598144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:58.948956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":21,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399793+0000","last_change":"2024-09-21T08:51:40.135404+0000","last_active":"2024-09-21T08:54:46.399793+0000","last_peered":"2024-09-21T08:54:46.399793+0000","last_clean":"2024-09-21T08:54:46.399793+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:54:46.399793+0000","last_undegraded":"2024-09-21T08:54:46.399793+0000","last_fullsized":"2024-09-21T08:54:46.399793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.913626+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:53:45.913626+0000","last_peered":"2024-09-21T08:53:45.913626+0000","last_clean":"2024-09-21T08:53:45.913626+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:53:45.913626+0000","last_undegraded":"2024-09-21T08:53:45.913626+0000","last_fullsized":"2024-09-21T08:53:45.913626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.085254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583271+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583271+0000","last_peered":"2024-09-21T08:54:46.583271+0000","last_clean":"2024-09-21T08:54:46.583271+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583271+0000","last_undegraded":"2024-09-21T08:54:46.583271+0000","last_fullsized":"2024-09-21T08:54:46.583271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229015+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:52:14.229015+0000","last_peered":"2024-09-21T08:52:14.229015+0000","last_clean":"2024-09-21T08:52:14.229015+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:52:14.229015+0000","last_undegraded":"2024-09-21T08:52:14.229015+0000","last_fullsized":"2024-09-21T08:52:14.229015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:48.757416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231605+0000","last_change":"2024-09-21T08:51:40.143862+0000","last_active":"2024-09-21T08:52:14.231605+0000","last_peered":"2024-09-21T08:52:14.231605+0000","last_clean":"2024-09-21T08:52:14.231605+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:52:14.231605+0000","last_undegraded":"2024-09-21T08:52:14.231605+0000","last_fullsized":"2024-09-21T08:52:14.231605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:22.460199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227756+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:52:14.227756+0000","last_peered":"2024-09-21T08:52:14.227756+0000","last_clean":"2024-09-21T08:52:14.227756+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:52:14.227756+0000","last_undegraded":"2024-09-21T08:52:14.227756+0000","last_fullsized":"2024-09-21T08:52:14.227756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:16.521067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182622+0000","last_change":"2024-09-21T08:51:40.138654+0000","last_active":"2024-09-21T08:54:05.182622+0000","last_peered":"2024-09-21T08:54:05.182622+0000","last_clean":"2024-09-21T08:54:05.182622+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:54:05.182622+0000","last_undegraded":"2024-09-21T08:54:05.182622+0000","last_fullsized":"2024-09-21T08:54:05.182622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:10.717027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225664+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:52:14.225664+0000","last_peered":"2024-09-21T08:52:14.225664+0000","last_clean":"2024-09-21T08:52:14.225664+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:52:14.225664+0000","last_undegraded":"2024-09-21T08:52:14.225664+0000","last_fullsized":"2024-09-21T08:52:14.225664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:29.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.584533+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.584533+0000","last_peered":"2024-09-21T08:54:46.584533+0000","last_clean":"2024-09-21T08:54:46.584533+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.584533+0000","last_undegraded":"2024-09-21T08:54:46.584533+0000","last_fullsized":"2024-09-21T08:54:46.584533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:48.958880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.169984+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:53:02.169984+0000","last_peered":"2024-09-21T08:53:02.169984+0000","last_clean":"2024-09-21T08:53:02.169984+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:53:02.169984+0000","last_undegraded":"2024-09-21T08:53:02.169984+0000","last_fullsized":"2024-09-21T08:53:02.169984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227035+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:52:14.227035+0000","last_peered":"2024-09-21T08:52:14.227035+0000","last_clean":"2024-09-21T08:52:14.227035+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:52:14.227035+0000","last_undegraded":"2024-09-21T08:52:14.227035+0000","last_fullsized":"2024-09-21T08:52:14.227035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:20.030105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.139486+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:58.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'35","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.545112+0000","last_change":"2024-09-21T08:51:44.149044+0000","last_active":"2024-09-21T08:54:46.545112+0000","last_peered":"2024-09-21T08:54:46.545112+0000","last_clean":"2024-09-21T08:54:46.545112+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:54:46.545112+0000","last_undegraded":"2024-09-21T08:54:46.545112+0000","last_fullsized":"2024-09-21T08:54:46.545112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:16.675629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227130+0000","last_change":"2024-09-21T08:51:46.152252+0000","last_active":"2024-09-21T08:52:14.227130+0000","last_peered":"2024-09-21T08:52:14.227130+0000","last_clean":"2024-09-21T08:52:14.227130+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:52:14.227130+0000","last_undegraded":"2024-09-21T08:52:14.227130+0000","last_fullsized":"2024-09-21T08:52:14.227130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.176311+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:53:02.176311+0000","last_peered":"2024-09-21T08:53:02.176311+0000","last_clean":"2024-09-21T08:53:02.176311+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:53:02.176311+0000","last_undegraded":"2024-09-21T08:53:02.176311+0000","last_fullsized":"2024-09-21T08:53:02.176311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:29.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534995+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.534995+0000","last_peered":"2024-09-21T08:54:46.534995+0000","last_clean":"2024-09-21T08:54:46.534995+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.534995+0000","last_undegraded":"2024-09-21T08:54:46.534995+0000","last_fullsized":"2024-09-21T08:54:46.534995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:42.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181680+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:00.181680+0000","last_peered":"2024-09-21T08:54:00.181680+0000","last_clean":"2024-09-21T08:54:00.181680+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:00.181680+0000","last_undegraded":"2024-09-21T08:54:00.181680+0000","last_fullsized":"2024-09-21T08:54:00.181680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:05.633192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.545682+0000","last_change":"2024-09-21T08:51:42.139320+0000","last_active":"2024-09-21T08:53:45.545682+0000","last_peered":"2024-09-21T08:53:45.545682+0000","last_clean":"2024-09-21T08:53:45.545682+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:53:45.545682+0000","last_undegraded":"2024-09-21T08:53:45.545682+0000","last_fullsized":"2024-09-21T08:53:45.545682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:43.645980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226057+0000","last_change":"2024-09-21T08:51:44.146522+0000","last_active":"2024-09-21T08:52:14.226057+0000","last_peered":"2024-09-21T08:52:14.226057+0000","last_clean":"2024-09-21T08:52:14.226057+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:52:14.226057+0000","last_undegraded":"2024-09-21T08:52:14.226057+0000","last_fullsized":"2024-09-21T08:52:14.226057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:14.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225937+0000","last_change":"2024-09-21T08:51:46.157301+0000","last_active":"2024-09-21T08:52:14.225937+0000","last_peered":"2024-09-21T08:52:14.225937+0000","last_clean":"2024-09-21T08:52:14.225937+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:52:14.225937+0000","last_undegraded":"2024-09-21T08:52:14.225937+0000","last_fullsized":"2024-09-21T08:52:14.225937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225151+0000","last_change":"2024-09-21T08:51:48.154173+0000","last_active":"2024-09-21T08:52:14.225151+0000","last_peered":"2024-09-21T08:52:14.225151+0000","last_clean":"2024-09-21T08:52:14.225151+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:52:14.225151+0000","last_undegraded":"2024-09-21T08:52:14.225151+0000","last_fullsized":"2024-09-21T08:52:14.225151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:16:14.347576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535149+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.535149+0000","last_peered":"2024-09-21T08:54:46.535149+0000","last_clean":"2024-09-21T08:54:46.535149+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.535149+0000","last_undegraded":"2024-09-21T08:54:46.535149+0000","last_fullsized":"2024-09-21T08:54:46.535149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:36.705710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224381+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:52:14.224381+0000","last_peered":"2024-09-21T08:52:14.224381+0000","last_clean":"2024-09-21T08:52:14.224381+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:52:14.224381+0000","last_undegraded":"2024-09-21T08:52:14.224381+0000","last_fullsized":"2024-09-21T08:52:14.224381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:09.304434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227963+0000","last_change":"2024-09-21T08:51:42.137023+0000","last_active":"2024-09-21T08:52:14.227963+0000","last_peered":"2024-09-21T08:52:14.227963+0000","last_clean":"2024-09-21T08:52:14.227963+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:52:14.227963+0000","last_undegraded":"2024-09-21T08:52:14.227963+0000","last_fullsized":"2024-09-21T08:52:14.227963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232114+0000","last_change":"2024-09-21T08:51:44.151497+0000","last_active":"2024-09-21T08:52:14.232114+0000","last_peered":"2024-09-21T08:52:14.232114+0000","last_clean":"2024-09-21T08:52:14.232114+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:52:14.232114+0000","last_undegraded":"2024-09-21T08:52:14.232114+0000","last_fullsized":"2024-09-21T08:52:14.232114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:34.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708968+0000","last_change":"2024-09-21T08:51:46.158108+0000","last_active":"2024-09-21T08:54:46.708968+0000","last_peered":"2024-09-21T08:54:46.708968+0000","last_clean":"2024-09-21T08:54:46.708968+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:54:46.708968+0000","last_undegraded":"2024-09-21T08:54:46.708968+0000","last_fullsized":"2024-09-21T08:54:46.708968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.241076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.638227+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:52:19.638227+0000","last_peered":"2024-09-21T08:52:19.638227+0000","last_clean":"2024-09-21T08:52:19.638227+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:52:19.638227+0000","last_undegraded":"2024-09-21T08:52:19.638227+0000","last_fullsized":"2024-09-21T08:52:19.638227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.204645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310855+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.310855+0000","last_peered":"2024-09-21T08:54:46.310855+0000","last_clean":"2024-09-21T08:54:46.310855+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.310855+0000","last_undegraded":"2024-09-21T08:54:46.310855+0000","last_fullsized":"2024-09-21T08:54:46.310855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.889090+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:52:19.889090+0000","last_peered":"2024-09-21T08:52:19.889090+0000","last_clean":"2024-09-21T08:52:19.889090+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:52:19.889090+0000","last_undegraded":"2024-09-21T08:52:19.889090+0000","last_fullsized":"2024-09-21T08:52:19.889090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231441+0000","last_change":"2024-09-21T08:51:42.136387+0000","last_active":"2024-09-21T08:52:14.231441+0000","last_peered":"2024-09-21T08:52:14.231441+0000","last_clean":"2024-09-21T08:52:14.231441+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:52:14.231441+0000","last_undegraded":"2024-09-21T08:52:14.231441+0000","last_fullsized":"2024-09-21T08:52:14.231441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:42.938313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.499787+0000","last_change":"2024-09-21T08:51:44.151655+0000","last_active":"2024-09-21T08:53:44.499787+0000","last_peered":"2024-09-21T08:53:44.499787+0000","last_clean":"2024-09-21T08:53:44.499787+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:53:44.499787+0000","last_undegraded":"2024-09-21T08:53:44.499787+0000","last_fullsized":"2024-09-21T08:53:44.499787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.388478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.605742+0000","last_change":"2024-09-21T08:51:46.154154+0000","last_active":"2024-09-21T08:54:46.605742+0000","last_peered":"2024-09-21T08:54:46.605742+0000","last_clean":"2024-09-21T08:54:46.605742+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:46.605742+0000","last_undegraded":"2024-09-21T08:54:46.605742+0000","last_fullsized":"2024-09-21T08:54:46.605742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.824819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534945+0000","last_change":"2024-09-21T08:51:40.141892+0000","last_active":"2024-09-21T08:54:46.534945+0000","last_peered":"2024-09-21T08:54:46.534945+0000","last_clean":"2024-09-21T08:54:46.534945+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:54:46.534945+0000","last_undegraded":"2024-09-21T08:54:46.534945+0000","last_fullsized":"2024-09-21T08:54:46.534945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:15.778333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231615+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:52:14.231615+0000","last_peered":"2024-09-21T08:52:14.231615+0000","last_clean":"2024-09-21T08:52:14.231615+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:52:14.231615+0000","last_undegraded":"2024-09-21T08:52:14.231615+0000","last_fullsized":"2024-09-21T08:52:14.231615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227856+0000","last_change":"2024-09-21T08:51:42.139818+0000","last_active":"2024-09-21T08:52:14.227856+0000","last_peered":"2024-09-21T08:52:14.227856+0000","last_clean":"2024-09-21T08:52:14.227856+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:52:14.227856+0000","last_undegraded":"2024-09-21T08:52:14.227856+0000","last_fullsized":"2024-09-21T08:52:14.227856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.508478+0000","last_change":"2024-09-21T08:51:44.148564+0000","last_active":"2024-09-21T08:53:44.508478+0000","last_peered":"2024-09-21T08:53:44.508478+0000","last_clean":"2024-09-21T08:53:44.508478+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:53:44.508478+0000","last_undegraded":"2024-09-21T08:53:44.508478+0000","last_fullsized":"2024-09-21T08:53:44.508478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:46.255459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227433+0000","last_change":"2024-09-21T08:51:46.157947+0000","last_active":"2024-09-21T08:52:14.227433+0000","last_peered":"2024-09-21T08:52:14.227433+0000","last_clean":"2024-09-21T08:52:14.227433+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:52:14.227433+0000","last_undegraded":"2024-09-21T08:52:14.227433+0000","last_fullsized":"2024-09-21T08:52:14.227433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:02.289163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.178600+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:02.178600+0000","last_peered":"2024-09-21T08:53:02.178600+0000","last_clean":"2024-09-21T08:53:02.178600+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:02.178600+0000","last_undegraded":"2024-09-21T08:53:02.178600+0000","last_fullsized":"2024-09-21T08:53:02.178600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:09.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400040+0000","last_change":"2024-09-21T08:51:40.128515+0000","last_active":"2024-09-21T08:54:46.400040+0000","last_peered":"2024-09-21T08:54:46.400040+0000","last_clean":"2024-09-21T08:54:46.400040+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:54:46.400040+0000","last_undegraded":"2024-09-21T08:54:46.400040+0000","last_fullsized":"2024-09-21T08:54:46.400040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.233575+0000","last_change":"2024-09-21T08:51:38.148403+0000","last_active":"2024-09-21T08:52:14.233575+0000","last_peered":"2024-09-21T08:52:14.233575+0000","last_clean":"2024-09-21T08:52:14.233575+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:52:14.233575+0000","last_undegraded":"2024-09-21T08:52:14.233575+0000","last_fullsized":"2024-09-21T08:52:14.233575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.872881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225711+0000","last_change":"2024-09-21T08:51:42.135619+0000","last_active":"2024-09-21T08:52:14.225711+0000","last_peered":"2024-09-21T08:52:14.225711+0000","last_clean":"2024-09-21T08:52:14.225711+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:52:14.225711+0000","last_undegraded":"2024-09-21T08:52:14.225711+0000","last_fullsized":"2024-09-21T08:52:14.225711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.062622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.490003+0000","last_change":"2024-09-21T08:51:44.144706+0000","last_active":"2024-09-21T08:53:44.490003+0000","last_peered":"2024-09-21T08:53:44.490003+0000","last_clean":"2024-09-21T08:53:44.490003+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:53:44.490003+0000","last_undegraded":"2024-09-21T08:53:44.490003+0000","last_fullsized":"2024-09-21T08:53:44.490003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:07.374743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225286+0000","last_change":"2024-09-21T08:51:46.152912+0000","last_active":"2024-09-21T08:52:14.225286+0000","last_peered":"2024-09-21T08:52:14.225286+0000","last_clean":"2024-09-21T08:52:14.225286+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:52:14.225286+0000","last_undegraded":"2024-09-21T08:52:14.225286+0000","last_fullsized":"2024-09-21T08:52:14.225286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:56.616218+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:52:56.616218+0000","last_peered":"2024-09-21T08:52:56.616218+0000","last_clean":"2024-09-21T08:52:56.616218+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:52:56.616218+0000","last_undegraded":"2024-09-21T08:52:56.616218+0000","last_fullsized":"2024-09-21T08:52:56.616218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:53.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310377+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.310377+0000","last_peered":"2024-09-21T08:54:46.310377+0000","last_clean":"2024-09-21T08:54:46.310377+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.310377+0000","last_undegraded":"2024-09-21T08:54:46.310377+0000","last_fullsized":"2024-09-21T08:54:46.310377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:09.036028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230727+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:52:14.230727+0000","last_peered":"2024-09-21T08:52:14.230727+0000","last_clean":"2024-09-21T08:52:14.230727+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:52:14.230727+0000","last_undegraded":"2024-09-21T08:52:14.230727+0000","last_fullsized":"2024-09-21T08:52:14.230727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:31.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228487+0000","last_change":"2024-09-21T08:51:42.137342+0000","last_active":"2024-09-21T08:52:14.228487+0000","last_peered":"2024-09-21T08:52:14.228487+0000","last_clean":"2024-09-21T08:52:14.228487+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:52:14.228487+0000","last_undegraded":"2024-09-21T08:52:14.228487+0000","last_fullsized":"2024-09-21T08:52:14.228487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.510274+0000","last_change":"2024-09-21T08:51:44.145486+0000","last_active":"2024-09-21T08:53:44.510274+0000","last_peered":"2024-09-21T08:53:44.510274+0000","last_clean":"2024-09-21T08:53:44.510274+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:53:44.510274+0000","last_undegraded":"2024-09-21T08:53:44.510274+0000","last_fullsized":"2024-09-21T08:53:44.510274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:45.211269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.718054+0000","last_change":"2024-09-21T08:51:46.153164+0000","last_active":"2024-09-21T08:54:46.718054+0000","last_peered":"2024-09-21T08:54:46.718054+0000","last_clean":"2024-09-21T08:54:46.718054+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:46.718054+0000","last_undegraded":"2024-09-21T08:54:46.718054+0000","last_fullsized":"2024-09-21T08:54:46.718054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:25.619586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226871+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:52:14.226871+0000","last_peered":"2024-09-21T08:52:14.226871+0000","last_clean":"2024-09-21T08:52:14.226871+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:52:14.226871+0000","last_undegraded":"2024-09-21T08:52:14.226871+0000","last_fullsized":"2024-09-21T08:52:14.226871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:41.262657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608904+0000","last_change":"2024-09-21T08:51:40.133810+0000","last_active":"2024-09-21T08:54:46.608904+0000","last_peered":"2024-09-21T08:54:46.608904+0000","last_clean":"2024-09-21T08:54:46.608904+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:54:46.608904+0000","last_undegraded":"2024-09-21T08:54:46.608904+0000","last_fullsized":"2024-09-21T08:54:46.608904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.992615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228858+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:52:14.228858+0000","last_peered":"2024-09-21T08:52:14.228858+0000","last_clean":"2024-09-21T08:52:14.228858+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:52:14.228858+0000","last_undegraded":"2024-09-21T08:52:14.228858+0000","last_fullsized":"2024-09-21T08:52:14.228858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:07.067511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226360+0000","last_change":"2024-09-21T08:51:42.136459+0000","last_active":"2024-09-21T08:52:14.226360+0000","last_peered":"2024-09-21T08:52:14.226360+0000","last_clean":"2024-09-21T08:52:14.226360+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:52:14.226360+0000","last_undegraded":"2024-09-21T08:52:14.226360+0000","last_fullsized":"2024-09-21T08:52:14.226360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.652788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.512066+0000","last_change":"2024-09-21T08:51:44.146420+0000","last_active":"2024-09-21T08:53:44.512066+0000","last_peered":"2024-09-21T08:53:44.512066+0000","last_clean":"2024-09-21T08:53:44.512066+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:53:44.512066+0000","last_undegraded":"2024-09-21T08:53:44.512066+0000","last_fullsized":"2024-09-21T08:53:44.512066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:16.779029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225340+0000","last_change":"2024-09-21T08:51:46.154347+0000","last_active":"2024-09-21T08:52:14.225340+0000","last_peered":"2024-09-21T08:52:14.225340+0000","last_clean":"2024-09-21T08:52:14.225340+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:52:14.225340+0000","last_undegraded":"2024-09-21T08:52:14.225340+0000","last_fullsized":"2024-09-21T08:52:14.225340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695069+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.695069+0000","last_peered":"2024-09-21T08:54:46.695069+0000","last_clean":"2024-09-21T08:54:46.695069+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.695069+0000","last_undegraded":"2024-09-21T08:54:46.695069+0000","last_fullsized":"2024-09-21T08:54:46.695069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:50.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.237306+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:52:14.237306+0000","last_peered":"2024-09-21T08:52:14.237306+0000","last_clean":"2024-09-21T08:52:14.237306+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:52:14.237306+0000","last_undegraded":"2024-09-21T08:52:14.237306+0000","last_fullsized":"2024-09-21T08:52:14.237306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:33.234761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226839+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:52:14.226839+0000","last_peered":"2024-09-21T08:52:14.226839+0000","last_clean":"2024-09-21T08:52:14.226839+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:52:14.226839+0000","last_undegraded":"2024-09-21T08:52:14.226839+0000","last_fullsized":"2024-09-21T08:52:14.226839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:31.835091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232438+0000","last_change":"2024-09-21T08:51:42.142191+0000","last_active":"2024-09-21T08:52:14.232438+0000","last_peered":"2024-09-21T08:52:14.232438+0000","last_clean":"2024-09-21T08:52:14.232438+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:52:14.232438+0000","last_undegraded":"2024-09-21T08:52:14.232438+0000","last_fullsized":"2024-09-21T08:52:14.232438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:06.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.494067+0000","last_change":"2024-09-21T08:51:44.146281+0000","last_active":"2024-09-21T08:53:44.494067+0000","last_peered":"2024-09-21T08:53:44.494067+0000","last_clean":"2024-09-21T08:53:44.494067+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:53:44.494067+0000","last_undegraded":"2024-09-21T08:53:44.494067+0000","last_fullsized":"2024-09-21T08:53:44.494067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231318+0000","last_change":"2024-09-21T08:51:46.150884+0000","last_active":"2024-09-21T08:52:14.231318+0000","last_peered":"2024-09-21T08:52:14.231318+0000","last_clean":"2024-09-21T08:52:14.231318+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:52:14.231318+0000","last_undegraded":"2024-09-21T08:52:14.231318+0000","last_fullsized":"2024-09-21T08:52:14.231318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:48.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180503+0000","last_change":"2024-09-21T08:51:48.161107+0000","last_active":"2024-09-21T08:53:50.180503+0000","last_peered":"2024-09-21T08:53:50.180503+0000","last_clean":"2024-09-21T08:53:50.180503+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:53:50.180503+0000","last_undegraded":"2024-09-21T08:53:50.180503+0000","last_fullsized":"2024-09-21T08:53:50.180503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:05.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.311433+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:46.311433+0000","last_peered":"2024-09-21T08:54:46.311433+0000","last_clean":"2024-09-21T08:54:46.311433+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:54:46.311433+0000","last_undegraded":"2024-09-21T08:54:46.311433+0000","last_fullsized":"2024-09-21T08:54:46.311433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:28.560398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226315+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:52:14.226315+0000","last_peered":"2024-09-21T08:52:14.226315+0000","last_clean":"2024-09-21T08:52:14.226315+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:52:14.226315+0000","last_undegraded":"2024-09-21T08:52:14.226315+0000","last_fullsized":"2024-09-21T08:52:14.226315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:24.009059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226056+0000","last_change":"2024-09-21T08:51:42.136842+0000","last_active":"2024-09-21T08:52:14.226056+0000","last_peered":"2024-09-21T08:52:14.226056+0000","last_clean":"2024-09-21T08:52:14.226056+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:52:14.226056+0000","last_undegraded":"2024-09-21T08:52:14.226056+0000","last_fullsized":"2024-09-21T08:52:14.226056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.518204+0000","last_change":"2024-09-21T08:51:44.145728+0000","last_active":"2024-09-21T08:53:44.518204+0000","last_peered":"2024-09-21T08:53:44.518204+0000","last_clean":"2024-09-21T08:53:44.518204+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:53:44.518204+0000","last_undegraded":"2024-09-21T08:53:44.518204+0000","last_fullsized":"2024-09-21T08:53:44.518204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:30.360384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":402,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.699230+0000","last_change":"2024-09-21T08:51:46.156417+0000","last_active":"2024-09-21T08:54:46.699230+0000","last_peered":"2024-09-21T08:54:46.699230+0000","last_clean":"2024-09-21T08:54:46.699230+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:46.699230+0000","last_undegraded":"2024-09-21T08:54:46.699230+0000","last_fullsized":"2024-09-21T08:54:46.699230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.289841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179175+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:53:54.179175+0000","last_peered":"2024-09-21T08:53:54.179175+0000","last_clean":"2024-09-21T08:53:54.179175+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:53:54.179175+0000","last_undegraded":"2024-09-21T08:53:54.179175+0000","last_fullsized":"2024-09-21T08:53:54.179175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:56.456030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578009+0000","last_change":"2024-09-21T08:51:40.139340+0000","last_active":"2024-09-21T08:54:46.578009+0000","last_peered":"2024-09-21T08:54:46.578009+0000","last_clean":"2024-09-21T08:54:46.578009+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:54:46.578009+0000","last_undegraded":"2024-09-21T08:54:46.578009+0000","last_fullsized":"2024-09-21T08:54:46.578009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:43.928809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225673+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:52:14.225673+0000","last_peered":"2024-09-21T08:52:14.225673+0000","last_clean":"2024-09-21T08:52:14.225673+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:52:14.225673+0000","last_undegraded":"2024-09-21T08:52:14.225673+0000","last_fullsized":"2024-09-21T08:52:14.225673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:20.136829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'4","reported_seq":602,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.555571+0000","last_change":"2024-09-21T08:51:42.134577+0000","last_active":"2024-09-21T08:53:45.555571+0000","last_peered":"2024-09-21T08:53:45.555571+0000","last_clean":"2024-09-21T08:53:45.555571+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:53:45.555571+0000","last_undegraded":"2024-09-21T08:53:45.555571+0000","last_fullsized":"2024-09-21T08:53:45.555571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230245+0000","last_change":"2024-09-21T08:51:44.144448+0000","last_active":"2024-09-21T08:52:14.230245+0000","last_peered":"2024-09-21T08:52:14.230245+0000","last_clean":"2024-09-21T08:52:14.230245+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:52:14.230245+0000","last_undegraded":"2024-09-21T08:52:14.230245+0000","last_fullsized":"2024-09-21T08:52:14.230245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:36.186338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.660323+0000","last_change":"2024-09-21T08:51:46.147009+0000","last_active":"2024-09-21T08:54:46.660323+0000","last_peered":"2024-09-21T08:54:46.660323+0000","last_clean":"2024-09-21T08:54:46.660323+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:46.660323+0000","last_undegraded":"2024-09-21T08:54:46.660323+0000","last_fullsized":"2024-09-21T08:54:46.660323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.684038+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:45.684038+0000","last_peered":"2024-09-21T08:53:45.684038+0000","last_clean":"2024-09-21T08:53:45.684038+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:45.684038+0000","last_undegraded":"2024-09-21T08:53:45.684038+0000","last_fullsized":"2024-09-21T08:53:45.684038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.217764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535001+0000","last_change":"2024-09-21T08:51:40.143685+0000","last_active":"2024-09-21T08:54:46.535001+0000","last_peered":"2024-09-21T08:54:46.535001+0000","last_clean":"2024-09-21T08:54:46.535001+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:54:46.535001+0000","last_undegraded":"2024-09-21T08:54:46.535001+0000","last_fullsized":"2024-09-21T08:54:46.535001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.644149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.518125+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.518125+0000","last_peered":"2024-09-21T08:54:46.518125+0000","last_clean":"2024-09-21T08:54:46.518125+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.518125+0000","last_undegraded":"2024-09-21T08:54:46.518125+0000","last_fullsized":"2024-09-21T08:54:46.518125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:09.410811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230923+0000","last_change":"2024-09-21T08:51:42.142788+0000","last_active":"2024-09-21T08:52:14.230923+0000","last_peered":"2024-09-21T08:52:14.230923+0000","last_clean":"2024-09-21T08:52:14.230923+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:52:14.230923+0000","last_undegraded":"2024-09-21T08:52:14.230923+0000","last_fullsized":"2024-09-21T08:52:14.230923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:28.690766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.505755+0000","last_change":"2024-09-21T08:51:44.146611+0000","last_active":"2024-09-21T08:53:44.505755+0000","last_peered":"2024-09-21T08:53:44.505755+0000","last_clean":"2024-09-21T08:53:44.505755+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:53:44.505755+0000","last_undegraded":"2024-09-21T08:53:44.505755+0000","last_fullsized":"2024-09-21T08:53:44.505755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:59.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231940+0000","last_change":"2024-09-21T08:51:46.158723+0000","last_active":"2024-09-21T08:52:14.231940+0000","last_peered":"2024-09-21T08:52:14.231940+0000","last_clean":"2024-09-21T08:52:14.231940+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:52:14.231940+0000","last_undegraded":"2024-09-21T08:52:14.231940+0000","last_fullsized":"2024-09-21T08:52:14.231940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:17.004798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.635195+0000","last_change":"2024-09-21T08:51:48.156029+0000","last_active":"2024-09-21T08:54:46.635195+0000","last_peered":"2024-09-21T08:54:46.635195+0000","last_clean":"2024-09-21T08:54:46.635195+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:54:46.635195+0000","last_undegraded":"2024-09-21T08:54:46.635195+0000","last_fullsized":"2024-09-21T08:54:46.635195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:47.978506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399786+0000","last_change":"2024-09-21T08:51:40.141982+0000","last_active":"2024-09-21T08:54:46.399786+0000","last_peered":"2024-09-21T08:54:46.399786+0000","last_clean":"2024-09-21T08:54:46.399786+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:54:46.399786+0000","last_undegraded":"2024-09-21T08:54:46.399786+0000","last_fullsized":"2024-09-21T08:54:46.399786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:59.500749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229118+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:52:14.229118+0000","last_peered":"2024-09-21T08:52:14.229118+0000","last_clean":"2024-09-21T08:52:14.229118+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:52:14.229118+0000","last_undegraded":"2024-09-21T08:52:14.229118+0000","last_fullsized":"2024-09-21T08:52:14.229118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228862+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:52:14.228862+0000","last_peered":"2024-09-21T08:52:14.228862+0000","last_clean":"2024-09-21T08:52:14.228862+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:52:14.228862+0000","last_undegraded":"2024-09-21T08:52:14.228862+0000","last_fullsized":"2024-09-21T08:52:14.228862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179869+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:53:45.179869+0000","last_peered":"2024-09-21T08:53:45.179869+0000","last_clean":"2024-09-21T08:53:45.179869+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:53:45.179869+0000","last_undegraded":"2024-09-21T08:53:45.179869+0000","last_fullsized":"2024-09-21T08:53:45.179869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:33.456799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228510+0000","last_change":"2024-09-21T08:51:42.134377+0000","last_active":"2024-09-21T08:52:14.228510+0000","last_peered":"2024-09-21T08:52:14.228510+0000","last_clean":"2024-09-21T08:52:14.228510+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:52:14.228510+0000","last_undegraded":"2024-09-21T08:52:14.228510+0000","last_fullsized":"2024-09-21T08:52:14.228510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'77","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181599+0000","last_change":"2024-09-21T08:51:44.147739+0000","last_active":"2024-09-21T08:53:55.181599+0000","last_peered":"2024-09-21T08:53:55.181599+0000","last_clean":"2024-09-21T08:53:55.181599+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:53:55.181599+0000","last_undegraded":"2024-09-21T08:53:55.181599+0000","last_fullsized":"2024-09-21T08:53:55.181599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:09.473552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":68,"num_read_kb":57,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227064+0000","last_change":"2024-09-21T08:51:46.152510+0000","last_active":"2024-09-21T08:52:14.227064+0000","last_peered":"2024-09-21T08:52:14.227064+0000","last_clean":"2024-09-21T08:52:14.227064+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:52:14.227064+0000","last_undegraded":"2024-09-21T08:52:14.227064+0000","last_fullsized":"2024-09-21T08:52:14.227064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:46.952503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.612082+0000","last_change":"2024-09-21T08:51:48.153950+0000","last_active":"2024-09-21T08:54:46.612082+0000","last_peered":"2024-09-21T08:54:46.612082+0000","last_clean":"2024-09-21T08:54:46.612082+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:54:46.612082+0000","last_undegraded":"2024-09-21T08:54:46.612082+0000","last_fullsized":"2024-09-21T08:54:46.612082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:39:17.944711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231327+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:52:14.231327+0000","last_peered":"2024-09-21T08:52:14.231327+0000","last_clean":"2024-09-21T08:52:14.231327+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:52:14.231327+0000","last_undegraded":"2024-09-21T08:52:14.231327+0000","last_fullsized":"2024-09-21T08:52:14.231327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:56.405706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223860+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:52:14.223860+0000","last_peered":"2024-09-21T08:52:14.223860+0000","last_clean":"2024-09-21T08:52:14.223860+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:52:14.223860+0000","last_undegraded":"2024-09-21T08:52:14.223860+0000","last_fullsized":"2024-09-21T08:52:14.223860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225233+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:52:14.225233+0000","last_peered":"2024-09-21T08:52:14.225233+0000","last_clean":"2024-09-21T08:52:14.225233+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:52:14.225233+0000","last_undegraded":"2024-09-21T08:52:14.225233+0000","last_fullsized":"2024-09-21T08:52:14.225233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.236996+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:52:14.236996+0000","last_peered":"2024-09-21T08:52:14.236996+0000","last_clean":"2024-09-21T08:52:14.236996+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:52:14.236996+0000","last_undegraded":"2024-09-21T08:52:14.236996+0000","last_fullsized":"2024-09-21T08:52:14.236996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.070327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216405+0000","last_change":"2024-09-21T08:51:44.151651+0000","last_active":"2024-09-21T08:54:42.216405+0000","last_peered":"2024-09-21T08:54:42.216405+0000","last_clean":"2024-09-21T08:54:42.216405+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:42.216405+0000","last_undegraded":"2024-09-21T08:54:42.216405+0000","last_fullsized":"2024-09-21T08:54:42.216405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229206+0000","last_change":"2024-09-21T08:51:46.151027+0000","last_active":"2024-09-21T08:52:14.229206+0000","last_peered":"2024-09-21T08:52:14.229206+0000","last_clean":"2024-09-21T08:52:14.229206+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:52:14.229206+0000","last_undegraded":"2024-09-21T08:52:14.229206+0000","last_fullsized":"2024-09-21T08:52:14.229206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:21.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.174515+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:53:02.174515+0000","last_peered":"2024-09-21T08:53:02.174515+0000","last_clean":"2024-09-21T08:53:02.174515+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:53:02.174515+0000","last_undegraded":"2024-09-21T08:53:02.174515+0000","last_fullsized":"2024-09-21T08:53:02.174515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:09.403435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535009+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.535009+0000","last_peered":"2024-09-21T08:54:46.535009+0000","last_clean":"2024-09-21T08:54:46.535009+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.535009+0000","last_undegraded":"2024-09-21T08:54:46.535009+0000","last_fullsized":"2024-09-21T08:54:46.535009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227766+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:52:14.227766+0000","last_peered":"2024-09-21T08:52:14.227766+0000","last_clean":"2024-09-21T08:52:14.227766+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:52:14.227766+0000","last_undegraded":"2024-09-21T08:52:14.227766+0000","last_fullsized":"2024-09-21T08:52:14.227766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225020+0000","last_change":"2024-09-21T08:51:38.137786+0000","last_active":"2024-09-21T08:52:14.225020+0000","last_peered":"2024-09-21T08:52:14.225020+0000","last_clean":"2024-09-21T08:52:14.225020+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:52:14.225020+0000","last_undegraded":"2024-09-21T08:52:14.225020+0000","last_fullsized":"2024-09-21T08:52:14.225020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.245255+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:52:14.245255+0000","last_peered":"2024-09-21T08:52:14.245255+0000","last_clean":"2024-09-21T08:52:14.245255+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:52:14.245255+0000","last_undegraded":"2024-09-21T08:52:14.245255+0000","last_fullsized":"2024-09-21T08:52:14.245255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.385447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216645+0000","last_change":"2024-09-21T08:51:44.143788+0000","last_active":"2024-09-21T08:54:42.216645+0000","last_peered":"2024-09-21T08:54:42.216645+0000","last_clean":"2024-09-21T08:54:42.216645+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:54:42.216645+0000","last_undegraded":"2024-09-21T08:54:42.216645+0000","last_fullsized":"2024-09-21T08:54:42.216645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:03.808346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226722+0000","last_change":"2024-09-21T08:51:46.152516+0000","last_active":"2024-09-21T08:52:14.226722+0000","last_peered":"2024-09-21T08:52:14.226722+0000","last_clean":"2024-09-21T08:52:14.226722+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:52:14.226722+0000","last_undegraded":"2024-09-21T08:52:14.226722+0000","last_fullsized":"2024-09-21T08:52:14.226722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:34.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224587+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:52:14.224587+0000","last_peered":"2024-09-21T08:52:14.224587+0000","last_clean":"2024-09-21T08:52:14.224587+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:52:14.224587+0000","last_undegraded":"2024-09-21T08:52:14.224587+0000","last_fullsized":"2024-09-21T08:52:14.224587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:11.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.897959+0000","last_change":"2024-09-21T08:51:40.136811+0000","last_active":"2024-09-21T08:52:19.897959+0000","last_peered":"2024-09-21T08:52:19.897959+0000","last_clean":"2024-09-21T08:52:19.897959+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:52:19.897959+0000","last_undegraded":"2024-09-21T08:52:19.897959+0000","last_fullsized":"2024-09-21T08:52:19.897959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224875+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:52:14.224875+0000","last_peered":"2024-09-21T08:52:14.224875+0000","last_clean":"2024-09-21T08:52:14.224875+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:52:14.224875+0000","last_undegraded":"2024-09-21T08:52:14.224875+0000","last_fullsized":"2024-09-21T08:52:14.224875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228110+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:52:14.228110+0000","last_peered":"2024-09-21T08:52:14.228110+0000","last_clean":"2024-09-21T08:52:14.228110+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:52:14.228110+0000","last_undegraded":"2024-09-21T08:52:14.228110+0000","last_fullsized":"2024-09-21T08:52:14.228110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:30.036950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227211+0000","last_change":"2024-09-21T08:51:42.141282+0000","last_active":"2024-09-21T08:52:14.227211+0000","last_peered":"2024-09-21T08:52:14.227211+0000","last_clean":"2024-09-21T08:52:14.227211+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:52:14.227211+0000","last_undegraded":"2024-09-21T08:52:14.227211+0000","last_fullsized":"2024-09-21T08:52:14.227211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.948185+0000","last_change":"2024-09-21T08:51:44.140590+0000","last_active":"2024-09-21T08:54:45.948185+0000","last_peered":"2024-09-21T08:54:45.948185+0000","last_clean":"2024-09-21T08:54:45.948185+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:45.948185+0000","last_undegraded":"2024-09-21T08:54:45.948185+0000","last_fullsized":"2024-09-21T08:54:45.948185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:35.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231632+0000","last_change":"2024-09-21T08:51:46.150420+0000","last_active":"2024-09-21T08:52:14.231632+0000","last_peered":"2024-09-21T08:52:14.231632+0000","last_clean":"2024-09-21T08:52:14.231632+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:52:14.231632+0000","last_undegraded":"2024-09-21T08:52:14.231632+0000","last_fullsized":"2024-09-21T08:52:14.231632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:59.570923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.567201+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.567201+0000","last_peered":"2024-09-21T08:54:46.567201+0000","last_clean":"2024-09-21T08:54:46.567201+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.567201+0000","last_undegraded":"2024-09-21T08:54:46.567201+0000","last_fullsized":"2024-09-21T08:54:46.567201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:38.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898484+0000","last_change":"2024-09-21T08:51:40.142809+0000","last_active":"2024-09-21T08:52:19.898484+0000","last_peered":"2024-09-21T08:52:19.898484+0000","last_clean":"2024-09-21T08:52:19.898484+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:52:19.898484+0000","last_undegraded":"2024-09-21T08:52:19.898484+0000","last_fullsized":"2024-09-21T08:52:19.898484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179133+0000","last_change":"2024-09-21T08:51:38.147128+0000","last_active":"2024-09-21T08:53:45.179133+0000","last_peered":"2024-09-21T08:53:45.179133+0000","last_clean":"2024-09-21T08:53:45.179133+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:53:45.179133+0000","last_undegraded":"2024-09-21T08:53:45.179133+0000","last_fullsized":"2024-09-21T08:53:45.179133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:04.684325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226549+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:52:14.226549+0000","last_peered":"2024-09-21T08:52:14.226549+0000","last_clean":"2024-09-21T08:52:14.226549+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:52:14.226549+0000","last_undegraded":"2024-09-21T08:52:14.226549+0000","last_fullsized":"2024-09-21T08:52:14.226549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178352+0000","last_change":"2024-09-21T08:51:42.136825+0000","last_active":"2024-09-21T08:53:49.178352+0000","last_peered":"2024-09-21T08:53:49.178352+0000","last_clean":"2024-09-21T08:53:49.178352+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:53:49.178352+0000","last_undegraded":"2024-09-21T08:53:49.178352+0000","last_fullsized":"2024-09-21T08:53:49.178352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.517295+0000","last_change":"2024-09-21T08:51:44.146959+0000","last_active":"2024-09-21T08:53:44.517295+0000","last_peered":"2024-09-21T08:53:44.517295+0000","last_clean":"2024-09-21T08:53:44.517295+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:53:44.517295+0000","last_undegraded":"2024-09-21T08:53:44.517295+0000","last_fullsized":"2024-09-21T08:53:44.517295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228236+0000","last_change":"2024-09-21T08:51:46.155541+0000","last_active":"2024-09-21T08:52:14.228236+0000","last_peered":"2024-09-21T08:52:14.228236+0000","last_clean":"2024-09-21T08:52:14.228236+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:52:14.228236+0000","last_undegraded":"2024-09-21T08:52:14.228236+0000","last_fullsized":"2024-09-21T08:52:14.228236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:24.113565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.874713+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:53:45.874713+0000","last_peered":"2024-09-21T08:53:45.874713+0000","last_clean":"2024-09-21T08:53:45.874713+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:53:45.874713+0000","last_undegraded":"2024-09-21T08:53:45.874713+0000","last_fullsized":"2024-09-21T08:53:45.874713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.827304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170271+0000","last_change":"2024-09-21T08:51:40.133246+0000","last_active":"2024-09-21T08:53:02.170271+0000","last_peered":"2024-09-21T08:53:02.170271+0000","last_clean":"2024-09-21T08:53:02.170271+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:53:02.170271+0000","last_undegraded":"2024-09-21T08:53:02.170271+0000","last_fullsized":"2024-09-21T08:53:02.170271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.576389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227037+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:52:14.227037+0000","last_peered":"2024-09-21T08:52:14.227037+0000","last_clean":"2024-09-21T08:52:14.227037+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:52:14.227037+0000","last_undegraded":"2024-09-21T08:52:14.227037+0000","last_fullsized":"2024-09-21T08:52:14.227037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:12.352985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230062+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:52:14.230062+0000","last_peered":"2024-09-21T08:52:14.230062+0000","last_clean":"2024-09-21T08:52:14.230062+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:52:14.230062+0000","last_undegraded":"2024-09-21T08:52:14.230062+0000","last_fullsized":"2024-09-21T08:52:14.230062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224660+0000","last_change":"2024-09-21T08:51:42.136553+0000","last_active":"2024-09-21T08:52:14.224660+0000","last_peered":"2024-09-21T08:52:14.224660+0000","last_clean":"2024-09-21T08:52:14.224660+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:52:14.224660+0000","last_undegraded":"2024-09-21T08:52:14.224660+0000","last_fullsized":"2024-09-21T08:52:14.224660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:23.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:44.152406+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":354,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216399+0000","last_change":"2024-09-21T08:51:46.147127+0000","last_active":"2024-09-21T08:54:42.216399+0000","last_peered":"2024-09-21T08:54:42.216399+0000","last_clean":"2024-09-21T08:54:42.216399+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:54:42.216399+0000","last_undegraded":"2024-09-21T08:54:42.216399+0000","last_fullsized":"2024-09-21T08:54:42.216399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:36.081632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230628+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:52:14.230628+0000","last_peered":"2024-09-21T08:52:14.230628+0000","last_clean":"2024-09-21T08:52:14.230628+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:52:14.230628+0000","last_undegraded":"2024-09-21T08:52:14.230628+0000","last_fullsized":"2024-09-21T08:52:14.230628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:10.942375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170054+0000","last_change":"2024-09-21T08:51:40.145001+0000","last_active":"2024-09-21T08:53:02.170054+0000","last_peered":"2024-09-21T08:53:02.170054+0000","last_clean":"2024-09-21T08:53:02.170054+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:53:02.170054+0000","last_undegraded":"2024-09-21T08:53:02.170054+0000","last_fullsized":"2024-09-21T08:53:02.170054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:09.524590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528793+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.528793+0000","last_peered":"2024-09-21T08:54:46.528793+0000","last_clean":"2024-09-21T08:54:46.528793+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.528793+0000","last_undegraded":"2024-09-21T08:54:46.528793+0000","last_fullsized":"2024-09-21T08:54:46.528793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:48.815999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227389+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:52:14.227389+0000","last_peered":"2024-09-21T08:52:14.227389+0000","last_clean":"2024-09-21T08:52:14.227389+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:52:14.227389+0000","last_undegraded":"2024-09-21T08:52:14.227389+0000","last_fullsized":"2024-09-21T08:52:14.227389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225844+0000","last_change":"2024-09-21T08:51:42.136276+0000","last_active":"2024-09-21T08:52:14.225844+0000","last_peered":"2024-09-21T08:52:14.225844+0000","last_clean":"2024-09-21T08:52:14.225844+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:52:14.225844+0000","last_undegraded":"2024-09-21T08:52:14.225844+0000","last_fullsized":"2024-09-21T08:52:14.225844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:29.036853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.172648+0000","last_change":"2024-09-21T08:51:44.146949+0000","last_active":"2024-09-21T08:53:02.172648+0000","last_peered":"2024-09-21T08:53:02.172648+0000","last_clean":"2024-09-21T08:53:02.172648+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:53:02.172648+0000","last_undegraded":"2024-09-21T08:53:02.172648+0000","last_fullsized":"2024-09-21T08:53:02.172648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:24.672757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695824+0000","last_change":"2024-09-21T08:51:46.157876+0000","last_active":"2024-09-21T08:54:46.695824+0000","last_peered":"2024-09-21T08:54:46.695824+0000","last_clean":"2024-09-21T08:54:46.695824+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:54:46.695824+0000","last_undegraded":"2024-09-21T08:54:46.695824+0000","last_fullsized":"2024-09-21T08:54:46.695824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:58.663889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227725+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:52:14.227725+0000","last_peered":"2024-09-21T08:52:14.227725+0000","last_clean":"2024-09-21T08:52:14.227725+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:52:14.227725+0000","last_undegraded":"2024-09-21T08:52:14.227725+0000","last_fullsized":"2024-09-21T08:52:14.227725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:38.232117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.928314+0000","last_change":"2024-09-21T08:51:40.139991+0000","last_active":"2024-09-21T08:53:45.928314+0000","last_peered":"2024-09-21T08:53:45.928314+0000","last_clean":"2024-09-21T08:53:45.928314+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:53:45.928314+0000","last_undegraded":"2024-09-21T08:53:45.928314+0000","last_fullsized":"2024-09-21T08:53:45.928314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:15.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226716+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:52:14.226716+0000","last_peered":"2024-09-21T08:52:14.226716+0000","last_clean":"2024-09-21T08:52:14.226716+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:52:14.226716+0000","last_undegraded":"2024-09-21T08:52:14.226716+0000","last_fullsized":"2024-09-21T08:52:14.226716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:34.648397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231442+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:52:14.231442+0000","last_peered":"2024-09-21T08:52:14.231442+0000","last_clean":"2024-09-21T08:52:14.231442+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:52:14.231442+0000","last_undegraded":"2024-09-21T08:52:14.231442+0000","last_fullsized":"2024-09-21T08:52:14.231442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.235154+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:52:14.235154+0000","last_peered":"2024-09-21T08:52:14.235154+0000","last_clean":"2024-09-21T08:52:14.235154+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:52:14.235154+0000","last_undegraded":"2024-09-21T08:52:14.235154+0000","last_fullsized":"2024-09-21T08:52:14.235154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:44.480516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.503705+0000","last_change":"2024-09-21T08:51:44.151520+0000","last_active":"2024-09-21T08:53:44.503705+0000","last_peered":"2024-09-21T08:53:44.503705+0000","last_clean":"2024-09-21T08:53:44.503705+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:53:44.503705+0000","last_undegraded":"2024-09-21T08:53:44.503705+0000","last_fullsized":"2024-09-21T08:53:44.503705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:23:27.022747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226572+0000","last_change":"2024-09-21T08:51:46.148294+0000","last_active":"2024-09-21T08:52:14.226572+0000","last_peered":"2024-09-21T08:52:14.226572+0000","last_clean":"2024-09-21T08:52:14.226572+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:52:14.226572+0000","last_undegraded":"2024-09-21T08:52:14.226572+0000","last_fullsized":"2024-09-21T08:52:14.226572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:33.051043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232595+0000","last_change":"2024-09-21T08:51:48.152691+0000","last_active":"2024-09-21T08:52:14.232595+0000","last_peered":"2024-09-21T08:52:14.232595+0000","last_clean":"2024-09-21T08:52:14.232595+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:52:14.232595+0000","last_undegraded":"2024-09-21T08:52:14.232595+0000","last_fullsized":"2024-09-21T08:52:14.232595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:38.470582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.407365+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.407365+0000","last_peered":"2024-09-21T08:54:46.407365+0000","last_clean":"2024-09-21T08:54:46.407365+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.407365+0000","last_undegraded":"2024-09-21T08:54:46.407365+0000","last_fullsized":"2024-09-21T08:54:46.407365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:16.117971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312954+0000","last_change":"2024-09-21T08:51:40.144129+0000","last_active":"2024-09-21T08:54:46.312954+0000","last_peered":"2024-09-21T08:54:46.312954+0000","last_clean":"2024-09-21T08:54:46.312954+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:54:46.312954+0000","last_undegraded":"2024-09-21T08:54:46.312954+0000","last_fullsized":"2024-09-21T08:54:46.312954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:13.975778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228951+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:52:14.228951+0000","last_peered":"2024-09-21T08:52:14.228951+0000","last_clean":"2024-09-21T08:52:14.228951+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:52:14.228951+0000","last_undegraded":"2024-09-21T08:52:14.228951+0000","last_fullsized":"2024-09-21T08:52:14.228951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:30.847013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228755+0000","last_change":"2024-09-21T08:51:42.133381+0000","last_active":"2024-09-21T08:52:14.228755+0000","last_peered":"2024-09-21T08:52:14.228755+0000","last_clean":"2024-09-21T08:52:14.228755+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:52:14.228755+0000","last_undegraded":"2024-09-21T08:52:14.228755+0000","last_fullsized":"2024-09-21T08:52:14.228755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:30.430814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.509388+0000","last_change":"2024-09-21T08:51:44.145046+0000","last_active":"2024-09-21T08:53:44.509388+0000","last_peered":"2024-09-21T08:53:44.509388+0000","last_clean":"2024-09-21T08:53:44.509388+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:53:44.509388+0000","last_undegraded":"2024-09-21T08:53:44.509388+0000","last_fullsized":"2024-09-21T08:53:44.509388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:47.801350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224610+0000","last_change":"2024-09-21T08:51:46.158200+0000","last_active":"2024-09-21T08:52:14.224610+0000","last_peered":"2024-09-21T08:52:14.224610+0000","last_clean":"2024-09-21T08:52:14.224610+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:52:14.224610+0000","last_undegraded":"2024-09-21T08:52:14.224610+0000","last_fullsized":"2024-09-21T08:52:14.224610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:37.227055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.209012+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:44.209012+0000","last_peered":"2024-09-21T08:53:44.209012+0000","last_clean":"2024-09-21T08:53:44.209012+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:44.209012+0000","last_undegraded":"2024-09-21T08:53:44.209012+0000","last_fullsized":"2024-09-21T08:53:44.209012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:31.644486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'5","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181750+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:00.181750+0000","last_peered":"2024-09-21T08:54:00.181750+0000","last_clean":"2024-09-21T08:54:00.181750+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:54:00.181750+0000","last_undegraded":"2024-09-21T08:54:00.181750+0000","last_fullsized":"2024-09-21T08:54:00.181750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.294093+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.294093+0000","last_peered":"2024-09-21T08:54:46.294093+0000","last_clean":"2024-09-21T08:54:46.294093+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.294093+0000","last_undegraded":"2024-09-21T08:54:46.294093+0000","last_fullsized":"2024-09-21T08:54:46.294093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:50.293941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.136260+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:30.066785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953028+0000","last_change":"2024-09-21T08:51:44.144365+0000","last_active":"2024-09-21T08:54:45.953028+0000","last_peered":"2024-09-21T08:54:45.953028+0000","last_clean":"2024-09-21T08:54:45.953028+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:45.953028+0000","last_undegraded":"2024-09-21T08:54:45.953028+0000","last_fullsized":"2024-09-21T08:54:45.953028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:46.704900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227983+0000","last_change":"2024-09-21T08:51:46.158835+0000","last_active":"2024-09-21T08:52:14.227983+0000","last_peered":"2024-09-21T08:52:14.227983+0000","last_clean":"2024-09-21T08:52:14.227983+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:52:14.227983+0000","last_undegraded":"2024-09-21T08:52:14.227983+0000","last_fullsized":"2024-09-21T08:52:14.227983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:32.915843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.029809+0000","last_change":"2024-09-21T08:51:48.154918+0000","last_active":"2024-09-21T08:54:46.029809+0000","last_peered":"2024-09-21T08:54:46.029809+0000","last_clean":"2024-09-21T08:54:46.029809+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:54:46.029809+0000","last_undegraded":"2024-09-21T08:54:46.029809+0000","last_fullsized":"2024-09-21T08:54:46.029809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:16.848003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583334+0000","last_change":"2024-09-21T08:51:40.122583+0000","last_active":"2024-09-21T08:54:46.583334+0000","last_peered":"2024-09-21T08:54:46.583334+0000","last_clean":"2024-09-21T08:54:46.583334+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:54:46.583334+0000","last_undegraded":"2024-09-21T08:54:46.583334+0000","last_fullsized":"2024-09-21T08:54:46.583334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:22.038126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234016+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:52:14.234016+0000","last_peered":"2024-09-21T08:52:14.234016+0000","last_clean":"2024-09-21T08:52:14.234016+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:52:14.234016+0000","last_undegraded":"2024-09-21T08:52:14.234016+0000","last_fullsized":"2024-09-21T08:52:14.234016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:48.539998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226151+0000","last_change":"2024-09-21T08:51:42.140686+0000","last_active":"2024-09-21T08:52:14.226151+0000","last_peered":"2024-09-21T08:52:14.226151+0000","last_clean":"2024-09-21T08:52:14.226151+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:52:14.226151+0000","last_undegraded":"2024-09-21T08:52:14.226151+0000","last_fullsized":"2024-09-21T08:52:14.226151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:42.691888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.010694+0000","last_change":"2024-09-21T08:51:44.143454+0000","last_active":"2024-09-21T08:54:46.010694+0000","last_peered":"2024-09-21T08:54:46.010694+0000","last_clean":"2024-09-21T08:54:46.010694+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:54:46.010694+0000","last_undegraded":"2024-09-21T08:54:46.010694+0000","last_fullsized":"2024-09-21T08:54:46.010694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226645+0000","last_change":"2024-09-21T08:51:46.147907+0000","last_active":"2024-09-21T08:52:14.226645+0000","last_peered":"2024-09-21T08:52:14.226645+0000","last_clean":"2024-09-21T08:52:14.226645+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:52:14.226645+0000","last_undegraded":"2024-09-21T08:52:14.226645+0000","last_fullsized":"2024-09-21T08:52:14.226645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:37.528413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230362+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:52:14.230362+0000","last_peered":"2024-09-21T08:52:14.230362+0000","last_clean":"2024-09-21T08:52:14.230362+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:52:14.230362+0000","last_undegraded":"2024-09-21T08:52:14.230362+0000","last_fullsized":"2024-09-21T08:52:14.230362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:39.412207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223965+0000","last_change":"2024-09-21T08:51:40.145568+0000","last_active":"2024-09-21T08:52:14.223965+0000","last_peered":"2024-09-21T08:52:14.223965+0000","last_clean":"2024-09-21T08:52:14.223965+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:52:14.223965+0000","last_undegraded":"2024-09-21T08:52:14.223965+0000","last_fullsized":"2024-09-21T08:52:14.223965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.236481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.160254+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:53:02.160254+0000","last_peered":"2024-09-21T08:53:02.160254+0000","last_clean":"2024-09-21T08:53:02.160254+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:53:02.160254+0000","last_undegraded":"2024-09-21T08:53:02.160254+0000","last_fullsized":"2024-09-21T08:53:02.160254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224272+0000","last_change":"2024-09-21T08:51:42.139408+0000","last_active":"2024-09-21T08:52:14.224272+0000","last_peered":"2024-09-21T08:52:14.224272+0000","last_clean":"2024-09-21T08:52:14.224272+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:52:14.224272+0000","last_undegraded":"2024-09-21T08:52:14.224272+0000","last_fullsized":"2024-09-21T08:52:14.224272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:32.273127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.496177+0000","last_change":"2024-09-21T08:51:44.145680+0000","last_active":"2024-09-21T08:53:44.496177+0000","last_peered":"2024-09-21T08:53:44.496177+0000","last_clean":"2024-09-21T08:53:44.496177+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:53:44.496177+0000","last_undegraded":"2024-09-21T08:53:44.496177+0000","last_fullsized":"2024-09-21T08:53:44.496177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:10.374149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227427+0000","last_change":"2024-09-21T08:51:46.153528+0000","last_active":"2024-09-21T08:52:14.227427+0000","last_peered":"2024-09-21T08:52:14.227427+0000","last_clean":"2024-09-21T08:52:14.227427+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:52:14.227427+0000","last_undegraded":"2024-09-21T08:52:14.227427+0000","last_fullsized":"2024-09-21T08:52:14.227427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:22.537802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405394+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.405394+0000","last_peered":"2024-09-21T08:54:46.405394+0000","last_clean":"2024-09-21T08:54:46.405394+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.405394+0000","last_undegraded":"2024-09-21T08:54:46.405394+0000","last_fullsized":"2024-09-21T08:54:46.405394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:27.405363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.841739+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:53:45.841739+0000","last_peered":"2024-09-21T08:53:45.841739+0000","last_clean":"2024-09-21T08:53:45.841739+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:53:45.841739+0000","last_undegraded":"2024-09-21T08:53:45.841739+0000","last_fullsized":"2024-09-21T08:53:45.841739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:23.655957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228233+0000","last_change":"2024-09-21T08:51:42.136453+0000","last_active":"2024-09-21T08:52:14.228233+0000","last_peered":"2024-09-21T08:52:14.228233+0000","last_clean":"2024-09-21T08:52:14.228233+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:52:14.228233+0000","last_undegraded":"2024-09-21T08:52:14.228233+0000","last_fullsized":"2024-09-21T08:52:14.228233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'56","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.515168+0000","last_change":"2024-09-21T08:51:44.146351+0000","last_active":"2024-09-21T08:53:44.515168+0000","last_peered":"2024-09-21T08:53:44.515168+0000","last_clean":"2024-09-21T08:53:44.515168+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:53:44.515168+0000","last_undegraded":"2024-09-21T08:53:44.515168+0000","last_fullsized":"2024-09-21T08:53:44.515168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231093+0000","last_change":"2024-09-21T08:51:46.155998+0000","last_active":"2024-09-21T08:52:14.231093+0000","last_peered":"2024-09-21T08:52:14.231093+0000","last_clean":"2024-09-21T08:52:14.231093+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:52:14.231093+0000","last_undegraded":"2024-09-21T08:52:14.231093+0000","last_fullsized":"2024-09-21T08:52:14.231093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:51.236181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.871525+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:53:45.871525+0000","last_peered":"2024-09-21T08:53:45.871525+0000","last_clean":"2024-09-21T08:53:45.871525+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:53:45.871525+0000","last_undegraded":"2024-09-21T08:53:45.871525+0000","last_fullsized":"2024-09-21T08:53:45.871525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:07.375683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.313490+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.313490+0000","last_peered":"2024-09-21T08:54:46.313490+0000","last_clean":"2024-09-21T08:54:46.313490+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.313490+0000","last_undegraded":"2024-09-21T08:54:46.313490+0000","last_fullsized":"2024-09-21T08:54:46.313490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'5","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.274711+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:46.274711+0000","last_peered":"2024-09-21T08:54:46.274711+0000","last_clean":"2024-09-21T08:54:46.274711+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:46.274711+0000","last_undegraded":"2024-09-21T08:54:46.274711+0000","last_fullsized":"2024-09-21T08:54:46.274711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231259+0000","last_change":"2024-09-21T08:51:42.139604+0000","last_active":"2024-09-21T08:52:14.231259+0000","last_peered":"2024-09-21T08:52:14.231259+0000","last_clean":"2024-09-21T08:52:14.231259+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:52:14.231259+0000","last_undegraded":"2024-09-21T08:52:14.231259+0000","last_fullsized":"2024-09-21T08:52:14.231259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.490123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.497130+0000","last_change":"2024-09-21T08:51:44.146257+0000","last_active":"2024-09-21T08:53:44.497130+0000","last_peered":"2024-09-21T08:53:44.497130+0000","last_clean":"2024-09-21T08:53:44.497130+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:53:44.497130+0000","last_undegraded":"2024-09-21T08:53:44.497130+0000","last_fullsized":"2024-09-21T08:53:44.497130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:49.195311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227189+0000","last_change":"2024-09-21T08:51:46.156505+0000","last_active":"2024-09-21T08:52:14.227189+0000","last_peered":"2024-09-21T08:52:14.227189+0000","last_clean":"2024-09-21T08:52:14.227189+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:52:14.227189+0000","last_undegraded":"2024-09-21T08:52:14.227189+0000","last_fullsized":"2024-09-21T08:52:14.227189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:06.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.934131+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:53:45.934131+0000","last_peered":"2024-09-21T08:53:45.934131+0000","last_clean":"2024-09-21T08:53:45.934131+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:53:45.934131+0000","last_undegraded":"2024-09-21T08:53:45.934131+0000","last_fullsized":"2024-09-21T08:53:45.934131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:58.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.142254+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:03.523431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183294+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:10.183294+0000","last_peered":"2024-09-21T08:54:10.183294+0000","last_clean":"2024-09-21T08:54:10.183294+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:10.183294+0000","last_undegraded":"2024-09-21T08:54:10.183294+0000","last_fullsized":"2024-09-21T08:54:10.183294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231343+0000","last_change":"2024-09-21T08:51:42.139686+0000","last_active":"2024-09-21T08:52:14.231343+0000","last_peered":"2024-09-21T08:52:14.231343+0000","last_clean":"2024-09-21T08:52:14.231343+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:52:14.231343+0000","last_undegraded":"2024-09-21T08:52:14.231343+0000","last_fullsized":"2024-09-21T08:52:14.231343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.566863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.513262+0000","last_change":"2024-09-21T08:51:44.141704+0000","last_active":"2024-09-21T08:53:44.513262+0000","last_peered":"2024-09-21T08:53:44.513262+0000","last_clean":"2024-09-21T08:53:44.513262+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:53:44.513262+0000","last_undegraded":"2024-09-21T08:53:44.513262+0000","last_fullsized":"2024-09-21T08:53:44.513262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226978+0000","last_change":"2024-09-21T08:51:46.159395+0000","last_active":"2024-09-21T08:52:14.226978+0000","last_peered":"2024-09-21T08:52:14.226978+0000","last_clean":"2024-09-21T08:52:14.226978+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:52:14.226978+0000","last_undegraded":"2024-09-21T08:52:14.226978+0000","last_fullsized":"2024-09-21T08:52:14.226978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:32.704956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.658263+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.658263+0000","last_peered":"2024-09-21T08:54:46.658263+0000","last_clean":"2024-09-21T08:54:46.658263+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.658263+0000","last_undegraded":"2024-09-21T08:54:46.658263+0000","last_fullsized":"2024-09-21T08:54:46.658263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:05.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535066+0000","last_change":"2024-09-21T08:51:40.136848+0000","last_active":"2024-09-21T08:54:46.535066+0000","last_peered":"2024-09-21T08:54:46.535066+0000","last_clean":"2024-09-21T08:54:46.535066+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:54:46.535066+0000","last_undegraded":"2024-09-21T08:54:46.535066+0000","last_fullsized":"2024-09-21T08:54:46.535066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227140+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:52:14.227140+0000","last_peered":"2024-09-21T08:52:14.227140+0000","last_clean":"2024-09-21T08:52:14.227140+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:52:14.227140+0000","last_undegraded":"2024-09-21T08:52:14.227140+0000","last_fullsized":"2024-09-21T08:52:14.227140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:52.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229052+0000","last_change":"2024-09-21T08:51:42.135155+0000","last_active":"2024-09-21T08:52:14.229052+0000","last_peered":"2024-09-21T08:52:14.229052+0000","last_clean":"2024-09-21T08:52:14.229052+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:52:14.229052+0000","last_undegraded":"2024-09-21T08:52:14.229052+0000","last_fullsized":"2024-09-21T08:52:14.229052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179980+0000","last_change":"2024-09-21T08:51:44.149082+0000","last_active":"2024-09-21T08:53:45.179980+0000","last_peered":"2024-09-21T08:53:45.179980+0000","last_clean":"2024-09-21T08:53:45.179980+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:53:45.179980+0000","last_undegraded":"2024-09-21T08:53:45.179980+0000","last_fullsized":"2024-09-21T08:53:45.179980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:33.834476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.607288+0000","last_change":"2024-09-21T08:51:46.158858+0000","last_active":"2024-09-21T08:54:46.607288+0000","last_peered":"2024-09-21T08:54:46.607288+0000","last_clean":"2024-09-21T08:54:46.607288+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:54:46.607288+0000","last_undegraded":"2024-09-21T08:54:46.607288+0000","last_fullsized":"2024-09-21T08:54:46.607288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223513+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:52:14.223513+0000","last_peered":"2024-09-21T08:52:14.223513+0000","last_clean":"2024-09-21T08:52:14.223513+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:52:14.223513+0000","last_undegraded":"2024-09-21T08:52:14.223513+0000","last_fullsized":"2024-09-21T08:52:14.223513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.887975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583055+0000","last_change":"2024-09-21T08:51:40.133956+0000","last_active":"2024-09-21T08:54:46.583055+0000","last_peered":"2024-09-21T08:54:46.583055+0000","last_clean":"2024-09-21T08:54:46.583055+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:54:46.583055+0000","last_undegraded":"2024-09-21T08:54:46.583055+0000","last_fullsized":"2024-09-21T08:54:46.583055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:08.168952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229125+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:52:14.229125+0000","last_peered":"2024-09-21T08:52:14.229125+0000","last_clean":"2024-09-21T08:52:14.229125+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:52:14.229125+0000","last_undegraded":"2024-09-21T08:52:14.229125+0000","last_fullsized":"2024-09-21T08:52:14.229125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228198+0000","last_change":"2024-09-21T08:51:42.135023+0000","last_active":"2024-09-21T08:52:14.228198+0000","last_peered":"2024-09-21T08:52:14.228198+0000","last_clean":"2024-09-21T08:52:14.228198+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:52:14.228198+0000","last_undegraded":"2024-09-21T08:52:14.228198+0000","last_fullsized":"2024-09-21T08:52:14.228198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.487830+0000","last_change":"2024-09-21T08:51:44.147321+0000","last_active":"2024-09-21T08:53:44.487830+0000","last_peered":"2024-09-21T08:53:44.487830+0000","last_clean":"2024-09-21T08:53:44.487830+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:53:44.487830+0000","last_undegraded":"2024-09-21T08:53:44.487830+0000","last_fullsized":"2024-09-21T08:53:44.487830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225095+0000","last_change":"2024-09-21T08:51:46.152903+0000","last_active":"2024-09-21T08:52:14.225095+0000","last_peered":"2024-09-21T08:52:14.225095+0000","last_clean":"2024-09-21T08:52:14.225095+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:52:14.225095+0000","last_undegraded":"2024-09-21T08:52:14.225095+0000","last_fullsized":"2024-09-21T08:52:14.225095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227463+0000","last_change":"2024-09-21T08:51:48.155963+0000","last_active":"2024-09-21T08:52:14.227463+0000","last_peered":"2024-09-21T08:52:14.227463+0000","last_clean":"2024-09-21T08:52:14.227463+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:52:14.227463+0000","last_undegraded":"2024-09-21T08:52:14.227463+0000","last_fullsized":"2024-09-21T08:52:14.227463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:26.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582875+0000","last_change":"2024-09-21T08:51:40.132727+0000","last_active":"2024-09-21T08:54:46.582875+0000","last_peered":"2024-09-21T08:54:46.582875+0000","last_clean":"2024-09-21T08:54:46.582875+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:54:46.582875+0000","last_undegraded":"2024-09-21T08:54:46.582875+0000","last_fullsized":"2024-09-21T08:54:46.582875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:05.660834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230235+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:52:14.230235+0000","last_peered":"2024-09-21T08:52:14.230235+0000","last_clean":"2024-09-21T08:52:14.230235+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:52:14.230235+0000","last_undegraded":"2024-09-21T08:52:14.230235+0000","last_fullsized":"2024-09-21T08:52:14.230235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:48.192584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230292+0000","last_change":"2024-09-21T08:51:42.142158+0000","last_active":"2024-09-21T08:52:14.230292+0000","last_peered":"2024-09-21T08:52:14.230292+0000","last_clean":"2024-09-21T08:52:14.230292+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:52:14.230292+0000","last_undegraded":"2024-09-21T08:52:14.230292+0000","last_fullsized":"2024-09-21T08:52:14.230292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:52.876334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.489064+0000","last_change":"2024-09-21T08:51:44.146900+0000","last_active":"2024-09-21T08:53:44.489064+0000","last_peered":"2024-09-21T08:53:44.489064+0000","last_clean":"2024-09-21T08:53:44.489064+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:53:44.489064+0000","last_undegraded":"2024-09-21T08:53:44.489064+0000","last_fullsized":"2024-09-21T08:53:44.489064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.326420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224021+0000","last_change":"2024-09-21T08:51:46.154489+0000","last_active":"2024-09-21T08:52:14.224021+0000","last_peered":"2024-09-21T08:52:14.224021+0000","last_clean":"2024-09-21T08:52:14.224021+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:52:14.224021+0000","last_undegraded":"2024-09-21T08:52:14.224021+0000","last_fullsized":"2024-09-21T08:52:14.224021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:28.311454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230785+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:52:14.230785+0000","last_peered":"2024-09-21T08:52:14.230785+0000","last_clean":"2024-09-21T08:52:14.230785+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:52:14.230785+0000","last_undegraded":"2024-09-21T08:52:14.230785+0000","last_fullsized":"2024-09-21T08:52:14.230785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:36:08.427260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602783+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.602783+0000","last_peered":"2024-09-21T08:54:46.602783+0000","last_clean":"2024-09-21T08:54:46.602783+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.602783+0000","last_undegraded":"2024-09-21T08:54:46.602783+0000","last_fullsized":"2024-09-21T08:54:46.602783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:40.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227596+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:52:14.227596+0000","last_peered":"2024-09-21T08:52:14.227596+0000","last_clean":"2024-09-21T08:52:14.227596+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:52:14.227596+0000","last_undegraded":"2024-09-21T08:52:14.227596+0000","last_fullsized":"2024-09-21T08:52:14.227596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:00.290251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229618+0000","last_change":"2024-09-21T08:51:42.137057+0000","last_active":"2024-09-21T08:52:14.229618+0000","last_peered":"2024-09-21T08:52:14.229618+0000","last_clean":"2024-09-21T08:52:14.229618+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:52:14.229618+0000","last_undegraded":"2024-09-21T08:52:14.229618+0000","last_fullsized":"2024-09-21T08:52:14.229618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:17.785662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'27","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.938799+0000","last_change":"2024-09-21T08:51:44.145647+0000","last_active":"2024-09-21T08:53:45.938799+0000","last_peered":"2024-09-21T08:53:45.938799+0000","last_clean":"2024-09-21T08:53:45.938799+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:53:45.938799+0000","last_undegraded":"2024-09-21T08:53:45.938799+0000","last_fullsized":"2024-09-21T08:53:45.938799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:28.199820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224769+0000","last_change":"2024-09-21T08:51:46.154674+0000","last_active":"2024-09-21T08:52:14.224769+0000","last_peered":"2024-09-21T08:52:14.224769+0000","last_clean":"2024-09-21T08:52:14.224769+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:52:14.224769+0000","last_undegraded":"2024-09-21T08:52:14.224769+0000","last_fullsized":"2024-09-21T08:52:14.224769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.520500+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:53:44.520500+0000","last_peered":"2024-09-21T08:53:44.520500+0000","last_clean":"2024-09-21T08:53:44.520500+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:53:44.520500+0000","last_undegraded":"2024-09-21T08:53:44.520500+0000","last_fullsized":"2024-09-21T08:53:44.520500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:36.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.353736+0000","last_change":"2024-09-21T08:51:40.129771+0000","last_active":"2024-09-21T08:53:02.353736+0000","last_peered":"2024-09-21T08:53:02.353736+0000","last_clean":"2024-09-21T08:53:02.353736+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:53:02.353736+0000","last_undegraded":"2024-09-21T08:53:02.353736+0000","last_fullsized":"2024-09-21T08:53:02.353736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:34.355402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227597+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:52:14.227597+0000","last_peered":"2024-09-21T08:52:14.227597+0000","last_clean":"2024-09-21T08:52:14.227597+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:52:14.227597+0000","last_undegraded":"2024-09-21T08:52:14.227597+0000","last_fullsized":"2024-09-21T08:52:14.227597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:11.497380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:43.194165+0000","last_change":"2024-09-21T08:51:42.141642+0000","last_active":"2024-09-21T08:53:43.194165+0000","last_peered":"2024-09-21T08:53:43.194165+0000","last_clean":"2024-09-21T08:53:43.194165+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:53:43.194165+0000","last_undegraded":"2024-09-21T08:53:43.194165+0000","last_fullsized":"2024-09-21T08:53:43.194165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953961+0000","last_change":"2024-09-21T08:51:44.147527+0000","last_active":"2024-09-21T08:54:45.953961+0000","last_peered":"2024-09-21T08:54:45.953961+0000","last_clean":"2024-09-21T08:54:45.953961+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:54:45.953961+0000","last_undegraded":"2024-09-21T08:54:45.953961+0000","last_fullsized":"2024-09-21T08:54:45.953961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:03.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226325+0000","last_change":"2024-09-21T08:51:46.155051+0000","last_active":"2024-09-21T08:52:14.226325+0000","last_peered":"2024-09-21T08:52:14.226325+0000","last_clean":"2024-09-21T08:52:14.226325+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:52:14.226325+0000","last_undegraded":"2024-09-21T08:52:14.226325+0000","last_fullsized":"2024-09-21T08:52:14.226325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.523078+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:53:44.523078+0000","last_peered":"2024-09-21T08:53:44.523078+0000","last_clean":"2024-09-21T08:53:44.523078+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:53:44.523078+0000","last_undegraded":"2024-09-21T08:53:44.523078+0000","last_fullsized":"2024-09-21T08:53:44.523078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:47.237579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.636811+0000","last_change":"2024-09-21T08:51:40.143086+0000","last_active":"2024-09-21T08:52:19.636811+0000","last_peered":"2024-09-21T08:52:19.636811+0000","last_clean":"2024-09-21T08:52:19.636811+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:52:19.636811+0000","last_undegraded":"2024-09-21T08:52:19.636811+0000","last_fullsized":"2024-09-21T08:52:19.636811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:10.757827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781418+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:52:18.781418+0000","last_peered":"2024-09-21T08:52:18.781418+0000","last_clean":"2024-09-21T08:52:18.781418+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:52:18.781418+0000","last_undegraded":"2024-09-21T08:52:18.781418+0000","last_fullsized":"2024-09-21T08:52:18.781418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:16.508900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354678+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:02.354678+0000","last_peered":"2024-09-21T08:53:02.354678+0000","last_clean":"2024-09-21T08:53:02.354678+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:02.354678+0000","last_undegraded":"2024-09-21T08:53:02.354678+0000","last_fullsized":"2024-09-21T08:53:02.354678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.521233+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.521233+0000","last_peered":"2024-09-21T08:54:46.521233+0000","last_clean":"2024-09-21T08:54:46.521233+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.521233+0000","last_undegraded":"2024-09-21T08:54:46.521233+0000","last_fullsized":"2024-09-21T08:54:46.521233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936501+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:45.936501+0000","last_peered":"2024-09-21T08:53:45.936501+0000","last_clean":"2024-09-21T08:53:45.936501+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:45.936501+0000","last_undegraded":"2024-09-21T08:53:45.936501+0000","last_fullsized":"2024-09-21T08:53:45.936501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:44.661851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179857+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:53:45.179857+0000","last_peered":"2024-09-21T08:53:45.179857+0000","last_clean":"2024-09-21T08:53:45.179857+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:53:45.179857+0000","last_undegraded":"2024-09-21T08:53:45.179857+0000","last_fullsized":"2024-09-21T08:53:45.179857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:26.992698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608820+0000","last_change":"2024-09-21T08:51:40.136629+0000","last_active":"2024-09-21T08:54:46.608820+0000","last_peered":"2024-09-21T08:54:46.608820+0000","last_clean":"2024-09-21T08:54:46.608820+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:54:46.608820+0000","last_undegraded":"2024-09-21T08:54:46.608820+0000","last_fullsized":"2024-09-21T08:54:46.608820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:57.025963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602613+0000","last_change":"2024-09-21T08:51:40.130372+0000","last_active":"2024-09-21T08:54:46.602613+0000","last_peered":"2024-09-21T08:54:46.602613+0000","last_clean":"2024-09-21T08:54:46.602613+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:54:46.602613+0000","last_undegraded":"2024-09-21T08:54:46.602613+0000","last_fullsized":"2024-09-21T08:54:46.602613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:32.855034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.880617+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:52:19.880617+0000","last_peered":"2024-09-21T08:52:19.880617+0000","last_clean":"2024-09-21T08:52:19.880617+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:52:19.880617+0000","last_undegraded":"2024-09-21T08:52:19.880617+0000","last_fullsized":"2024-09-21T08:52:19.880617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:53.742244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609556+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609556+0000","last_peered":"2024-09-21T08:54:46.609556+0000","last_clean":"2024-09-21T08:54:46.609556+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609556+0000","last_undegraded":"2024-09-21T08:54:46.609556+0000","last_fullsized":"2024-09-21T08:54:46.609556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:58.432631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227339+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.227339+0000","last_peered":"2024-09-21T08:52:14.227339+0000","last_clean":"2024-09-21T08:52:14.227339+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:52:14.227339+0000","last_undegraded":"2024-09-21T08:52:14.227339+0000","last_fullsized":"2024-09-21T08:52:14.227339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:08.084918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.303531+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:52:19.303531+0000","last_peered":"2024-09-21T08:52:19.303531+0000","last_clean":"2024-09-21T08:52:19.303531+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:52:19.303531+0000","last_undegraded":"2024-09-21T08:52:19.303531+0000","last_fullsized":"2024-09-21T08:52:19.303531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.883350+0000","last_change":"2024-09-21T08:51:38.145888+0000","last_active":"2024-09-21T08:52:19.883350+0000","last_peered":"2024-09-21T08:52:19.883350+0000","last_clean":"2024-09-21T08:52:19.883350+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:52:19.883350+0000","last_undegraded":"2024-09-21T08:52:19.883350+0000","last_fullsized":"2024-09-21T08:52:19.883350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:12.474475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602717+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.602717+0000","last_peered":"2024-09-21T08:54:46.602717+0000","last_clean":"2024-09-21T08:54:46.602717+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.602717+0000","last_undegraded":"2024-09-21T08:54:46.602717+0000","last_fullsized":"2024-09-21T08:54:46.602717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.886383+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:52:19.886383+0000","last_peered":"2024-09-21T08:52:19.886383+0000","last_clean":"2024-09-21T08:52:19.886383+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:52:19.886383+0000","last_undegraded":"2024-09-21T08:52:19.886383+0000","last_fullsized":"2024-09-21T08:52:19.886383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:27.938724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602644+0000","last_change":"2024-09-21T08:51:40.137071+0000","last_active":"2024-09-21T08:54:46.602644+0000","last_peered":"2024-09-21T08:54:46.602644+0000","last_clean":"2024-09-21T08:54:46.602644+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:54:46.602644+0000","last_undegraded":"2024-09-21T08:54:46.602644+0000","last_fullsized":"2024-09-21T08:54:46.602644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.480193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224082+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:52:14.224082+0000","last_peered":"2024-09-21T08:52:14.224082+0000","last_clean":"2024-09-21T08:52:14.224082+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:52:14.224082+0000","last_undegraded":"2024-09-21T08:52:14.224082+0000","last_fullsized":"2024-09-21T08:52:14.224082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:59.614757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609381+0000","last_change":"2024-09-21T08:51:40.140110+0000","last_active":"2024-09-21T08:54:46.609381+0000","last_peered":"2024-09-21T08:54:46.609381+0000","last_clean":"2024-09-21T08:54:46.609381+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:54:46.609381+0000","last_undegraded":"2024-09-21T08:54:46.609381+0000","last_fullsized":"2024-09-21T08:54:46.609381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:55.756332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.515119+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.515119+0000","last_peered":"2024-09-21T08:54:46.515119+0000","last_clean":"2024-09-21T08:54:46.515119+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.515119+0000","last_undegraded":"2024-09-21T08:54:46.515119+0000","last_fullsized":"2024-09-21T08:54:46.515119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578020+0000","last_change":"2024-09-21T08:51:40.129690+0000","last_active":"2024-09-21T08:54:46.578020+0000","last_peered":"2024-09-21T08:54:46.578020+0000","last_clean":"2024-09-21T08:54:46.578020+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:54:46.578020+0000","last_undegraded":"2024-09-21T08:54:46.578020+0000","last_fullsized":"2024-09-21T08:54:46.578020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227220+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:52:14.227220+0000","last_peered":"2024-09-21T08:52:14.227220+0000","last_clean":"2024-09-21T08:52:14.227220+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:52:14.227220+0000","last_undegraded":"2024-09-21T08:52:14.227220+0000","last_fullsized":"2024-09-21T08:52:14.227220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312075+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.312075+0000","last_peered":"2024-09-21T08:54:46.312075+0000","last_clean":"2024-09-21T08:54:46.312075+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.312075+0000","last_undegraded":"2024-09-21T08:54:46.312075+0000","last_fullsized":"2024-09-21T08:54:46.312075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225656+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:52:14.225656+0000","last_peered":"2024-09-21T08:52:14.225656+0000","last_clean":"2024-09-21T08:52:14.225656+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:52:14.225656+0000","last_undegraded":"2024-09-21T08:52:14.225656+0000","last_fullsized":"2024-09-21T08:52:14.225656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:47.826428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'11","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583270+0000","last_change":"2024-09-21T08:51:40.141700+0000","last_active":"2024-09-21T08:54:46.583270+0000","last_peered":"2024-09-21T08:54:46.583270+0000","last_clean":"2024-09-21T08:54:46.583270+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:54:46.583270+0000","last_undegraded":"2024-09-21T08:54:46.583270+0000","last_fullsized":"2024-09-21T08:54:46.583270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:11.312454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229520+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:52:14.229520+0000","last_peered":"2024-09-21T08:52:14.229520+0000","last_clean":"2024-09-21T08:52:14.229520+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:52:14.229520+0000","last_undegraded":"2024-09-21T08:52:14.229520+0000","last_fullsized":"2024-09-21T08:52:14.229520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:10.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228569+0000","last_change":"2024-09-21T08:51:40.137601+0000","last_active":"2024-09-21T08:52:14.228569+0000","last_peered":"2024-09-21T08:52:14.228569+0000","last_clean":"2024-09-21T08:52:14.228569+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:52:14.228569+0000","last_undegraded":"2024-09-21T08:52:14.228569+0000","last_fullsized":"2024-09-21T08:52:14.228569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524736+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.524736+0000","last_peered":"2024-09-21T08:54:46.524736+0000","last_clean":"2024-09-21T08:54:46.524736+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.524736+0000","last_undegraded":"2024-09-21T08:54:46.524736+0000","last_fullsized":"2024-09-21T08:54:46.524736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.740205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.577907+0000","last_change":"2024-09-21T08:51:40.139425+0000","last_active":"2024-09-21T08:54:46.577907+0000","last_peered":"2024-09-21T08:54:46.577907+0000","last_clean":"2024-09-21T08:54:46.577907+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:54:46.577907+0000","last_undegraded":"2024-09-21T08:54:46.577907+0000","last_fullsized":"2024-09-21T08:54:46.577907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.312677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234554+0000","last_change":"2024-09-21T08:51:38.149787+0000","last_active":"2024-09-21T08:52:14.234554+0000","last_peered":"2024-09-21T08:52:14.234554+0000","last_clean":"2024-09-21T08:52:14.234554+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:52:14.234554+0000","last_undegraded":"2024-09-21T08:52:14.234554+0000","last_fullsized":"2024-09-21T08:52:14.234554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:50.908268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:20.354197+0000","last_change":"2024-09-21T08:51:40.139999+0000","last_active":"2024-09-21T08:52:20.354197+0000","last_peered":"2024-09-21T08:52:20.354197+0000","last_clean":"2024-09-21T08:52:20.354197+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:52:20.354197+0000","last_undegraded":"2024-09-21T08:52:20.354197+0000","last_fullsized":"2024-09-21T08:52:20.354197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.888167+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:53:45.888167+0000","last_peered":"2024-09-21T08:53:45.888167+0000","last_clean":"2024-09-21T08:53:45.888167+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:53:45.888167+0000","last_undegraded":"2024-09-21T08:53:45.888167+0000","last_fullsized":"2024-09-21T08:53:45.888167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:58.598806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224454+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.224454+0000","last_peered":"2024-09-21T08:52:14.224454+0000","last_clean":"2024-09-21T08:52:14.224454+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:52:14.224454+0000","last_undegraded":"2024-09-21T08:52:14.224454+0000","last_fullsized":"2024-09-21T08:52:14.224454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:02.905185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399878+0000","last_change":"2024-09-21T08:51:40.136460+0000","last_active":"2024-09-21T08:54:46.399878+0000","last_peered":"2024-09-21T08:54:46.399878+0000","last_clean":"2024-09-21T08:54:46.399878+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:54:46.399878+0000","last_undegraded":"2024-09-21T08:54:46.399878+0000","last_fullsized":"2024-09-21T08:54:46.399878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225460+0000","last_change":"2024-09-21T08:51:38.149631+0000","last_active":"2024-09-21T08:52:14.225460+0000","last_peered":"2024-09-21T08:52:14.225460+0000","last_clean":"2024-09-21T08:52:14.225460+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:52:14.225460+0000","last_undegraded":"2024-09-21T08:52:14.225460+0000","last_fullsized":"2024-09-21T08:52:14.225460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936952+0000","last_change":"2024-09-21T08:51:40.144724+0000","last_active":"2024-09-21T08:53:45.936952+0000","last_peered":"2024-09-21T08:53:45.936952+0000","last_clean":"2024-09-21T08:53:45.936952+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:53:45.936952+0000","last_undegraded":"2024-09-21T08:53:45.936952+0000","last_fullsized":"2024-09-21T08:53:45.936952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44344,"kb_used_data":9000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327496,"statfs":{"total":96636764160,"available":96591355904,"internally_reserved":0,"allocated":9216000,"data_stored":8872727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48948,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322892,"statfs":{"total":96636764160,"available":96586641408,"internally_reserved":0,"allocated":13930496,"data_stored":13653978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":11272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":11542528,"data_stored":11233488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7086080,"data_stored":6775541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:54:54.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:54:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.486+0000 7fc8ae277640 1 Processor -- start 2024-09-21T08:54:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.486+0000 7fc8ae277640 1 -- start start 2024-09-21T08:54:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.486+0000 7fc8ae277640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8a812e940 0x7fc8a8130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.486+0000 7fc8ae277640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a806eba0 con 0x7fc8a806eda0 2024-09-21T08:54:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.486+0000 7fc8ae277640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a806d2f0 con 0x7fc8a812e940 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc8a7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc8a806eda0 0x7fc8a806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46294/0 (socket says 172.21.15.29:46294) 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc8a7fff640 1 -- 172.21.15.29:0/941253773 learned_addr learned my addr 172.21.15.29:0/941253773 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc89ffff640 1 --2- 172.21.15.29:0/941253773 >> v2:172.21.15.29:3300/0 conn(0x7fc8a812e940 0x7fc8a8130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc8a77fe640 1 -- 172.21.15.29:0/941253773 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155217280 0 0) 0x7fc8a806eba0 con 0x7fc8a806eda0 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc8a77fe640 1 -- 172.21.15.29:0/941253773 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc894003520 con 0x7fc8a806eda0 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc89ffff640 1 -- 172.21.15.29:0/941253773 >> v1:172.21.15.29:6789/0 conn(0x7fc8a806eda0 legacy=0x7fc8a806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.487+0000 7fc89ffff640 1 -- 172.21.15.29:0/941253773 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a8070d50 con 0x7fc8a812e940 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc89ffff640 1 --2- 172.21.15.29:0/941253773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a812e940 0x7fc8a8130d30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc890009720 tx=0x7fc89002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a590ce10fc788 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8a77fe640 1 -- 172.21.15.29:0/941253773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc890037070 con 0x7fc8a812e940 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8a77fe640 1 -- 172.21.15.29:0/941253773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89002ae20 con 0x7fc8a812e940 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8a77fe640 1 -- 172.21.15.29:0/941253773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc890032570 con 0x7fc8a812e940 2024-09-21T08:54:54.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 -- 172.21.15.29:0/941253773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a812e940 msgr2=0x7fc8a8130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 --2- 172.21.15.29:0/941253773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a812e940 0x7fc8a8130d30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc890009720 tx=0x7fc89002a1a0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 -- 172.21.15.29:0/941253773 shutdown_connections 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 --2- 172.21.15.29:0/941253773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a812e940 0x7fc8a8130d30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 -- 172.21.15.29:0/941253773 >> 172.21.15.29:0/941253773 conn(0x7fc8a809a890 msgr2=0x7fc8a809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 -- 172.21.15.29:0/941253773 shutdown_connections 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.488+0000 7fc8ae277640 1 -- 172.21.15.29:0/941253773 wait complete. 2024-09-21T08:54:54.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.489+0000 7fc8ae277640 1 Processor -- start 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.489+0000 7fc8ae277640 1 -- start start 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8ae277640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8ae277640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a806fcd0 con 0x7fc8a806eda0 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53730/0 (socket says 172.21.15.29:53730) 2024-09-21T08:54:54.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a7fff640 1 -- 172.21.15.29:0/3047315702 learned_addr learned my addr 172.21.15.29:0/3047315702 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a7fff640 1 -- 172.21.15.29:0/3047315702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a8128350 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a7fff640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c3b0 tx=0x7fc89800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc898017070 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898005c10 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8980070d0 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a8125d80 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.490+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a8122fc0 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.491+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc89801a070 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.491+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a806f180 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.491+0000 7fc8a57fa640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 0x7fc88803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.491+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc89804b170 con 0x7fc8a806eda0 2024-09-21T08:54:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.492+0000 7fc89ffff640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 0x7fc88803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.492+0000 7fc89ffff640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 0x7fc88803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.496+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc898019e10 con 0x7fc8a806eda0 2024-09-21T08:54:54.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.672+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8a812e270 con 0x7fc8a806eda0 2024-09-21T08:54:54.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.673+0000 7fc8a57fa640 1 -- 172.21.15.29:0/3047315702 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21227 (secure 0 0 0) 0x7fc898010b90 con 0x7fc8a806eda0 2024-09-21T08:54:54.676 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:54:54.676 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"fsid":"cbe6e3ef-ff28-4e6a-9cd0-a5b68367091a","created":"2024-09-21T08:51:09.099153+0000","modified":"2024-09-21T08:52:14.220368+0000","last_up_change":"2024-09-21T08:51:19.491480+0000","last_in_change":"2024-09-21T08:51:10.125422+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T08:51:21.193119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T08:51:24.662885+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-21T08:51:36.134691+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-21T08:51:38.460162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-21T08:51:40.471100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-21T08:51:42.231500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-21T08:51:44.181404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-21T08:51:46.256064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"714d784d-ac09-47ed-8d27-1cb6f40cc329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6801","nonce":3430791726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6803","nonce":3430791726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6807","nonce":3430791726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3430791726},{"type":"v1","addr":"172.21.15.29:6805","nonce":3430791726}]},"public_addr":"172.21.15.29:6801/3430791726","cluster_addr":"172.21.15.29:6803/3430791726","heartbeat_back_addr":"172.21.15.29:6807/3430791726","heartbeat_front_addr":"172.21.15.29:6805/3430791726","state":["exists","up"]},{"osd":1,"uuid":"bf1b1902-3d56-41a8-875d-450faadbaacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6809","nonce":2855083704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6811","nonce":2855083704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6815","nonce":2855083704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2855083704},{"type":"v1","addr":"172.21.15.196:6813","nonce":2855083704}]},"public_addr":"172.21.15.196:6809/2855083704","cluster_addr":"172.21.15.196:6811/2855083704","heartbeat_back_addr":"172.21.15.196:6815/2855083704","heartbeat_front_addr":"172.21.15.196:6813/2855083704","state":["exists","up"]},{"osd":2,"uuid":"c7bb78c2-1ae4-47d5-81e2-4e7fd6589e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6817","nonce":3551232799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6819","nonce":3551232799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6823","nonce":3551232799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3551232799},{"type":"v1","addr":"172.21.15.196:6821","nonce":3551232799}]},"public_addr":"172.21.15.196:6817/3551232799","cluster_addr":"172.21.15.196:6819/3551232799","heartbeat_back_addr":"172.21.15.196:6823/3551232799","heartbeat_front_addr":"172.21.15.196:6821/3551232799","state":["exists","up"]},{"osd":3,"uuid":"9c0a545d-00f4-4e74-b0b2-cff5cc65f4ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6801","nonce":127179937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6803","nonce":127179937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6807","nonce":127179937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":127179937},{"type":"v1","addr":"172.21.15.196:6805","nonce":127179937}]},"public_addr":"172.21.15.196:6801/127179937","cluster_addr":"172.21.15.196:6803/127179937","heartbeat_back_addr":"172.21.15.196:6807/127179937","heartbeat_front_addr":"172.21.15.196:6805/127179937","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.562002+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:16.886611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.464880+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T08:51:17.134208+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.22","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.0","mappings":[{"from":0,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:54:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 msgr2=0x7fc88803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 0x7fc88803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).stop 2024-09-21T08:54:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 msgr2=0x7fc8a8096770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c3b0 tx=0x7fc89800c870 comp rx=0 tx=0).stop 2024-09-21T08:54:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 shutdown_connections 2024-09-21T08:54:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc8880382a0 0x7fc88803a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 --2- 172.21.15.29:0/3047315702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a806eda0 0x7fc8a8096770 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 >> 172.21.15.29:0/3047315702 conn(0x7fc8a809a890 msgr2=0x7fc8a812ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 shutdown_connections 2024-09-21T08:54:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:54.676+0000 7fc8ae277640 1 -- 172.21.15.29:0/3047315702 wait complete. 2024-09-21T08:54:55.690 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T08:54:55.690 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T08:54:55.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6cc8b640 1 Processor -- start 2024-09-21T08:54:55.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6cc8b640 1 -- start start 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6cc8b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda68071aa0 0x7fda68071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6cc8b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda68071520 con 0x7fda680723c0 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6cc8b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fda68070130 con 0x7fda68071aa0 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda6659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda68071aa0 0x7fda68071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda65d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fda680723c0 0x7fda6806e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46308/0 (socket says 172.21.15.29:46308) 2024-09-21T08:54:55.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.806+0000 7fda65d9b640 1 -- 172.21.15.29:0/292171000 learned_addr learned my addr 172.21.15.29:0/292171000 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:55.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.807+0000 7fda6659c640 1 -- 172.21.15.29:0/292171000 >> v1:172.21.15.29:6789/0 conn(0x7fda680723c0 legacy=0x7fda6806e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.807+0000 7fda6659c640 1 -- 172.21.15.29:0/292171000 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680727d0 con 0x7fda68071aa0 2024-09-21T08:54:55.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.807+0000 7fda6559a640 1 -- 172.21.15.29:0/292171000 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542261627 0 0) 0x7fda68071520 con 0x7fda680723c0 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6659c640 1 --2- 172.21.15.29:0/292171000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68071e80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fda5800b9c0 tx=0x7fda5802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e383ddc63e9e28be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6559a640 1 -- 172.21.15.29:0/292171000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58031640 con 0x7fda68071aa0 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6559a640 1 -- 172.21.15.29:0/292171000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda580317e0 con 0x7fda68071aa0 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6559a640 1 -- 172.21.15.29:0/292171000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58031ae0 con 0x7fda68071aa0 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 -- 172.21.15.29:0/292171000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 msgr2=0x7fda68071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/292171000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68071e80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fda5800b9c0 tx=0x7fda5802c7e0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 -- 172.21.15.29:0/292171000 shutdown_connections 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/292171000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68071e80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 -- 172.21.15.29:0/292171000 >> 172.21.15.29:0/292171000 conn(0x7fda6809df80 msgr2=0x7fda6809e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 -- 172.21.15.29:0/292171000 shutdown_connections 2024-09-21T08:54:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.808+0000 7fda6cc8b640 1 -- 172.21.15.29:0/292171000 wait complete. 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.809+0000 7fda6cc8b640 1 Processor -- start 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.809+0000 7fda6cc8b640 1 -- start start 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6cc8b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6cc8b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fda6806f070 con 0x7fda68071aa0 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53754/0 (socket says 172.21.15.29:53754) 2024-09-21T08:54:55.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6659c640 1 -- 172.21.15.29:0/75144395 learned_addr learned my addr 172.21.15.29:0/75144395 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6659c640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68072a60 con 0x7fda68071aa0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.810+0000 7fda6659c640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.811+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58033be0 con 0x7fda68071aa0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.811+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda58033da0 con 0x7fda68071aa0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.811+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda68095be0 con 0x7fda68071aa0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.811+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5803e590 con 0x7fda68071aa0 2024-09-21T08:54:55.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.811+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda680945a0 con 0x7fda68071aa0 2024-09-21T08:54:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda68097e60 con 0x7fda68071aa0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda5803b040 con 0x7fda68071aa0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 0x7fda4803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fda5806f6d0 con 0x7fda68071aa0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 0x7fda48046b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda5804ce80 con 0x7fda480446a0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fda58076050 con 0x7fda68071aa0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda66d9d640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 0x7fda48046b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda65d9b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 0x7fda4803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.812+0000 7fda66d9d640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 0x7fda48046b40 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.813+0000 7fda65d9b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 0x7fda4803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda5c000c00 tx=0x7fda5c007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.813+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== osd.0 v2:172.21.15.29:6800/3430791726 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda5804ce80 con 0x7fda480446a0 2024-09-21T08:54:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 --> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda68071e80 con 0x7fda480446a0 2024-09-21T08:54:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda56ffd640 1 -- 172.21.15.29:0/75144395 <== osd.0 v2:172.21.15.29:6800/3430791726 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda68071e80 con 0x7fda480446a0 2024-09-21T08:54:55.830 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T08:54:55.831 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T08:54:55.831 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T08:54:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 msgr2=0x7fda48046b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 0x7fda48046b40 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 msgr2=0x7fda4803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 0x7fda4803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda5c000c00 tx=0x7fda5c007970 comp rx=0 tx=0).stop 2024-09-21T08:54:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 msgr2=0x7fda68094060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda580046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 shutdown_connections 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:6800/3430791726,v1:172.21.15.29:6801/3430791726] conn(0x7fda480446a0 0x7fda48046b40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fda480382a0 0x7fda4803a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 --2- 172.21.15.29:0/75144395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda68071aa0 0x7fda68094060 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.826+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 >> 172.21.15.29:0/75144395 conn(0x7fda6809df80 msgr2=0x7fda6808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.827+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 shutdown_connections 2024-09-21T08:54:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.827+0000 7fda6cc8b640 1 -- 172.21.15.29:0/75144395 wait complete. 2024-09-21T08:54:55.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T08:54:55.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.939+0000 7fbd7061e640 1 Processor -- start 2024-09-21T08:54:55.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.939+0000 7fbd7061e640 1 -- start start 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.939+0000 7fbd7061e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd6812cca0 0x7fbd6812d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.939+0000 7fbd7061e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6812d5c0 con 0x7fbd681290e0 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.939+0000 7fbd7061e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6806e350 con 0x7fbd6812cca0 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6e3ba640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd6812cca0 0x7fbd6812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6dbb9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd681290e0 0x7fbd68129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46320/0 (socket says 172.21.15.29:46320) 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6dbb9640 1 -- 172.21.15.29:0/1792386999 learned_addr learned my addr 172.21.15.29:0/1792386999 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6e3ba640 1 -- 172.21.15.29:0/1792386999 >> v1:172.21.15.29:6789/0 conn(0x7fbd681290e0 legacy=0x7fbd68129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6e3ba640 1 -- 172.21.15.29:0/1792386999 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd68071f70 con 0x7fbd6812cca0 2024-09-21T08:54:55.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.940+0000 7fbd6d3b8640 1 -- 172.21.15.29:0/1792386999 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551989798 0 0) 0x7fbd6812d5c0 con 0x7fbd681290e0 2024-09-21T08:54:55.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd6e3ba640 1 --2- 172.21.15.29:0/1792386999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6812cca0 0x7fbd6812d080 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009720 tx=0x7fbd5c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1d5a9859d9f2c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd6d3b8640 1 -- 172.21.15.29:0/1792386999 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c037070 con 0x7fbd6812cca0 2024-09-21T08:54:55.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd6d3b8640 1 -- 172.21.15.29:0/1792386999 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c02ad90 con 0x7fbd6812cca0 2024-09-21T08:54:55.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd6d3b8640 1 -- 172.21.15.29:0/1792386999 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c032590 con 0x7fbd6812cca0 2024-09-21T08:54:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 -- 172.21.15.29:0/1792386999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6812cca0 msgr2=0x7fbd6812d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 --2- 172.21.15.29:0/1792386999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6812cca0 0x7fbd6812d080 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009720 tx=0x7fbd5c02a110 comp rx=0 tx=0).stop 2024-09-21T08:54:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 -- 172.21.15.29:0/1792386999 shutdown_connections 2024-09-21T08:54:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 --2- 172.21.15.29:0/1792386999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6812cca0 0x7fbd6812d080 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:55.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 -- 172.21.15.29:0/1792386999 >> 172.21.15.29:0/1792386999 conn(0x7fbd6809a890 msgr2=0x7fbd6809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 -- 172.21.15.29:0/1792386999 shutdown_connections 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.941+0000 7fbd7061e640 1 -- 172.21.15.29:0/1792386999 wait complete. 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.942+0000 7fbd7061e640 1 Processor -- start 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.942+0000 7fbd7061e640 1 -- start start 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd7061e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd7061e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68070e60 con 0x7fbd681290e0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd6e3ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd6e3ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53772/0 (socket says 172.21.15.29:53772) 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd6e3ba640 1 -- 172.21.15.29:0/2789815752 learned_addr learned my addr 172.21.15.29:0/2789815752 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd6e3ba640 1 -- 172.21.15.29:0/2789815752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6808c3f0 con 0x7fbd681290e0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd6e3ba640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009840 tx=0x7fbd5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c041070 con 0x7fbd681290e0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c03c460 con 0x7fbd681290e0 2024-09-21T08:54:55.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681265a0 con 0x7fbd681290e0 2024-09-21T08:54:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c037040 con 0x7fbd681290e0 2024-09-21T08:54:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.943+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6808d500 con 0x7fbd681290e0 2024-09-21T08:54:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.944+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbd5c044070 con 0x7fbd681290e0 2024-09-21T08:54:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.944+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6808e010 con 0x7fbd681290e0 2024-09-21T08:54:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.945+0000 7fbd5affd640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 0x7fbd4c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.945+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbd5c06c620 con 0x7fbd681290e0 2024-09-21T08:54:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.945+0000 7fbd6dbb9640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 0x7fbd4c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.945+0000 7fbd6dbb9640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 0x7fbd4c03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:55.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:55.949+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd5c03c760 con 0x7fbd681290e0 2024-09-21T08:54:56.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.125+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbd6808c870 con 0x7fbd4c0382a0 2024-09-21T08:54:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.127+0000 7fbd5affd640 1 -- 172.21.15.29:0/2789815752 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbd6808c870 con 0x7fbd4c0382a0 2024-09-21T08:54:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T08:54:56.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 msgr2=0x7fbd4c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 0x7fbd4c03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64007a40 comp rx=0 tx=0).stop 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 msgr2=0x7fbd6808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009840 tx=0x7fbd5c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 shutdown_connections 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fbd4c0382a0 0x7fbd4c03a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.128+0000 7fbd7061e640 1 --2- 172.21.15.29:0/2789815752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd681290e0 0x7fbd6808afc0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.129+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 >> 172.21.15.29:0/2789815752 conn(0x7fbd6809a890 msgr2=0x7fbd68128980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.129+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 shutdown_connections 2024-09-21T08:54:56.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.129+0000 7fbd7061e640 1 -- 172.21.15.29:0/2789815752 wait complete. 2024-09-21T08:54:56.142 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T08:54:56.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T08:54:56.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.245+0000 7f7ef79d6640 1 Processor -- start 2024-09-21T08:54:56.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.245+0000 7f7ef79d6640 1 -- start start 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef79d6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ef00995d0 0x7f7ef0099c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef79d6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef0098a60 con 0x7f7ef009a1c0 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef79d6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef00992c0 con 0x7f7ef00995d0 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef5772640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ef00995d0 0x7f7ef0099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef4f71640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7ef009a1c0 0x7f7ef009be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46334/0 (socket says 172.21.15.29:46334) 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef4f71640 1 -- 172.21.15.29:0/1451173155 learned_addr learned my addr 172.21.15.29:0/1451173155 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef5772640 1 -- 172.21.15.29:0/1451173155 >> v1:172.21.15.29:6789/0 conn(0x7f7ef009a1c0 legacy=0x7f7ef009be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ee7fff640 1 -- 172.21.15.29:0/1451173155 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311906457 0 0) 0x7f7ef0098a60 con 0x7f7ef009a1c0 2024-09-21T08:54:56.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.246+0000 7f7ef5772640 1 -- 172.21.15.29:0/1451173155 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef009a5d0 con 0x7f7ef00995d0 2024-09-21T08:54:56.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.247+0000 7f7ef5772640 1 --2- 172.21.15.29:0/1451173155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0099c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009720 tx=0x7f7eec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c884276796845dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.247+0000 7f7ee7fff640 1 -- 172.21.15.29:0/1451173155 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec037070 con 0x7f7ef00995d0 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.247+0000 7f7ee7fff640 1 -- 172.21.15.29:0/1451173155 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec02ad90 con 0x7f7ef00995d0 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.247+0000 7f7ee7fff640 1 -- 172.21.15.29:0/1451173155 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec032590 con 0x7f7ef00995d0 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 -- 172.21.15.29:0/1451173155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 msgr2=0x7f7ef0099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/1451173155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0099c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009720 tx=0x7f7eec02a110 comp rx=0 tx=0).stop 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 -- 172.21.15.29:0/1451173155 shutdown_connections 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/1451173155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0099c80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 -- 172.21.15.29:0/1451173155 >> 172.21.15.29:0/1451173155 conn(0x7f7ef006d4b0 msgr2=0x7f7ef006d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 -- 172.21.15.29:0/1451173155 shutdown_connections 2024-09-21T08:54:56.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.248+0000 7f7ef79d6640 1 -- 172.21.15.29:0/1451173155 wait complete. 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef79d6640 1 Processor -- start 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef79d6640 1 -- start start 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef79d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef79d6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef009c950 con 0x7f7ef00995d0 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef5772640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef5772640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53788/0 (socket says 172.21.15.29:53788) 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef5772640 1 -- 172.21.15.29:0/2218134465 learned_addr learned my addr 172.21.15.29:0/2218134465 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.249+0000 7f7ef5772640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef01b5a90 con 0x7f7ef00995d0 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ef5772640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7eec035040 tx=0x7f7eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec037040 con 0x7f7ef00995d0 2024-09-21T08:54:56.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec004160 con 0x7f7ef00995d0 2024-09-21T08:54:56.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef01b56d0 con 0x7f7ef00995d0 2024-09-21T08:54:56.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec004440 con 0x7f7ef00995d0 2024-09-21T08:54:56.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.250+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef008bec0 con 0x7f7ef00995d0 2024-09-21T08:54:56.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ef0097b90 con 0x7f7ef00995d0 2024-09-21T08:54:56.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7eec003610 con 0x7f7ef00995d0 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 0x7f7ed403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7eec06ce30 con 0x7f7ef00995d0 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 0x7f7ed4046ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7eec044ec0 con 0x7f7ed4044700 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7eec06f4e0 con 0x7f7ef00995d0 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ef4f71640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 0x7f7ed403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.251+0000 7f7ef5f73640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 0x7f7ed4046ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.252+0000 7f7ef4f71640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 0x7f7ed403a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000c00 tx=0x7f7ee0007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.252+0000 7f7ef5f73640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 0x7f7ed4046ba0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.253+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== osd.1 v2:172.21.15.196:6808/2855083704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7eec044ec0 con 0x7f7ed4044700 2024-09-21T08:54:56.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.265+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 --> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ef009d7f0 con 0x7f7ed4044700 2024-09-21T08:54:56.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ee5ffb640 1 -- 172.21.15.29:0/2218134465 <== osd.1 v2:172.21.15.196:6808/2855083704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ef009d7f0 con 0x7f7ed4044700 2024-09-21T08:54:56.268 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T08:54:56.268 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T08:54:56.268 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T08:54:56.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 msgr2=0x7f7ed4046ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 0x7f7ed4046ba0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 msgr2=0x7f7ed403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 0x7f7ed403a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000c00 tx=0x7f7ee0007970 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 msgr2=0x7f7ef0097650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7eec035040 tx=0x7f7eec0046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 shutdown_connections 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6808/2855083704,v1:172.21.15.196:6809/2855083704] conn(0x7f7ed4044700 0x7f7ed4046ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f7ed40382a0 0x7f7ed403a760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 --2- 172.21.15.29:0/2218134465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef00995d0 0x7f7ef0097650 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 >> 172.21.15.29:0/2218134465 conn(0x7f7ef006d4b0 msgr2=0x7f7ef009ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 shutdown_connections 2024-09-21T08:54:56.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.266+0000 7f7ef79d6640 1 -- 172.21.15.29:0/2218134465 wait complete. 2024-09-21T08:54:56.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T08:54:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.378+0000 7f5e9565e640 1 Processor -- start 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.378+0000 7f5e9565e640 1 -- start start 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e9565e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e9012f9d0 0x7f5e90131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e9565e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e90071f70 con 0x7f5e9012cca0 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e9565e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9006e350 con 0x7f5e9012f9d0 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e9012f9d0 0x7f5e90131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5e9012cca0 0x7f5e9012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46344/0 (socket says 172.21.15.29:46344) 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8effd640 1 -- 172.21.15.29:0/2122677826 learned_addr learned my addr 172.21.15.29:0/2122677826 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8e7fc640 1 -- 172.21.15.29:0/2122677826 >> v1:172.21.15.29:6789/0 conn(0x7f5e9012cca0 legacy=0x7f5e9012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8e7fc640 1 -- 172.21.15.29:0/2122677826 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e900715c0 con 0x7f5e9012f9d0 2024-09-21T08:54:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.379+0000 7f5e8dffb640 1 -- 172.21.15.29:0/2122677826 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168227250 0 0) 0x7f5e90071f70 con 0x7f5e9012cca0 2024-09-21T08:54:56.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.380+0000 7f5e8e7fc640 1 --2- 172.21.15.29:0/2122677826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012f9d0 0x7f5e90131dc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009720 tx=0x7f5e7802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fe67a41e964f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.380+0000 7f5e8dffb640 1 -- 172.21.15.29:0/2122677826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78037070 con 0x7f5e9012f9d0 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.380+0000 7f5e8dffb640 1 -- 172.21.15.29:0/2122677826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7802ad90 con 0x7f5e9012f9d0 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.380+0000 7f5e8dffb640 1 -- 172.21.15.29:0/2122677826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e78032590 con 0x7f5e9012f9d0 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 -- 172.21.15.29:0/2122677826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012f9d0 msgr2=0x7f5e90131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2122677826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012f9d0 0x7f5e90131dc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009720 tx=0x7f5e7802a110 comp rx=0 tx=0).stop 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 -- 172.21.15.29:0/2122677826 shutdown_connections 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2122677826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012f9d0 0x7f5e90131dc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 -- 172.21.15.29:0/2122677826 >> 172.21.15.29:0/2122677826 conn(0x7f5e9009a890 msgr2=0x7f5e9009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 -- 172.21.15.29:0/2122677826 shutdown_connections 2024-09-21T08:54:56.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.381+0000 7f5e9565e640 1 -- 172.21.15.29:0/2122677826 wait complete. 2024-09-21T08:54:56.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e9565e640 1 Processor -- start 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e9565e640 1 -- start start 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e9565e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e9565e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9012ca50 con 0x7f5e9012cca0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e8effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e8effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53802/0 (socket says 172.21.15.29:53802) 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.382+0000 7f5e8effd640 1 -- 172.21.15.29:0/2404692134 learned_addr learned my addr 172.21.15.29:0/2404692134 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e8effd640 1 -- 172.21.15.29:0/2404692134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e90129f50 con 0x7f5e9012cca0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e8effd640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c700 tx=0x7f5e8000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80018070 con 0x7f5e9012cca0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e80004d70 con 0x7f5e9012cca0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e8000a7d0 con 0x7f5e9012cca0 2024-09-21T08:54:56.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e90070240 con 0x7f5e9012cca0 2024-09-21T08:54:56.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.383+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e90070700 con 0x7f5e9012cca0 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.384+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e8001b070 con 0x7f5e9012cca0 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.384+0000 7f5e877fe640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 0x7f5e7003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.384+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5e8004b3e0 con 0x7f5e9012cca0 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.384+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e90070a40 con 0x7f5e9012cca0 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.384+0000 7f5e8e7fc640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 0x7f5e7003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.385+0000 7f5e8e7fc640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 0x7f5e7003a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009720 tx=0x7f5e7802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.389+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5e80011360 con 0x7f5e9012cca0 2024-09-21T08:54:56.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.563+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5e9006e510 con 0x7f5e700382a0 2024-09-21T08:54:56.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.564+0000 7f5e877fe640 1 -- 172.21.15.29:0/2404692134 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e9006e510 con 0x7f5e700382a0 2024-09-21T08:54:56.566 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 msgr2=0x7f5e7003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 0x7f5e7003a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009720 tx=0x7f5e7802e000 comp rx=0 tx=0).stop 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 msgr2=0x7f5e9006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c700 tx=0x7f5e8000cbc0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 shutdown_connections 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f5e700382a0 0x7f5e7003a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 --2- 172.21.15.29:0/2404692134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e9012cca0 0x7f5e9006ea20 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 >> 172.21.15.29:0/2404692134 conn(0x7f5e9009a890 msgr2=0x7f5e9012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 shutdown_connections 2024-09-21T08:54:56.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.566+0000 7f5e9565e640 1 -- 172.21.15.29:0/2404692134 wait complete. 2024-09-21T08:54:56.579 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T08:54:56.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T08:54:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.682+0000 7f2b1df86640 1 Processor -- start 2024-09-21T08:54:56.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.682+0000 7f2b1df86640 1 -- start start 2024-09-21T08:54:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b1df86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b1809a390 0x7f2b18134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b1df86640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b18098a60 con 0x7f2b180995d0 2024-09-21T08:54:56.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b1df86640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2b180992c0 con 0x7f2b1809a390 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b177fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2b180995d0 0x7f2b18099c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46350/0 (socket says 172.21.15.29:46350) 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b177fe640 1 -- 172.21.15.29:0/3398261224 learned_addr learned my addr 172.21.15.29:0/3398261224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b16ffd640 1 --2- 172.21.15.29:0/3398261224 >> v2:172.21.15.29:3300/0 conn(0x7f2b1809a390 0x7f2b18134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b167fc640 1 -- 172.21.15.29:0/3398261224 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327630266 0 0) 0x7f2b18098a60 con 0x7f2b180995d0 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b167fc640 1 -- 172.21.15.29:0/3398261224 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b00003520 con 0x7f2b180995d0 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b16ffd640 1 -- 172.21.15.29:0/3398261224 >> v1:172.21.15.29:6789/0 conn(0x7f2b180995d0 legacy=0x7f2b18099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.683+0000 7f2b16ffd640 1 -- 172.21.15.29:0/3398261224 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1809a7a0 con 0x7f2b1809a390 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.684+0000 7f2b16ffd640 1 --2- 172.21.15.29:0/3398261224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b1809a390 0x7f2b18134090 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009720 tx=0x7f2b0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695e0dfe165ab9bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.684+0000 7f2b167fc640 1 -- 172.21.15.29:0/3398261224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c037070 con 0x7f2b1809a390 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.684+0000 7f2b167fc640 1 -- 172.21.15.29:0/3398261224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c02ad90 con 0x7f2b1809a390 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.684+0000 7f2b167fc640 1 -- 172.21.15.29:0/3398261224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c032590 con 0x7f2b1809a390 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 -- 172.21.15.29:0/3398261224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b1809a390 msgr2=0x7f2b18134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 --2- 172.21.15.29:0/3398261224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b1809a390 0x7f2b18134090 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009720 tx=0x7f2b0c02a110 comp rx=0 tx=0).stop 2024-09-21T08:54:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 -- 172.21.15.29:0/3398261224 shutdown_connections 2024-09-21T08:54:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 --2- 172.21.15.29:0/3398261224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b1809a390 0x7f2b18134090 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 -- 172.21.15.29:0/3398261224 >> 172.21.15.29:0/3398261224 conn(0x7f2b1806d4b0 msgr2=0x7f2b1806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 -- 172.21.15.29:0/3398261224 shutdown_connections 2024-09-21T08:54:56.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.685+0000 7f2b1df86640 1 -- 172.21.15.29:0/3398261224 wait complete. 2024-09-21T08:54:56.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b1df86640 1 Processor -- start 2024-09-21T08:54:56.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b1df86640 1 -- start start 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b1df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b1df86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b18134960 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53814/0 (socket says 172.21.15.29:53814) 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b177fe640 1 -- 172.21.15.29:0/88018254 learned_addr learned my addr 172.21.15.29:0/88018254 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.686+0000 7f2b177fe640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b18096640 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2b177fe640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c480 tx=0x7f2b0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08017070 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08005c10 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b180961a0 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b08007070 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.687+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b18094e50 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b180974b0 con 0x7f2b180995d0 2024-09-21T08:54:56.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b0801a070 con 0x7f2b180995d0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 0x7f2b0403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f2b0804b060 con 0x7f2b180995d0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 0x7f2b04046b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b04047210 con 0x7f2b040446a0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2b08052050 con 0x7f2b180995d0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2b16ffd640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 0x7f2b0403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.688+0000 7f2b17fff640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 0x7f2b04046b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.689+0000 7f2b17fff640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 0x7f2b04046b40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.689+0000 7f2b16ffd640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 0x7f2b0403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c034000 tx=0x7f2b0c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.690+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== osd.2 v2:172.21.15.196:6816/3551232799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b04047210 con 0x7f2b040446a0 2024-09-21T08:54:56.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.702+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 --> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b18099c80 con 0x7f2b040446a0 2024-09-21T08:54:56.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2afffff640 1 -- 172.21.15.29:0/88018254 <== osd.2 v2:172.21.15.196:6816/3551232799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2b18099c80 con 0x7f2b040446a0 2024-09-21T08:54:56.705 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T08:54:56.706 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T08:54:56.706 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T08:54:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 msgr2=0x7f2b04046b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 0x7f2b04046b40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 msgr2=0x7f2b0403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 0x7f2b0403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c034000 tx=0x7f2b0c02e000 comp rx=0 tx=0).stop 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 msgr2=0x7f2b18094910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c480 tx=0x7f2b0800c940 comp rx=0 tx=0).stop 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 shutdown_connections 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6816/3551232799,v1:172.21.15.196:6817/3551232799] conn(0x7f2b040446a0 0x7f2b04046b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f2b040382a0 0x7f2b0403a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 --2- 172.21.15.29:0/88018254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b180995d0 0x7f2b18094910 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.703+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 >> 172.21.15.29:0/88018254 conn(0x7f2b1806d4b0 msgr2=0x7f2b1808d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.704+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 shutdown_connections 2024-09-21T08:54:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.704+0000 7f2b1df86640 1 -- 172.21.15.29:0/88018254 wait complete. 2024-09-21T08:54:56.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T08:54:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.816+0000 7fef9b847640 1 Processor -- start 2024-09-21T08:54:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.816+0000 7fef9b847640 1 -- start start 2024-09-21T08:54:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef9b847640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef9412cca0 0x7fef9412d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef9b847640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef9412d5c0 con 0x7fef941290e0 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef9b847640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fef9406e350 con 0x7fef9412cca0 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef995e3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef9412cca0 0x7fef9412d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef995e3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef9412cca0 0x7fef9412d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53816/0 (socket says 172.21.15.29:53816) 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef995e3640 1 -- 172.21.15.29:0/801936746 learned_addr learned my addr 172.21.15.29:0/801936746 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef98de2640 1 --1- 172.21.15.29:0/801936746 >> v1:172.21.15.29:6789/0 conn(0x7fef941290e0 0x7fef94129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46358/0 (socket says 172.21.15.29:46358) 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef995e3640 1 -- 172.21.15.29:0/801936746 >> v1:172.21.15.29:6789/0 conn(0x7fef941290e0 legacy=0x7fef94129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.817+0000 7fef995e3640 1 -- 172.21.15.29:0/801936746 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef94071f70 con 0x7fef9412cca0 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef995e3640 1 --2- 172.21.15.29:0/801936746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef9412cca0 0x7fef9412d080 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fef900097f0 tx=0x7fef9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57afaf873f9c7436 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef8bfff640 1 -- 172.21.15.29:0/801936746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef90037070 con 0x7fef9412cca0 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef8bfff640 1 -- 172.21.15.29:0/801936746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef90032440 con 0x7fef9412cca0 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef8bfff640 1 -- 172.21.15.29:0/801936746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9002ae60 con 0x7fef9412cca0 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 -- 172.21.15.29:0/801936746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef9412cca0 msgr2=0x7fef9412d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 --2- 172.21.15.29:0/801936746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef9412cca0 0x7fef9412d080 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fef900097f0 tx=0x7fef9002a1e0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 -- 172.21.15.29:0/801936746 shutdown_connections 2024-09-21T08:54:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 --2- 172.21.15.29:0/801936746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef9412cca0 0x7fef9412d080 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 -- 172.21.15.29:0/801936746 >> 172.21.15.29:0/801936746 conn(0x7fef9409a890 msgr2=0x7fef9409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.818+0000 7fef9b847640 1 -- 172.21.15.29:0/801936746 shutdown_connections 2024-09-21T08:54:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.819+0000 7fef9b847640 1 -- 172.21.15.29:0/801936746 wait complete. 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.819+0000 7fef9b847640 1 Processor -- start 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.819+0000 7fef9b847640 1 -- start start 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef9b847640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef9b847640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fef94070e60 con 0x7fef941290e0 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef995e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef995e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53822/0 (socket says 172.21.15.29:53822) 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef995e3640 1 -- 172.21.15.29:0/1209763252 learned_addr learned my addr 172.21.15.29:0/1209763252 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef995e3640 1 -- 172.21.15.29:0/1209763252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9408cb30 con 0x7fef941290e0 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef995e3640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fef90035040 tx=0x7fef900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef90041020 con 0x7fef941290e0 2024-09-21T08:54:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef900307f0 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9408c690 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.820+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef90037040 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.821+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9408da80 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.821+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fef90044020 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.821+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9408d300 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.822+0000 7fef89ffb640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 0x7fef7803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.822+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fef9006c810 con 0x7fef941290e0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.822+0000 7fef98de2640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 0x7fef7803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.822+0000 7fef98de2640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 0x7fef7803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fef84001550 tx=0x7fef84007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:56.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:56.826+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef9004b030 con 0x7fef941290e0 2024-09-21T08:54:57.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.006+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fef9406e510 con 0x7fef780382a0 2024-09-21T08:54:57.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.006+0000 7fef89ffb640 1 -- 172.21.15.29:0/1209763252 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef9406e510 con 0x7fef780382a0 2024-09-21T08:54:57.009 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 msgr2=0x7fef7803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 0x7fef7803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fef84001550 tx=0x7fef84007a40 comp rx=0 tx=0).stop 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 msgr2=0x7fef941c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fef90035040 tx=0x7fef900046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 shutdown_connections 2024-09-21T08:54:57.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fef780382a0 0x7fef7803a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 --2- 172.21.15.29:0/1209763252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef941290e0 0x7fef941c1820 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 >> 172.21.15.29:0/1209763252 conn(0x7fef9409a890 msgr2=0x7fef9409ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 shutdown_connections 2024-09-21T08:54:57.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.009+0000 7fef9b847640 1 -- 172.21.15.29:0/1209763252 wait complete. 2024-09-21T08:54:57.021 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T08:54:57.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4cee27640 1 Processor -- start 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4cee27640 1 -- start start 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4cee27640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4c806d0c0 0x7fd4c806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4cee27640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c8099260 con 0x7fd4c806d9e0 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4cee27640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c8070670 con 0x7fd4c806d0c0 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4ccbc3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4c806d0c0 0x7fd4c806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4c7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd4c806d9e0 0x7fd4c8130b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46368/0 (socket says 172.21.15.29:46368) 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.125+0000 7fd4c7fff640 1 -- 172.21.15.29:0/2870233101 learned_addr learned my addr 172.21.15.29:0/2870233101 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.126+0000 7fd4ccbc3640 1 -- 172.21.15.29:0/2870233101 >> v1:172.21.15.29:6789/0 conn(0x7fd4c806d9e0 legacy=0x7fd4c8130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.126+0000 7fd4ccbc3640 1 -- 172.21.15.29:0/2870233101 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c8071d70 con 0x7fd4c806d0c0 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.126+0000 7fd4ccbc3640 1 --2- 172.21.15.29:0/2870233101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c806d4a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009750 tx=0x7fd4bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab9c519698fb4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4c77fe640 1 -- 172.21.15.29:0/2870233101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc037070 con 0x7fd4c806d0c0 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4c77fe640 1 -- 172.21.15.29:0/2870233101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc02ad80 con 0x7fd4c806d0c0 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4c77fe640 1 -- 172.21.15.29:0/2870233101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc032590 con 0x7fd4c806d0c0 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 -- 172.21.15.29:0/2870233101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 msgr2=0x7fd4c806d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 --2- 172.21.15.29:0/2870233101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c806d4a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009750 tx=0x7fd4bc02a140 comp rx=0 tx=0).stop 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 -- 172.21.15.29:0/2870233101 shutdown_connections 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 --2- 172.21.15.29:0/2870233101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c806d4a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 -- 172.21.15.29:0/2870233101 >> 172.21.15.29:0/2870233101 conn(0x7fd4c80998b0 msgr2=0x7fd4c8099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 -- 172.21.15.29:0/2870233101 shutdown_connections 2024-09-21T08:54:57.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.127+0000 7fd4cee27640 1 -- 172.21.15.29:0/2870233101 wait complete. 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.128+0000 7fd4cee27640 1 Processor -- start 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.128+0000 7fd4cee27640 1 -- start start 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4cee27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4cee27640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8132240 con 0x7fd4c806d0c0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4ccbc3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4ccbc3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53836/0 (socket says 172.21.15.29:53836) 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4ccbc3640 1 -- 172.21.15.29:0/3221013140 learned_addr learned my addr 172.21.15.29:0/3221013140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4ccbc3640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c8094370 con 0x7fd4c806d0c0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4ccbc3640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc041070 con 0x7fd4c806d0c0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc03c590 con 0x7fd4c806d0c0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c80948a0 con 0x7fd4c806d0c0 2024-09-21T08:54:57.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc037040 con 0x7fd4c806d0c0 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.129+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c812f9d0 con 0x7fd4c806d0c0 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.130+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4c8094b30 con 0x7fd4c806d0c0 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.130+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd4bc044070 con 0x7fd4c806d0c0 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.130+0000 7fd4c57fa640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 0x7fd4ac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.130+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd4bc06c600 con 0x7fd4c806d0c0 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4c57fa640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 0x7fd4ac046ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4bc036e90 con 0x7fd4ac044700 2024-09-21T08:54:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd4bc0712a0 con 0x7fd4c806d0c0 2024-09-21T08:54:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4c7fff640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 0x7fd4ac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4cd3c4640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 0x7fd4ac046ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4cd3c4640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 0x7fd4ac046ba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.131+0000 7fd4c7fff640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 0x7fd4ac03a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b4007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.132+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== osd.3 v2:172.21.15.196:6800/127179937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4bc036e90 con 0x7fd4ac044700 2024-09-21T08:54:57.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.145+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 --> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd4c806d4a0 con 0x7fd4ac044700 2024-09-21T08:54:57.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.145+0000 7fd4c57fa640 1 -- 172.21.15.29:0/3221013140 <== osd.3 v2:172.21.15.196:6800/127179937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd4c806d4a0 con 0x7fd4ac044700 2024-09-21T08:54:57.148 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T08:54:57.148 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T08:54:57.148 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T08:54:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 msgr2=0x7fd4ac046ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 0x7fd4ac046ba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 msgr2=0x7fd4ac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 0x7fd4ac03a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b4007ac0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 msgr2=0x7fd4c812f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc0046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 shutdown_connections 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6800/127179937,v1:172.21.15.196:6801/127179937] conn(0x7fd4ac044700 0x7fd4ac046ba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd4ac0382a0 0x7fd4ac03a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 --2- 172.21.15.29:0/3221013140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4c806d0c0 0x7fd4c812f2b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 >> 172.21.15.29:0/3221013140 conn(0x7fd4c80998b0 msgr2=0x7fd4c808cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 shutdown_connections 2024-09-21T08:54:57.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.146+0000 7fd4cee27640 1 -- 172.21.15.29:0/3221013140 wait complete. 2024-09-21T08:54:57.158 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T08:54:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.258+0000 7fc7671b7640 1 Processor -- start 2024-09-21T08:54:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc7671b7640 1 -- start start 2024-09-21T08:54:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc7671b7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc76009a100 0x7fc760133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc7671b7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc76009d3b0 con 0x7fc76009bd50 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc7671b7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc76009c840 con 0x7fc76009a100 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc757fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc76009a100 0x7fc760133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc764f53640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc76009bd50 0x7fc76009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46378/0 (socket says 172.21.15.29:46378) 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc764f53640 1 -- 172.21.15.29:0/3606862250 learned_addr learned my addr 172.21.15.29:0/3606862250 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc757fff640 1 -- 172.21.15.29:0/3606862250 >> v1:172.21.15.29:6789/0 conn(0x7fc76009bd50 legacy=0x7fc76009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc757fff640 1 -- 172.21.15.29:0/3606862250 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760098230 con 0x7fc76009a100 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.259+0000 7fc7577fe640 1 -- 172.21.15.29:0/3606862250 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385415563 0 0) 0x7fc75c001110 con 0x7fc76009bd50 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.260+0000 7fc757fff640 1 --2- 172.21.15.29:0/3606862250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc750009720 tx=0x7fc75002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15d1dceeb2e4df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.260+0000 7fc7577fe640 1 -- 172.21.15.29:0/3606862250 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc750037070 con 0x7fc76009a100 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.260+0000 7fc7577fe640 1 -- 172.21.15.29:0/3606862250 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc75002ad90 con 0x7fc76009a100 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.260+0000 7fc7577fe640 1 -- 172.21.15.29:0/3606862250 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc750032590 con 0x7fc76009a100 2024-09-21T08:54:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 -- 172.21.15.29:0/3606862250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 msgr2=0x7fc760133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 --2- 172.21.15.29:0/3606862250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc750009720 tx=0x7fc75002a110 comp rx=0 tx=0).stop 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 -- 172.21.15.29:0/3606862250 shutdown_connections 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 --2- 172.21.15.29:0/3606862250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760133da0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 -- 172.21.15.29:0/3606862250 >> 172.21.15.29:0/3606862250 conn(0x7fc76006d4a0 msgr2=0x7fc76006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 -- 172.21.15.29:0/3606862250 shutdown_connections 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.261+0000 7fc7671b7640 1 -- 172.21.15.29:0/3606862250 wait complete. 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc7671b7640 1 Processor -- start 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc7671b7640 1 -- start start 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc7671b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc7671b7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc760134670 con 0x7fc76009a100 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc764f53640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc764f53640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53846/0 (socket says 172.21.15.29:53846) 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.262+0000 7fc764f53640 1 -- 172.21.15.29:0/2277275715 learned_addr learned my addr 172.21.15.29:0/2277275715 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc764f53640 1 -- 172.21.15.29:0/2277275715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760094be0 con 0x7fc76009a100 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc764f53640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c700 tx=0x7fc75c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c018070 con 0x7fc76009a100 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc75c0070d0 con 0x7fc76009a100 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76009a760 con 0x7fc76009a100 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c0073f0 con 0x7fc76009a100 2024-09-21T08:54:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.263+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc760095a50 con 0x7fc76009a100 2024-09-21T08:54:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.264+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc75c01b070 con 0x7fc76009a100 2024-09-21T08:54:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.264+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc760094030 con 0x7fc76009a100 2024-09-21T08:54:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.264+0000 7fc7557fa640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 0x7fc74c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.264+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc75c04b0c0 con 0x7fc76009a100 2024-09-21T08:54:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.265+0000 7fc757fff640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 0x7fc74c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.265+0000 7fc757fff640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 0x7fc74c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc750034000 tx=0x7fc75002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.269+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc76009d3b0 con 0x7fc76009a100 2024-09-21T08:54:57.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.444+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc76009d020 con 0x7fc74c0382a0 2024-09-21T08:54:57.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.445+0000 7fc7557fa640 1 -- 172.21.15.29:0/2277275715 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc76009d020 con 0x7fc74c0382a0 2024-09-21T08:54:57.447 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T08:54:57.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 msgr2=0x7fc74c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 0x7fc74c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc750034000 tx=0x7fc75002e000 comp rx=0 tx=0).stop 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 msgr2=0x7fc760092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c700 tx=0x7fc75c00cbc0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 shutdown_connections 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc74c0382a0 0x7fc74c03a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 --2- 172.21.15.29:0/2277275715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc76009a100 0x7fc760092f40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 >> 172.21.15.29:0/2277275715 conn(0x7fc76006d4a0 msgr2=0x7fc76009f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 shutdown_connections 2024-09-21T08:54:57.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.447+0000 7fc7671b7640 1 -- 172.21.15.29:0/2277275715 wait complete. 2024-09-21T08:54:57.463 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:54:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.561+0000 7ff864bbd640 1 Processor -- start 2024-09-21T08:54:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.561+0000 7ff864bbd640 1 -- start start 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff864bbd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff86006eda0 0x7ff86006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff864bbd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86006eba0 con 0x7ff86006f6c0 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff864bbd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff86006d2f0 con 0x7ff86006eda0 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85e59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff86006eda0 0x7ff86006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85dd9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff86006f6c0 0x7ff860121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:46390/0 (socket says 172.21.15.29:46390) 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85e59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff86006eda0 0x7ff86006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53854/0 (socket says 172.21.15.29:53854) 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85dd9b640 1 -- 172.21.15.29:0/3417912831 learned_addr learned my addr 172.21.15.29:0/3417912831 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85e59c640 1 -- 172.21.15.29:0/3417912831 >> v1:172.21.15.29:6789/0 conn(0x7ff86006f6c0 legacy=0x7ff860121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.562+0000 7ff85e59c640 1 -- 172.21.15.29:0/3417912831 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff860070d50 con 0x7ff86006eda0 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.563+0000 7ff85e59c640 1 --2- 172.21.15.29:0/3417912831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff86006f180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff850009720 tx=0x7ff85002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b31db141f86980a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.563+0000 7ff85d59a640 1 -- 172.21.15.29:0/3417912831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850037070 con 0x7ff86006eda0 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.563+0000 7ff85d59a640 1 -- 172.21.15.29:0/3417912831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85002ae20 con 0x7ff86006eda0 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.563+0000 7ff85d59a640 1 -- 172.21.15.29:0/3417912831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850032590 con 0x7ff86006eda0 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 -- 172.21.15.29:0/3417912831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 msgr2=0x7ff86006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3417912831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff86006f180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff850009720 tx=0x7ff85002a1a0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 -- 172.21.15.29:0/3417912831 shutdown_connections 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3417912831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff86006f180 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 -- 172.21.15.29:0/3417912831 >> 172.21.15.29:0/3417912831 conn(0x7ff86009a890 msgr2=0x7ff86009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 -- 172.21.15.29:0/3417912831 shutdown_connections 2024-09-21T08:54:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.564+0000 7ff864bbd640 1 -- 172.21.15.29:0/3417912831 wait complete. 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff864bbd640 1 Processor -- start 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff864bbd640 1 -- start start 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff864bbd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff864bbd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff860122160 con 0x7ff86006eda0 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff85e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff85e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53862/0 (socket says 172.21.15.29:53862) 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.565+0000 7ff85e59c640 1 -- 172.21.15.29:0/3464011166 learned_addr learned my addr 172.21.15.29:0/3464011166 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff85e59c640 1 -- 172.21.15.29:0/3464011166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86008db50 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff85e59c640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff85002a1e0 tx=0x7ff8500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850042070 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85003e590 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8601c1ce0 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850037040 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.566+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601c21b0 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.567+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff850045070 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.567+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86008d6b0 con 0x7ff86006eda0 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.567+0000 7ff84effd640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 0x7ff84003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:54:57.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.567+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff85006c5c0 con 0x7ff86006eda0 2024-09-21T08:54:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.567+0000 7ff85dd9b640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 0x7ff84003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:54:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.568+0000 7ff85dd9b640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 0x7ff84003a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff854007fd0 tx=0x7ff854007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:54:57.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.572+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff85002ae20 con 0x7ff86006eda0 2024-09-21T08:54:57.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.742+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff86008e3b0 con 0x7ff8400382d0 2024-09-21T08:54:57.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.758+0000 7ff84effd640 1 -- 172.21.15.29:0/3464011166 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665679 (secure 0 0 0) 0x7ff86008e3b0 con 0x7ff8400382d0 2024-09-21T08:54:57.767 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:54:57.773 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 msgr2=0x7ff84003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 0x7ff84003a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff854007fd0 tx=0x7ff854007ac0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 msgr2=0x7ff8601c17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff85002a1e0 tx=0x7ff8500046c0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 shutdown_connections 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7ff8400382d0 0x7ff84003a790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 --2- 172.21.15.29:0/3464011166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff86006eda0 0x7ff8601c17a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:54:57.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 >> 172.21.15.29:0/3464011166 conn(0x7ff86009a890 msgr2=0x7ff86006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:54:57.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 shutdown_connections 2024-09-21T08:54:57.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:54:57.763+0000 7ff864bbd640 1 -- 172.21.15.29:0/3464011166 wait complete. 2024-09-21T08:54:57.776 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-21T08:54:57.212443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4609,"ondisk_log_size":4609,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":140200,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377347160,"statfs":{"total":386547056640,"available":386403491840,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231353+0000","last_change":"2024-09-21T08:51:38.149131+0000","last_active":"2024-09-21T08:52:14.231353+0000","last_peered":"2024-09-21T08:52:14.231353+0000","last_clean":"2024-09-21T08:52:14.231353+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:52:14.231353+0000","last_undegraded":"2024-09-21T08:52:14.231353+0000","last_fullsized":"2024-09-21T08:52:14.231353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:33.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400047+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.400047+0000","last_peered":"2024-09-21T08:54:46.400047+0000","last_clean":"2024-09-21T08:54:46.400047+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.400047+0000","last_undegraded":"2024-09-21T08:54:46.400047+0000","last_fullsized":"2024-09-21T08:54:46.400047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227696+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:52:14.227696+0000","last_peered":"2024-09-21T08:52:14.227696+0000","last_clean":"2024-09-21T08:52:14.227696+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:52:14.227696+0000","last_undegraded":"2024-09-21T08:52:14.227696+0000","last_fullsized":"2024-09-21T08:52:14.227696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:44:26.727846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535392+0000","last_change":"2024-09-21T08:51:40.136089+0000","last_active":"2024-09-21T08:54:46.535392+0000","last_peered":"2024-09-21T08:54:46.535392+0000","last_clean":"2024-09-21T08:54:46.535392+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:54:46.535392+0000","last_undegraded":"2024-09-21T08:54:46.535392+0000","last_fullsized":"2024-09-21T08:54:46.535392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:42.691157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781340+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:52:18.781340+0000","last_peered":"2024-09-21T08:52:18.781340+0000","last_clean":"2024-09-21T08:52:18.781340+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:52:18.781340+0000","last_undegraded":"2024-09-21T08:52:18.781340+0000","last_fullsized":"2024-09-21T08:52:18.781340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:41.267539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.239510+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:52:14.239510+0000","last_peered":"2024-09-21T08:52:14.239510+0000","last_clean":"2024-09-21T08:52:14.239510+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:52:14.239510+0000","last_undegraded":"2024-09-21T08:52:14.239510+0000","last_fullsized":"2024-09-21T08:52:14.239510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.787607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231201+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:52:14.231201+0000","last_peered":"2024-09-21T08:52:14.231201+0000","last_clean":"2024-09-21T08:52:14.231201+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:52:14.231201+0000","last_undegraded":"2024-09-21T08:52:14.231201+0000","last_fullsized":"2024-09-21T08:52:14.231201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:09.428425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183972+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:10.183972+0000","last_peered":"2024-09-21T08:54:10.183972+0000","last_clean":"2024-09-21T08:54:10.183972+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:10.183972+0000","last_undegraded":"2024-09-21T08:54:10.183972+0000","last_fullsized":"2024-09-21T08:54:10.183972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:10.655450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.738181+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:53:45.738181+0000","last_peered":"2024-09-21T08:53:45.738181+0000","last_clean":"2024-09-21T08:53:45.738181+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:53:45.738181+0000","last_undegraded":"2024-09-21T08:53:45.738181+0000","last_fullsized":"2024-09-21T08:53:45.738181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:27.599255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898400+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:52:19.898400+0000","last_peered":"2024-09-21T08:52:19.898400+0000","last_clean":"2024-09-21T08:52:19.898400+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:52:19.898400+0000","last_undegraded":"2024-09-21T08:52:19.898400+0000","last_fullsized":"2024-09-21T08:52:19.898400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:22.144849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227886+0000","last_change":"2024-09-21T08:51:38.149505+0000","last_active":"2024-09-21T08:52:14.227886+0000","last_peered":"2024-09-21T08:52:14.227886+0000","last_clean":"2024-09-21T08:52:14.227886+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:52:14.227886+0000","last_undegraded":"2024-09-21T08:52:14.227886+0000","last_fullsized":"2024-09-21T08:52:14.227886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:34.592638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399870+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.399870+0000","last_peered":"2024-09-21T08:54:46.399870+0000","last_clean":"2024-09-21T08:54:46.399870+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.399870+0000","last_undegraded":"2024-09-21T08:54:46.399870+0000","last_fullsized":"2024-09-21T08:54:46.399870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:31.174220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225068+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:52:14.225068+0000","last_peered":"2024-09-21T08:52:14.225068+0000","last_clean":"2024-09-21T08:52:14.225068+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:52:14.225068+0000","last_undegraded":"2024-09-21T08:52:14.225068+0000","last_fullsized":"2024-09-21T08:52:14.225068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:38.320272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354111+0000","last_change":"2024-09-21T08:51:40.136615+0000","last_active":"2024-09-21T08:53:02.354111+0000","last_peered":"2024-09-21T08:53:02.354111+0000","last_clean":"2024-09-21T08:53:02.354111+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:53:02.354111+0000","last_undegraded":"2024-09-21T08:53:02.354111+0000","last_fullsized":"2024-09-21T08:53:02.354111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:01.638135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225452+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:52:14.225452+0000","last_peered":"2024-09-21T08:52:14.225452+0000","last_clean":"2024-09-21T08:52:14.225452+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:52:14.225452+0000","last_undegraded":"2024-09-21T08:52:14.225452+0000","last_fullsized":"2024-09-21T08:52:14.225452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399104+0000","last_change":"2024-09-21T08:51:40.139948+0000","last_active":"2024-09-21T08:54:46.399104+0000","last_peered":"2024-09-21T08:54:46.399104+0000","last_clean":"2024-09-21T08:54:46.399104+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:54:46.399104+0000","last_undegraded":"2024-09-21T08:54:46.399104+0000","last_fullsized":"2024-09-21T08:54:46.399104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:46.303446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182197+0000","last_change":"2024-09-21T08:51:40.135605+0000","last_active":"2024-09-21T08:54:00.182197+0000","last_peered":"2024-09-21T08:54:00.182197+0000","last_clean":"2024-09-21T08:54:00.182197+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:54:00.182197+0000","last_undegraded":"2024-09-21T08:54:00.182197+0000","last_fullsized":"2024-09-21T08:54:00.182197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:18.269727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227228+0000","last_change":"2024-09-21T08:51:38.140312+0000","last_active":"2024-09-21T08:52:14.227228+0000","last_peered":"2024-09-21T08:52:14.227228+0000","last_clean":"2024-09-21T08:52:14.227228+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:52:14.227228+0000","last_undegraded":"2024-09-21T08:52:14.227228+0000","last_fullsized":"2024-09-21T08:52:14.227228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:02.069891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936352+0000","last_change":"2024-09-21T08:51:40.137259+0000","last_active":"2024-09-21T08:53:45.936352+0000","last_peered":"2024-09-21T08:53:45.936352+0000","last_clean":"2024-09-21T08:53:45.936352+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:53:45.936352+0000","last_undegraded":"2024-09-21T08:53:45.936352+0000","last_fullsized":"2024-09-21T08:53:45.936352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.600518+0000","last_change":"2024-09-21T08:51:38.150225+0000","last_active":"2024-09-21T08:54:46.600518+0000","last_peered":"2024-09-21T08:54:46.600518+0000","last_clean":"2024-09-21T08:54:46.600518+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:54:46.600518+0000","last_undegraded":"2024-09-21T08:54:46.600518+0000","last_fullsized":"2024-09-21T08:54:46.600518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:58.948956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399793+0000","last_change":"2024-09-21T08:51:40.135404+0000","last_active":"2024-09-21T08:54:46.399793+0000","last_peered":"2024-09-21T08:54:46.399793+0000","last_clean":"2024-09-21T08:54:46.399793+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:54:46.399793+0000","last_undegraded":"2024-09-21T08:54:46.399793+0000","last_fullsized":"2024-09-21T08:54:46.399793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.913626+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:53:45.913626+0000","last_peered":"2024-09-21T08:53:45.913626+0000","last_clean":"2024-09-21T08:53:45.913626+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:53:45.913626+0000","last_undegraded":"2024-09-21T08:53:45.913626+0000","last_fullsized":"2024-09-21T08:53:45.913626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.085254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583271+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583271+0000","last_peered":"2024-09-21T08:54:46.583271+0000","last_clean":"2024-09-21T08:54:46.583271+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583271+0000","last_undegraded":"2024-09-21T08:54:46.583271+0000","last_fullsized":"2024-09-21T08:54:46.583271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229015+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:52:14.229015+0000","last_peered":"2024-09-21T08:52:14.229015+0000","last_clean":"2024-09-21T08:52:14.229015+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:52:14.229015+0000","last_undegraded":"2024-09-21T08:52:14.229015+0000","last_fullsized":"2024-09-21T08:52:14.229015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:48.757416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231605+0000","last_change":"2024-09-21T08:51:40.143862+0000","last_active":"2024-09-21T08:52:14.231605+0000","last_peered":"2024-09-21T08:52:14.231605+0000","last_clean":"2024-09-21T08:52:14.231605+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:52:14.231605+0000","last_undegraded":"2024-09-21T08:52:14.231605+0000","last_fullsized":"2024-09-21T08:52:14.231605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:22.460199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227756+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:52:14.227756+0000","last_peered":"2024-09-21T08:52:14.227756+0000","last_clean":"2024-09-21T08:52:14.227756+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:52:14.227756+0000","last_undegraded":"2024-09-21T08:52:14.227756+0000","last_fullsized":"2024-09-21T08:52:14.227756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:16.521067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182622+0000","last_change":"2024-09-21T08:51:40.138654+0000","last_active":"2024-09-21T08:54:05.182622+0000","last_peered":"2024-09-21T08:54:05.182622+0000","last_clean":"2024-09-21T08:54:05.182622+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:54:05.182622+0000","last_undegraded":"2024-09-21T08:54:05.182622+0000","last_fullsized":"2024-09-21T08:54:05.182622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:10.717027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225664+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:52:14.225664+0000","last_peered":"2024-09-21T08:52:14.225664+0000","last_clean":"2024-09-21T08:52:14.225664+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:52:14.225664+0000","last_undegraded":"2024-09-21T08:52:14.225664+0000","last_fullsized":"2024-09-21T08:52:14.225664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:29.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.584533+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.584533+0000","last_peered":"2024-09-21T08:54:46.584533+0000","last_clean":"2024-09-21T08:54:46.584533+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.584533+0000","last_undegraded":"2024-09-21T08:54:46.584533+0000","last_fullsized":"2024-09-21T08:54:46.584533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:48.958880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.169984+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:53:02.169984+0000","last_peered":"2024-09-21T08:53:02.169984+0000","last_clean":"2024-09-21T08:53:02.169984+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:53:02.169984+0000","last_undegraded":"2024-09-21T08:53:02.169984+0000","last_fullsized":"2024-09-21T08:53:02.169984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.128402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227035+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:52:14.227035+0000","last_peered":"2024-09-21T08:52:14.227035+0000","last_clean":"2024-09-21T08:52:14.227035+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:52:14.227035+0000","last_undegraded":"2024-09-21T08:52:14.227035+0000","last_fullsized":"2024-09-21T08:52:14.227035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:20.030105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.139486+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:58.274973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.267968+0000","last_change":"2024-09-21T08:51:44.149044+0000","last_active":"2024-09-21T08:54:53.267968+0000","last_peered":"2024-09-21T08:54:53.267968+0000","last_clean":"2024-09-21T08:54:53.267968+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:54:53.267968+0000","last_undegraded":"2024-09-21T08:54:53.267968+0000","last_fullsized":"2024-09-21T08:54:53.267968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:16.675629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227130+0000","last_change":"2024-09-21T08:51:46.152252+0000","last_active":"2024-09-21T08:52:14.227130+0000","last_peered":"2024-09-21T08:52:14.227130+0000","last_clean":"2024-09-21T08:52:14.227130+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:52:14.227130+0000","last_undegraded":"2024-09-21T08:52:14.227130+0000","last_fullsized":"2024-09-21T08:52:14.227130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.176311+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:53:02.176311+0000","last_peered":"2024-09-21T08:53:02.176311+0000","last_clean":"2024-09-21T08:53:02.176311+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:53:02.176311+0000","last_undegraded":"2024-09-21T08:53:02.176311+0000","last_fullsized":"2024-09-21T08:53:02.176311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:29.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534995+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.534995+0000","last_peered":"2024-09-21T08:54:46.534995+0000","last_clean":"2024-09-21T08:54:46.534995+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.534995+0000","last_undegraded":"2024-09-21T08:54:46.534995+0000","last_fullsized":"2024-09-21T08:54:46.534995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:42.033247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.258282+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:46.258282+0000","last_peered":"2024-09-21T08:54:46.258282+0000","last_clean":"2024-09-21T08:54:46.258282+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:46.258282+0000","last_undegraded":"2024-09-21T08:54:46.258282+0000","last_fullsized":"2024-09-21T08:54:46.258282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:55:05.633192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.107681+0000","last_change":"2024-09-21T08:51:42.139320+0000","last_active":"2024-09-21T08:54:53.107681+0000","last_peered":"2024-09-21T08:54:53.107681+0000","last_clean":"2024-09-21T08:54:53.107681+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:54:53.107681+0000","last_undegraded":"2024-09-21T08:54:53.107681+0000","last_fullsized":"2024-09-21T08:54:53.107681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:43.645980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226057+0000","last_change":"2024-09-21T08:51:44.146522+0000","last_active":"2024-09-21T08:52:14.226057+0000","last_peered":"2024-09-21T08:52:14.226057+0000","last_clean":"2024-09-21T08:52:14.226057+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:52:14.226057+0000","last_undegraded":"2024-09-21T08:52:14.226057+0000","last_fullsized":"2024-09-21T08:52:14.226057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:20:14.669193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225937+0000","last_change":"2024-09-21T08:51:46.157301+0000","last_active":"2024-09-21T08:52:14.225937+0000","last_peered":"2024-09-21T08:52:14.225937+0000","last_clean":"2024-09-21T08:52:14.225937+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:52:14.225937+0000","last_undegraded":"2024-09-21T08:52:14.225937+0000","last_fullsized":"2024-09-21T08:52:14.225937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225151+0000","last_change":"2024-09-21T08:51:48.154173+0000","last_active":"2024-09-21T08:52:14.225151+0000","last_peered":"2024-09-21T08:52:14.225151+0000","last_clean":"2024-09-21T08:52:14.225151+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:52:14.225151+0000","last_undegraded":"2024-09-21T08:52:14.225151+0000","last_fullsized":"2024-09-21T08:52:14.225151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:16:14.347576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535149+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.535149+0000","last_peered":"2024-09-21T08:54:46.535149+0000","last_clean":"2024-09-21T08:54:46.535149+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.535149+0000","last_undegraded":"2024-09-21T08:54:46.535149+0000","last_fullsized":"2024-09-21T08:54:46.535149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:36.705710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224381+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:52:14.224381+0000","last_peered":"2024-09-21T08:52:14.224381+0000","last_clean":"2024-09-21T08:52:14.224381+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:52:14.224381+0000","last_undegraded":"2024-09-21T08:52:14.224381+0000","last_fullsized":"2024-09-21T08:52:14.224381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:09.304434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227963+0000","last_change":"2024-09-21T08:51:42.137023+0000","last_active":"2024-09-21T08:52:14.227963+0000","last_peered":"2024-09-21T08:52:14.227963+0000","last_clean":"2024-09-21T08:52:14.227963+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:52:14.227963+0000","last_undegraded":"2024-09-21T08:52:14.227963+0000","last_fullsized":"2024-09-21T08:52:14.227963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232114+0000","last_change":"2024-09-21T08:51:44.151497+0000","last_active":"2024-09-21T08:52:14.232114+0000","last_peered":"2024-09-21T08:52:14.232114+0000","last_clean":"2024-09-21T08:52:14.232114+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:52:14.232114+0000","last_undegraded":"2024-09-21T08:52:14.232114+0000","last_fullsized":"2024-09-21T08:52:14.232114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:12:34.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.135137+0000","last_change":"2024-09-21T08:51:46.158108+0000","last_active":"2024-09-21T08:54:53.135137+0000","last_peered":"2024-09-21T08:54:53.135137+0000","last_clean":"2024-09-21T08:54:53.135137+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:54:53.135137+0000","last_undegraded":"2024-09-21T08:54:53.135137+0000","last_fullsized":"2024-09-21T08:54:53.135137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.241076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.638227+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:52:19.638227+0000","last_peered":"2024-09-21T08:52:19.638227+0000","last_clean":"2024-09-21T08:52:19.638227+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:52:19.638227+0000","last_undegraded":"2024-09-21T08:52:19.638227+0000","last_fullsized":"2024-09-21T08:52:19.638227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.204645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310855+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.310855+0000","last_peered":"2024-09-21T08:54:46.310855+0000","last_clean":"2024-09-21T08:54:46.310855+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.310855+0000","last_undegraded":"2024-09-21T08:54:46.310855+0000","last_fullsized":"2024-09-21T08:54:46.310855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.889090+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:52:19.889090+0000","last_peered":"2024-09-21T08:52:19.889090+0000","last_clean":"2024-09-21T08:52:19.889090+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:52:19.889090+0000","last_undegraded":"2024-09-21T08:52:19.889090+0000","last_fullsized":"2024-09-21T08:52:19.889090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231441+0000","last_change":"2024-09-21T08:51:42.136387+0000","last_active":"2024-09-21T08:52:14.231441+0000","last_peered":"2024-09-21T08:52:14.231441+0000","last_clean":"2024-09-21T08:52:14.231441+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:52:14.231441+0000","last_undegraded":"2024-09-21T08:52:14.231441+0000","last_fullsized":"2024-09-21T08:52:14.231441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:42.938313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.253247+0000","last_change":"2024-09-21T08:51:44.151655+0000","last_active":"2024-09-21T08:54:53.253247+0000","last_peered":"2024-09-21T08:54:53.253247+0000","last_clean":"2024-09-21T08:54:53.253247+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:54:53.253247+0000","last_undegraded":"2024-09-21T08:54:53.253247+0000","last_fullsized":"2024-09-21T08:54:53.253247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.388478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":403,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.139741+0000","last_change":"2024-09-21T08:51:46.154154+0000","last_active":"2024-09-21T08:54:53.139741+0000","last_peered":"2024-09-21T08:54:53.139741+0000","last_clean":"2024-09-21T08:54:53.139741+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:53.139741+0000","last_undegraded":"2024-09-21T08:54:53.139741+0000","last_fullsized":"2024-09-21T08:54:53.139741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.824819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.534945+0000","last_change":"2024-09-21T08:51:40.141892+0000","last_active":"2024-09-21T08:54:46.534945+0000","last_peered":"2024-09-21T08:54:46.534945+0000","last_clean":"2024-09-21T08:54:46.534945+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:54:46.534945+0000","last_undegraded":"2024-09-21T08:54:46.534945+0000","last_fullsized":"2024-09-21T08:54:46.534945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:15.778333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231615+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:52:14.231615+0000","last_peered":"2024-09-21T08:52:14.231615+0000","last_clean":"2024-09-21T08:52:14.231615+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:52:14.231615+0000","last_undegraded":"2024-09-21T08:52:14.231615+0000","last_fullsized":"2024-09-21T08:52:14.231615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.849464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227856+0000","last_change":"2024-09-21T08:51:42.139818+0000","last_active":"2024-09-21T08:52:14.227856+0000","last_peered":"2024-09-21T08:52:14.227856+0000","last_clean":"2024-09-21T08:52:14.227856+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:52:14.227856+0000","last_undegraded":"2024-09-21T08:52:14.227856+0000","last_fullsized":"2024-09-21T08:52:14.227856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'43","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.280049+0000","last_change":"2024-09-21T08:51:44.148564+0000","last_active":"2024-09-21T08:54:53.280049+0000","last_peered":"2024-09-21T08:54:53.280049+0000","last_clean":"2024-09-21T08:54:53.280049+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:54:53.280049+0000","last_undegraded":"2024-09-21T08:54:53.280049+0000","last_fullsized":"2024-09-21T08:54:53.280049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:46.255459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227433+0000","last_change":"2024-09-21T08:51:46.157947+0000","last_active":"2024-09-21T08:52:14.227433+0000","last_peered":"2024-09-21T08:52:14.227433+0000","last_clean":"2024-09-21T08:52:14.227433+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:52:14.227433+0000","last_undegraded":"2024-09-21T08:52:14.227433+0000","last_fullsized":"2024-09-21T08:52:14.227433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:02.289163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.178600+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:02.178600+0000","last_peered":"2024-09-21T08:53:02.178600+0000","last_clean":"2024-09-21T08:53:02.178600+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:02.178600+0000","last_undegraded":"2024-09-21T08:53:02.178600+0000","last_fullsized":"2024-09-21T08:53:02.178600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:09.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.400040+0000","last_change":"2024-09-21T08:51:40.128515+0000","last_active":"2024-09-21T08:54:46.400040+0000","last_peered":"2024-09-21T08:54:46.400040+0000","last_clean":"2024-09-21T08:54:46.400040+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:54:46.400040+0000","last_undegraded":"2024-09-21T08:54:46.400040+0000","last_fullsized":"2024-09-21T08:54:46.400040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:29.000718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.233575+0000","last_change":"2024-09-21T08:51:38.148403+0000","last_active":"2024-09-21T08:52:14.233575+0000","last_peered":"2024-09-21T08:52:14.233575+0000","last_clean":"2024-09-21T08:52:14.233575+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:52:14.233575+0000","last_undegraded":"2024-09-21T08:52:14.233575+0000","last_fullsized":"2024-09-21T08:52:14.233575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:03.872881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225711+0000","last_change":"2024-09-21T08:51:42.135619+0000","last_active":"2024-09-21T08:52:14.225711+0000","last_peered":"2024-09-21T08:52:14.225711+0000","last_clean":"2024-09-21T08:52:14.225711+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:52:14.225711+0000","last_undegraded":"2024-09-21T08:52:14.225711+0000","last_fullsized":"2024-09-21T08:52:14.225711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.062622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'34","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.223046+0000","last_change":"2024-09-21T08:51:44.144706+0000","last_active":"2024-09-21T08:54:53.223046+0000","last_peered":"2024-09-21T08:54:53.223046+0000","last_clean":"2024-09-21T08:54:53.223046+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:54:53.223046+0000","last_undegraded":"2024-09-21T08:54:53.223046+0000","last_fullsized":"2024-09-21T08:54:53.223046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:07.374743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225286+0000","last_change":"2024-09-21T08:51:46.152912+0000","last_active":"2024-09-21T08:52:14.225286+0000","last_peered":"2024-09-21T08:52:14.225286+0000","last_clean":"2024-09-21T08:52:14.225286+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:52:14.225286+0000","last_undegraded":"2024-09-21T08:52:14.225286+0000","last_fullsized":"2024-09-21T08:52:14.225286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:53.116793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:56.616218+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:52:56.616218+0000","last_peered":"2024-09-21T08:52:56.616218+0000","last_clean":"2024-09-21T08:52:56.616218+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:52:56.616218+0000","last_undegraded":"2024-09-21T08:52:56.616218+0000","last_fullsized":"2024-09-21T08:52:56.616218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:53.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.310377+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.310377+0000","last_peered":"2024-09-21T08:54:46.310377+0000","last_clean":"2024-09-21T08:54:46.310377+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.310377+0000","last_undegraded":"2024-09-21T08:54:46.310377+0000","last_fullsized":"2024-09-21T08:54:46.310377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:09.036028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230727+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:52:14.230727+0000","last_peered":"2024-09-21T08:52:14.230727+0000","last_clean":"2024-09-21T08:52:14.230727+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:52:14.230727+0000","last_undegraded":"2024-09-21T08:52:14.230727+0000","last_fullsized":"2024-09-21T08:52:14.230727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:31.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228487+0000","last_change":"2024-09-21T08:51:42.137342+0000","last_active":"2024-09-21T08:52:14.228487+0000","last_peered":"2024-09-21T08:52:14.228487+0000","last_clean":"2024-09-21T08:52:14.228487+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:52:14.228487+0000","last_undegraded":"2024-09-21T08:52:14.228487+0000","last_fullsized":"2024-09-21T08:52:14.228487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.285602+0000","last_change":"2024-09-21T08:51:44.145486+0000","last_active":"2024-09-21T08:54:53.285602+0000","last_peered":"2024-09-21T08:54:53.285602+0000","last_clean":"2024-09-21T08:54:53.285602+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:54:53.285602+0000","last_undegraded":"2024-09-21T08:54:53.285602+0000","last_fullsized":"2024-09-21T08:54:53.285602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:45.211269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":350,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.140851+0000","last_change":"2024-09-21T08:51:46.153164+0000","last_active":"2024-09-21T08:54:53.140851+0000","last_peered":"2024-09-21T08:54:53.140851+0000","last_clean":"2024-09-21T08:54:53.140851+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:53.140851+0000","last_undegraded":"2024-09-21T08:54:53.140851+0000","last_fullsized":"2024-09-21T08:54:53.140851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:25.619586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226871+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:52:14.226871+0000","last_peered":"2024-09-21T08:52:14.226871+0000","last_clean":"2024-09-21T08:52:14.226871+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:52:14.226871+0000","last_undegraded":"2024-09-21T08:52:14.226871+0000","last_fullsized":"2024-09-21T08:52:14.226871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:41.262657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608904+0000","last_change":"2024-09-21T08:51:40.133810+0000","last_active":"2024-09-21T08:54:46.608904+0000","last_peered":"2024-09-21T08:54:46.608904+0000","last_clean":"2024-09-21T08:54:46.608904+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:54:46.608904+0000","last_undegraded":"2024-09-21T08:54:46.608904+0000","last_fullsized":"2024-09-21T08:54:46.608904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:50.992615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228858+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:52:14.228858+0000","last_peered":"2024-09-21T08:52:14.228858+0000","last_clean":"2024-09-21T08:52:14.228858+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:52:14.228858+0000","last_undegraded":"2024-09-21T08:52:14.228858+0000","last_fullsized":"2024-09-21T08:52:14.228858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:07.067511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226360+0000","last_change":"2024-09-21T08:51:42.136459+0000","last_active":"2024-09-21T08:52:14.226360+0000","last_peered":"2024-09-21T08:52:14.226360+0000","last_clean":"2024-09-21T08:52:14.226360+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:52:14.226360+0000","last_undegraded":"2024-09-21T08:52:14.226360+0000","last_fullsized":"2024-09-21T08:52:14.226360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.652788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'60","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.231569+0000","last_change":"2024-09-21T08:51:44.146420+0000","last_active":"2024-09-21T08:54:53.231569+0000","last_peered":"2024-09-21T08:54:53.231569+0000","last_clean":"2024-09-21T08:54:53.231569+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:54:53.231569+0000","last_undegraded":"2024-09-21T08:54:53.231569+0000","last_fullsized":"2024-09-21T08:54:53.231569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:16.779029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225340+0000","last_change":"2024-09-21T08:51:46.154347+0000","last_active":"2024-09-21T08:52:14.225340+0000","last_peered":"2024-09-21T08:52:14.225340+0000","last_clean":"2024-09-21T08:52:14.225340+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:52:14.225340+0000","last_undegraded":"2024-09-21T08:52:14.225340+0000","last_fullsized":"2024-09-21T08:52:14.225340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.695069+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.695069+0000","last_peered":"2024-09-21T08:54:46.695069+0000","last_clean":"2024-09-21T08:54:46.695069+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.695069+0000","last_undegraded":"2024-09-21T08:54:46.695069+0000","last_fullsized":"2024-09-21T08:54:46.695069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:50.251774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.237306+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:52:14.237306+0000","last_peered":"2024-09-21T08:52:14.237306+0000","last_clean":"2024-09-21T08:52:14.237306+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:52:14.237306+0000","last_undegraded":"2024-09-21T08:52:14.237306+0000","last_fullsized":"2024-09-21T08:52:14.237306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:33.234761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226839+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:52:14.226839+0000","last_peered":"2024-09-21T08:52:14.226839+0000","last_clean":"2024-09-21T08:52:14.226839+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:52:14.226839+0000","last_undegraded":"2024-09-21T08:52:14.226839+0000","last_fullsized":"2024-09-21T08:52:14.226839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:41:31.835091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232438+0000","last_change":"2024-09-21T08:51:42.142191+0000","last_active":"2024-09-21T08:52:14.232438+0000","last_peered":"2024-09-21T08:52:14.232438+0000","last_clean":"2024-09-21T08:52:14.232438+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:52:14.232438+0000","last_undegraded":"2024-09-21T08:52:14.232438+0000","last_fullsized":"2024-09-21T08:52:14.232438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:06.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.234890+0000","last_change":"2024-09-21T08:51:44.146281+0000","last_active":"2024-09-21T08:54:53.234890+0000","last_peered":"2024-09-21T08:54:53.234890+0000","last_clean":"2024-09-21T08:54:53.234890+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:54:53.234890+0000","last_undegraded":"2024-09-21T08:54:53.234890+0000","last_fullsized":"2024-09-21T08:54:53.234890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231318+0000","last_change":"2024-09-21T08:51:46.150884+0000","last_active":"2024-09-21T08:52:14.231318+0000","last_peered":"2024-09-21T08:52:14.231318+0000","last_clean":"2024-09-21T08:52:14.231318+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:52:14.231318+0000","last_undegraded":"2024-09-21T08:52:14.231318+0000","last_fullsized":"2024-09-21T08:52:14.231318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:48.550464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180503+0000","last_change":"2024-09-21T08:51:48.161107+0000","last_active":"2024-09-21T08:53:50.180503+0000","last_peered":"2024-09-21T08:53:50.180503+0000","last_clean":"2024-09-21T08:53:50.180503+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:53:50.180503+0000","last_undegraded":"2024-09-21T08:53:50.180503+0000","last_fullsized":"2024-09-21T08:53:50.180503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:05.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.311433+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:46.311433+0000","last_peered":"2024-09-21T08:54:46.311433+0000","last_clean":"2024-09-21T08:54:46.311433+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:54:46.311433+0000","last_undegraded":"2024-09-21T08:54:46.311433+0000","last_fullsized":"2024-09-21T08:54:46.311433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:28.560398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226315+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:52:14.226315+0000","last_peered":"2024-09-21T08:52:14.226315+0000","last_clean":"2024-09-21T08:52:14.226315+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:52:14.226315+0000","last_undegraded":"2024-09-21T08:52:14.226315+0000","last_fullsized":"2024-09-21T08:52:14.226315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:24.009059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226056+0000","last_change":"2024-09-21T08:51:42.136842+0000","last_active":"2024-09-21T08:52:14.226056+0000","last_peered":"2024-09-21T08:52:14.226056+0000","last_clean":"2024-09-21T08:52:14.226056+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:52:14.226056+0000","last_undegraded":"2024-09-21T08:52:14.226056+0000","last_fullsized":"2024-09-21T08:52:14.226056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:52.702050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.213365+0000","last_change":"2024-09-21T08:51:44.145728+0000","last_active":"2024-09-21T08:54:53.213365+0000","last_peered":"2024-09-21T08:54:53.213365+0000","last_clean":"2024-09-21T08:54:53.213365+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:54:53.213365+0000","last_undegraded":"2024-09-21T08:54:53.213365+0000","last_fullsized":"2024-09-21T08:54:53.213365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:30.360384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.136263+0000","last_change":"2024-09-21T08:51:46.156417+0000","last_active":"2024-09-21T08:54:53.136263+0000","last_peered":"2024-09-21T08:54:53.136263+0000","last_clean":"2024-09-21T08:54:53.136263+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:53.136263+0000","last_undegraded":"2024-09-21T08:54:53.136263+0000","last_fullsized":"2024-09-21T08:54:53.136263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:19.289841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179175+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:53:54.179175+0000","last_peered":"2024-09-21T08:53:54.179175+0000","last_clean":"2024-09-21T08:53:54.179175+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:53:54.179175+0000","last_undegraded":"2024-09-21T08:53:54.179175+0000","last_fullsized":"2024-09-21T08:53:54.179175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:56.456030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578009+0000","last_change":"2024-09-21T08:51:40.139340+0000","last_active":"2024-09-21T08:54:46.578009+0000","last_peered":"2024-09-21T08:54:46.578009+0000","last_clean":"2024-09-21T08:54:46.578009+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:54:46.578009+0000","last_undegraded":"2024-09-21T08:54:46.578009+0000","last_fullsized":"2024-09-21T08:54:46.578009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:43.928809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225673+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:52:14.225673+0000","last_peered":"2024-09-21T08:52:14.225673+0000","last_clean":"2024-09-21T08:52:14.225673+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:52:14.225673+0000","last_undegraded":"2024-09-21T08:52:14.225673+0000","last_fullsized":"2024-09-21T08:52:14.225673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:20.136829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'4","reported_seq":608,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.128760+0000","last_change":"2024-09-21T08:51:42.134577+0000","last_active":"2024-09-21T08:54:53.128760+0000","last_peered":"2024-09-21T08:54:53.128760+0000","last_clean":"2024-09-21T08:54:53.128760+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:54:53.128760+0000","last_undegraded":"2024-09-21T08:54:53.128760+0000","last_fullsized":"2024-09-21T08:54:53.128760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:35.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230245+0000","last_change":"2024-09-21T08:51:44.144448+0000","last_active":"2024-09-21T08:52:14.230245+0000","last_peered":"2024-09-21T08:52:14.230245+0000","last_clean":"2024-09-21T08:52:14.230245+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:52:14.230245+0000","last_undegraded":"2024-09-21T08:52:14.230245+0000","last_fullsized":"2024-09-21T08:52:14.230245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:36.186338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.137512+0000","last_change":"2024-09-21T08:51:46.147009+0000","last_active":"2024-09-21T08:54:53.137512+0000","last_peered":"2024-09-21T08:54:53.137512+0000","last_clean":"2024-09-21T08:54:53.137512+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:53.137512+0000","last_undegraded":"2024-09-21T08:54:53.137512+0000","last_fullsized":"2024-09-21T08:54:53.137512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:41.000989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.684038+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:45.684038+0000","last_peered":"2024-09-21T08:53:45.684038+0000","last_clean":"2024-09-21T08:53:45.684038+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:45.684038+0000","last_undegraded":"2024-09-21T08:53:45.684038+0000","last_fullsized":"2024-09-21T08:53:45.684038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.217764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535001+0000","last_change":"2024-09-21T08:51:40.143685+0000","last_active":"2024-09-21T08:54:46.535001+0000","last_peered":"2024-09-21T08:54:46.535001+0000","last_clean":"2024-09-21T08:54:46.535001+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:54:46.535001+0000","last_undegraded":"2024-09-21T08:54:46.535001+0000","last_fullsized":"2024-09-21T08:54:46.535001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.644149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.518125+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.518125+0000","last_peered":"2024-09-21T08:54:46.518125+0000","last_clean":"2024-09-21T08:54:46.518125+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.518125+0000","last_undegraded":"2024-09-21T08:54:46.518125+0000","last_fullsized":"2024-09-21T08:54:46.518125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:32:09.410811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230923+0000","last_change":"2024-09-21T08:51:42.142788+0000","last_active":"2024-09-21T08:52:14.230923+0000","last_peered":"2024-09-21T08:52:14.230923+0000","last_clean":"2024-09-21T08:52:14.230923+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:52:14.230923+0000","last_undegraded":"2024-09-21T08:52:14.230923+0000","last_fullsized":"2024-09-21T08:52:14.230923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:28.690766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.271295+0000","last_change":"2024-09-21T08:51:44.146611+0000","last_active":"2024-09-21T08:54:53.271295+0000","last_peered":"2024-09-21T08:54:53.271295+0000","last_clean":"2024-09-21T08:54:53.271295+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:54:53.271295+0000","last_undegraded":"2024-09-21T08:54:53.271295+0000","last_fullsized":"2024-09-21T08:54:53.271295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:59.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231940+0000","last_change":"2024-09-21T08:51:46.158723+0000","last_active":"2024-09-21T08:52:14.231940+0000","last_peered":"2024-09-21T08:52:14.231940+0000","last_clean":"2024-09-21T08:52:14.231940+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:52:14.231940+0000","last_undegraded":"2024-09-21T08:52:14.231940+0000","last_fullsized":"2024-09-21T08:52:14.231940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:17.004798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.635195+0000","last_change":"2024-09-21T08:51:48.156029+0000","last_active":"2024-09-21T08:54:46.635195+0000","last_peered":"2024-09-21T08:54:46.635195+0000","last_clean":"2024-09-21T08:54:46.635195+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:54:46.635195+0000","last_undegraded":"2024-09-21T08:54:46.635195+0000","last_fullsized":"2024-09-21T08:54:46.635195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:47.978506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399786+0000","last_change":"2024-09-21T08:51:40.141982+0000","last_active":"2024-09-21T08:54:46.399786+0000","last_peered":"2024-09-21T08:54:46.399786+0000","last_clean":"2024-09-21T08:54:46.399786+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:54:46.399786+0000","last_undegraded":"2024-09-21T08:54:46.399786+0000","last_fullsized":"2024-09-21T08:54:46.399786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:59.500749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229118+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:52:14.229118+0000","last_peered":"2024-09-21T08:52:14.229118+0000","last_clean":"2024-09-21T08:52:14.229118+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:52:14.229118+0000","last_undegraded":"2024-09-21T08:52:14.229118+0000","last_fullsized":"2024-09-21T08:52:14.229118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:32.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228862+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:52:14.228862+0000","last_peered":"2024-09-21T08:52:14.228862+0000","last_clean":"2024-09-21T08:52:14.228862+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:52:14.228862+0000","last_undegraded":"2024-09-21T08:52:14.228862+0000","last_fullsized":"2024-09-21T08:52:14.228862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:01.460915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.230537+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:54:46.230537+0000","last_peered":"2024-09-21T08:54:46.230537+0000","last_clean":"2024-09-21T08:54:46.230537+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:54:46.230537+0000","last_undegraded":"2024-09-21T08:54:46.230537+0000","last_fullsized":"2024-09-21T08:54:46.230537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:33.456799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228510+0000","last_change":"2024-09-21T08:51:42.134377+0000","last_active":"2024-09-21T08:52:14.228510+0000","last_peered":"2024-09-21T08:52:14.228510+0000","last_clean":"2024-09-21T08:52:14.228510+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:52:14.228510+0000","last_undegraded":"2024-09-21T08:52:14.228510+0000","last_fullsized":"2024-09-21T08:52:14.228510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.277223+0000","last_change":"2024-09-21T08:51:44.147739+0000","last_active":"2024-09-21T08:54:53.277223+0000","last_peered":"2024-09-21T08:54:53.277223+0000","last_clean":"2024-09-21T08:54:53.277223+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:54:53.277223+0000","last_undegraded":"2024-09-21T08:54:53.277223+0000","last_fullsized":"2024-09-21T08:54:53.277223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:09.473552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227064+0000","last_change":"2024-09-21T08:51:46.152510+0000","last_active":"2024-09-21T08:52:14.227064+0000","last_peered":"2024-09-21T08:52:14.227064+0000","last_clean":"2024-09-21T08:52:14.227064+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:52:14.227064+0000","last_undegraded":"2024-09-21T08:52:14.227064+0000","last_fullsized":"2024-09-21T08:52:14.227064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:46.952503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.612082+0000","last_change":"2024-09-21T08:51:48.153950+0000","last_active":"2024-09-21T08:54:46.612082+0000","last_peered":"2024-09-21T08:54:46.612082+0000","last_clean":"2024-09-21T08:54:46.612082+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:54:46.612082+0000","last_undegraded":"2024-09-21T08:54:46.612082+0000","last_fullsized":"2024-09-21T08:54:46.612082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:39:17.944711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231327+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:52:14.231327+0000","last_peered":"2024-09-21T08:52:14.231327+0000","last_clean":"2024-09-21T08:52:14.231327+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:52:14.231327+0000","last_undegraded":"2024-09-21T08:52:14.231327+0000","last_fullsized":"2024-09-21T08:52:14.231327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:56.405706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223860+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:52:14.223860+0000","last_peered":"2024-09-21T08:52:14.223860+0000","last_clean":"2024-09-21T08:52:14.223860+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:52:14.223860+0000","last_undegraded":"2024-09-21T08:52:14.223860+0000","last_fullsized":"2024-09-21T08:52:14.223860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:51.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225233+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:52:14.225233+0000","last_peered":"2024-09-21T08:52:14.225233+0000","last_clean":"2024-09-21T08:52:14.225233+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:52:14.225233+0000","last_undegraded":"2024-09-21T08:52:14.225233+0000","last_fullsized":"2024-09-21T08:52:14.225233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.236996+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:52:14.236996+0000","last_peered":"2024-09-21T08:52:14.236996+0000","last_clean":"2024-09-21T08:52:14.236996+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:52:14.236996+0000","last_undegraded":"2024-09-21T08:52:14.236996+0000","last_fullsized":"2024-09-21T08:52:14.236996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.070327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'284","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.275395+0000","last_change":"2024-09-21T08:51:44.151651+0000","last_active":"2024-09-21T08:54:53.275395+0000","last_peered":"2024-09-21T08:54:53.275395+0000","last_clean":"2024-09-21T08:54:53.275395+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:53.275395+0000","last_undegraded":"2024-09-21T08:54:53.275395+0000","last_fullsized":"2024-09-21T08:54:53.275395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229206+0000","last_change":"2024-09-21T08:51:46.151027+0000","last_active":"2024-09-21T08:52:14.229206+0000","last_peered":"2024-09-21T08:52:14.229206+0000","last_clean":"2024-09-21T08:52:14.229206+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:52:14.229206+0000","last_undegraded":"2024-09-21T08:52:14.229206+0000","last_fullsized":"2024-09-21T08:52:14.229206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:21.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.174515+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:53:02.174515+0000","last_peered":"2024-09-21T08:53:02.174515+0000","last_clean":"2024-09-21T08:53:02.174515+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:53:02.174515+0000","last_undegraded":"2024-09-21T08:53:02.174515+0000","last_fullsized":"2024-09-21T08:53:02.174515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:09.403435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535009+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.535009+0000","last_peered":"2024-09-21T08:54:46.535009+0000","last_clean":"2024-09-21T08:54:46.535009+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.535009+0000","last_undegraded":"2024-09-21T08:54:46.535009+0000","last_fullsized":"2024-09-21T08:54:46.535009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227766+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:52:14.227766+0000","last_peered":"2024-09-21T08:52:14.227766+0000","last_clean":"2024-09-21T08:52:14.227766+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:52:14.227766+0000","last_undegraded":"2024-09-21T08:52:14.227766+0000","last_fullsized":"2024-09-21T08:52:14.227766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:16.900520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225020+0000","last_change":"2024-09-21T08:51:38.137786+0000","last_active":"2024-09-21T08:52:14.225020+0000","last_peered":"2024-09-21T08:52:14.225020+0000","last_clean":"2024-09-21T08:52:14.225020+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:52:14.225020+0000","last_undegraded":"2024-09-21T08:52:14.225020+0000","last_fullsized":"2024-09-21T08:52:14.225020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.245255+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:52:14.245255+0000","last_peered":"2024-09-21T08:52:14.245255+0000","last_clean":"2024-09-21T08:52:14.245255+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:52:14.245255+0000","last_undegraded":"2024-09-21T08:52:14.245255+0000","last_fullsized":"2024-09-21T08:52:14.245255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.385447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:42.216645+0000","last_change":"2024-09-21T08:51:44.143788+0000","last_active":"2024-09-21T08:54:42.216645+0000","last_peered":"2024-09-21T08:54:42.216645+0000","last_clean":"2024-09-21T08:54:42.216645+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:54:42.216645+0000","last_undegraded":"2024-09-21T08:54:42.216645+0000","last_fullsized":"2024-09-21T08:54:42.216645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:03.808346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226722+0000","last_change":"2024-09-21T08:51:46.152516+0000","last_active":"2024-09-21T08:52:14.226722+0000","last_peered":"2024-09-21T08:52:14.226722+0000","last_clean":"2024-09-21T08:52:14.226722+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:52:14.226722+0000","last_undegraded":"2024-09-21T08:52:14.226722+0000","last_fullsized":"2024-09-21T08:52:14.226722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:34.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224587+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:52:14.224587+0000","last_peered":"2024-09-21T08:52:14.224587+0000","last_clean":"2024-09-21T08:52:14.224587+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:52:14.224587+0000","last_undegraded":"2024-09-21T08:52:14.224587+0000","last_fullsized":"2024-09-21T08:52:14.224587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:11.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.897959+0000","last_change":"2024-09-21T08:51:40.136811+0000","last_active":"2024-09-21T08:52:19.897959+0000","last_peered":"2024-09-21T08:52:19.897959+0000","last_clean":"2024-09-21T08:52:19.897959+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:52:19.897959+0000","last_undegraded":"2024-09-21T08:52:19.897959+0000","last_fullsized":"2024-09-21T08:52:19.897959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:09.075531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224875+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:52:14.224875+0000","last_peered":"2024-09-21T08:52:14.224875+0000","last_clean":"2024-09-21T08:52:14.224875+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:52:14.224875+0000","last_undegraded":"2024-09-21T08:52:14.224875+0000","last_fullsized":"2024-09-21T08:52:14.224875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:54.411595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228110+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:52:14.228110+0000","last_peered":"2024-09-21T08:52:14.228110+0000","last_clean":"2024-09-21T08:52:14.228110+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:52:14.228110+0000","last_undegraded":"2024-09-21T08:52:14.228110+0000","last_fullsized":"2024-09-21T08:52:14.228110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:30.036950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227211+0000","last_change":"2024-09-21T08:51:42.141282+0000","last_active":"2024-09-21T08:52:14.227211+0000","last_peered":"2024-09-21T08:52:14.227211+0000","last_clean":"2024-09-21T08:52:14.227211+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:52:14.227211+0000","last_undegraded":"2024-09-21T08:52:14.227211+0000","last_fullsized":"2024-09-21T08:52:14.227211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.948185+0000","last_change":"2024-09-21T08:51:44.140590+0000","last_active":"2024-09-21T08:54:45.948185+0000","last_peered":"2024-09-21T08:54:45.948185+0000","last_clean":"2024-09-21T08:54:45.948185+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:45.948185+0000","last_undegraded":"2024-09-21T08:54:45.948185+0000","last_fullsized":"2024-09-21T08:54:45.948185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:35.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231632+0000","last_change":"2024-09-21T08:51:46.150420+0000","last_active":"2024-09-21T08:52:14.231632+0000","last_peered":"2024-09-21T08:52:14.231632+0000","last_clean":"2024-09-21T08:52:14.231632+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:52:14.231632+0000","last_undegraded":"2024-09-21T08:52:14.231632+0000","last_fullsized":"2024-09-21T08:52:14.231632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:59.570923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.567201+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.567201+0000","last_peered":"2024-09-21T08:54:46.567201+0000","last_clean":"2024-09-21T08:54:46.567201+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.567201+0000","last_undegraded":"2024-09-21T08:54:46.567201+0000","last_fullsized":"2024-09-21T08:54:46.567201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:38.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.898484+0000","last_change":"2024-09-21T08:51:40.142809+0000","last_active":"2024-09-21T08:52:19.898484+0000","last_peered":"2024-09-21T08:52:19.898484+0000","last_clean":"2024-09-21T08:52:19.898484+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:52:19.898484+0000","last_undegraded":"2024-09-21T08:52:19.898484+0000","last_fullsized":"2024-09-21T08:52:19.898484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:35.464819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.200050+0000","last_change":"2024-09-21T08:51:38.147128+0000","last_active":"2024-09-21T08:54:46.200050+0000","last_peered":"2024-09-21T08:54:46.200050+0000","last_clean":"2024-09-21T08:54:46.200050+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:54:46.200050+0000","last_undegraded":"2024-09-21T08:54:46.200050+0000","last_fullsized":"2024-09-21T08:54:46.200050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:04.684325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226549+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:52:14.226549+0000","last_peered":"2024-09-21T08:52:14.226549+0000","last_clean":"2024-09-21T08:52:14.226549+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:52:14.226549+0000","last_undegraded":"2024-09-21T08:52:14.226549+0000","last_fullsized":"2024-09-21T08:52:14.226549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:59.698574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.717292+0000","last_change":"2024-09-21T08:51:42.136825+0000","last_active":"2024-09-21T08:54:46.717292+0000","last_peered":"2024-09-21T08:54:46.717292+0000","last_clean":"2024-09-21T08:54:46.717292+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:54:46.717292+0000","last_undegraded":"2024-09-21T08:54:46.717292+0000","last_fullsized":"2024-09-21T08:54:46.717292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:15.849657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'67","reported_seq":134,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.256422+0000","last_change":"2024-09-21T08:51:44.146959+0000","last_active":"2024-09-21T08:54:53.256422+0000","last_peered":"2024-09-21T08:54:53.256422+0000","last_clean":"2024-09-21T08:54:53.256422+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:54:53.256422+0000","last_undegraded":"2024-09-21T08:54:53.256422+0000","last_fullsized":"2024-09-21T08:54:53.256422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228236+0000","last_change":"2024-09-21T08:51:46.155541+0000","last_active":"2024-09-21T08:52:14.228236+0000","last_peered":"2024-09-21T08:52:14.228236+0000","last_clean":"2024-09-21T08:52:14.228236+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:52:14.228236+0000","last_undegraded":"2024-09-21T08:52:14.228236+0000","last_fullsized":"2024-09-21T08:52:14.228236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:24.113565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.874713+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:53:45.874713+0000","last_peered":"2024-09-21T08:53:45.874713+0000","last_clean":"2024-09-21T08:53:45.874713+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:53:45.874713+0000","last_undegraded":"2024-09-21T08:53:45.874713+0000","last_fullsized":"2024-09-21T08:53:45.874713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.827304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170271+0000","last_change":"2024-09-21T08:51:40.133246+0000","last_active":"2024-09-21T08:53:02.170271+0000","last_peered":"2024-09-21T08:53:02.170271+0000","last_clean":"2024-09-21T08:53:02.170271+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:53:02.170271+0000","last_undegraded":"2024-09-21T08:53:02.170271+0000","last_fullsized":"2024-09-21T08:53:02.170271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.576389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227037+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:52:14.227037+0000","last_peered":"2024-09-21T08:52:14.227037+0000","last_clean":"2024-09-21T08:52:14.227037+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:52:14.227037+0000","last_undegraded":"2024-09-21T08:52:14.227037+0000","last_fullsized":"2024-09-21T08:52:14.227037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:12.352985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230062+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:52:14.230062+0000","last_peered":"2024-09-21T08:52:14.230062+0000","last_clean":"2024-09-21T08:52:14.230062+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:52:14.230062+0000","last_undegraded":"2024-09-21T08:52:14.230062+0000","last_fullsized":"2024-09-21T08:52:14.230062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:10.789513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224660+0000","last_change":"2024-09-21T08:51:42.136553+0000","last_active":"2024-09-21T08:52:14.224660+0000","last_peered":"2024-09-21T08:52:14.224660+0000","last_clean":"2024-09-21T08:52:14.224660+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:52:14.224660+0000","last_undegraded":"2024-09-21T08:52:14.224660+0000","last_fullsized":"2024-09-21T08:52:14.224660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:23.270685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:44.152406+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":357,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.133791+0000","last_change":"2024-09-21T08:51:46.147127+0000","last_active":"2024-09-21T08:54:53.133791+0000","last_peered":"2024-09-21T08:54:53.133791+0000","last_clean":"2024-09-21T08:54:53.133791+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:54:53.133791+0000","last_undegraded":"2024-09-21T08:54:53.133791+0000","last_fullsized":"2024-09-21T08:54:53.133791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:36.081632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230628+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:52:14.230628+0000","last_peered":"2024-09-21T08:52:14.230628+0000","last_clean":"2024-09-21T08:52:14.230628+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:52:14.230628+0000","last_undegraded":"2024-09-21T08:52:14.230628+0000","last_fullsized":"2024-09-21T08:52:14.230628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:10.942375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.170054+0000","last_change":"2024-09-21T08:51:40.145001+0000","last_active":"2024-09-21T08:53:02.170054+0000","last_peered":"2024-09-21T08:53:02.170054+0000","last_clean":"2024-09-21T08:53:02.170054+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:53:02.170054+0000","last_undegraded":"2024-09-21T08:53:02.170054+0000","last_fullsized":"2024-09-21T08:53:02.170054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:09.524590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528793+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.528793+0000","last_peered":"2024-09-21T08:54:46.528793+0000","last_clean":"2024-09-21T08:54:46.528793+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.528793+0000","last_undegraded":"2024-09-21T08:54:46.528793+0000","last_fullsized":"2024-09-21T08:54:46.528793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:48.815999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227389+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:52:14.227389+0000","last_peered":"2024-09-21T08:52:14.227389+0000","last_clean":"2024-09-21T08:52:14.227389+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:52:14.227389+0000","last_undegraded":"2024-09-21T08:52:14.227389+0000","last_fullsized":"2024-09-21T08:52:14.227389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:37.564868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225844+0000","last_change":"2024-09-21T08:51:42.136276+0000","last_active":"2024-09-21T08:52:14.225844+0000","last_peered":"2024-09-21T08:52:14.225844+0000","last_clean":"2024-09-21T08:52:14.225844+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:52:14.225844+0000","last_undegraded":"2024-09-21T08:52:14.225844+0000","last_fullsized":"2024-09-21T08:52:14.225844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:29.036853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.172648+0000","last_change":"2024-09-21T08:51:44.146949+0000","last_active":"2024-09-21T08:53:02.172648+0000","last_peered":"2024-09-21T08:53:02.172648+0000","last_clean":"2024-09-21T08:53:02.172648+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:53:02.172648+0000","last_undegraded":"2024-09-21T08:53:02.172648+0000","last_fullsized":"2024-09-21T08:53:02.172648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:24.672757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.138820+0000","last_change":"2024-09-21T08:51:46.157876+0000","last_active":"2024-09-21T08:54:53.138820+0000","last_peered":"2024-09-21T08:54:53.138820+0000","last_clean":"2024-09-21T08:54:53.138820+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:54:53.138820+0000","last_undegraded":"2024-09-21T08:54:53.138820+0000","last_fullsized":"2024-09-21T08:54:53.138820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:58.663889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227725+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:52:14.227725+0000","last_peered":"2024-09-21T08:52:14.227725+0000","last_clean":"2024-09-21T08:52:14.227725+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:52:14.227725+0000","last_undegraded":"2024-09-21T08:52:14.227725+0000","last_fullsized":"2024-09-21T08:52:14.227725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:57:38.232117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.928314+0000","last_change":"2024-09-21T08:51:40.139991+0000","last_active":"2024-09-21T08:53:45.928314+0000","last_peered":"2024-09-21T08:53:45.928314+0000","last_clean":"2024-09-21T08:53:45.928314+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:53:45.928314+0000","last_undegraded":"2024-09-21T08:53:45.928314+0000","last_fullsized":"2024-09-21T08:53:45.928314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:15.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226716+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:52:14.226716+0000","last_peered":"2024-09-21T08:52:14.226716+0000","last_clean":"2024-09-21T08:52:14.226716+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:52:14.226716+0000","last_undegraded":"2024-09-21T08:52:14.226716+0000","last_fullsized":"2024-09-21T08:52:14.226716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:34.648397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231442+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:52:14.231442+0000","last_peered":"2024-09-21T08:52:14.231442+0000","last_clean":"2024-09-21T08:52:14.231442+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:52:14.231442+0000","last_undegraded":"2024-09-21T08:52:14.231442+0000","last_fullsized":"2024-09-21T08:52:14.231442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:00.460876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.235154+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:52:14.235154+0000","last_peered":"2024-09-21T08:52:14.235154+0000","last_clean":"2024-09-21T08:52:14.235154+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:52:14.235154+0000","last_undegraded":"2024-09-21T08:52:14.235154+0000","last_fullsized":"2024-09-21T08:52:14.235154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:44.480516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'91","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.265103+0000","last_change":"2024-09-21T08:51:44.151520+0000","last_active":"2024-09-21T08:54:53.265103+0000","last_peered":"2024-09-21T08:54:53.265103+0000","last_clean":"2024-09-21T08:54:53.265103+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:54:53.265103+0000","last_undegraded":"2024-09-21T08:54:53.265103+0000","last_fullsized":"2024-09-21T08:54:53.265103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:23:27.022747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226572+0000","last_change":"2024-09-21T08:51:46.148294+0000","last_active":"2024-09-21T08:52:14.226572+0000","last_peered":"2024-09-21T08:52:14.226572+0000","last_clean":"2024-09-21T08:52:14.226572+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:52:14.226572+0000","last_undegraded":"2024-09-21T08:52:14.226572+0000","last_fullsized":"2024-09-21T08:52:14.226572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:33.051043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.232595+0000","last_change":"2024-09-21T08:51:48.152691+0000","last_active":"2024-09-21T08:52:14.232595+0000","last_peered":"2024-09-21T08:52:14.232595+0000","last_clean":"2024-09-21T08:52:14.232595+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:52:14.232595+0000","last_undegraded":"2024-09-21T08:52:14.232595+0000","last_fullsized":"2024-09-21T08:52:14.232595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:38.470582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.407365+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.407365+0000","last_peered":"2024-09-21T08:54:46.407365+0000","last_clean":"2024-09-21T08:54:46.407365+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.407365+0000","last_undegraded":"2024-09-21T08:54:46.407365+0000","last_fullsized":"2024-09-21T08:54:46.407365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:16.117971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312954+0000","last_change":"2024-09-21T08:51:40.144129+0000","last_active":"2024-09-21T08:54:46.312954+0000","last_peered":"2024-09-21T08:54:46.312954+0000","last_clean":"2024-09-21T08:54:46.312954+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:54:46.312954+0000","last_undegraded":"2024-09-21T08:54:46.312954+0000","last_fullsized":"2024-09-21T08:54:46.312954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:13.975778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228951+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:52:14.228951+0000","last_peered":"2024-09-21T08:52:14.228951+0000","last_clean":"2024-09-21T08:52:14.228951+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:52:14.228951+0000","last_undegraded":"2024-09-21T08:52:14.228951+0000","last_fullsized":"2024-09-21T08:52:14.228951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:30.847013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228755+0000","last_change":"2024-09-21T08:51:42.133381+0000","last_active":"2024-09-21T08:52:14.228755+0000","last_peered":"2024-09-21T08:52:14.228755+0000","last_clean":"2024-09-21T08:52:14.228755+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:52:14.228755+0000","last_undegraded":"2024-09-21T08:52:14.228755+0000","last_fullsized":"2024-09-21T08:52:14.228755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:30.430814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.282859+0000","last_change":"2024-09-21T08:51:44.145046+0000","last_active":"2024-09-21T08:54:53.282859+0000","last_peered":"2024-09-21T08:54:53.282859+0000","last_clean":"2024-09-21T08:54:53.282859+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:54:53.282859+0000","last_undegraded":"2024-09-21T08:54:53.282859+0000","last_fullsized":"2024-09-21T08:54:53.282859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:47.801350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224610+0000","last_change":"2024-09-21T08:51:46.158200+0000","last_active":"2024-09-21T08:52:14.224610+0000","last_peered":"2024-09-21T08:52:14.224610+0000","last_clean":"2024-09-21T08:52:14.224610+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:52:14.224610+0000","last_undegraded":"2024-09-21T08:52:14.224610+0000","last_fullsized":"2024-09-21T08:52:14.224610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:37.227055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.209012+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:44.209012+0000","last_peered":"2024-09-21T08:53:44.209012+0000","last_clean":"2024-09-21T08:53:44.209012+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:44.209012+0000","last_undegraded":"2024-09-21T08:53:44.209012+0000","last_fullsized":"2024-09-21T08:53:44.209012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:31.644486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'5","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181750+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:00.181750+0000","last_peered":"2024-09-21T08:54:00.181750+0000","last_clean":"2024-09-21T08:54:00.181750+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:54:00.181750+0000","last_undegraded":"2024-09-21T08:54:00.181750+0000","last_fullsized":"2024-09-21T08:54:00.181750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.294093+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.294093+0000","last_peered":"2024-09-21T08:54:46.294093+0000","last_clean":"2024-09-21T08:54:46.294093+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.294093+0000","last_undegraded":"2024-09-21T08:54:46.294093+0000","last_fullsized":"2024-09-21T08:54:46.294093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:50.293941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229853+0000","last_change":"2024-09-21T08:51:42.136260+0000","last_active":"2024-09-21T08:52:14.229853+0000","last_peered":"2024-09-21T08:52:14.229853+0000","last_clean":"2024-09-21T08:52:14.229853+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:52:14.229853+0000","last_undegraded":"2024-09-21T08:52:14.229853+0000","last_fullsized":"2024-09-21T08:52:14.229853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:30.066785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:45.953028+0000","last_change":"2024-09-21T08:51:44.144365+0000","last_active":"2024-09-21T08:54:45.953028+0000","last_peered":"2024-09-21T08:54:45.953028+0000","last_clean":"2024-09-21T08:54:45.953028+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:45.953028+0000","last_undegraded":"2024-09-21T08:54:45.953028+0000","last_fullsized":"2024-09-21T08:54:45.953028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:46.704900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227983+0000","last_change":"2024-09-21T08:51:46.158835+0000","last_active":"2024-09-21T08:52:14.227983+0000","last_peered":"2024-09-21T08:52:14.227983+0000","last_clean":"2024-09-21T08:52:14.227983+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:52:14.227983+0000","last_undegraded":"2024-09-21T08:52:14.227983+0000","last_fullsized":"2024-09-21T08:52:14.227983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:32.915843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.029809+0000","last_change":"2024-09-21T08:51:48.154918+0000","last_active":"2024-09-21T08:54:46.029809+0000","last_peered":"2024-09-21T08:54:46.029809+0000","last_clean":"2024-09-21T08:54:46.029809+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:54:46.029809+0000","last_undegraded":"2024-09-21T08:54:46.029809+0000","last_fullsized":"2024-09-21T08:54:46.029809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:16.848003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583334+0000","last_change":"2024-09-21T08:51:40.122583+0000","last_active":"2024-09-21T08:54:46.583334+0000","last_peered":"2024-09-21T08:54:46.583334+0000","last_clean":"2024-09-21T08:54:46.583334+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:54:46.583334+0000","last_undegraded":"2024-09-21T08:54:46.583334+0000","last_fullsized":"2024-09-21T08:54:46.583334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:22.038126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234016+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:52:14.234016+0000","last_peered":"2024-09-21T08:52:14.234016+0000","last_clean":"2024-09-21T08:52:14.234016+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:52:14.234016+0000","last_undegraded":"2024-09-21T08:52:14.234016+0000","last_fullsized":"2024-09-21T08:52:14.234016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:48.539998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226151+0000","last_change":"2024-09-21T08:51:42.140686+0000","last_active":"2024-09-21T08:52:14.226151+0000","last_peered":"2024-09-21T08:52:14.226151+0000","last_clean":"2024-09-21T08:52:14.226151+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:52:14.226151+0000","last_undegraded":"2024-09-21T08:52:14.226151+0000","last_fullsized":"2024-09-21T08:52:14.226151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:43:42.691888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'43","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.250248+0000","last_change":"2024-09-21T08:51:44.143454+0000","last_active":"2024-09-21T08:54:53.250248+0000","last_peered":"2024-09-21T08:54:53.250248+0000","last_clean":"2024-09-21T08:54:53.250248+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:54:53.250248+0000","last_undegraded":"2024-09-21T08:54:53.250248+0000","last_fullsized":"2024-09-21T08:54:53.250248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:23.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226645+0000","last_change":"2024-09-21T08:51:46.147907+0000","last_active":"2024-09-21T08:52:14.226645+0000","last_peered":"2024-09-21T08:52:14.226645+0000","last_clean":"2024-09-21T08:52:14.226645+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:52:14.226645+0000","last_undegraded":"2024-09-21T08:52:14.226645+0000","last_fullsized":"2024-09-21T08:52:14.226645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:37.528413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230362+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:52:14.230362+0000","last_peered":"2024-09-21T08:52:14.230362+0000","last_clean":"2024-09-21T08:52:14.230362+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:52:14.230362+0000","last_undegraded":"2024-09-21T08:52:14.230362+0000","last_fullsized":"2024-09-21T08:52:14.230362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:39.412207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223965+0000","last_change":"2024-09-21T08:51:40.145568+0000","last_active":"2024-09-21T08:52:14.223965+0000","last_peered":"2024-09-21T08:52:14.223965+0000","last_clean":"2024-09-21T08:52:14.223965+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:52:14.223965+0000","last_undegraded":"2024-09-21T08:52:14.223965+0000","last_fullsized":"2024-09-21T08:52:14.223965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.236481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.160254+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:53:02.160254+0000","last_peered":"2024-09-21T08:53:02.160254+0000","last_clean":"2024-09-21T08:53:02.160254+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:53:02.160254+0000","last_undegraded":"2024-09-21T08:53:02.160254+0000","last_fullsized":"2024-09-21T08:53:02.160254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224272+0000","last_change":"2024-09-21T08:51:42.139408+0000","last_active":"2024-09-21T08:52:14.224272+0000","last_peered":"2024-09-21T08:52:14.224272+0000","last_clean":"2024-09-21T08:52:14.224272+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:52:14.224272+0000","last_undegraded":"2024-09-21T08:52:14.224272+0000","last_fullsized":"2024-09-21T08:52:14.224272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:32.273127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.241429+0000","last_change":"2024-09-21T08:51:44.145680+0000","last_active":"2024-09-21T08:54:53.241429+0000","last_peered":"2024-09-21T08:54:53.241429+0000","last_clean":"2024-09-21T08:54:53.241429+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:54:53.241429+0000","last_undegraded":"2024-09-21T08:54:53.241429+0000","last_fullsized":"2024-09-21T08:54:53.241429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:10.374149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227427+0000","last_change":"2024-09-21T08:51:46.153528+0000","last_active":"2024-09-21T08:52:14.227427+0000","last_peered":"2024-09-21T08:52:14.227427+0000","last_clean":"2024-09-21T08:52:14.227427+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:52:14.227427+0000","last_undegraded":"2024-09-21T08:52:14.227427+0000","last_fullsized":"2024-09-21T08:52:14.227427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:22.537802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405394+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.405394+0000","last_peered":"2024-09-21T08:54:46.405394+0000","last_clean":"2024-09-21T08:54:46.405394+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.405394+0000","last_undegraded":"2024-09-21T08:54:46.405394+0000","last_fullsized":"2024-09-21T08:54:46.405394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:27.405363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.841739+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:53:45.841739+0000","last_peered":"2024-09-21T08:53:45.841739+0000","last_clean":"2024-09-21T08:53:45.841739+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:53:45.841739+0000","last_undegraded":"2024-09-21T08:53:45.841739+0000","last_fullsized":"2024-09-21T08:53:45.841739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:23.655957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228233+0000","last_change":"2024-09-21T08:51:42.136453+0000","last_active":"2024-09-21T08:52:14.228233+0000","last_peered":"2024-09-21T08:52:14.228233+0000","last_clean":"2024-09-21T08:52:14.228233+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:52:14.228233+0000","last_undegraded":"2024-09-21T08:52:14.228233+0000","last_fullsized":"2024-09-21T08:52:14.228233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'62","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.238339+0000","last_change":"2024-09-21T08:51:44.146351+0000","last_active":"2024-09-21T08:54:53.238339+0000","last_peered":"2024-09-21T08:54:53.238339+0000","last_clean":"2024-09-21T08:54:53.238339+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:54:53.238339+0000","last_undegraded":"2024-09-21T08:54:53.238339+0000","last_fullsized":"2024-09-21T08:54:53.238339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:43.060922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231093+0000","last_change":"2024-09-21T08:51:46.155998+0000","last_active":"2024-09-21T08:52:14.231093+0000","last_peered":"2024-09-21T08:52:14.231093+0000","last_clean":"2024-09-21T08:52:14.231093+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:52:14.231093+0000","last_undegraded":"2024-09-21T08:52:14.231093+0000","last_fullsized":"2024-09-21T08:52:14.231093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:45:51.236181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.871525+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:53:45.871525+0000","last_peered":"2024-09-21T08:53:45.871525+0000","last_clean":"2024-09-21T08:53:45.871525+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:53:45.871525+0000","last_undegraded":"2024-09-21T08:53:45.871525+0000","last_fullsized":"2024-09-21T08:53:45.871525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:07.375683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.313490+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.313490+0000","last_peered":"2024-09-21T08:54:46.313490+0000","last_clean":"2024-09-21T08:54:46.313490+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.313490+0000","last_undegraded":"2024-09-21T08:54:46.313490+0000","last_fullsized":"2024-09-21T08:54:46.313490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:31.282745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.277380+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:46.277380+0000","last_peered":"2024-09-21T08:54:46.277380+0000","last_clean":"2024-09-21T08:54:46.277380+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:46.277380+0000","last_undegraded":"2024-09-21T08:54:46.277380+0000","last_fullsized":"2024-09-21T08:54:46.277380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231259+0000","last_change":"2024-09-21T08:51:42.139604+0000","last_active":"2024-09-21T08:52:14.231259+0000","last_peered":"2024-09-21T08:52:14.231259+0000","last_clean":"2024-09-21T08:52:14.231259+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:52:14.231259+0000","last_undegraded":"2024-09-21T08:52:14.231259+0000","last_fullsized":"2024-09-21T08:52:14.231259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.490123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.244363+0000","last_change":"2024-09-21T08:51:44.146257+0000","last_active":"2024-09-21T08:54:53.244363+0000","last_peered":"2024-09-21T08:54:53.244363+0000","last_clean":"2024-09-21T08:54:53.244363+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:54:53.244363+0000","last_undegraded":"2024-09-21T08:54:53.244363+0000","last_fullsized":"2024-09-21T08:54:53.244363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:49.195311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227189+0000","last_change":"2024-09-21T08:51:46.156505+0000","last_active":"2024-09-21T08:52:14.227189+0000","last_peered":"2024-09-21T08:52:14.227189+0000","last_clean":"2024-09-21T08:52:14.227189+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:52:14.227189+0000","last_undegraded":"2024-09-21T08:52:14.227189+0000","last_fullsized":"2024-09-21T08:52:14.227189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:06.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.934131+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:53:45.934131+0000","last_peered":"2024-09-21T08:53:45.934131+0000","last_clean":"2024-09-21T08:53:45.934131+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:53:45.934131+0000","last_undegraded":"2024-09-21T08:53:45.934131+0000","last_fullsized":"2024-09-21T08:53:45.934131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:58.109469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.142254+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:03.523431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.214659+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:46.214659+0000","last_peered":"2024-09-21T08:54:46.214659+0000","last_clean":"2024-09-21T08:54:46.214659+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:46.214659+0000","last_undegraded":"2024-09-21T08:54:46.214659+0000","last_fullsized":"2024-09-21T08:54:46.214659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:17.559502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.231343+0000","last_change":"2024-09-21T08:51:42.139686+0000","last_active":"2024-09-21T08:52:14.231343+0000","last_peered":"2024-09-21T08:52:14.231343+0000","last_clean":"2024-09-21T08:52:14.231343+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:52:14.231343+0000","last_undegraded":"2024-09-21T08:52:14.231343+0000","last_fullsized":"2024-09-21T08:52:14.231343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:31.566863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.188366+0000","last_change":"2024-09-21T08:51:44.141704+0000","last_active":"2024-09-21T08:54:53.188366+0000","last_peered":"2024-09-21T08:54:53.188366+0000","last_clean":"2024-09-21T08:54:53.188366+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:54:53.188366+0000","last_undegraded":"2024-09-21T08:54:53.188366+0000","last_fullsized":"2024-09-21T08:54:53.188366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:48.675594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226978+0000","last_change":"2024-09-21T08:51:46.159395+0000","last_active":"2024-09-21T08:52:14.226978+0000","last_peered":"2024-09-21T08:52:14.226978+0000","last_clean":"2024-09-21T08:52:14.226978+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:52:14.226978+0000","last_undegraded":"2024-09-21T08:52:14.226978+0000","last_fullsized":"2024-09-21T08:52:14.226978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:32.704956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.658263+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.658263+0000","last_peered":"2024-09-21T08:54:46.658263+0000","last_clean":"2024-09-21T08:54:46.658263+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.658263+0000","last_undegraded":"2024-09-21T08:54:46.658263+0000","last_fullsized":"2024-09-21T08:54:46.658263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:05.839724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.535066+0000","last_change":"2024-09-21T08:51:40.136848+0000","last_active":"2024-09-21T08:54:46.535066+0000","last_peered":"2024-09-21T08:54:46.535066+0000","last_clean":"2024-09-21T08:54:46.535066+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:54:46.535066+0000","last_undegraded":"2024-09-21T08:54:46.535066+0000","last_fullsized":"2024-09-21T08:54:46.535066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227140+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:52:14.227140+0000","last_peered":"2024-09-21T08:52:14.227140+0000","last_clean":"2024-09-21T08:52:14.227140+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:52:14.227140+0000","last_undegraded":"2024-09-21T08:52:14.227140+0000","last_fullsized":"2024-09-21T08:52:14.227140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:52.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229052+0000","last_change":"2024-09-21T08:51:42.135155+0000","last_active":"2024-09-21T08:52:14.229052+0000","last_peered":"2024-09-21T08:52:14.229052+0000","last_clean":"2024-09-21T08:52:14.229052+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:52:14.229052+0000","last_undegraded":"2024-09-21T08:52:14.229052+0000","last_fullsized":"2024-09-21T08:52:14.229052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:13.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179980+0000","last_change":"2024-09-21T08:51:44.149082+0000","last_active":"2024-09-21T08:53:45.179980+0000","last_peered":"2024-09-21T08:53:45.179980+0000","last_clean":"2024-09-21T08:53:45.179980+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:53:45.179980+0000","last_undegraded":"2024-09-21T08:53:45.179980+0000","last_fullsized":"2024-09-21T08:53:45.179980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:33.834476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.132323+0000","last_change":"2024-09-21T08:51:46.158858+0000","last_active":"2024-09-21T08:54:53.132323+0000","last_peered":"2024-09-21T08:54:53.132323+0000","last_clean":"2024-09-21T08:54:53.132323+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:54:53.132323+0000","last_undegraded":"2024-09-21T08:54:53.132323+0000","last_fullsized":"2024-09-21T08:54:53.132323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.564342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.223513+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:52:14.223513+0000","last_peered":"2024-09-21T08:52:14.223513+0000","last_clean":"2024-09-21T08:52:14.223513+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:52:14.223513+0000","last_undegraded":"2024-09-21T08:52:14.223513+0000","last_fullsized":"2024-09-21T08:52:14.223513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:44.887975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583055+0000","last_change":"2024-09-21T08:51:40.133956+0000","last_active":"2024-09-21T08:54:46.583055+0000","last_peered":"2024-09-21T08:54:46.583055+0000","last_clean":"2024-09-21T08:54:46.583055+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:54:46.583055+0000","last_undegraded":"2024-09-21T08:54:46.583055+0000","last_fullsized":"2024-09-21T08:54:46.583055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:08.168952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229125+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:52:14.229125+0000","last_peered":"2024-09-21T08:52:14.229125+0000","last_clean":"2024-09-21T08:52:14.229125+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:52:14.229125+0000","last_undegraded":"2024-09-21T08:52:14.229125+0000","last_fullsized":"2024-09-21T08:52:14.229125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:25.799927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228198+0000","last_change":"2024-09-21T08:51:42.135023+0000","last_active":"2024-09-21T08:52:14.228198+0000","last_peered":"2024-09-21T08:52:14.228198+0000","last_clean":"2024-09-21T08:52:14.228198+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:52:14.228198+0000","last_undegraded":"2024-09-21T08:52:14.228198+0000","last_fullsized":"2024-09-21T08:52:14.228198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:58.778986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.216574+0000","last_change":"2024-09-21T08:51:44.147321+0000","last_active":"2024-09-21T08:54:53.216574+0000","last_peered":"2024-09-21T08:54:53.216574+0000","last_clean":"2024-09-21T08:54:53.216574+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:54:53.216574+0000","last_undegraded":"2024-09-21T08:54:53.216574+0000","last_fullsized":"2024-09-21T08:54:53.216574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:42.142145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225095+0000","last_change":"2024-09-21T08:51:46.152903+0000","last_active":"2024-09-21T08:52:14.225095+0000","last_peered":"2024-09-21T08:52:14.225095+0000","last_clean":"2024-09-21T08:52:14.225095+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:52:14.225095+0000","last_undegraded":"2024-09-21T08:52:14.225095+0000","last_fullsized":"2024-09-21T08:52:14.225095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:49.114358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227463+0000","last_change":"2024-09-21T08:51:48.155963+0000","last_active":"2024-09-21T08:52:14.227463+0000","last_peered":"2024-09-21T08:52:14.227463+0000","last_clean":"2024-09-21T08:52:14.227463+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:52:14.227463+0000","last_undegraded":"2024-09-21T08:52:14.227463+0000","last_fullsized":"2024-09-21T08:52:14.227463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:26.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582875+0000","last_change":"2024-09-21T08:51:40.132727+0000","last_active":"2024-09-21T08:54:46.582875+0000","last_peered":"2024-09-21T08:54:46.582875+0000","last_clean":"2024-09-21T08:54:46.582875+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:54:46.582875+0000","last_undegraded":"2024-09-21T08:54:46.582875+0000","last_fullsized":"2024-09-21T08:54:46.582875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:05.660834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230235+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:52:14.230235+0000","last_peered":"2024-09-21T08:52:14.230235+0000","last_clean":"2024-09-21T08:52:14.230235+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:52:14.230235+0000","last_undegraded":"2024-09-21T08:52:14.230235+0000","last_fullsized":"2024-09-21T08:52:14.230235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:48.192584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230292+0000","last_change":"2024-09-21T08:51:42.142158+0000","last_active":"2024-09-21T08:52:14.230292+0000","last_peered":"2024-09-21T08:52:14.230292+0000","last_clean":"2024-09-21T08:52:14.230292+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:52:14.230292+0000","last_undegraded":"2024-09-21T08:52:14.230292+0000","last_fullsized":"2024-09-21T08:52:14.230292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:52.876334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.219896+0000","last_change":"2024-09-21T08:51:44.146900+0000","last_active":"2024-09-21T08:54:53.219896+0000","last_peered":"2024-09-21T08:54:53.219896+0000","last_clean":"2024-09-21T08:54:53.219896+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:54:53.219896+0000","last_undegraded":"2024-09-21T08:54:53.219896+0000","last_fullsized":"2024-09-21T08:54:53.219896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:36.326420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224021+0000","last_change":"2024-09-21T08:51:46.154489+0000","last_active":"2024-09-21T08:52:14.224021+0000","last_peered":"2024-09-21T08:52:14.224021+0000","last_clean":"2024-09-21T08:52:14.224021+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:52:14.224021+0000","last_undegraded":"2024-09-21T08:52:14.224021+0000","last_fullsized":"2024-09-21T08:52:14.224021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:28.311454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.230785+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:52:14.230785+0000","last_peered":"2024-09-21T08:52:14.230785+0000","last_clean":"2024-09-21T08:52:14.230785+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:52:14.230785+0000","last_undegraded":"2024-09-21T08:52:14.230785+0000","last_fullsized":"2024-09-21T08:52:14.230785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:36:08.427260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602783+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.602783+0000","last_peered":"2024-09-21T08:54:46.602783+0000","last_clean":"2024-09-21T08:54:46.602783+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.602783+0000","last_undegraded":"2024-09-21T08:54:46.602783+0000","last_fullsized":"2024-09-21T08:54:46.602783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:59:40.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227596+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:52:14.227596+0000","last_peered":"2024-09-21T08:52:14.227596+0000","last_clean":"2024-09-21T08:52:14.227596+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:52:14.227596+0000","last_undegraded":"2024-09-21T08:52:14.227596+0000","last_fullsized":"2024-09-21T08:52:14.227596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:00.290251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229618+0000","last_change":"2024-09-21T08:51:42.137057+0000","last_active":"2024-09-21T08:52:14.229618+0000","last_peered":"2024-09-21T08:52:14.229618+0000","last_clean":"2024-09-21T08:52:14.229618+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:52:14.229618+0000","last_undegraded":"2024-09-21T08:52:14.229618+0000","last_fullsized":"2024-09-21T08:52:14.229618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:17.785662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.182294+0000","last_change":"2024-09-21T08:51:44.145647+0000","last_active":"2024-09-21T08:54:53.182294+0000","last_peered":"2024-09-21T08:54:53.182294+0000","last_clean":"2024-09-21T08:54:53.182294+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:54:53.182294+0000","last_undegraded":"2024-09-21T08:54:53.182294+0000","last_fullsized":"2024-09-21T08:54:53.182294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:28.199820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224769+0000","last_change":"2024-09-21T08:51:46.154674+0000","last_active":"2024-09-21T08:52:14.224769+0000","last_peered":"2024-09-21T08:52:14.224769+0000","last_clean":"2024-09-21T08:52:14.224769+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:52:14.224769+0000","last_undegraded":"2024-09-21T08:52:14.224769+0000","last_fullsized":"2024-09-21T08:52:14.224769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.859613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.520500+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:53:44.520500+0000","last_peered":"2024-09-21T08:53:44.520500+0000","last_clean":"2024-09-21T08:53:44.520500+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:53:44.520500+0000","last_undegraded":"2024-09-21T08:53:44.520500+0000","last_fullsized":"2024-09-21T08:53:44.520500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:36.396086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.353736+0000","last_change":"2024-09-21T08:51:40.129771+0000","last_active":"2024-09-21T08:53:02.353736+0000","last_peered":"2024-09-21T08:53:02.353736+0000","last_clean":"2024-09-21T08:53:02.353736+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:53:02.353736+0000","last_undegraded":"2024-09-21T08:53:02.353736+0000","last_fullsized":"2024-09-21T08:53:02.353736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:34.355402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227597+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:52:14.227597+0000","last_peered":"2024-09-21T08:52:14.227597+0000","last_clean":"2024-09-21T08:52:14.227597+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:52:14.227597+0000","last_undegraded":"2024-09-21T08:52:14.227597+0000","last_fullsized":"2024-09-21T08:52:14.227597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:11.497380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:43.194165+0000","last_change":"2024-09-21T08:51:42.141642+0000","last_active":"2024-09-21T08:53:43.194165+0000","last_peered":"2024-09-21T08:53:43.194165+0000","last_clean":"2024-09-21T08:53:43.194165+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:53:43.194165+0000","last_undegraded":"2024-09-21T08:53:43.194165+0000","last_fullsized":"2024-09-21T08:53:43.194165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:58.151287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'35","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.191106+0000","last_change":"2024-09-21T08:51:44.147527+0000","last_active":"2024-09-21T08:54:53.191106+0000","last_peered":"2024-09-21T08:54:53.191106+0000","last_clean":"2024-09-21T08:54:53.191106+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:54:53.191106+0000","last_undegraded":"2024-09-21T08:54:53.191106+0000","last_fullsized":"2024-09-21T08:54:53.191106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:03.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.226325+0000","last_change":"2024-09-21T08:51:46.155051+0000","last_active":"2024-09-21T08:52:14.226325+0000","last_peered":"2024-09-21T08:52:14.226325+0000","last_clean":"2024-09-21T08:52:14.226325+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:52:14.226325+0000","last_undegraded":"2024-09-21T08:52:14.226325+0000","last_fullsized":"2024-09-21T08:52:14.226325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:43.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.523078+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:53:44.523078+0000","last_peered":"2024-09-21T08:53:44.523078+0000","last_clean":"2024-09-21T08:53:44.523078+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:53:44.523078+0000","last_undegraded":"2024-09-21T08:53:44.523078+0000","last_fullsized":"2024-09-21T08:53:44.523078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:47.237579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.636811+0000","last_change":"2024-09-21T08:51:40.143086+0000","last_active":"2024-09-21T08:52:19.636811+0000","last_peered":"2024-09-21T08:52:19.636811+0000","last_clean":"2024-09-21T08:52:19.636811+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:52:19.636811+0000","last_undegraded":"2024-09-21T08:52:19.636811+0000","last_fullsized":"2024-09-21T08:52:19.636811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:10.757827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:18.781418+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:52:18.781418+0000","last_peered":"2024-09-21T08:52:18.781418+0000","last_clean":"2024-09-21T08:52:18.781418+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:52:18.781418+0000","last_undegraded":"2024-09-21T08:52:18.781418+0000","last_fullsized":"2024-09-21T08:52:18.781418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:16.508900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:02.354678+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:02.354678+0000","last_peered":"2024-09-21T08:53:02.354678+0000","last_clean":"2024-09-21T08:53:02.354678+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:02.354678+0000","last_undegraded":"2024-09-21T08:53:02.354678+0000","last_fullsized":"2024-09-21T08:53:02.354678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.275324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.521233+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.521233+0000","last_peered":"2024-09-21T08:54:46.521233+0000","last_clean":"2024-09-21T08:54:46.521233+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.521233+0000","last_undegraded":"2024-09-21T08:54:46.521233+0000","last_fullsized":"2024-09-21T08:54:46.521233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:26.680210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936501+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:45.936501+0000","last_peered":"2024-09-21T08:53:45.936501+0000","last_clean":"2024-09-21T08:53:45.936501+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:45.936501+0000","last_undegraded":"2024-09-21T08:53:45.936501+0000","last_fullsized":"2024-09-21T08:53:45.936501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:44.661851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.189544+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:54:46.189544+0000","last_peered":"2024-09-21T08:54:46.189544+0000","last_clean":"2024-09-21T08:54:46.189544+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:54:46.189544+0000","last_undegraded":"2024-09-21T08:54:46.189544+0000","last_fullsized":"2024-09-21T08:54:46.189544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:26.992698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608820+0000","last_change":"2024-09-21T08:51:40.136629+0000","last_active":"2024-09-21T08:54:46.608820+0000","last_peered":"2024-09-21T08:54:46.608820+0000","last_clean":"2024-09-21T08:54:46.608820+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:54:46.608820+0000","last_undegraded":"2024-09-21T08:54:46.608820+0000","last_fullsized":"2024-09-21T08:54:46.608820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227659+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:52:14.227659+0000","last_peered":"2024-09-21T08:52:14.227659+0000","last_clean":"2024-09-21T08:52:14.227659+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:52:14.227659+0000","last_undegraded":"2024-09-21T08:52:14.227659+0000","last_fullsized":"2024-09-21T08:52:14.227659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:57.025963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602613+0000","last_change":"2024-09-21T08:51:40.130372+0000","last_active":"2024-09-21T08:54:46.602613+0000","last_peered":"2024-09-21T08:54:46.602613+0000","last_clean":"2024-09-21T08:54:46.602613+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:54:46.602613+0000","last_undegraded":"2024-09-21T08:54:46.602613+0000","last_fullsized":"2024-09-21T08:54:46.602613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:32.855034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.880617+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:52:19.880617+0000","last_peered":"2024-09-21T08:52:19.880617+0000","last_clean":"2024-09-21T08:52:19.880617+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:52:19.880617+0000","last_undegraded":"2024-09-21T08:52:19.880617+0000","last_fullsized":"2024-09-21T08:52:19.880617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:53.742244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609556+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609556+0000","last_peered":"2024-09-21T08:54:46.609556+0000","last_clean":"2024-09-21T08:54:46.609556+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609556+0000","last_undegraded":"2024-09-21T08:54:46.609556+0000","last_fullsized":"2024-09-21T08:54:46.609556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:58.432631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227339+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.227339+0000","last_peered":"2024-09-21T08:52:14.227339+0000","last_clean":"2024-09-21T08:52:14.227339+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:52:14.227339+0000","last_undegraded":"2024-09-21T08:52:14.227339+0000","last_fullsized":"2024-09-21T08:52:14.227339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:08.084918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.303531+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:52:19.303531+0000","last_peered":"2024-09-21T08:52:19.303531+0000","last_clean":"2024-09-21T08:52:19.303531+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:52:19.303531+0000","last_undegraded":"2024-09-21T08:52:19.303531+0000","last_fullsized":"2024-09-21T08:52:19.303531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.883350+0000","last_change":"2024-09-21T08:51:38.145888+0000","last_active":"2024-09-21T08:52:19.883350+0000","last_peered":"2024-09-21T08:52:19.883350+0000","last_clean":"2024-09-21T08:52:19.883350+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:52:19.883350+0000","last_undegraded":"2024-09-21T08:52:19.883350+0000","last_fullsized":"2024-09-21T08:52:19.883350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:12.474475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602717+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.602717+0000","last_peered":"2024-09-21T08:54:46.602717+0000","last_clean":"2024-09-21T08:54:46.602717+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.602717+0000","last_undegraded":"2024-09-21T08:54:46.602717+0000","last_fullsized":"2024-09-21T08:54:46.602717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:00.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:19.886383+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:52:19.886383+0000","last_peered":"2024-09-21T08:52:19.886383+0000","last_clean":"2024-09-21T08:52:19.886383+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:52:19.886383+0000","last_undegraded":"2024-09-21T08:52:19.886383+0000","last_fullsized":"2024-09-21T08:52:19.886383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:27.938724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.602644+0000","last_change":"2024-09-21T08:51:40.137071+0000","last_active":"2024-09-21T08:54:46.602644+0000","last_peered":"2024-09-21T08:54:46.602644+0000","last_clean":"2024-09-21T08:54:46.602644+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:54:46.602644+0000","last_undegraded":"2024-09-21T08:54:46.602644+0000","last_fullsized":"2024-09-21T08:54:46.602644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.480193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224082+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:52:14.224082+0000","last_peered":"2024-09-21T08:52:14.224082+0000","last_clean":"2024-09-21T08:52:14.224082+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:52:14.224082+0000","last_undegraded":"2024-09-21T08:52:14.224082+0000","last_fullsized":"2024-09-21T08:52:14.224082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:59.614757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609381+0000","last_change":"2024-09-21T08:51:40.140110+0000","last_active":"2024-09-21T08:54:46.609381+0000","last_peered":"2024-09-21T08:54:46.609381+0000","last_clean":"2024-09-21T08:54:46.609381+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:54:46.609381+0000","last_undegraded":"2024-09-21T08:54:46.609381+0000","last_fullsized":"2024-09-21T08:54:46.609381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:55:55.756332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.515119+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.515119+0000","last_peered":"2024-09-21T08:54:46.515119+0000","last_clean":"2024-09-21T08:54:46.515119+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.515119+0000","last_undegraded":"2024-09-21T08:54:46.515119+0000","last_fullsized":"2024-09-21T08:54:46.515119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:54.123288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.578020+0000","last_change":"2024-09-21T08:51:40.129690+0000","last_active":"2024-09-21T08:54:46.578020+0000","last_peered":"2024-09-21T08:54:46.578020+0000","last_clean":"2024-09-21T08:54:46.578020+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:54:46.578020+0000","last_undegraded":"2024-09-21T08:54:46.578020+0000","last_fullsized":"2024-09-21T08:54:46.578020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.227220+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:52:14.227220+0000","last_peered":"2024-09-21T08:52:14.227220+0000","last_clean":"2024-09-21T08:52:14.227220+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:52:14.227220+0000","last_undegraded":"2024-09-21T08:52:14.227220+0000","last_fullsized":"2024-09-21T08:52:14.227220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:45.569441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.312075+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.312075+0000","last_peered":"2024-09-21T08:54:46.312075+0000","last_clean":"2024-09-21T08:54:46.312075+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.312075+0000","last_undegraded":"2024-09-21T08:54:46.312075+0000","last_fullsized":"2024-09-21T08:54:46.312075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.801488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225656+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:52:14.225656+0000","last_peered":"2024-09-21T08:52:14.225656+0000","last_clean":"2024-09-21T08:52:14.225656+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:52:14.225656+0000","last_undegraded":"2024-09-21T08:52:14.225656+0000","last_fullsized":"2024-09-21T08:52:14.225656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:47.826428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'11","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583270+0000","last_change":"2024-09-21T08:51:40.141700+0000","last_active":"2024-09-21T08:54:46.583270+0000","last_peered":"2024-09-21T08:54:46.583270+0000","last_clean":"2024-09-21T08:54:46.583270+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:54:46.583270+0000","last_undegraded":"2024-09-21T08:54:46.583270+0000","last_fullsized":"2024-09-21T08:54:46.583270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:11.312454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.229520+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:52:14.229520+0000","last_peered":"2024-09-21T08:52:14.229520+0000","last_clean":"2024-09-21T08:52:14.229520+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:52:14.229520+0000","last_undegraded":"2024-09-21T08:52:14.229520+0000","last_fullsized":"2024-09-21T08:52:14.229520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:10.267304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.228569+0000","last_change":"2024-09-21T08:51:40.137601+0000","last_active":"2024-09-21T08:52:14.228569+0000","last_peered":"2024-09-21T08:52:14.228569+0000","last_clean":"2024-09-21T08:52:14.228569+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:52:14.228569+0000","last_undegraded":"2024-09-21T08:52:14.228569+0000","last_fullsized":"2024-09-21T08:52:14.228569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:50.824020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524736+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.524736+0000","last_peered":"2024-09-21T08:54:46.524736+0000","last_clean":"2024-09-21T08:54:46.524736+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.524736+0000","last_undegraded":"2024-09-21T08:54:46.524736+0000","last_fullsized":"2024-09-21T08:54:46.524736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.740205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.577907+0000","last_change":"2024-09-21T08:51:40.139425+0000","last_active":"2024-09-21T08:54:46.577907+0000","last_peered":"2024-09-21T08:54:46.577907+0000","last_clean":"2024-09-21T08:54:46.577907+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:54:46.577907+0000","last_undegraded":"2024-09-21T08:54:46.577907+0000","last_fullsized":"2024-09-21T08:54:46.577907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:32.312677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.234554+0000","last_change":"2024-09-21T08:51:38.149787+0000","last_active":"2024-09-21T08:52:14.234554+0000","last_peered":"2024-09-21T08:52:14.234554+0000","last_clean":"2024-09-21T08:52:14.234554+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:52:14.234554+0000","last_undegraded":"2024-09-21T08:52:14.234554+0000","last_fullsized":"2024-09-21T08:52:14.234554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:50.908268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:20.354197+0000","last_change":"2024-09-21T08:51:40.139999+0000","last_active":"2024-09-21T08:52:20.354197+0000","last_peered":"2024-09-21T08:52:20.354197+0000","last_clean":"2024-09-21T08:52:20.354197+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:52:20.354197+0000","last_undegraded":"2024-09-21T08:52:20.354197+0000","last_fullsized":"2024-09-21T08:52:20.354197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:43.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.888167+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:53:45.888167+0000","last_peered":"2024-09-21T08:53:45.888167+0000","last_clean":"2024-09-21T08:53:45.888167+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:53:45.888167+0000","last_undegraded":"2024-09-21T08:53:45.888167+0000","last_fullsized":"2024-09-21T08:53:45.888167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:58.598806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.224454+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:52:14.224454+0000","last_peered":"2024-09-21T08:52:14.224454+0000","last_clean":"2024-09-21T08:52:14.224454+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:52:14.224454+0000","last_undegraded":"2024-09-21T08:52:14.224454+0000","last_fullsized":"2024-09-21T08:52:14.224454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:02.905185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.399878+0000","last_change":"2024-09-21T08:51:40.136460+0000","last_active":"2024-09-21T08:54:46.399878+0000","last_peered":"2024-09-21T08:54:46.399878+0000","last_clean":"2024-09-21T08:54:46.399878+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:54:46.399878+0000","last_undegraded":"2024-09-21T08:54:46.399878+0000","last_fullsized":"2024-09-21T08:54:46.399878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:45.642225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:52:14.225460+0000","last_change":"2024-09-21T08:51:38.149631+0000","last_active":"2024-09-21T08:52:14.225460+0000","last_peered":"2024-09-21T08:52:14.225460+0000","last_clean":"2024-09-21T08:52:14.225460+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:52:14.225460+0000","last_undegraded":"2024-09-21T08:52:14.225460+0000","last_fullsized":"2024-09-21T08:52:14.225460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.669477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936952+0000","last_change":"2024-09-21T08:51:40.144724+0000","last_active":"2024-09-21T08:53:45.936952+0000","last_peered":"2024-09-21T08:53:45.936952+0000","last_clean":"2024-09-21T08:53:45.936952+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:53:45.936952+0000","last_undegraded":"2024-09-21T08:53:45.936952+0000","last_fullsized":"2024-09-21T08:53:45.936952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:26.017080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673008,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35836,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:54:57.836 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.836 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.837 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.838 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.839 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.840 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.841 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.842 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.843 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.844 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.845 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.846 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T08:51:21.493390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.847 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.848 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.849 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.850 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.851 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.852 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.853 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.854 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.855 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.856 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.857 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.858 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.859 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.860 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.861 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.862 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.863 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:54:57.864 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T08:55:17.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.978+0000 7f27aeb81640 1 Processor -- start 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.978+0000 7f27aeb81640 1 -- start start 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27aeb81640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27a809a100 0x7f27a8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27aeb81640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a809d3b0 con 0x7f27a809bd50 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27aeb81640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f27a809c840 con 0x7f27a809a100 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27ac91d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f27a809bd50 0x7f27a809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48178/0 (socket says 172.21.15.29:48178) 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27ac91d640 1 -- 172.21.15.29:0/1410672751 learned_addr learned my addr 172.21.15.29:0/1410672751 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27a7fff640 1 --2- 172.21.15.29:0/1410672751 >> v2:172.21.15.29:3300/0 conn(0x7f27a809a100 0x7f27a8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27a77fe640 1 -- 172.21.15.29:0/1410672751 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817932750 0 0) 0x7f2798001110 con 0x7f27a809bd50 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27a77fe640 1 -- 172.21.15.29:0/1410672751 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2790003520 con 0x7f27a809bd50 2024-09-21T08:55:17.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27a7fff640 1 -- 172.21.15.29:0/1410672751 >> v1:172.21.15.29:6789/0 conn(0x7f27a809bd50 legacy=0x7f27a809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:17.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.979+0000 7f27a7fff640 1 -- 172.21.15.29:0/1410672751 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a8098230 con 0x7f27a809a100 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.980+0000 7f27a7fff640 1 --2- 172.21.15.29:0/1410672751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8133da0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f279c009720 tx=0x7f279c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0c2980c8c5f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.980+0000 7f27a77fe640 1 -- 172.21.15.29:0/1410672751 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c037070 con 0x7f27a809a100 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.980+0000 7f27a77fe640 1 -- 172.21.15.29:0/1410672751 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c02ad90 con 0x7f27a809a100 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.980+0000 7f27a77fe640 1 -- 172.21.15.29:0/1410672751 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c032590 con 0x7f27a809a100 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 -- 172.21.15.29:0/1410672751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 msgr2=0x7f27a8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 --2- 172.21.15.29:0/1410672751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8133da0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f279c009720 tx=0x7f279c02a110 comp rx=0 tx=0).stop 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 -- 172.21.15.29:0/1410672751 shutdown_connections 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 --2- 172.21.15.29:0/1410672751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8133da0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:17.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 -- 172.21.15.29:0/1410672751 >> 172.21.15.29:0/1410672751 conn(0x7f27a806d4a0 msgr2=0x7f27a806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 -- 172.21.15.29:0/1410672751 shutdown_connections 2024-09-21T08:55:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.981+0000 7f27aeb81640 1 -- 172.21.15.29:0/1410672751 wait complete. 2024-09-21T08:55:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.982+0000 7f27aeb81640 1 Processor -- start 2024-09-21T08:55:17.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.982+0000 7f27aeb81640 1 -- start start 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.982+0000 7f27aeb81640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.982+0000 7f27aeb81640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8134670 con 0x7f27a809a100 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.982+0000 7f27ac91d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27ac91d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40290/0 (socket says 172.21.15.29:40290) 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27ac91d640 1 -- 172.21.15.29:0/810375291 learned_addr learned my addr 172.21.15.29:0/810375291 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27ac91d640 1 -- 172.21.15.29:0/810375291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a8125fc0 con 0x7f27a809a100 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27ac91d640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f279800c6b0 tx=0x7f279800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2798017070 con 0x7f27a809a100 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27980058b0 con 0x7f27a809a100 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2798005bd0 con 0x7f27a809a100 2024-09-21T08:55:17.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a8096570 con 0x7f27a809a100 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.983+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a8096f80 con 0x7f27a809a100 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.984+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f279801a070 con 0x7f27a809a100 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.984+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a8126360 con 0x7f27a809a100 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.984+0000 7f27a57fa640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 0x7f279403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.984+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f279804b010 con 0x7f27a809a100 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.985+0000 7f27a7fff640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 0x7f279403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:17.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.985+0000 7f27a7fff640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 0x7f279403a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f279c034000 tx=0x7f279c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:17.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:17.989+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27a8125fc0 con 0x7f27a809a100 2024-09-21T08:55:18.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.161+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27a809d020 con 0x7f27940382a0 2024-09-21T08:55:18.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.176+0000 7f27a57fa640 1 -- 172.21.15.29:0/810375291 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658744 (secure 0 0 0) 0x7f27a809d020 con 0x7f27940382a0 2024-09-21T08:55:18.185 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:55:18.190 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:55:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 msgr2=0x7f279403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 0x7f279403a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f279c034000 tx=0x7f279c02e000 comp rx=0 tx=0).stop 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 msgr2=0x7f27a8132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f279800c6b0 tx=0x7f279800cb70 comp rx=0 tx=0).stop 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 shutdown_connections 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f27940382a0 0x7f279403a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 --2- 172.21.15.29:0/810375291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27a809a100 0x7f27a8132a40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.181+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 >> 172.21.15.29:0/810375291 conn(0x7f27a806d4a0 msgr2=0x7f27a808d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.182+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 shutdown_connections 2024-09-21T08:55:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:18.182+0000 7f27aeb81640 1 -- 172.21.15.29:0/810375291 wait complete. 2024-09-21T08:55:18.194 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-21T08:55:17.219586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4739,"ondisk_log_size":4739,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148512,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338848,"statfs":{"total":386547056640,"available":386394980352,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":954,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004692"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179209+0000","last_change":"2024-09-21T08:51:38.149131+0000","last_active":"2024-09-21T08:53:45.179209+0000","last_peered":"2024-09-21T08:53:45.179209+0000","last_clean":"2024-09-21T08:53:45.179209+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:53:45.179209+0000","last_undegraded":"2024-09-21T08:53:45.179209+0000","last_fullsized":"2024-09-21T08:53:45.179209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405789+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.405789+0000","last_peered":"2024-09-21T08:54:46.405789+0000","last_clean":"2024-09-21T08:54:46.405789+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.405789+0000","last_undegraded":"2024-09-21T08:54:46.405789+0000","last_fullsized":"2024-09-21T08:54:46.405789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177730+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:53:44.177730+0000","last_peered":"2024-09-21T08:53:44.177730+0000","last_clean":"2024-09-21T08:53:44.177730+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:53:44.177730+0000","last_undegraded":"2024-09-21T08:53:44.177730+0000","last_fullsized":"2024-09-21T08:53:44.177730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541887+0000","last_change":"2024-09-21T08:51:40.136089+0000","last_active":"2024-09-21T08:54:46.541887+0000","last_peered":"2024-09-21T08:54:46.541887+0000","last_clean":"2024-09-21T08:54:46.541887+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:54:46.541887+0000","last_undegraded":"2024-09-21T08:54:46.541887+0000","last_fullsized":"2024-09-21T08:54:46.541887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179953+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:53:45.179953+0000","last_peered":"2024-09-21T08:53:45.179953+0000","last_clean":"2024-09-21T08:53:45.179953+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:53:45.179953+0000","last_undegraded":"2024-09-21T08:53:45.179953+0000","last_fullsized":"2024-09-21T08:53:45.179953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:44.186519+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:54:44.186519+0000","last_peered":"2024-09-21T08:54:44.186519+0000","last_clean":"2024-09-21T08:54:44.186519+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:54:44.186519+0000","last_undegraded":"2024-09-21T08:54:44.186519+0000","last_fullsized":"2024-09-21T08:54:44.186519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.178559+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:53:40.178559+0000","last_peered":"2024-09-21T08:53:40.178559+0000","last_clean":"2024-09-21T08:53:40.178559+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:53:40.178559+0000","last_undegraded":"2024-09-21T08:53:40.178559+0000","last_fullsized":"2024-09-21T08:53:40.178559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.655114+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:46.655114+0000","last_peered":"2024-09-21T08:54:46.655114+0000","last_clean":"2024-09-21T08:54:46.655114+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:46.655114+0000","last_undegraded":"2024-09-21T08:54:46.655114+0000","last_fullsized":"2024-09-21T08:54:46.655114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183955+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:54:10.183955+0000","last_peered":"2024-09-21T08:54:10.183955+0000","last_clean":"2024-09-21T08:54:10.183955+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:54:10.183955+0000","last_undegraded":"2024-09-21T08:54:10.183955+0000","last_fullsized":"2024-09-21T08:54:10.183955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.178586+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:53:40.178586+0000","last_peered":"2024-09-21T08:53:40.178586+0000","last_clean":"2024-09-21T08:53:40.178586+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:53:40.178586+0000","last_undegraded":"2024-09-21T08:53:40.178586+0000","last_fullsized":"2024-09-21T08:53:40.178586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183213+0000","last_change":"2024-09-21T08:51:38.149505+0000","last_active":"2024-09-21T08:54:10.183213+0000","last_peered":"2024-09-21T08:54:10.183213+0000","last_clean":"2024-09-21T08:54:10.183213+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:54:10.183213+0000","last_undegraded":"2024-09-21T08:54:10.183213+0000","last_fullsized":"2024-09-21T08:54:10.183213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.406217+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.406217+0000","last_peered":"2024-09-21T08:54:46.406217+0000","last_clean":"2024-09-21T08:54:46.406217+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.406217+0000","last_undegraded":"2024-09-21T08:54:46.406217+0000","last_fullsized":"2024-09-21T08:54:46.406217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183836+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:54:10.183836+0000","last_peered":"2024-09-21T08:54:10.183836+0000","last_clean":"2024-09-21T08:54:10.183836+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:54:10.183836+0000","last_undegraded":"2024-09-21T08:54:10.183836+0000","last_fullsized":"2024-09-21T08:54:10.183836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179172+0000","last_change":"2024-09-21T08:51:40.136615+0000","last_active":"2024-09-21T08:53:45.179172+0000","last_peered":"2024-09-21T08:53:45.179172+0000","last_clean":"2024-09-21T08:53:45.179172+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:53:45.179172+0000","last_undegraded":"2024-09-21T08:53:45.179172+0000","last_fullsized":"2024-09-21T08:53:45.179172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181581+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:54:09.181581+0000","last_peered":"2024-09-21T08:54:09.181581+0000","last_clean":"2024-09-21T08:54:09.181581+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:54:09.181581+0000","last_undegraded":"2024-09-21T08:54:09.181581+0000","last_fullsized":"2024-09-21T08:54:09.181581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405180+0000","last_change":"2024-09-21T08:51:40.139948+0000","last_active":"2024-09-21T08:54:46.405180+0000","last_peered":"2024-09-21T08:54:46.405180+0000","last_clean":"2024-09-21T08:54:46.405180+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:54:46.405180+0000","last_undegraded":"2024-09-21T08:54:46.405180+0000","last_fullsized":"2024-09-21T08:54:46.405180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.657199+0000","last_change":"2024-09-21T08:51:40.135605+0000","last_active":"2024-09-21T08:54:46.657199+0000","last_peered":"2024-09-21T08:54:46.657199+0000","last_clean":"2024-09-21T08:54:46.657199+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:54:46.657199+0000","last_undegraded":"2024-09-21T08:54:46.657199+0000","last_fullsized":"2024-09-21T08:54:46.657199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182694+0000","last_change":"2024-09-21T08:51:38.140312+0000","last_active":"2024-09-21T08:54:05.182694+0000","last_peered":"2024-09-21T08:54:05.182694+0000","last_clean":"2024-09-21T08:54:05.182694+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:54:05.182694+0000","last_undegraded":"2024-09-21T08:54:05.182694+0000","last_fullsized":"2024-09-21T08:54:05.182694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181721+0000","last_change":"2024-09-21T08:51:40.137259+0000","last_active":"2024-09-21T08:54:00.181721+0000","last_peered":"2024-09-21T08:54:00.181721+0000","last_clean":"2024-09-21T08:54:00.181721+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:54:00.181721+0000","last_undegraded":"2024-09-21T08:54:00.181721+0000","last_fullsized":"2024-09-21T08:54:00.181721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.204956+0000","last_change":"2024-09-21T08:51:38.150225+0000","last_active":"2024-09-21T08:54:53.204956+0000","last_peered":"2024-09-21T08:54:53.204956+0000","last_clean":"2024-09-21T08:54:53.204956+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:54:53.204956+0000","last_undegraded":"2024-09-21T08:54:53.204956+0000","last_fullsized":"2024-09-21T08:54:53.204956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405539+0000","last_change":"2024-09-21T08:51:40.135404+0000","last_active":"2024-09-21T08:54:46.405539+0000","last_peered":"2024-09-21T08:54:46.405539+0000","last_clean":"2024-09-21T08:54:46.405539+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:54:46.405539+0000","last_undegraded":"2024-09-21T08:54:46.405539+0000","last_fullsized":"2024-09-21T08:54:46.405539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182597+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:54:05.182597+0000","last_peered":"2024-09-21T08:54:05.182597+0000","last_clean":"2024-09-21T08:54:05.182597+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:54:05.182597+0000","last_undegraded":"2024-09-21T08:54:05.182597+0000","last_fullsized":"2024-09-21T08:54:05.182597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583544+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583544+0000","last_peered":"2024-09-21T08:54:46.583544+0000","last_clean":"2024-09-21T08:54:46.583544+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583544+0000","last_undegraded":"2024-09-21T08:54:46.583544+0000","last_fullsized":"2024-09-21T08:54:46.583544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182575+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:54:05.182575+0000","last_peered":"2024-09-21T08:54:05.182575+0000","last_clean":"2024-09-21T08:54:05.182575+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:54:05.182575+0000","last_undegraded":"2024-09-21T08:54:05.182575+0000","last_fullsized":"2024-09-21T08:54:05.182575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182574+0000","last_change":"2024-09-21T08:51:40.143862+0000","last_active":"2024-09-21T08:54:05.182574+0000","last_peered":"2024-09-21T08:54:05.182574+0000","last_clean":"2024-09-21T08:54:05.182574+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:54:05.182574+0000","last_undegraded":"2024-09-21T08:54:05.182574+0000","last_fullsized":"2024-09-21T08:54:05.182574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180840+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:54:04.180840+0000","last_peered":"2024-09-21T08:54:04.180840+0000","last_clean":"2024-09-21T08:54:04.180840+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:54:04.180840+0000","last_undegraded":"2024-09-21T08:54:04.180840+0000","last_fullsized":"2024-09-21T08:54:04.180840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.654826+0000","last_change":"2024-09-21T08:51:40.138654+0000","last_active":"2024-09-21T08:54:46.654826+0000","last_peered":"2024-09-21T08:54:46.654826+0000","last_clean":"2024-09-21T08:54:46.654826+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:54:46.654826+0000","last_undegraded":"2024-09-21T08:54:46.654826+0000","last_fullsized":"2024-09-21T08:54:46.654826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182261+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:54:00.182261+0000","last_peered":"2024-09-21T08:54:00.182261+0000","last_clean":"2024-09-21T08:54:00.182261+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:54:00.182261+0000","last_undegraded":"2024-09-21T08:54:00.182261+0000","last_fullsized":"2024-09-21T08:54:00.182261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.617459+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.617459+0000","last_peered":"2024-09-21T08:54:46.617459+0000","last_clean":"2024-09-21T08:54:46.617459+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.617459+0000","last_undegraded":"2024-09-21T08:54:46.617459+0000","last_fullsized":"2024-09-21T08:54:46.617459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182340+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:54:00.182340+0000","last_peered":"2024-09-21T08:54:00.182340+0000","last_clean":"2024-09-21T08:54:00.182340+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:54:00.182340+0000","last_undegraded":"2024-09-21T08:54:00.182340+0000","last_fullsized":"2024-09-21T08:54:00.182340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182291+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:54:00.182291+0000","last_peered":"2024-09-21T08:54:00.182291+0000","last_clean":"2024-09-21T08:54:00.182291+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:54:00.182291+0000","last_undegraded":"2024-09-21T08:54:00.182291+0000","last_fullsized":"2024-09-21T08:54:00.182291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.798158+0000","last_change":"2024-09-21T08:54:59.798211+0000","last_active":"2024-09-21T08:54:59.798158+0000","last_peered":"2024-09-21T08:54:59.798158+0000","last_clean":"2024-09-21T08:54:59.798158+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:54:59.798158+0000","last_undegraded":"2024-09-21T08:54:59.798158+0000","last_fullsized":"2024-09-21T08:54:59.798158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.798019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:26.891797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.268926+0000","last_change":"2024-09-21T08:51:44.149044+0000","last_active":"2024-09-21T08:54:53.268926+0000","last_peered":"2024-09-21T08:54:53.268926+0000","last_clean":"2024-09-21T08:54:53.268926+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:54:53.268926+0000","last_undegraded":"2024-09-21T08:54:53.268926+0000","last_fullsized":"2024-09-21T08:54:53.268926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.311370+0000","last_change":"2024-09-21T08:55:08.311412+0000","last_active":"2024-09-21T08:55:08.311370+0000","last_peered":"2024-09-21T08:55:08.311370+0000","last_clean":"2024-09-21T08:55:08.311370+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:55:08.311370+0000","last_undegraded":"2024-09-21T08:55:08.311370+0000","last_fullsized":"2024-09-21T08:55:08.311370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.311270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:32.145710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184062+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:54:15.184062+0000","last_peered":"2024-09-21T08:54:15.184062+0000","last_clean":"2024-09-21T08:54:15.184062+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:54:15.184062+0000","last_undegraded":"2024-09-21T08:54:15.184062+0000","last_fullsized":"2024-09-21T08:54:15.184062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541471+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.541471+0000","last_peered":"2024-09-21T08:54:46.541471+0000","last_clean":"2024-09-21T08:54:46.541471+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.541471+0000","last_undegraded":"2024-09-21T08:54:46.541471+0000","last_fullsized":"2024-09-21T08:54:46.541471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202533+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:53.202533+0000","last_peered":"2024-09-21T08:54:53.202533+0000","last_clean":"2024-09-21T08:54:53.202533+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:53.202533+0000","last_undegraded":"2024-09-21T08:54:53.202533+0000","last_fullsized":"2024-09-21T08:54:53.202533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.788065+0000","last_change":"2024-09-21T08:55:13.788099+0000","last_active":"2024-09-21T08:55:13.788065+0000","last_peered":"2024-09-21T08:55:13.788065+0000","last_clean":"2024-09-21T08:55:13.788065+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:55:13.788065+0000","last_undegraded":"2024-09-21T08:55:13.788065+0000","last_fullsized":"2024-09-21T08:55:13.788065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.787969+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:42.737974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.271126+0000","last_change":"2024-09-21T08:55:03.271154+0000","last_active":"2024-09-21T08:55:03.271126+0000","last_peered":"2024-09-21T08:55:03.271126+0000","last_clean":"2024-09-21T08:55:03.271126+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:55:03.271126+0000","last_undegraded":"2024-09-21T08:55:03.271126+0000","last_fullsized":"2024-09-21T08:55:03.271126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.271042+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:48.059788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183386+0000","last_change":"2024-09-21T08:51:46.157301+0000","last_active":"2024-09-21T08:54:10.183386+0000","last_peered":"2024-09-21T08:54:10.183386+0000","last_clean":"2024-09-21T08:54:10.183386+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:54:10.183386+0000","last_undegraded":"2024-09-21T08:54:10.183386+0000","last_fullsized":"2024-09-21T08:54:10.183386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:19.183040+0000","last_change":"2024-09-21T08:51:48.154173+0000","last_active":"2024-09-21T08:54:19.183040+0000","last_peered":"2024-09-21T08:54:19.183040+0000","last_clean":"2024-09-21T08:54:19.183040+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:54:19.183040+0000","last_undegraded":"2024-09-21T08:54:19.183040+0000","last_fullsized":"2024-09-21T08:54:19.183040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541456+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.541456+0000","last_peered":"2024-09-21T08:54:46.541456+0000","last_clean":"2024-09-21T08:54:46.541456+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.541456+0000","last_undegraded":"2024-09-21T08:54:46.541456+0000","last_fullsized":"2024-09-21T08:54:46.541456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182223+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:54:00.182223+0000","last_peered":"2024-09-21T08:54:00.182223+0000","last_clean":"2024-09-21T08:54:00.182223+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:54:00.182223+0000","last_undegraded":"2024-09-21T08:54:00.182223+0000","last_fullsized":"2024-09-21T08:54:00.182223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181734+0000","last_change":"2024-09-21T08:51:42.137023+0000","last_active":"2024-09-21T08:54:09.181734+0000","last_peered":"2024-09-21T08:54:09.181734+0000","last_clean":"2024-09-21T08:54:09.181734+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:54:09.181734+0000","last_undegraded":"2024-09-21T08:54:09.181734+0000","last_fullsized":"2024-09-21T08:54:09.181734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.846397+0000","last_change":"2024-09-21T08:55:03.846476+0000","last_active":"2024-09-21T08:55:03.846397+0000","last_peered":"2024-09-21T08:55:03.846397+0000","last_clean":"2024-09-21T08:55:03.846397+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:55:03.846397+0000","last_undegraded":"2024-09-21T08:55:03.846397+0000","last_fullsized":"2024-09-21T08:55:03.846397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.846298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.204915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":388,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.291997+0000","last_change":"2024-09-21T08:51:46.158108+0000","last_active":"2024-09-21T08:54:53.291997+0000","last_peered":"2024-09-21T08:54:53.291997+0000","last_clean":"2024-09-21T08:54:53.291997+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:54:53.291997+0000","last_undegraded":"2024-09-21T08:54:53.291997+0000","last_fullsized":"2024-09-21T08:54:53.291997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.184863+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:54:20.184863+0000","last_peered":"2024-09-21T08:54:20.184863+0000","last_clean":"2024-09-21T08:54:20.184863+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:54:20.184863+0000","last_undegraded":"2024-09-21T08:54:20.184863+0000","last_fullsized":"2024-09-21T08:54:20.184863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319998+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.319998+0000","last_peered":"2024-09-21T08:54:46.319998+0000","last_clean":"2024-09-21T08:54:46.319998+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.319998+0000","last_undegraded":"2024-09-21T08:54:46.319998+0000","last_fullsized":"2024-09-21T08:54:46.319998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181661+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:54:00.181661+0000","last_peered":"2024-09-21T08:54:00.181661+0000","last_clean":"2024-09-21T08:54:00.181661+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:54:00.181661+0000","last_undegraded":"2024-09-21T08:54:00.181661+0000","last_fullsized":"2024-09-21T08:54:00.181661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.844294+0000","last_change":"2024-09-21T08:55:06.844317+0000","last_active":"2024-09-21T08:55:06.844294+0000","last_peered":"2024-09-21T08:55:06.844294+0000","last_clean":"2024-09-21T08:55:06.844294+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:55:06.844294+0000","last_undegraded":"2024-09-21T08:55:06.844294+0000","last_fullsized":"2024-09-21T08:55:06.844294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.844209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:21.913747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.875043+0000","last_change":"2024-09-21T08:55:01.875112+0000","last_active":"2024-09-21T08:55:01.875043+0000","last_peered":"2024-09-21T08:55:01.875043+0000","last_clean":"2024-09-21T08:55:01.875043+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:55:01.875043+0000","last_undegraded":"2024-09-21T08:55:01.875043+0000","last_fullsized":"2024-09-21T08:55:01.875043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.874944+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:51.653141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":412,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.728803+0000","last_change":"2024-09-21T08:54:59.728835+0000","last_active":"2024-09-21T08:54:59.728803+0000","last_peered":"2024-09-21T08:54:59.728803+0000","last_clean":"2024-09-21T08:54:59.728803+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:59.728803+0000","last_undegraded":"2024-09-21T08:54:59.728803+0000","last_fullsized":"2024-09-21T08:54:59.728803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.728698+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:59.656529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541832+0000","last_change":"2024-09-21T08:51:40.141892+0000","last_active":"2024-09-21T08:54:46.541832+0000","last_peered":"2024-09-21T08:54:46.541832+0000","last_clean":"2024-09-21T08:54:46.541832+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:54:46.541832+0000","last_undegraded":"2024-09-21T08:54:46.541832+0000","last_fullsized":"2024-09-21T08:54:46.541832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181051+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:53:55.181051+0000","last_peered":"2024-09-21T08:53:55.181051+0000","last_clean":"2024-09-21T08:53:55.181051+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:53:55.181051+0000","last_undegraded":"2024-09-21T08:53:55.181051+0000","last_fullsized":"2024-09-21T08:53:55.181051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.335766+0000","last_change":"2024-09-21T08:55:07.335805+0000","last_active":"2024-09-21T08:55:07.335766+0000","last_peered":"2024-09-21T08:55:07.335766+0000","last_clean":"2024-09-21T08:55:07.335766+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:55:07.335766+0000","last_undegraded":"2024-09-21T08:55:07.335766+0000","last_fullsized":"2024-09-21T08:55:07.335766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.335664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:12.617439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.848147+0000","last_change":"2024-09-21T08:55:05.848218+0000","last_active":"2024-09-21T08:55:05.848147+0000","last_peered":"2024-09-21T08:55:05.848147+0000","last_clean":"2024-09-21T08:55:05.848147+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:55:05.848147+0000","last_undegraded":"2024-09-21T08:55:05.848147+0000","last_fullsized":"2024-09-21T08:55:05.848147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.848037+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:50.214913+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180828+0000","last_change":"2024-09-21T08:51:46.157947+0000","last_active":"2024-09-21T08:54:04.180828+0000","last_peered":"2024-09-21T08:54:04.180828+0000","last_clean":"2024-09-21T08:54:04.180828+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:54:04.180828+0000","last_undegraded":"2024-09-21T08:54:04.180828+0000","last_fullsized":"2024-09-21T08:54:04.180828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180919+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:55.180919+0000","last_peered":"2024-09-21T08:53:55.180919+0000","last_clean":"2024-09-21T08:53:55.180919+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:55.180919+0000","last_undegraded":"2024-09-21T08:53:55.180919+0000","last_fullsized":"2024-09-21T08:53:55.180919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405678+0000","last_change":"2024-09-21T08:51:40.128515+0000","last_active":"2024-09-21T08:54:46.405678+0000","last_peered":"2024-09-21T08:54:46.405678+0000","last_clean":"2024-09-21T08:54:46.405678+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:54:46.405678+0000","last_undegraded":"2024-09-21T08:54:46.405678+0000","last_fullsized":"2024-09-21T08:54:46.405678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180985+0000","last_change":"2024-09-21T08:51:38.148403+0000","last_active":"2024-09-21T08:53:55.180985+0000","last_peered":"2024-09-21T08:53:55.180985+0000","last_clean":"2024-09-21T08:53:55.180985+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:53:55.180985+0000","last_undegraded":"2024-09-21T08:53:55.180985+0000","last_fullsized":"2024-09-21T08:53:55.180985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179154+0000","last_change":"2024-09-21T08:51:42.135619+0000","last_active":"2024-09-21T08:53:54.179154+0000","last_peered":"2024-09-21T08:53:54.179154+0000","last_clean":"2024-09-21T08:53:54.179154+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:53:54.179154+0000","last_undegraded":"2024-09-21T08:53:54.179154+0000","last_fullsized":"2024-09-21T08:53:54.179154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.783317+0000","last_change":"2024-09-21T08:55:02.783357+0000","last_active":"2024-09-21T08:55:02.783317+0000","last_peered":"2024-09-21T08:55:02.783317+0000","last_clean":"2024-09-21T08:55:02.783317+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:55:02.783317+0000","last_undegraded":"2024-09-21T08:55:02.783317+0000","last_fullsized":"2024-09-21T08:55:02.783317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.783222+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:51.818565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.753372+0000","last_change":"2024-09-21T08:54:58.753424+0000","last_active":"2024-09-21T08:54:58.753372+0000","last_peered":"2024-09-21T08:54:58.753372+0000","last_clean":"2024-09-21T08:54:58.753372+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:54:58.753372+0000","last_undegraded":"2024-09-21T08:54:58.753372+0000","last_fullsized":"2024-09-21T08:54:58.753372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.753265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:03.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180995+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:53:55.180995+0000","last_peered":"2024-09-21T08:53:55.180995+0000","last_clean":"2024-09-21T08:53:55.180995+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:53:55.180995+0000","last_undegraded":"2024-09-21T08:53:55.180995+0000","last_fullsized":"2024-09-21T08:53:55.180995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319668+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.319668+0000","last_peered":"2024-09-21T08:54:46.319668+0000","last_clean":"2024-09-21T08:54:46.319668+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.319668+0000","last_undegraded":"2024-09-21T08:54:46.319668+0000","last_fullsized":"2024-09-21T08:54:46.319668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181518+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:53:55.181518+0000","last_peered":"2024-09-21T08:53:55.181518+0000","last_clean":"2024-09-21T08:53:55.181518+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:53:55.181518+0000","last_undegraded":"2024-09-21T08:53:55.181518+0000","last_fullsized":"2024-09-21T08:53:55.181518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.180009+0000","last_change":"2024-09-21T08:51:42.137342+0000","last_active":"2024-09-21T08:53:59.180009+0000","last_peered":"2024-09-21T08:53:59.180009+0000","last_clean":"2024-09-21T08:53:59.180009+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:53:59.180009+0000","last_undegraded":"2024-09-21T08:53:59.180009+0000","last_fullsized":"2024-09-21T08:53:59.180009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.804389+0000","last_change":"2024-09-21T08:55:08.804457+0000","last_active":"2024-09-21T08:55:08.804389+0000","last_peered":"2024-09-21T08:55:08.804389+0000","last_clean":"2024-09-21T08:55:08.804389+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:55:08.804389+0000","last_undegraded":"2024-09-21T08:55:08.804389+0000","last_fullsized":"2024-09-21T08:55:08.804389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.804253+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:28.647102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.784943+0000","last_change":"2024-09-21T08:54:57.784970+0000","last_active":"2024-09-21T08:54:57.784943+0000","last_peered":"2024-09-21T08:54:57.784943+0000","last_clean":"2024-09-21T08:54:57.784943+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:57.784943+0000","last_undegraded":"2024-09-21T08:54:57.784943+0000","last_fullsized":"2024-09-21T08:54:57.784943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.784865+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:42.573611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.180055+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:53:59.180055+0000","last_peered":"2024-09-21T08:53:59.180055+0000","last_clean":"2024-09-21T08:53:59.180055+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:53:59.180055+0000","last_undegraded":"2024-09-21T08:53:59.180055+0000","last_fullsized":"2024-09-21T08:53:59.180055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609152+0000","last_change":"2024-09-21T08:51:40.133810+0000","last_active":"2024-09-21T08:54:46.609152+0000","last_peered":"2024-09-21T08:54:46.609152+0000","last_clean":"2024-09-21T08:54:46.609152+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:54:46.609152+0000","last_undegraded":"2024-09-21T08:54:46.609152+0000","last_fullsized":"2024-09-21T08:54:46.609152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181448+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:53:55.181448+0000","last_peered":"2024-09-21T08:53:55.181448+0000","last_clean":"2024-09-21T08:53:55.181448+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:53:55.181448+0000","last_undegraded":"2024-09-21T08:53:55.181448+0000","last_fullsized":"2024-09-21T08:53:55.181448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179219+0000","last_change":"2024-09-21T08:51:42.136459+0000","last_active":"2024-09-21T08:53:54.179219+0000","last_peered":"2024-09-21T08:53:54.179219+0000","last_clean":"2024-09-21T08:53:54.179219+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:53:54.179219+0000","last_undegraded":"2024-09-21T08:53:54.179219+0000","last_fullsized":"2024-09-21T08:53:54.179219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'60","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.232543+0000","last_change":"2024-09-21T08:51:44.146420+0000","last_active":"2024-09-21T08:54:53.232543+0000","last_peered":"2024-09-21T08:54:53.232543+0000","last_clean":"2024-09-21T08:54:53.232543+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:54:53.232543+0000","last_undegraded":"2024-09-21T08:54:53.232543+0000","last_fullsized":"2024-09-21T08:54:53.232543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.769611+0000","last_change":"2024-09-21T08:55:03.769638+0000","last_active":"2024-09-21T08:55:03.769611+0000","last_peered":"2024-09-21T08:55:03.769611+0000","last_clean":"2024-09-21T08:55:03.769611+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:55:03.769611+0000","last_undegraded":"2024-09-21T08:55:03.769611+0000","last_fullsized":"2024-09-21T08:55:03.769611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:37.381181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.698737+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.698737+0000","last_peered":"2024-09-21T08:54:46.698737+0000","last_clean":"2024-09-21T08:54:46.698737+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.698737+0000","last_undegraded":"2024-09-21T08:54:46.698737+0000","last_fullsized":"2024-09-21T08:54:46.698737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180964+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:53:55.180964+0000","last_peered":"2024-09-21T08:53:55.180964+0000","last_clean":"2024-09-21T08:53:55.180964+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:53:55.180964+0000","last_undegraded":"2024-09-21T08:53:55.180964+0000","last_fullsized":"2024-09-21T08:53:55.180964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179249+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:53:54.179249+0000","last_peered":"2024-09-21T08:53:54.179249+0000","last_clean":"2024-09-21T08:53:54.179249+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:53:54.179249+0000","last_undegraded":"2024-09-21T08:53:54.179249+0000","last_fullsized":"2024-09-21T08:53:54.179249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.770302+0000","last_change":"2024-09-21T08:55:10.770379+0000","last_active":"2024-09-21T08:55:10.770302+0000","last_peered":"2024-09-21T08:55:10.770302+0000","last_clean":"2024-09-21T08:55:10.770302+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:55:10.770302+0000","last_undegraded":"2024-09-21T08:55:10.770302+0000","last_fullsized":"2024-09-21T08:55:10.770302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.770161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:07.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.337520+0000","last_change":"2024-09-21T08:55:05.337560+0000","last_active":"2024-09-21T08:55:05.337520+0000","last_peered":"2024-09-21T08:55:05.337520+0000","last_clean":"2024-09-21T08:55:05.337520+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:55:05.337520+0000","last_undegraded":"2024-09-21T08:55:05.337520+0000","last_fullsized":"2024-09-21T08:55:05.337520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.337433+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:14.239468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182410+0000","last_change":"2024-09-21T08:51:46.150884+0000","last_active":"2024-09-21T08:54:00.182410+0000","last_peered":"2024-09-21T08:54:00.182410+0000","last_clean":"2024-09-21T08:54:00.182410+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:54:00.182410+0000","last_undegraded":"2024-09-21T08:54:00.182410+0000","last_fullsized":"2024-09-21T08:54:00.182410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.659798+0000","last_change":"2024-09-21T08:51:48.161107+0000","last_active":"2024-09-21T08:54:46.659798+0000","last_peered":"2024-09-21T08:54:46.659798+0000","last_clean":"2024-09-21T08:54:46.659798+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:54:46.659798+0000","last_undegraded":"2024-09-21T08:54:46.659798+0000","last_fullsized":"2024-09-21T08:54:46.659798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.765704+0000","last_change":"2024-09-21T08:55:14.765733+0000","last_active":"2024-09-21T08:55:14.765704+0000","last_peered":"2024-09-21T08:55:14.765704+0000","last_clean":"2024-09-21T08:55:14.765704+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:55:14.765704+0000","last_undegraded":"2024-09-21T08:55:14.765704+0000","last_fullsized":"2024-09-21T08:55:14.765704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.765635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:45.731851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180658+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:53:50.180658+0000","last_peered":"2024-09-21T08:53:50.180658+0000","last_clean":"2024-09-21T08:53:50.180658+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:53:50.180658+0000","last_undegraded":"2024-09-21T08:53:50.180658+0000","last_fullsized":"2024-09-21T08:53:50.180658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.180019+0000","last_change":"2024-09-21T08:51:42.136842+0000","last_active":"2024-09-21T08:53:59.180019+0000","last_peered":"2024-09-21T08:53:59.180019+0000","last_clean":"2024-09-21T08:53:59.180019+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:53:59.180019+0000","last_undegraded":"2024-09-21T08:53:59.180019+0000","last_fullsized":"2024-09-21T08:53:59.180019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.869787+0000","last_change":"2024-09-21T08:55:06.869844+0000","last_active":"2024-09-21T08:55:06.869787+0000","last_peered":"2024-09-21T08:55:06.869787+0000","last_clean":"2024-09-21T08:55:06.869787+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:55:06.869787+0000","last_undegraded":"2024-09-21T08:55:06.869787+0000","last_fullsized":"2024-09-21T08:55:06.869787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.869692+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:33.235003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.047021+0000","last_change":"2024-09-21T08:54:57.047051+0000","last_active":"2024-09-21T08:54:57.047021+0000","last_peered":"2024-09-21T08:54:57.047021+0000","last_clean":"2024-09-21T08:54:57.047021+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:57.047021+0000","last_undegraded":"2024-09-21T08:54:57.047021+0000","last_fullsized":"2024-09-21T08:54:57.047021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.046922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:17.104050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.661551+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:54:46.661551+0000","last_peered":"2024-09-21T08:54:46.661551+0000","last_clean":"2024-09-21T08:54:46.661551+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:54:46.661551+0000","last_undegraded":"2024-09-21T08:54:46.661551+0000","last_fullsized":"2024-09-21T08:54:46.661551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583260+0000","last_change":"2024-09-21T08:51:40.139340+0000","last_active":"2024-09-21T08:54:46.583260+0000","last_peered":"2024-09-21T08:54:46.583260+0000","last_clean":"2024-09-21T08:54:46.583260+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:54:46.583260+0000","last_undegraded":"2024-09-21T08:54:46.583260+0000","last_fullsized":"2024-09-21T08:54:46.583260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180609+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:53:50.180609+0000","last_peered":"2024-09-21T08:53:50.180609+0000","last_clean":"2024-09-21T08:53:50.180609+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:53:50.180609+0000","last_undegraded":"2024-09-21T08:53:50.180609+0000","last_fullsized":"2024-09-21T08:53:50.180609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":620,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.275886+0000","last_change":"2024-09-21T08:55:13.275924+0000","last_active":"2024-09-21T08:55:13.275886+0000","last_peered":"2024-09-21T08:55:13.275886+0000","last_clean":"2024-09-21T08:55:13.275886+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:55:13.275886+0000","last_undegraded":"2024-09-21T08:55:13.275886+0000","last_fullsized":"2024-09-21T08:55:13.275886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.275785+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.674831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.785272+0000","last_change":"2024-09-21T08:55:00.785316+0000","last_active":"2024-09-21T08:55:00.785272+0000","last_peered":"2024-09-21T08:55:00.785272+0000","last_clean":"2024-09-21T08:55:00.785272+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:55:00.785272+0000","last_undegraded":"2024-09-21T08:55:00.785272+0000","last_fullsized":"2024-09-21T08:55:00.785272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.785184+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:02.902127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.291164+0000","last_change":"2024-09-21T08:54:57.291227+0000","last_active":"2024-09-21T08:54:57.291164+0000","last_peered":"2024-09-21T08:54:57.291164+0000","last_clean":"2024-09-21T08:54:57.291164+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:57.291164+0000","last_undegraded":"2024-09-21T08:54:57.291164+0000","last_fullsized":"2024-09-21T08:54:57.291164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.291058+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:31.954176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180814+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:55.180814+0000","last_peered":"2024-09-21T08:53:55.180814+0000","last_clean":"2024-09-21T08:53:55.180814+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:55.180814+0000","last_undegraded":"2024-09-21T08:53:55.180814+0000","last_fullsized":"2024-09-21T08:53:55.180814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541719+0000","last_change":"2024-09-21T08:51:40.143685+0000","last_active":"2024-09-21T08:54:46.541719+0000","last_peered":"2024-09-21T08:54:46.541719+0000","last_clean":"2024-09-21T08:54:46.541719+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:54:46.541719+0000","last_undegraded":"2024-09-21T08:54:46.541719+0000","last_fullsized":"2024-09-21T08:54:46.541719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.520779+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.520779+0000","last_peered":"2024-09-21T08:54:46.520779+0000","last_clean":"2024-09-21T08:54:46.520779+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.520779+0000","last_undegraded":"2024-09-21T08:54:46.520779+0000","last_fullsized":"2024-09-21T08:54:46.520779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.789003+0000","last_change":"2024-09-21T08:54:58.789049+0000","last_active":"2024-09-21T08:54:58.789003+0000","last_peered":"2024-09-21T08:54:58.789003+0000","last_clean":"2024-09-21T08:54:58.789003+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:54:58.789003+0000","last_undegraded":"2024-09-21T08:54:58.789003+0000","last_fullsized":"2024-09-21T08:54:58.789003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.788878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:55.506296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.233411+0000","last_change":"2024-09-21T08:55:02.233457+0000","last_active":"2024-09-21T08:55:02.233411+0000","last_peered":"2024-09-21T08:55:02.233411+0000","last_clean":"2024-09-21T08:55:02.233411+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:55:02.233411+0000","last_undegraded":"2024-09-21T08:55:02.233411+0000","last_fullsized":"2024-09-21T08:55:02.233411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.233330+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:49.289271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.914245+0000","last_change":"2024-09-21T08:55:00.914269+0000","last_active":"2024-09-21T08:55:00.914245+0000","last_peered":"2024-09-21T08:55:00.914245+0000","last_clean":"2024-09-21T08:55:00.914245+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:55:00.914245+0000","last_undegraded":"2024-09-21T08:55:00.914245+0000","last_fullsized":"2024-09-21T08:55:00.914245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.914158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:41.840956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.697022+0000","last_change":"2024-09-21T08:51:48.156029+0000","last_active":"2024-09-21T08:54:46.697022+0000","last_peered":"2024-09-21T08:54:46.697022+0000","last_clean":"2024-09-21T08:54:46.697022+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:54:46.697022+0000","last_undegraded":"2024-09-21T08:54:46.697022+0000","last_fullsized":"2024-09-21T08:54:46.697022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.406219+0000","last_change":"2024-09-21T08:51:40.141982+0000","last_active":"2024-09-21T08:54:46.406219+0000","last_peered":"2024-09-21T08:54:46.406219+0000","last_clean":"2024-09-21T08:54:46.406219+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:54:46.406219+0000","last_undegraded":"2024-09-21T08:54:46.406219+0000","last_fullsized":"2024-09-21T08:54:46.406219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:25.176699+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:53:25.176699+0000","last_peered":"2024-09-21T08:53:25.176699+0000","last_clean":"2024-09-21T08:53:25.176699+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:53:25.176699+0000","last_undegraded":"2024-09-21T08:53:25.176699+0000","last_fullsized":"2024-09-21T08:53:25.176699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178620+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:53:35.178620+0000","last_peered":"2024-09-21T08:53:35.178620+0000","last_clean":"2024-09-21T08:53:35.178620+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:53:35.178620+0000","last_undegraded":"2024-09-21T08:53:35.178620+0000","last_fullsized":"2024-09-21T08:53:35.178620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.200398+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:54:53.200398+0000","last_peered":"2024-09-21T08:54:53.200398+0000","last_clean":"2024-09-21T08:54:53.200398+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:54:53.200398+0000","last_undegraded":"2024-09-21T08:54:53.200398+0000","last_fullsized":"2024-09-21T08:54:53.200398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.277195+0000","last_change":"2024-09-21T08:55:14.277221+0000","last_active":"2024-09-21T08:55:14.277195+0000","last_peered":"2024-09-21T08:55:14.277195+0000","last_clean":"2024-09-21T08:55:14.277195+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:55:14.277195+0000","last_undegraded":"2024-09-21T08:55:14.277195+0000","last_fullsized":"2024-09-21T08:55:14.277195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.277103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:39.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.278125+0000","last_change":"2024-09-21T08:51:44.147739+0000","last_active":"2024-09-21T08:54:53.278125+0000","last_peered":"2024-09-21T08:54:53.278125+0000","last_clean":"2024-09-21T08:54:53.278125+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:54:53.278125+0000","last_undegraded":"2024-09-21T08:54:53.278125+0000","last_fullsized":"2024-09-21T08:54:53.278125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.764985+0000","last_change":"2024-09-21T08:55:02.765010+0000","last_active":"2024-09-21T08:55:02.764985+0000","last_peered":"2024-09-21T08:55:02.764985+0000","last_clean":"2024-09-21T08:55:02.764985+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:55:02.764985+0000","last_undegraded":"2024-09-21T08:55:02.764985+0000","last_fullsized":"2024-09-21T08:55:02.764985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.764887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:26.749713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.616008+0000","last_change":"2024-09-21T08:51:48.153950+0000","last_active":"2024-09-21T08:54:46.616008+0000","last_peered":"2024-09-21T08:54:46.616008+0000","last_clean":"2024-09-21T08:54:46.616008+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:54:46.616008+0000","last_undegraded":"2024-09-21T08:54:46.616008+0000","last_fullsized":"2024-09-21T08:54:46.616008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180755+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:53:50.180755+0000","last_peered":"2024-09-21T08:53:50.180755+0000","last_clean":"2024-09-21T08:53:50.180755+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:53:50.180755+0000","last_undegraded":"2024-09-21T08:53:50.180755+0000","last_fullsized":"2024-09-21T08:53:50.180755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:30.177841+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:53:30.177841+0000","last_peered":"2024-09-21T08:53:30.177841+0000","last_clean":"2024-09-21T08:53:30.177841+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:53:30.177841+0000","last_undegraded":"2024-09-21T08:53:30.177841+0000","last_fullsized":"2024-09-21T08:53:30.177841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177546+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:53:44.177546+0000","last_peered":"2024-09-21T08:53:44.177546+0000","last_clean":"2024-09-21T08:53:44.177546+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:53:44.177546+0000","last_undegraded":"2024-09-21T08:53:44.177546+0000","last_fullsized":"2024-09-21T08:53:44.177546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181617+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:53:55.181617+0000","last_peered":"2024-09-21T08:53:55.181617+0000","last_clean":"2024-09-21T08:53:55.181617+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:53:55.181617+0000","last_undegraded":"2024-09-21T08:53:55.181617+0000","last_fullsized":"2024-09-21T08:53:55.181617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.257895+0000","last_change":"2024-09-21T08:54:59.257947+0000","last_active":"2024-09-21T08:54:59.257895+0000","last_peered":"2024-09-21T08:54:59.257895+0000","last_clean":"2024-09-21T08:54:59.257895+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:59.257895+0000","last_undegraded":"2024-09-21T08:54:59.257895+0000","last_fullsized":"2024-09-21T08:54:59.257895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.257796+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:55.128267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180702+0000","last_change":"2024-09-21T08:51:46.151027+0000","last_active":"2024-09-21T08:53:50.180702+0000","last_peered":"2024-09-21T08:53:50.180702+0000","last_clean":"2024-09-21T08:53:50.180702+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:53:50.180702+0000","last_undegraded":"2024-09-21T08:53:50.180702+0000","last_fullsized":"2024-09-21T08:53:50.180702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181790+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:54:00.181790+0000","last_peered":"2024-09-21T08:54:00.181790+0000","last_clean":"2024-09-21T08:54:00.181790+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:54:00.181790+0000","last_undegraded":"2024-09-21T08:54:00.181790+0000","last_fullsized":"2024-09-21T08:54:00.181790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541877+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.541877+0000","last_peered":"2024-09-21T08:54:46.541877+0000","last_clean":"2024-09-21T08:54:46.541877+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.541877+0000","last_undegraded":"2024-09-21T08:54:46.541877+0000","last_fullsized":"2024-09-21T08:54:46.541877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.177886+0000","last_change":"2024-09-21T08:51:29.224622+0000","last_active":"2024-09-21T08:53:35.177886+0000","last_peered":"2024-09-21T08:53:35.177886+0000","last_clean":"2024-09-21T08:53:35.177886+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:53:35.177886+0000","last_undegraded":"2024-09-21T08:53:35.177886+0000","last_fullsized":"2024-09-21T08:53:35.177886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:39.176970+0000","last_change":"2024-09-21T08:51:38.137786+0000","last_active":"2024-09-21T08:53:39.176970+0000","last_peered":"2024-09-21T08:53:39.176970+0000","last_clean":"2024-09-21T08:53:39.176970+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:53:39.176970+0000","last_undegraded":"2024-09-21T08:53:39.176970+0000","last_fullsized":"2024-09-21T08:53:39.176970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180969+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:53:55.180969+0000","last_peered":"2024-09-21T08:53:55.180969+0000","last_clean":"2024-09-21T08:53:55.180969+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:53:55.180969+0000","last_undegraded":"2024-09-21T08:53:55.180969+0000","last_fullsized":"2024-09-21T08:53:55.180969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.818854+0000","last_change":"2024-09-21T08:55:09.818896+0000","last_active":"2024-09-21T08:55:09.818854+0000","last_peered":"2024-09-21T08:55:09.818854+0000","last_clean":"2024-09-21T08:55:09.818854+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:55:09.818854+0000","last_undegraded":"2024-09-21T08:55:09.818854+0000","last_fullsized":"2024-09-21T08:55:09.818854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.818766+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:10.946408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.758952+0000","last_change":"2024-09-21T08:55:01.758991+0000","last_active":"2024-09-21T08:55:01.758952+0000","last_peered":"2024-09-21T08:55:01.758952+0000","last_clean":"2024-09-21T08:55:01.758952+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:55:01.758952+0000","last_undegraded":"2024-09-21T08:55:01.758952+0000","last_fullsized":"2024-09-21T08:55:01.758952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.758844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:27.038728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.183092+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:54:05.183092+0000","last_peered":"2024-09-21T08:54:05.183092+0000","last_clean":"2024-09-21T08:54:05.183092+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:54:05.183092+0000","last_undegraded":"2024-09-21T08:54:05.183092+0000","last_fullsized":"2024-09-21T08:54:05.183092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177682+0000","last_change":"2024-09-21T08:51:40.136811+0000","last_active":"2024-09-21T08:53:44.177682+0000","last_peered":"2024-09-21T08:53:44.177682+0000","last_clean":"2024-09-21T08:53:44.177682+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:53:44.177682+0000","last_undegraded":"2024-09-21T08:53:44.177682+0000","last_fullsized":"2024-09-21T08:53:44.177682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178574+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:53:35.178574+0000","last_peered":"2024-09-21T08:53:35.178574+0000","last_clean":"2024-09-21T08:53:35.178574+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:53:35.178574+0000","last_undegraded":"2024-09-21T08:53:35.178574+0000","last_fullsized":"2024-09-21T08:53:35.178574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179086+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:53:45.179086+0000","last_peered":"2024-09-21T08:53:45.179086+0000","last_clean":"2024-09-21T08:53:45.179086+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:53:45.179086+0000","last_undegraded":"2024-09-21T08:53:45.179086+0000","last_fullsized":"2024-09-21T08:53:45.179086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.772814+0000","last_change":"2024-09-21T08:55:12.772851+0000","last_active":"2024-09-21T08:55:12.772814+0000","last_peered":"2024-09-21T08:55:12.772814+0000","last_clean":"2024-09-21T08:55:12.772814+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:55:12.772814+0000","last_undegraded":"2024-09-21T08:55:12.772814+0000","last_fullsized":"2024-09-21T08:55:12.772814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.772717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:25.700341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.753243+0000","last_change":"2024-09-21T08:54:57.753327+0000","last_active":"2024-09-21T08:54:57.753243+0000","last_peered":"2024-09-21T08:54:57.753243+0000","last_clean":"2024-09-21T08:54:57.753243+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:57.753243+0000","last_undegraded":"2024-09-21T08:54:57.753243+0000","last_fullsized":"2024-09-21T08:54:57.753243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.753140+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:11.199581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181587+0000","last_change":"2024-09-21T08:51:46.150420+0000","last_active":"2024-09-21T08:53:55.181587+0000","last_peered":"2024-09-21T08:53:55.181587+0000","last_clean":"2024-09-21T08:53:55.181587+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:53:55.181587+0000","last_undegraded":"2024-09-21T08:53:55.181587+0000","last_fullsized":"2024-09-21T08:53:55.181587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.606666+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.606666+0000","last_peered":"2024-09-21T08:54:46.606666+0000","last_clean":"2024-09-21T08:54:46.606666+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.606666+0000","last_undegraded":"2024-09-21T08:54:46.606666+0000","last_fullsized":"2024-09-21T08:54:46.606666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179128+0000","last_change":"2024-09-21T08:51:40.142809+0000","last_active":"2024-09-21T08:53:45.179128+0000","last_peered":"2024-09-21T08:53:45.179128+0000","last_clean":"2024-09-21T08:53:45.179128+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:53:45.179128+0000","last_undegraded":"2024-09-21T08:53:45.179128+0000","last_fullsized":"2024-09-21T08:53:45.179128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202487+0000","last_change":"2024-09-21T08:51:38.147128+0000","last_active":"2024-09-21T08:54:53.202487+0000","last_peered":"2024-09-21T08:54:53.202487+0000","last_clean":"2024-09-21T08:54:53.202487+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:54:53.202487+0000","last_undegraded":"2024-09-21T08:54:53.202487+0000","last_fullsized":"2024-09-21T08:54:53.202487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:34.176333+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:53:34.176333+0000","last_peered":"2024-09-21T08:53:34.176333+0000","last_clean":"2024-09-21T08:53:34.176333+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:53:34.176333+0000","last_undegraded":"2024-09-21T08:53:34.176333+0000","last_fullsized":"2024-09-21T08:53:34.176333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.129525+0000","last_change":"2024-09-21T08:51:42.136825+0000","last_active":"2024-09-21T08:54:53.129525+0000","last_peered":"2024-09-21T08:54:53.129525+0000","last_clean":"2024-09-21T08:54:53.129525+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:54:53.129525+0000","last_undegraded":"2024-09-21T08:54:53.129525+0000","last_fullsized":"2024-09-21T08:54:53.129525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.852327+0000","last_change":"2024-09-21T08:55:05.852373+0000","last_active":"2024-09-21T08:55:05.852327+0000","last_peered":"2024-09-21T08:55:05.852327+0000","last_clean":"2024-09-21T08:55:05.852327+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:55:05.852327+0000","last_undegraded":"2024-09-21T08:55:05.852327+0000","last_fullsized":"2024-09-21T08:55:05.852327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.852239+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.553041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.982915+0000","last_change":"2024-09-21T08:54:58.982940+0000","last_active":"2024-09-21T08:54:58.982915+0000","last_peered":"2024-09-21T08:54:58.982915+0000","last_clean":"2024-09-21T08:54:58.982915+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:54:58.982915+0000","last_undegraded":"2024-09-21T08:54:58.982915+0000","last_fullsized":"2024-09-21T08:54:58.982915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.982822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:26.322430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180896+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:54:04.180896+0000","last_peered":"2024-09-21T08:54:04.180896+0000","last_clean":"2024-09-21T08:54:04.180896+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:54:04.180896+0000","last_undegraded":"2024-09-21T08:54:04.180896+0000","last_fullsized":"2024-09-21T08:54:04.180896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179149+0000","last_change":"2024-09-21T08:51:40.133246+0000","last_active":"2024-09-21T08:53:45.179149+0000","last_peered":"2024-09-21T08:53:45.179149+0000","last_clean":"2024-09-21T08:53:45.179149+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:53:45.179149+0000","last_undegraded":"2024-09-21T08:53:45.179149+0000","last_fullsized":"2024-09-21T08:53:45.179149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177661+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:53:44.177661+0000","last_peered":"2024-09-21T08:53:44.177661+0000","last_clean":"2024-09-21T08:53:44.177661+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:53:44.177661+0000","last_undegraded":"2024-09-21T08:53:44.177661+0000","last_fullsized":"2024-09-21T08:53:44.177661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178655+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:53:35.178655+0000","last_peered":"2024-09-21T08:53:35.178655+0000","last_clean":"2024-09-21T08:53:35.178655+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:53:35.178655+0000","last_undegraded":"2024-09-21T08:53:35.178655+0000","last_fullsized":"2024-09-21T08:53:35.178655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.847393+0000","last_change":"2024-09-21T08:55:05.847420+0000","last_active":"2024-09-21T08:55:05.847393+0000","last_peered":"2024-09-21T08:55:05.847393+0000","last_clean":"2024-09-21T08:55:05.847393+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:55:05.847393+0000","last_undegraded":"2024-09-21T08:55:05.847393+0000","last_fullsized":"2024-09-21T08:55:05.847393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.847290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:42:43.812529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.280580+0000","last_change":"2024-09-21T08:54:58.280639+0000","last_active":"2024-09-21T08:54:58.280580+0000","last_peered":"2024-09-21T08:54:58.280580+0000","last_clean":"2024-09-21T08:54:58.280580+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:54:58.280580+0000","last_undegraded":"2024-09-21T08:54:58.280580+0000","last_fullsized":"2024-09-21T08:54:58.280580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.280470+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:25.040327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":366,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.299126+0000","last_change":"2024-09-21T08:55:00.299155+0000","last_active":"2024-09-21T08:55:00.299126+0000","last_peered":"2024-09-21T08:55:00.299126+0000","last_clean":"2024-09-21T08:55:00.299126+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:55:00.299126+0000","last_undegraded":"2024-09-21T08:55:00.299126+0000","last_fullsized":"2024-09-21T08:55:00.299126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.299020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:39.253241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.183207+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:54:05.183207+0000","last_peered":"2024-09-21T08:54:05.183207+0000","last_clean":"2024-09-21T08:54:05.183207+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:54:05.183207+0000","last_undegraded":"2024-09-21T08:54:05.183207+0000","last_fullsized":"2024-09-21T08:54:05.183207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.768121+0000","last_change":"2024-09-21T08:55:11.768148+0000","last_active":"2024-09-21T08:55:11.768121+0000","last_peered":"2024-09-21T08:55:11.768121+0000","last_clean":"2024-09-21T08:55:11.768121+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:55:11.768121+0000","last_undegraded":"2024-09-21T08:55:11.768121+0000","last_fullsized":"2024-09-21T08:55:11.768121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.768028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:52.506242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.533077+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.533077+0000","last_peered":"2024-09-21T08:54:46.533077+0000","last_clean":"2024-09-21T08:54:46.533077+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.533077+0000","last_undegraded":"2024-09-21T08:54:46.533077+0000","last_fullsized":"2024-09-21T08:54:46.533077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:39.177090+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:53:39.177090+0000","last_peered":"2024-09-21T08:53:39.177090+0000","last_clean":"2024-09-21T08:53:39.177090+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:53:39.177090+0000","last_undegraded":"2024-09-21T08:53:39.177090+0000","last_fullsized":"2024-09-21T08:53:39.177090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.822697+0000","last_change":"2024-09-21T08:55:03.822721+0000","last_active":"2024-09-21T08:55:03.822697+0000","last_peered":"2024-09-21T08:55:03.822697+0000","last_clean":"2024-09-21T08:55:03.822697+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:55:03.822697+0000","last_undegraded":"2024-09-21T08:55:03.822697+0000","last_fullsized":"2024-09-21T08:55:03.822697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:17.459600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180647+0000","last_change":"2024-09-21T08:51:44.146949+0000","last_active":"2024-09-21T08:53:50.180647+0000","last_peered":"2024-09-21T08:53:50.180647+0000","last_clean":"2024-09-21T08:53:50.180647+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:53:50.180647+0000","last_undegraded":"2024-09-21T08:53:50.180647+0000","last_fullsized":"2024-09-21T08:53:50.180647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.791406+0000","last_change":"2024-09-21T08:55:11.791438+0000","last_active":"2024-09-21T08:55:11.791406+0000","last_peered":"2024-09-21T08:55:11.791406+0000","last_clean":"2024-09-21T08:55:11.791406+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:55:11.791406+0000","last_undegraded":"2024-09-21T08:55:11.791406+0000","last_fullsized":"2024-09-21T08:55:11.791406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.791309+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:31.481073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182548+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:54:05.182548+0000","last_peered":"2024-09-21T08:54:05.182548+0000","last_clean":"2024-09-21T08:54:05.182548+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:54:05.182548+0000","last_undegraded":"2024-09-21T08:54:05.182548+0000","last_fullsized":"2024-09-21T08:54:05.182548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.936600+0000","last_change":"2024-09-21T08:51:40.139991+0000","last_active":"2024-09-21T08:53:45.936600+0000","last_peered":"2024-09-21T08:53:45.936600+0000","last_clean":"2024-09-21T08:53:45.936600+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:53:45.936600+0000","last_undegraded":"2024-09-21T08:53:45.936600+0000","last_fullsized":"2024-09-21T08:53:45.936600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180129+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:53:50.180129+0000","last_peered":"2024-09-21T08:53:50.180129+0000","last_clean":"2024-09-21T08:53:50.180129+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:53:50.180129+0000","last_undegraded":"2024-09-21T08:53:50.180129+0000","last_fullsized":"2024-09-21T08:53:50.180129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.179309+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:53:40.179309+0000","last_peered":"2024-09-21T08:53:40.179309+0000","last_clean":"2024-09-21T08:53:40.179309+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:53:40.179309+0000","last_undegraded":"2024-09-21T08:53:40.179309+0000","last_fullsized":"2024-09-21T08:53:40.179309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179813+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:53:45.179813+0000","last_peered":"2024-09-21T08:53:45.179813+0000","last_clean":"2024-09-21T08:53:45.179813+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:53:45.179813+0000","last_undegraded":"2024-09-21T08:53:45.179813+0000","last_fullsized":"2024-09-21T08:53:45.179813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.829236+0000","last_change":"2024-09-21T08:55:02.829284+0000","last_active":"2024-09-21T08:55:02.829236+0000","last_peered":"2024-09-21T08:55:02.829236+0000","last_clean":"2024-09-21T08:55:02.829236+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:55:02.829236+0000","last_undegraded":"2024-09-21T08:55:02.829236+0000","last_fullsized":"2024-09-21T08:55:02.829236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.829144+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.593879+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.820049+0000","last_change":"2024-09-21T08:55:04.820070+0000","last_active":"2024-09-21T08:55:04.820049+0000","last_peered":"2024-09-21T08:55:04.820049+0000","last_clean":"2024-09-21T08:55:04.820049+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:55:04.820049+0000","last_undegraded":"2024-09-21T08:55:04.820049+0000","last_fullsized":"2024-09-21T08:55:04.820049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.819955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:13.094734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.834090+0000","last_change":"2024-09-21T08:55:12.834113+0000","last_active":"2024-09-21T08:55:12.834090+0000","last_peered":"2024-09-21T08:55:12.834090+0000","last_clean":"2024-09-21T08:55:12.834090+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:55:12.834090+0000","last_undegraded":"2024-09-21T08:55:12.834090+0000","last_fullsized":"2024-09-21T08:55:12.834090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.833970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:00.715535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.539257+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.539257+0000","last_peered":"2024-09-21T08:54:46.539257+0000","last_clean":"2024-09-21T08:54:46.539257+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.539257+0000","last_undegraded":"2024-09-21T08:54:46.539257+0000","last_fullsized":"2024-09-21T08:54:46.539257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319689+0000","last_change":"2024-09-21T08:51:40.144129+0000","last_active":"2024-09-21T08:54:46.319689+0000","last_peered":"2024-09-21T08:54:46.319689+0000","last_clean":"2024-09-21T08:54:46.319689+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:54:46.319689+0000","last_undegraded":"2024-09-21T08:54:46.319689+0000","last_fullsized":"2024-09-21T08:54:46.319689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182315+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:54:00.182315+0000","last_peered":"2024-09-21T08:54:00.182315+0000","last_clean":"2024-09-21T08:54:00.182315+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:54:00.182315+0000","last_undegraded":"2024-09-21T08:54:00.182315+0000","last_fullsized":"2024-09-21T08:54:00.182315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182519+0000","last_change":"2024-09-21T08:51:42.133381+0000","last_active":"2024-09-21T08:54:05.182519+0000","last_peered":"2024-09-21T08:54:05.182519+0000","last_clean":"2024-09-21T08:54:05.182519+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:54:05.182519+0000","last_undegraded":"2024-09-21T08:54:05.182519+0000","last_fullsized":"2024-09-21T08:54:05.182519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.810730+0000","last_change":"2024-09-21T08:55:04.810792+0000","last_active":"2024-09-21T08:55:04.810730+0000","last_peered":"2024-09-21T08:55:04.810730+0000","last_clean":"2024-09-21T08:55:04.810730+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:55:04.810730+0000","last_undegraded":"2024-09-21T08:55:04.810730+0000","last_fullsized":"2024-09-21T08:55:04.810730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.810614+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:15.348725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182992+0000","last_change":"2024-09-21T08:51:46.158200+0000","last_active":"2024-09-21T08:54:05.182992+0000","last_peered":"2024-09-21T08:54:05.182992+0000","last_clean":"2024-09-21T08:54:05.182992+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:54:05.182992+0000","last_undegraded":"2024-09-21T08:54:05.182992+0000","last_fullsized":"2024-09-21T08:54:05.182992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178433+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:49.178433+0000","last_peered":"2024-09-21T08:53:49.178433+0000","last_clean":"2024-09-21T08:53:49.178433+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:49.178433+0000","last_undegraded":"2024-09-21T08:53:49.178433+0000","last_fullsized":"2024-09-21T08:53:49.178433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'5","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656983+0000","last_change":"2024-09-21T08:51:40.142196+0000","last_active":"2024-09-21T08:54:46.656983+0000","last_peered":"2024-09-21T08:54:46.656983+0000","last_clean":"2024-09-21T08:54:46.656983+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:54:46.656983+0000","last_undegraded":"2024-09-21T08:54:46.656983+0000","last_fullsized":"2024-09-21T08:54:46.656983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.296889+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.296889+0000","last_peered":"2024-09-21T08:54:46.296889+0000","last_clean":"2024-09-21T08:54:46.296889+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.296889+0000","last_undegraded":"2024-09-21T08:54:46.296889+0000","last_fullsized":"2024-09-21T08:54:46.296889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.817707+0000","last_change":"2024-09-21T08:55:07.817734+0000","last_active":"2024-09-21T08:55:07.817707+0000","last_peered":"2024-09-21T08:55:07.817707+0000","last_clean":"2024-09-21T08:55:07.817707+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:55:07.817707+0000","last_undegraded":"2024-09-21T08:55:07.817707+0000","last_fullsized":"2024-09-21T08:55:07.817707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.817604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:06.637277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.835986+0000","last_change":"2024-09-21T08:54:56.836033+0000","last_active":"2024-09-21T08:54:56.835986+0000","last_peered":"2024-09-21T08:54:56.835986+0000","last_clean":"2024-09-21T08:54:56.835986+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:56.835986+0000","last_undegraded":"2024-09-21T08:54:56.835986+0000","last_fullsized":"2024-09-21T08:54:56.835986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_clean_scrub_stamp":"2024-09-21T08:54:56.835862+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.916858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.824181+0000","last_change":"2024-09-21T08:55:04.824228+0000","last_active":"2024-09-21T08:55:04.824181+0000","last_peered":"2024-09-21T08:55:04.824181+0000","last_clean":"2024-09-21T08:55:04.824181+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:55:04.824181+0000","last_undegraded":"2024-09-21T08:55:04.824181+0000","last_fullsized":"2024-09-21T08:55:04.824181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.824082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:20.883736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.317208+0000","last_change":"2024-09-21T08:51:48.154918+0000","last_active":"2024-09-21T08:54:46.317208+0000","last_peered":"2024-09-21T08:54:46.317208+0000","last_clean":"2024-09-21T08:54:46.317208+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:54:46.317208+0000","last_undegraded":"2024-09-21T08:54:46.317208+0000","last_fullsized":"2024-09-21T08:54:46.317208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583579+0000","last_change":"2024-09-21T08:51:40.122583+0000","last_active":"2024-09-21T08:54:46.583579+0000","last_peered":"2024-09-21T08:54:46.583579+0000","last_clean":"2024-09-21T08:54:46.583579+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:54:46.583579+0000","last_undegraded":"2024-09-21T08:54:46.583579+0000","last_fullsized":"2024-09-21T08:54:46.583579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182655+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:54:05.182655+0000","last_peered":"2024-09-21T08:54:05.182655+0000","last_clean":"2024-09-21T08:54:05.182655+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:54:05.182655+0000","last_undegraded":"2024-09-21T08:54:05.182655+0000","last_fullsized":"2024-09-21T08:54:05.182655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.849013+0000","last_change":"2024-09-21T08:55:13.849035+0000","last_active":"2024-09-21T08:55:13.849013+0000","last_peered":"2024-09-21T08:55:13.849013+0000","last_clean":"2024-09-21T08:55:13.849013+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:55:13.849013+0000","last_undegraded":"2024-09-21T08:55:13.849013+0000","last_fullsized":"2024-09-21T08:55:13.849013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.848927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.202435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'47","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.833227+0000","last_change":"2024-09-21T08:55:09.833272+0000","last_active":"2024-09-21T08:55:09.833227+0000","last_peered":"2024-09-21T08:55:09.833227+0000","last_clean":"2024-09-21T08:55:09.833227+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:55:09.833227+0000","last_undegraded":"2024-09-21T08:55:09.833227+0000","last_fullsized":"2024-09-21T08:55:09.833227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.833131+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:32.922483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.298583+0000","last_change":"2024-09-21T08:55:04.298628+0000","last_active":"2024-09-21T08:55:04.298583+0000","last_peered":"2024-09-21T08:55:04.298583+0000","last_clean":"2024-09-21T08:55:04.298583+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:55:04.298583+0000","last_undegraded":"2024-09-21T08:55:04.298583+0000","last_fullsized":"2024-09-21T08:55:04.298583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.298475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.675637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.185462+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:54:20.185462+0000","last_peered":"2024-09-21T08:54:20.185462+0000","last_clean":"2024-09-21T08:54:20.185462+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:54:20.185462+0000","last_undegraded":"2024-09-21T08:54:20.185462+0000","last_fullsized":"2024-09-21T08:54:20.185462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.759091+0000","last_change":"2024-09-21T08:55:09.759114+0000","last_active":"2024-09-21T08:55:09.759091+0000","last_peered":"2024-09-21T08:55:09.759091+0000","last_clean":"2024-09-21T08:55:09.759091+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:55:09.759091+0000","last_undegraded":"2024-09-21T08:55:09.759091+0000","last_fullsized":"2024-09-21T08:55:09.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.759005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:03.833615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182670+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:54:05.182670+0000","last_peered":"2024-09-21T08:54:05.182670+0000","last_clean":"2024-09-21T08:54:05.182670+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:54:05.182670+0000","last_undegraded":"2024-09-21T08:54:05.182670+0000","last_fullsized":"2024-09-21T08:54:05.182670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.791688+0000","last_change":"2024-09-21T08:55:01.791713+0000","last_active":"2024-09-21T08:55:01.791688+0000","last_peered":"2024-09-21T08:55:01.791688+0000","last_clean":"2024-09-21T08:55:01.791688+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:55:01.791688+0000","last_undegraded":"2024-09-21T08:55:01.791688+0000","last_fullsized":"2024-09-21T08:55:01.791688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.791549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.781022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.862851+0000","last_change":"2024-09-21T08:55:07.862890+0000","last_active":"2024-09-21T08:55:07.862851+0000","last_peered":"2024-09-21T08:55:07.862851+0000","last_clean":"2024-09-21T08:55:07.862851+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:55:07.862851+0000","last_undegraded":"2024-09-21T08:55:07.862851+0000","last_fullsized":"2024-09-21T08:55:07.862851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.862752+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:51.564071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.950779+0000","last_change":"2024-09-21T08:54:59.950823+0000","last_active":"2024-09-21T08:54:59.950779+0000","last_peered":"2024-09-21T08:54:59.950779+0000","last_clean":"2024-09-21T08:54:59.950779+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:54:59.950779+0000","last_undegraded":"2024-09-21T08:54:59.950779+0000","last_fullsized":"2024-09-21T08:54:59.950779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.950635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:23.543628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182949+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:54:05.182949+0000","last_peered":"2024-09-21T08:54:05.182949+0000","last_clean":"2024-09-21T08:54:05.182949+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:54:05.182949+0000","last_undegraded":"2024-09-21T08:54:05.182949+0000","last_fullsized":"2024-09-21T08:54:05.182949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177754+0000","last_change":"2024-09-21T08:51:42.136453+0000","last_active":"2024-09-21T08:53:44.177754+0000","last_peered":"2024-09-21T08:53:44.177754+0000","last_clean":"2024-09-21T08:53:44.177754+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:53:44.177754+0000","last_undegraded":"2024-09-21T08:53:44.177754+0000","last_fullsized":"2024-09-21T08:53:44.177754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'65","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.807924+0000","last_change":"2024-09-21T08:55:08.807971+0000","last_active":"2024-09-21T08:55:08.807924+0000","last_peered":"2024-09-21T08:55:08.807924+0000","last_clean":"2024-09-21T08:55:08.807924+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:55:08.807924+0000","last_undegraded":"2024-09-21T08:55:08.807924+0000","last_fullsized":"2024-09-21T08:55:08.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'65","last_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_deep_scrub":"36'65","last_deep_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.807820+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:33.816177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.013839+0000","last_change":"2024-09-21T08:54:58.013862+0000","last_active":"2024-09-21T08:54:58.013839+0000","last_peered":"2024-09-21T08:54:58.013839+0000","last_clean":"2024-09-21T08:54:58.013839+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:54:58.013839+0000","last_undegraded":"2024-09-21T08:54:58.013839+0000","last_fullsized":"2024-09-21T08:54:58.013839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.013702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:15.698435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181620+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:54:09.181620+0000","last_peered":"2024-09-21T08:54:09.181620+0000","last_clean":"2024-09-21T08:54:09.181620+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:54:09.181620+0000","last_undegraded":"2024-09-21T08:54:09.181620+0000","last_fullsized":"2024-09-21T08:54:09.181620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.320013+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.320013+0000","last_peered":"2024-09-21T08:54:46.320013+0000","last_clean":"2024-09-21T08:54:46.320013+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.320013+0000","last_undegraded":"2024-09-21T08:54:46.320013+0000","last_fullsized":"2024-09-21T08:54:46.320013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202409+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:53.202409+0000","last_peered":"2024-09-21T08:54:53.202409+0000","last_clean":"2024-09-21T08:54:53.202409+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:53.202409+0000","last_undegraded":"2024-09-21T08:54:53.202409+0000","last_fullsized":"2024-09-21T08:54:53.202409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180129+0000","last_change":"2024-09-21T08:51:42.139604+0000","last_active":"2024-09-21T08:53:50.180129+0000","last_peered":"2024-09-21T08:53:50.180129+0000","last_clean":"2024-09-21T08:53:50.180129+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:53:50.180129+0000","last_undegraded":"2024-09-21T08:53:50.180129+0000","last_fullsized":"2024-09-21T08:53:50.180129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.796107+0000","last_change":"2024-09-21T08:55:12.796146+0000","last_active":"2024-09-21T08:55:12.796107+0000","last_peered":"2024-09-21T08:55:12.796107+0000","last_clean":"2024-09-21T08:55:12.796107+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:55:12.796107+0000","last_undegraded":"2024-09-21T08:55:12.796107+0000","last_fullsized":"2024-09-21T08:55:12.796107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.796020+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:06.530723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.286766+0000","last_change":"2024-09-21T08:55:12.286792+0000","last_active":"2024-09-21T08:55:12.286766+0000","last_peered":"2024-09-21T08:55:12.286766+0000","last_clean":"2024-09-21T08:55:12.286766+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:55:12.286766+0000","last_undegraded":"2024-09-21T08:55:12.286766+0000","last_fullsized":"2024-09-21T08:55:12.286766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.286668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:03.780340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183893+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:54:10.183893+0000","last_peered":"2024-09-21T08:54:10.183893+0000","last_clean":"2024-09-21T08:54:10.183893+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:54:10.183893+0000","last_undegraded":"2024-09-21T08:54:10.183893+0000","last_fullsized":"2024-09-21T08:54:10.183893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.799865+0000","last_change":"2024-09-21T08:55:13.799916+0000","last_active":"2024-09-21T08:55:13.799865+0000","last_peered":"2024-09-21T08:55:13.799865+0000","last_clean":"2024-09-21T08:55:13.799865+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:55:13.799865+0000","last_undegraded":"2024-09-21T08:55:13.799865+0000","last_fullsized":"2024-09-21T08:55:13.799865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.799748+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.649021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202364+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:53.202364+0000","last_peered":"2024-09-21T08:54:53.202364+0000","last_clean":"2024-09-21T08:54:53.202364+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:53.202364+0000","last_undegraded":"2024-09-21T08:54:53.202364+0000","last_fullsized":"2024-09-21T08:54:53.202364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.846050+0000","last_change":"2024-09-21T08:55:14.846074+0000","last_active":"2024-09-21T08:55:14.846050+0000","last_peered":"2024-09-21T08:55:14.846050+0000","last_clean":"2024-09-21T08:55:14.846050+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:55:14.846050+0000","last_undegraded":"2024-09-21T08:55:14.846050+0000","last_fullsized":"2024-09-21T08:55:14.846050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.845959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:24.445746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.829303+0000","last_change":"2024-09-21T08:55:10.829399+0000","last_active":"2024-09-21T08:55:10.829303+0000","last_peered":"2024-09-21T08:55:10.829303+0000","last_clean":"2024-09-21T08:55:10.829303+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:55:10.829303+0000","last_undegraded":"2024-09-21T08:55:10.829303+0000","last_fullsized":"2024-09-21T08:55:10.829303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.829198+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:50.856893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178447+0000","last_change":"2024-09-21T08:51:46.159395+0000","last_active":"2024-09-21T08:53:49.178447+0000","last_peered":"2024-09-21T08:53:49.178447+0000","last_clean":"2024-09-21T08:53:49.178447+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:53:49.178447+0000","last_undegraded":"2024-09-21T08:53:49.178447+0000","last_fullsized":"2024-09-21T08:53:49.178447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708384+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.708384+0000","last_peered":"2024-09-21T08:54:46.708384+0000","last_clean":"2024-09-21T08:54:46.708384+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.708384+0000","last_undegraded":"2024-09-21T08:54:46.708384+0000","last_fullsized":"2024-09-21T08:54:46.708384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541939+0000","last_change":"2024-09-21T08:51:40.136848+0000","last_active":"2024-09-21T08:54:46.541939+0000","last_peered":"2024-09-21T08:54:46.541939+0000","last_clean":"2024-09-21T08:54:46.541939+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:54:46.541939+0000","last_undegraded":"2024-09-21T08:54:46.541939+0000","last_fullsized":"2024-09-21T08:54:46.541939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183940+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:54:10.183940+0000","last_peered":"2024-09-21T08:54:10.183940+0000","last_clean":"2024-09-21T08:54:10.183940+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:54:10.183940+0000","last_undegraded":"2024-09-21T08:54:10.183940+0000","last_fullsized":"2024-09-21T08:54:10.183940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.214468+0000","last_change":"2024-09-21T08:55:10.214510+0000","last_active":"2024-09-21T08:55:10.214468+0000","last_peered":"2024-09-21T08:55:10.214468+0000","last_clean":"2024-09-21T08:55:10.214468+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:55:10.214468+0000","last_undegraded":"2024-09-21T08:55:10.214468+0000","last_fullsized":"2024-09-21T08:55:10.214468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.214364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:53.485342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'11","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.321216+0000","last_change":"2024-09-21T08:51:44.149082+0000","last_active":"2024-09-21T08:54:46.321216+0000","last_peered":"2024-09-21T08:54:46.321216+0000","last_clean":"2024-09-21T08:54:46.321216+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:54:46.321216+0000","last_undegraded":"2024-09-21T08:54:46.321216+0000","last_fullsized":"2024-09-21T08:54:46.321216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.852926+0000","last_change":"2024-09-21T08:55:08.852971+0000","last_active":"2024-09-21T08:55:08.852926+0000","last_peered":"2024-09-21T08:55:08.852926+0000","last_clean":"2024-09-21T08:55:08.852926+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:55:08.852926+0000","last_undegraded":"2024-09-21T08:55:08.852926+0000","last_fullsized":"2024-09-21T08:55:08.852926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.852812+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:10.217991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183734+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:54:10.183734+0000","last_peered":"2024-09-21T08:54:10.183734+0000","last_clean":"2024-09-21T08:54:10.183734+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:54:10.183734+0000","last_undegraded":"2024-09-21T08:54:10.183734+0000","last_fullsized":"2024-09-21T08:54:10.183734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'19","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656791+0000","last_change":"2024-09-21T08:51:40.133956+0000","last_active":"2024-09-21T08:54:46.656791+0000","last_peered":"2024-09-21T08:54:46.656791+0000","last_clean":"2024-09-21T08:54:46.656791+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:54:46.656791+0000","last_undegraded":"2024-09-21T08:54:46.656791+0000","last_fullsized":"2024-09-21T08:54:46.656791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183358+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:54:10.183358+0000","last_peered":"2024-09-21T08:54:10.183358+0000","last_clean":"2024-09-21T08:54:10.183358+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:54:10.183358+0000","last_undegraded":"2024-09-21T08:54:10.183358+0000","last_fullsized":"2024-09-21T08:54:10.183358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.250725+0000","last_change":"2024-09-21T08:55:11.250750+0000","last_active":"2024-09-21T08:55:11.250725+0000","last_peered":"2024-09-21T08:55:11.250725+0000","last_clean":"2024-09-21T08:55:11.250725+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:55:11.250725+0000","last_undegraded":"2024-09-21T08:55:11.250725+0000","last_fullsized":"2024-09-21T08:55:11.250725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:35.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.282349+0000","last_change":"2024-09-21T08:55:01.282405+0000","last_active":"2024-09-21T08:55:01.282349+0000","last_peered":"2024-09-21T08:55:01.282349+0000","last_clean":"2024-09-21T08:55:01.282349+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:55:01.282349+0000","last_undegraded":"2024-09-21T08:55:01.282349+0000","last_fullsized":"2024-09-21T08:55:01.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.282245+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:55.435995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.731794+0000","last_change":"2024-09-21T08:55:00.731817+0000","last_active":"2024-09-21T08:55:00.731794+0000","last_peered":"2024-09-21T08:55:00.731794+0000","last_clean":"2024-09-21T08:55:00.731794+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:55:00.731794+0000","last_undegraded":"2024-09-21T08:55:00.731794+0000","last_fullsized":"2024-09-21T08:55:00.731794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.731703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:33.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184212+0000","last_change":"2024-09-21T08:51:48.155963+0000","last_active":"2024-09-21T08:54:15.184212+0000","last_peered":"2024-09-21T08:54:15.184212+0000","last_clean":"2024-09-21T08:54:15.184212+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:54:15.184212+0000","last_undegraded":"2024-09-21T08:54:15.184212+0000","last_fullsized":"2024-09-21T08:54:15.184212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'5","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.655220+0000","last_change":"2024-09-21T08:51:40.132727+0000","last_active":"2024-09-21T08:54:46.655220+0000","last_peered":"2024-09-21T08:54:46.655220+0000","last_clean":"2024-09-21T08:54:46.655220+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:54:46.655220+0000","last_undegraded":"2024-09-21T08:54:46.655220+0000","last_fullsized":"2024-09-21T08:54:46.655220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.184027+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:54:10.184027+0000","last_peered":"2024-09-21T08:54:10.184027+0000","last_clean":"2024-09-21T08:54:10.184027+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:54:10.184027+0000","last_undegraded":"2024-09-21T08:54:10.184027+0000","last_fullsized":"2024-09-21T08:54:10.184027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.806832+0000","last_change":"2024-09-21T08:55:11.806872+0000","last_active":"2024-09-21T08:55:11.806832+0000","last_peered":"2024-09-21T08:55:11.806832+0000","last_clean":"2024-09-21T08:55:11.806832+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:55:11.806832+0000","last_undegraded":"2024-09-21T08:55:11.806832+0000","last_fullsized":"2024-09-21T08:55:11.806832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.806716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:26.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.872312+0000","last_change":"2024-09-21T08:55:06.872367+0000","last_active":"2024-09-21T08:55:06.872312+0000","last_peered":"2024-09-21T08:55:06.872312+0000","last_clean":"2024-09-21T08:55:06.872312+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:55:06.872312+0000","last_undegraded":"2024-09-21T08:55:06.872312+0000","last_fullsized":"2024-09-21T08:55:06.872312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.872210+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:58.365881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183805+0000","last_change":"2024-09-21T08:51:46.154489+0000","last_active":"2024-09-21T08:54:10.183805+0000","last_peered":"2024-09-21T08:54:10.183805+0000","last_clean":"2024-09-21T08:54:10.183805+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:54:10.183805+0000","last_undegraded":"2024-09-21T08:54:10.183805+0000","last_fullsized":"2024-09-21T08:54:10.183805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184844+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:54:15.184844+0000","last_peered":"2024-09-21T08:54:15.184844+0000","last_clean":"2024-09-21T08:54:15.184844+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:54:15.184844+0000","last_undegraded":"2024-09-21T08:54:15.184844+0000","last_fullsized":"2024-09-21T08:54:15.184844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608985+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.608985+0000","last_peered":"2024-09-21T08:54:46.608985+0000","last_clean":"2024-09-21T08:54:46.608985+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.608985+0000","last_undegraded":"2024-09-21T08:54:46.608985+0000","last_fullsized":"2024-09-21T08:54:46.608985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:39.177104+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:53:39.177104+0000","last_peered":"2024-09-21T08:53:39.177104+0000","last_clean":"2024-09-21T08:53:39.177104+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:53:39.177104+0000","last_undegraded":"2024-09-21T08:53:39.177104+0000","last_fullsized":"2024-09-21T08:53:39.177104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.263419+0000","last_change":"2024-09-21T08:55:09.263468+0000","last_active":"2024-09-21T08:55:09.263419+0000","last_peered":"2024-09-21T08:55:09.263419+0000","last_clean":"2024-09-21T08:55:09.263419+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:55:09.263419+0000","last_undegraded":"2024-09-21T08:55:09.263419+0000","last_fullsized":"2024-09-21T08:55:09.263419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.263316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:55.833766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'31","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.779617+0000","last_change":"2024-09-21T08:55:10.779651+0000","last_active":"2024-09-21T08:55:10.779617+0000","last_peered":"2024-09-21T08:55:10.779617+0000","last_clean":"2024-09-21T08:55:10.779617+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:55:10.779617+0000","last_undegraded":"2024-09-21T08:55:10.779617+0000","last_fullsized":"2024-09-21T08:55:10.779617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'31","last_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_deep_scrub":"36'31","last_deep_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.779521+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:53.739000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184704+0000","last_change":"2024-09-21T08:51:46.154674+0000","last_active":"2024-09-21T08:54:15.184704+0000","last_peered":"2024-09-21T08:54:15.184704+0000","last_clean":"2024-09-21T08:54:15.184704+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:54:15.184704+0000","last_undegraded":"2024-09-21T08:54:15.184704+0000","last_fullsized":"2024-09-21T08:54:15.184704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:45.130295+0000","last_clean_scrub_stamp":"2024-09-21T08:51:45.130295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184813+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:54:15.184813+0000","last_peered":"2024-09-21T08:54:15.184813+0000","last_clean":"2024-09-21T08:54:15.184813+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:54:15.184813+0000","last_undegraded":"2024-09-21T08:54:15.184813+0000","last_fullsized":"2024-09-21T08:54:15.184813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182422+0000","last_change":"2024-09-21T08:51:40.129771+0000","last_active":"2024-09-21T08:54:05.182422+0000","last_peered":"2024-09-21T08:54:05.182422+0000","last_clean":"2024-09-21T08:54:05.182422+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:54:05.182422+0000","last_undegraded":"2024-09-21T08:54:05.182422+0000","last_fullsized":"2024-09-21T08:54:05.182422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179200+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:53:45.179200+0000","last_peered":"2024-09-21T08:53:45.179200+0000","last_clean":"2024-09-21T08:53:45.179200+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:53:45.179200+0000","last_undegraded":"2024-09-21T08:53:45.179200+0000","last_fullsized":"2024-09-21T08:53:45.179200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.318908+0000","last_change":"2024-09-21T08:55:06.318938+0000","last_active":"2024-09-21T08:55:06.318908+0000","last_peered":"2024-09-21T08:55:06.318908+0000","last_clean":"2024-09-21T08:55:06.318908+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:55:06.318908+0000","last_undegraded":"2024-09-21T08:55:06.318908+0000","last_fullsized":"2024-09-21T08:55:06.318908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.318814+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:39.323163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'35","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.191903+0000","last_change":"2024-09-21T08:51:44.147527+0000","last_active":"2024-09-21T08:54:53.191903+0000","last_peered":"2024-09-21T08:54:53.191903+0000","last_clean":"2024-09-21T08:54:53.191903+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:54:53.191903+0000","last_undegraded":"2024-09-21T08:54:53.191903+0000","last_fullsized":"2024-09-21T08:54:53.191903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:43.122520+0000","last_clean_scrub_stamp":"2024-09-21T08:51:43.122520+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.839335+0000","last_change":"2024-09-21T08:55:07.839358+0000","last_active":"2024-09-21T08:55:07.839335+0000","last_peered":"2024-09-21T08:55:07.839335+0000","last_clean":"2024-09-21T08:55:07.839335+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:55:07.839335+0000","last_undegraded":"2024-09-21T08:55:07.839335+0000","last_fullsized":"2024-09-21T08:55:07.839335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.839244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:46.238290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183990+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:54:10.183990+0000","last_peered":"2024-09-21T08:54:10.183990+0000","last_clean":"2024-09-21T08:54:10.183990+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:54:10.183990+0000","last_undegraded":"2024-09-21T08:54:10.183990+0000","last_fullsized":"2024-09-21T08:54:10.183990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180166+0000","last_change":"2024-09-21T08:51:40.143086+0000","last_active":"2024-09-21T08:53:50.180166+0000","last_peered":"2024-09-21T08:53:50.180166+0000","last_clean":"2024-09-21T08:53:50.180166+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:53:50.180166+0000","last_undegraded":"2024-09-21T08:53:50.180166+0000","last_fullsized":"2024-09-21T08:53:50.180166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179002+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:53:45.179002+0000","last_peered":"2024-09-21T08:53:45.179002+0000","last_clean":"2024-09-21T08:53:45.179002+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:53:45.179002+0000","last_undegraded":"2024-09-21T08:53:45.179002+0000","last_fullsized":"2024-09-21T08:53:45.179002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178463+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:49.178463+0000","last_peered":"2024-09-21T08:53:49.178463+0000","last_clean":"2024-09-21T08:53:49.178463+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:49.178463+0000","last_undegraded":"2024-09-21T08:53:49.178463+0000","last_fullsized":"2024-09-21T08:53:49.178463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524445+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.524445+0000","last_peered":"2024-09-21T08:54:46.524445+0000","last_clean":"2024-09-21T08:54:46.524445+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.524445+0000","last_undegraded":"2024-09-21T08:54:46.524445+0000","last_fullsized":"2024-09-21T08:54:46.524445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180717+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:50.180717+0000","last_peered":"2024-09-21T08:53:50.180717+0000","last_clean":"2024-09-21T08:53:50.180717+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:50.180717+0000","last_undegraded":"2024-09-21T08:53:50.180717+0000","last_fullsized":"2024-09-21T08:53:50.180717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.200378+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:54:53.200378+0000","last_peered":"2024-09-21T08:54:53.200378+0000","last_clean":"2024-09-21T08:54:53.200378+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:54:53.200378+0000","last_undegraded":"2024-09-21T08:54:53.200378+0000","last_fullsized":"2024-09-21T08:54:53.200378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609504+0000","last_change":"2024-09-21T08:51:40.136629+0000","last_active":"2024-09-21T08:54:46.609504+0000","last_peered":"2024-09-21T08:54:46.609504+0000","last_clean":"2024-09-21T08:54:46.609504+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:54:46.609504+0000","last_undegraded":"2024-09-21T08:54:46.609504+0000","last_fullsized":"2024-09-21T08:54:46.609504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177624+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:53:44.177624+0000","last_peered":"2024-09-21T08:53:44.177624+0000","last_clean":"2024-09-21T08:53:44.177624+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:53:44.177624+0000","last_undegraded":"2024-09-21T08:53:44.177624+0000","last_fullsized":"2024-09-21T08:53:44.177624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609139+0000","last_change":"2024-09-21T08:51:40.130372+0000","last_active":"2024-09-21T08:54:46.609139+0000","last_peered":"2024-09-21T08:54:46.609139+0000","last_clean":"2024-09-21T08:54:46.609139+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:54:46.609139+0000","last_undegraded":"2024-09-21T08:54:46.609139+0000","last_fullsized":"2024-09-21T08:54:46.609139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178400+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:53:49.178400+0000","last_peered":"2024-09-21T08:53:49.178400+0000","last_clean":"2024-09-21T08:53:49.178400+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:53:49.178400+0000","last_undegraded":"2024-09-21T08:53:49.178400+0000","last_fullsized":"2024-09-21T08:53:49.178400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609679+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609679+0000","last_peered":"2024-09-21T08:54:46.609679+0000","last_clean":"2024-09-21T08:54:46.609679+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609679+0000","last_undegraded":"2024-09-21T08:54:46.609679+0000","last_fullsized":"2024-09-21T08:54:46.609679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180095+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:53:50.180095+0000","last_peered":"2024-09-21T08:53:50.180095+0000","last_clean":"2024-09-21T08:53:50.180095+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:53:50.180095+0000","last_undegraded":"2024-09-21T08:53:50.180095+0000","last_fullsized":"2024-09-21T08:53:50.180095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177569+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:53:44.177569+0000","last_peered":"2024-09-21T08:53:44.177569+0000","last_clean":"2024-09-21T08:53:44.177569+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:53:44.177569+0000","last_undegraded":"2024-09-21T08:53:44.177569+0000","last_fullsized":"2024-09-21T08:53:44.177569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180080+0000","last_change":"2024-09-21T08:51:38.145888+0000","last_active":"2024-09-21T08:53:50.180080+0000","last_peered":"2024-09-21T08:53:50.180080+0000","last_clean":"2024-09-21T08:53:50.180080+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:53:50.180080+0000","last_undegraded":"2024-09-21T08:53:50.180080+0000","last_fullsized":"2024-09-21T08:53:50.180080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609115+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.609115+0000","last_peered":"2024-09-21T08:54:46.609115+0000","last_clean":"2024-09-21T08:54:46.609115+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.609115+0000","last_undegraded":"2024-09-21T08:54:46.609115+0000","last_fullsized":"2024-09-21T08:54:46.609115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178488+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:53:49.178488+0000","last_peered":"2024-09-21T08:53:49.178488+0000","last_clean":"2024-09-21T08:53:49.178488+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:53:49.178488+0000","last_undegraded":"2024-09-21T08:53:49.178488+0000","last_fullsized":"2024-09-21T08:53:49.178488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609721+0000","last_change":"2024-09-21T08:51:40.137071+0000","last_active":"2024-09-21T08:54:46.609721+0000","last_peered":"2024-09-21T08:54:46.609721+0000","last_clean":"2024-09-21T08:54:46.609721+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:54:46.609721+0000","last_undegraded":"2024-09-21T08:54:46.609721+0000","last_fullsized":"2024-09-21T08:54:46.609721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180543+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:53:50.180543+0000","last_peered":"2024-09-21T08:53:50.180543+0000","last_clean":"2024-09-21T08:53:50.180543+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:53:50.180543+0000","last_undegraded":"2024-09-21T08:53:50.180543+0000","last_fullsized":"2024-09-21T08:53:50.180543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656985+0000","last_change":"2024-09-21T08:51:40.140110+0000","last_active":"2024-09-21T08:54:46.656985+0000","last_peered":"2024-09-21T08:54:46.656985+0000","last_clean":"2024-09-21T08:54:46.656985+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:54:46.656985+0000","last_undegraded":"2024-09-21T08:54:46.656985+0000","last_fullsized":"2024-09-21T08:54:46.656985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.517739+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.517739+0000","last_peered":"2024-09-21T08:54:46.517739+0000","last_clean":"2024-09-21T08:54:46.517739+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.517739+0000","last_undegraded":"2024-09-21T08:54:46.517739+0000","last_fullsized":"2024-09-21T08:54:46.517739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582730+0000","last_change":"2024-09-21T08:51:40.129690+0000","last_active":"2024-09-21T08:54:46.582730+0000","last_peered":"2024-09-21T08:54:46.582730+0000","last_clean":"2024-09-21T08:54:46.582730+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:54:46.582730+0000","last_undegraded":"2024-09-21T08:54:46.582730+0000","last_fullsized":"2024-09-21T08:54:46.582730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180882+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:53:55.180882+0000","last_peered":"2024-09-21T08:53:55.180882+0000","last_clean":"2024-09-21T08:53:55.180882+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:53:55.180882+0000","last_undegraded":"2024-09-21T08:53:55.180882+0000","last_fullsized":"2024-09-21T08:53:55.180882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319563+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.319563+0000","last_peered":"2024-09-21T08:54:46.319563+0000","last_clean":"2024-09-21T08:54:46.319563+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.319563+0000","last_undegraded":"2024-09-21T08:54:46.319563+0000","last_fullsized":"2024-09-21T08:54:46.319563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180926+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:53:55.180926+0000","last_peered":"2024-09-21T08:53:55.180926+0000","last_clean":"2024-09-21T08:53:55.180926+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:53:55.180926+0000","last_undegraded":"2024-09-21T08:53:55.180926+0000","last_fullsized":"2024-09-21T08:53:55.180926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'11","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656906+0000","last_change":"2024-09-21T08:51:40.141700+0000","last_active":"2024-09-21T08:54:46.656906+0000","last_peered":"2024-09-21T08:54:46.656906+0000","last_clean":"2024-09-21T08:54:46.656906+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:54:46.656906+0000","last_undegraded":"2024-09-21T08:54:46.656906+0000","last_fullsized":"2024-09-21T08:54:46.656906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181475+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:53:55.181475+0000","last_peered":"2024-09-21T08:53:55.181475+0000","last_clean":"2024-09-21T08:53:55.181475+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:53:55.181475+0000","last_undegraded":"2024-09-21T08:53:55.181475+0000","last_fullsized":"2024-09-21T08:53:55.181475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180912+0000","last_change":"2024-09-21T08:51:40.137601+0000","last_active":"2024-09-21T08:53:55.180912+0000","last_peered":"2024-09-21T08:53:55.180912+0000","last_clean":"2024-09-21T08:53:55.180912+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:53:55.180912+0000","last_undegraded":"2024-09-21T08:53:55.180912+0000","last_fullsized":"2024-09-21T08:53:55.180912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528401+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.528401+0000","last_peered":"2024-09-21T08:54:46.528401+0000","last_clean":"2024-09-21T08:54:46.528401+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.528401+0000","last_undegraded":"2024-09-21T08:54:46.528401+0000","last_fullsized":"2024-09-21T08:54:46.528401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.582824+0000","last_change":"2024-09-21T08:51:40.139425+0000","last_active":"2024-09-21T08:54:46.582824+0000","last_peered":"2024-09-21T08:54:46.582824+0000","last_clean":"2024-09-21T08:54:46.582824+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:54:46.582824+0000","last_undegraded":"2024-09-21T08:54:46.582824+0000","last_fullsized":"2024-09-21T08:54:46.582824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181839+0000","last_change":"2024-09-21T08:51:38.149787+0000","last_active":"2024-09-21T08:54:00.181839+0000","last_peered":"2024-09-21T08:54:00.181839+0000","last_clean":"2024-09-21T08:54:00.181839+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:54:00.181839+0000","last_undegraded":"2024-09-21T08:54:00.181839+0000","last_fullsized":"2024-09-21T08:54:00.181839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.179926+0000","last_change":"2024-09-21T08:51:40.139999+0000","last_active":"2024-09-21T08:53:50.179926+0000","last_peered":"2024-09-21T08:53:50.179926+0000","last_clean":"2024-09-21T08:53:50.179926+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:53:50.179926+0000","last_undegraded":"2024-09-21T08:53:50.179926+0000","last_fullsized":"2024-09-21T08:53:50.179926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182422+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:54:00.182422+0000","last_peered":"2024-09-21T08:54:00.182422+0000","last_clean":"2024-09-21T08:54:00.182422+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:54:00.182422+0000","last_undegraded":"2024-09-21T08:54:00.182422+0000","last_fullsized":"2024-09-21T08:54:00.182422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182174+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:54:00.182174+0000","last_peered":"2024-09-21T08:54:00.182174+0000","last_clean":"2024-09-21T08:54:00.182174+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:54:00.182174+0000","last_undegraded":"2024-09-21T08:54:00.182174+0000","last_fullsized":"2024-09-21T08:54:00.182174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.406448+0000","last_change":"2024-09-21T08:51:40.136460+0000","last_active":"2024-09-21T08:54:46.406448+0000","last_peered":"2024-09-21T08:54:46.406448+0000","last_clean":"2024-09-21T08:54:46.406448+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:54:46.406448+0000","last_undegraded":"2024-09-21T08:54:46.406448+0000","last_fullsized":"2024-09-21T08:54:46.406448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.179939+0000","last_change":"2024-09-21T08:51:38.149631+0000","last_active":"2024-09-21T08:53:59.179939+0000","last_peered":"2024-09-21T08:53:59.179939+0000","last_clean":"2024-09-21T08:53:59.179939+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:53:59.179939+0000","last_undegraded":"2024-09-21T08:53:59.179939+0000","last_fullsized":"2024-09-21T08:53:59.179939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182644+0000","last_change":"2024-09-21T08:51:40.144724+0000","last_active":"2024-09-21T08:54:05.182644+0000","last_peered":"2024-09-21T08:54:05.182644+0000","last_clean":"2024-09-21T08:54:05.182644+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:54:05.182644+0000","last_undegraded":"2024-09-21T08:54:05.182644+0000","last_fullsized":"2024-09-21T08:54:05.182644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1499,"ondisk_log_size":1499,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673012,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39992,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331848,"statfs":{"total":96636764160,"available":96595812352,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673010,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.205 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.206 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.207 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.208 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.209 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.210 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.211 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.212 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.213 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T08:51:21.493390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.214 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.215 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.216 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.217 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.218 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.219 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.220 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.221 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.222 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-21T08:51:45.130295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.223 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-21T08:51:43.122520+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.224 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.225 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.226 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.227 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.228 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:18.228 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T08:55:38.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:55:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.342+0000 7fc0baef8640 1 Processor -- start 2024-09-21T08:55:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0baef8640 1 -- start start 2024-09-21T08:55:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0baef8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0b409a100 0x7fc0b4133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0baef8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b409d3b0 con 0x7fc0b409bd50 2024-09-21T08:55:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0baef8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b409c840 con 0x7fc0b409a100 2024-09-21T08:55:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0b3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0b409a100 0x7fc0b4133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0b8c94640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc0b409bd50 0x7fc0b409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34232/0 (socket says 172.21.15.29:34232) 2024-09-21T08:55:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0b8c94640 1 -- 172.21.15.29:0/2528285047 learned_addr learned my addr 172.21.15.29:0/2528285047 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0b3fff640 1 -- 172.21.15.29:0/2528285047 >> v1:172.21.15.29:6789/0 conn(0x7fc0b409bd50 legacy=0x7fc0b409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.343+0000 7fc0b3fff640 1 -- 172.21.15.29:0/2528285047 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b4098230 con 0x7fc0b409a100 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.344+0000 7fc0b3fff640 1 --2- 172.21.15.29:0/2528285047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4133da0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009720 tx=0x7fc0a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ae2dae43b9dae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.344+0000 7fc0b37fe640 1 -- 172.21.15.29:0/2528285047 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a8037070 con 0x7fc0b409a100 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.344+0000 7fc0b37fe640 1 -- 172.21.15.29:0/2528285047 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a802ad90 con 0x7fc0b409a100 2024-09-21T08:55:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.344+0000 7fc0b37fe640 1 -- 172.21.15.29:0/2528285047 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a8032590 con 0x7fc0b409a100 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 -- 172.21.15.29:0/2528285047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 msgr2=0x7fc0b4133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2528285047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4133da0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009720 tx=0x7fc0a802a110 comp rx=0 tx=0).stop 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 -- 172.21.15.29:0/2528285047 shutdown_connections 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2528285047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4133da0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 -- 172.21.15.29:0/2528285047 >> 172.21.15.29:0/2528285047 conn(0x7fc0b406d4a0 msgr2=0x7fc0b406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 -- 172.21.15.29:0/2528285047 shutdown_connections 2024-09-21T08:55:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.345+0000 7fc0baef8640 1 -- 172.21.15.29:0/2528285047 wait complete. 2024-09-21T08:55:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.346+0000 7fc0baef8640 1 Processor -- start 2024-09-21T08:55:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.346+0000 7fc0baef8640 1 -- start start 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.346+0000 7fc0baef8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.346+0000 7fc0baef8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4134670 con 0x7fc0b409a100 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b8c94640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b8c94640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34092/0 (socket says 172.21.15.29:34092) 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b8c94640 1 -- 172.21.15.29:0/2588232968 learned_addr learned my addr 172.21.15.29:0/2588232968 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b8c94640 1 -- 172.21.15.29:0/2588232968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b4095540 con 0x7fc0b409a100 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b8c94640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4a0 tx=0x7fc0a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4017070 con 0x7fc0b409a100 2024-09-21T08:55:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a4005c10 con 0x7fc0b409a100 2024-09-21T08:55:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b40950a0 con 0x7fc0b409a100 2024-09-21T08:55:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4007070 con 0x7fc0b409a100 2024-09-21T08:55:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.347+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b40963b0 con 0x7fc0b409a100 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.348+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc0a401a070 con 0x7fc0b409a100 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.349+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b40008d0 con 0x7fc0b409a100 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.349+0000 7fc0b17fa640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 0x7fc0a003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.349+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc0a404b000 con 0x7fc0b409a100 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.349+0000 7fc0b3fff640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 0x7fc0a003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.350+0000 7fc0b3fff640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 0x7fc0a003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8034000 tx=0x7fc0a802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.354+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc0b40963b0 con 0x7fc0b409a100 2024-09-21T08:55:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.524+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0b4074970 con 0x7fc0a00382a0 2024-09-21T08:55:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.540+0000 7fc0b17fa640 1 -- 172.21.15.29:0/2588232968 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661858 (secure 0 0 0) 0x7fc0b4074970 con 0x7fc0a00382a0 2024-09-21T08:55:38.549 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:55:38.555 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 msgr2=0x7fc0a003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 0x7fc0a003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8034000 tx=0x7fc0a802e000 comp rx=0 tx=0).stop 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 msgr2=0x7fc0b4132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4a0 tx=0x7fc0a400c960 comp rx=0 tx=0).stop 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 shutdown_connections 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fc0a00382a0 0x7fc0a003a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 --2- 172.21.15.29:0/2588232968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b409a100 0x7fc0b4132880 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 >> 172.21.15.29:0/2588232968 conn(0x7fc0b406d4a0 msgr2=0x7fc0b4096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 shutdown_connections 2024-09-21T08:55:38.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:38.545+0000 7fc0baef8640 1 -- 172.21.15.29:0/2588232968 wait complete. 2024-09-21T08:55:38.558 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-21T08:55:37.226921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4777,"ondisk_log_size":4777,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148512,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338848,"statfs":{"total":386547056640,"available":386394980352,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004382"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.758648+0000","last_change":"2024-09-21T08:55:27.758671+0000","last_active":"2024-09-21T08:55:27.758648+0000","last_peered":"2024-09-21T08:55:27.758648+0000","last_clean":"2024-09-21T08:55:27.758648+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:55:27.758648+0000","last_undegraded":"2024-09-21T08:55:27.758648+0000","last_fullsized":"2024-09-21T08:55:27.758648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.758533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:27.669521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.405789+0000","last_change":"2024-09-21T08:51:40.138057+0000","last_active":"2024-09-21T08:54:46.405789+0000","last_peered":"2024-09-21T08:54:46.405789+0000","last_clean":"2024-09-21T08:54:46.405789+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:54:46.405789+0000","last_undegraded":"2024-09-21T08:54:46.405789+0000","last_fullsized":"2024-09-21T08:54:46.405789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177730+0000","last_change":"2024-09-21T08:51:38.131727+0000","last_active":"2024-09-21T08:53:44.177730+0000","last_peered":"2024-09-21T08:53:44.177730+0000","last_clean":"2024-09-21T08:53:44.177730+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:53:44.177730+0000","last_undegraded":"2024-09-21T08:53:44.177730+0000","last_fullsized":"2024-09-21T08:53:44.177730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.803865+0000","last_change":"2024-09-21T08:55:33.803907+0000","last_active":"2024-09-21T08:55:33.803865+0000","last_peered":"2024-09-21T08:55:33.803865+0000","last_clean":"2024-09-21T08:55:33.803865+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:55:33.803865+0000","last_undegraded":"2024-09-21T08:55:33.803865+0000","last_fullsized":"2024-09-21T08:55:33.803865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.803741+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:25.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179953+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:53:45.179953+0000","last_peered":"2024-09-21T08:53:45.179953+0000","last_clean":"2024-09-21T08:53:45.179953+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:53:45.179953+0000","last_undegraded":"2024-09-21T08:53:45.179953+0000","last_fullsized":"2024-09-21T08:53:45.179953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:44.186519+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:54:44.186519+0000","last_peered":"2024-09-21T08:54:44.186519+0000","last_clean":"2024-09-21T08:54:44.186519+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:54:44.186519+0000","last_undegraded":"2024-09-21T08:54:44.186519+0000","last_fullsized":"2024-09-21T08:54:44.186519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.178559+0000","last_change":"2024-09-21T08:51:38.140634+0000","last_active":"2024-09-21T08:53:40.178559+0000","last_peered":"2024-09-21T08:53:40.178559+0000","last_clean":"2024-09-21T08:53:40.178559+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:53:40.178559+0000","last_undegraded":"2024-09-21T08:53:40.178559+0000","last_fullsized":"2024-09-21T08:53:40.178559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'5","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.655114+0000","last_change":"2024-09-21T08:51:40.133335+0000","last_active":"2024-09-21T08:54:46.655114+0000","last_peered":"2024-09-21T08:54:46.655114+0000","last_clean":"2024-09-21T08:54:46.655114+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:54:46.655114+0000","last_undegraded":"2024-09-21T08:54:46.655114+0000","last_fullsized":"2024-09-21T08:54:46.655114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183955+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:54:10.183955+0000","last_peered":"2024-09-21T08:54:10.183955+0000","last_clean":"2024-09-21T08:54:10.183955+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:54:10.183955+0000","last_undegraded":"2024-09-21T08:54:10.183955+0000","last_fullsized":"2024-09-21T08:54:10.183955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.178586+0000","last_change":"2024-09-21T08:51:40.139313+0000","last_active":"2024-09-21T08:53:40.178586+0000","last_peered":"2024-09-21T08:53:40.178586+0000","last_clean":"2024-09-21T08:53:40.178586+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:53:40.178586+0000","last_undegraded":"2024-09-21T08:53:40.178586+0000","last_fullsized":"2024-09-21T08:53:40.178586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.824531+0000","last_change":"2024-09-21T08:55:25.824569+0000","last_active":"2024-09-21T08:55:25.824531+0000","last_peered":"2024-09-21T08:55:25.824531+0000","last_clean":"2024-09-21T08:55:25.824531+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:55:25.824531+0000","last_undegraded":"2024-09-21T08:55:25.824531+0000","last_fullsized":"2024-09-21T08:55:25.824531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.824445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.554324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.406217+0000","last_change":"2024-09-21T08:52:14.242297+0000","last_active":"2024-09-21T08:54:46.406217+0000","last_peered":"2024-09-21T08:54:46.406217+0000","last_clean":"2024-09-21T08:54:46.406217+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:54:46.406217+0000","last_undegraded":"2024-09-21T08:54:46.406217+0000","last_fullsized":"2024-09-21T08:54:46.406217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183836+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:54:10.183836+0000","last_peered":"2024-09-21T08:54:10.183836+0000","last_clean":"2024-09-21T08:54:10.183836+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:54:10.183836+0000","last_undegraded":"2024-09-21T08:54:10.183836+0000","last_fullsized":"2024-09-21T08:54:10.183836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.870455+0000","last_change":"2024-09-21T08:55:24.870515+0000","last_active":"2024-09-21T08:55:24.870455+0000","last_peered":"2024-09-21T08:55:24.870455+0000","last_clean":"2024-09-21T08:55:24.870455+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:55:24.870455+0000","last_undegraded":"2024-09-21T08:55:24.870455+0000","last_fullsized":"2024-09-21T08:55:24.870455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.870353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:25.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181581+0000","last_change":"2024-09-21T08:51:38.137670+0000","last_active":"2024-09-21T08:54:09.181581+0000","last_peered":"2024-09-21T08:54:09.181581+0000","last_clean":"2024-09-21T08:54:09.181581+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:54:09.181581+0000","last_undegraded":"2024-09-21T08:54:09.181581+0000","last_fullsized":"2024-09-21T08:54:09.181581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.709457+0000","last_change":"2024-09-21T08:55:28.709517+0000","last_active":"2024-09-21T08:55:28.709457+0000","last_peered":"2024-09-21T08:55:28.709457+0000","last_clean":"2024-09-21T08:55:28.709457+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:55:28.709457+0000","last_undegraded":"2024-09-21T08:55:28.709457+0000","last_fullsized":"2024-09-21T08:55:28.709457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.709347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:36.913750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.776513+0000","last_change":"2024-09-21T08:55:34.776552+0000","last_active":"2024-09-21T08:55:34.776513+0000","last_peered":"2024-09-21T08:55:34.776513+0000","last_clean":"2024-09-21T08:55:34.776513+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:55:34.776513+0000","last_undegraded":"2024-09-21T08:55:34.776513+0000","last_fullsized":"2024-09-21T08:55:34.776513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.776428+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:14.086199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.302630+0000","last_change":"2024-09-21T08:55:33.302654+0000","last_active":"2024-09-21T08:55:33.302630+0000","last_peered":"2024-09-21T08:55:33.302630+0000","last_clean":"2024-09-21T08:55:33.302630+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:55:33.302630+0000","last_undegraded":"2024-09-21T08:55:33.302630+0000","last_fullsized":"2024-09-21T08:55:33.302630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.302523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:33.718305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.388837+0000","last_change":"2024-09-21T08:55:30.388861+0000","last_active":"2024-09-21T08:55:30.388837+0000","last_peered":"2024-09-21T08:55:30.388837+0000","last_clean":"2024-09-21T08:55:30.388837+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:55:30.388837+0000","last_undegraded":"2024-09-21T08:55:30.388837+0000","last_fullsized":"2024-09-21T08:55:30.388837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.388729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:08.353968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.912250+0000","last_change":"2024-09-21T08:55:21.912281+0000","last_active":"2024-09-21T08:55:21.912250+0000","last_peered":"2024-09-21T08:55:21.912250+0000","last_clean":"2024-09-21T08:55:21.912250+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:55:21.912250+0000","last_undegraded":"2024-09-21T08:55:21.912250+0000","last_fullsized":"2024-09-21T08:55:21.912250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.912160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:04.573712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.328948+0000","last_change":"2024-09-21T08:55:26.328976+0000","last_active":"2024-09-21T08:55:26.328948+0000","last_peered":"2024-09-21T08:55:26.328948+0000","last_clean":"2024-09-21T08:55:26.328948+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:55:26.328948+0000","last_undegraded":"2024-09-21T08:55:26.328948+0000","last_fullsized":"2024-09-21T08:55:26.328948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.328860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.318333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182597+0000","last_change":"2024-09-21T08:51:38.139269+0000","last_active":"2024-09-21T08:54:05.182597+0000","last_peered":"2024-09-21T08:54:05.182597+0000","last_clean":"2024-09-21T08:54:05.182597+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:54:05.182597+0000","last_undegraded":"2024-09-21T08:54:05.182597+0000","last_fullsized":"2024-09-21T08:54:05.182597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.583544+0000","last_change":"2024-09-21T08:51:40.130434+0000","last_active":"2024-09-21T08:54:46.583544+0000","last_peered":"2024-09-21T08:54:46.583544+0000","last_clean":"2024-09-21T08:54:46.583544+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:54:46.583544+0000","last_undegraded":"2024-09-21T08:54:46.583544+0000","last_fullsized":"2024-09-21T08:54:46.583544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182575+0000","last_change":"2024-09-21T08:51:38.133735+0000","last_active":"2024-09-21T08:54:05.182575+0000","last_peered":"2024-09-21T08:54:05.182575+0000","last_clean":"2024-09-21T08:54:05.182575+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:54:05.182575+0000","last_undegraded":"2024-09-21T08:54:05.182575+0000","last_fullsized":"2024-09-21T08:54:05.182575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.724429+0000","last_change":"2024-09-21T08:55:32.724453+0000","last_active":"2024-09-21T08:55:32.724429+0000","last_peered":"2024-09-21T08:55:32.724429+0000","last_clean":"2024-09-21T08:55:32.724429+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:55:32.724429+0000","last_undegraded":"2024-09-21T08:55:32.724429+0000","last_fullsized":"2024-09-21T08:55:32.724429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.724341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:18.603732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180840+0000","last_change":"2024-09-21T08:51:38.137460+0000","last_active":"2024-09-21T08:54:04.180840+0000","last_peered":"2024-09-21T08:54:04.180840+0000","last_clean":"2024-09-21T08:54:04.180840+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:54:04.180840+0000","last_undegraded":"2024-09-21T08:54:04.180840+0000","last_fullsized":"2024-09-21T08:54:04.180840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.328611+0000","last_change":"2024-09-21T08:55:34.328639+0000","last_active":"2024-09-21T08:55:34.328611+0000","last_peered":"2024-09-21T08:55:34.328611+0000","last_clean":"2024-09-21T08:55:34.328611+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:55:34.328611+0000","last_undegraded":"2024-09-21T08:55:34.328611+0000","last_fullsized":"2024-09-21T08:55:34.328611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.328524+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:28.403133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182261+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:54:00.182261+0000","last_peered":"2024-09-21T08:54:00.182261+0000","last_clean":"2024-09-21T08:54:00.182261+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:54:00.182261+0000","last_undegraded":"2024-09-21T08:54:00.182261+0000","last_fullsized":"2024-09-21T08:54:00.182261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.617459+0000","last_change":"2024-09-21T08:51:48.160972+0000","last_active":"2024-09-21T08:54:46.617459+0000","last_peered":"2024-09-21T08:54:46.617459+0000","last_clean":"2024-09-21T08:54:46.617459+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:54:46.617459+0000","last_undegraded":"2024-09-21T08:54:46.617459+0000","last_fullsized":"2024-09-21T08:54:46.617459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182340+0000","last_change":"2024-09-21T08:51:40.132470+0000","last_active":"2024-09-21T08:54:00.182340+0000","last_peered":"2024-09-21T08:54:00.182340+0000","last_clean":"2024-09-21T08:54:00.182340+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:54:00.182340+0000","last_undegraded":"2024-09-21T08:54:00.182340+0000","last_fullsized":"2024-09-21T08:54:00.182340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182291+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:54:00.182291+0000","last_peered":"2024-09-21T08:54:00.182291+0000","last_clean":"2024-09-21T08:54:00.182291+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:54:00.182291+0000","last_undegraded":"2024-09-21T08:54:00.182291+0000","last_fullsized":"2024-09-21T08:54:00.182291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.798158+0000","last_change":"2024-09-21T08:54:59.798211+0000","last_active":"2024-09-21T08:54:59.798158+0000","last_peered":"2024-09-21T08:54:59.798158+0000","last_clean":"2024-09-21T08:54:59.798158+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:54:59.798158+0000","last_undegraded":"2024-09-21T08:54:59.798158+0000","last_fullsized":"2024-09-21T08:54:59.798158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.798019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:26.891797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'42","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.790948+0000","last_change":"2024-09-21T08:55:25.791003+0000","last_active":"2024-09-21T08:55:25.790948+0000","last_peered":"2024-09-21T08:55:25.790948+0000","last_clean":"2024-09-21T08:55:25.790948+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:55:25.790948+0000","last_undegraded":"2024-09-21T08:55:25.790948+0000","last_fullsized":"2024-09-21T08:55:25.790948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'42","last_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_deep_scrub":"36'42","last_deep_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.790847+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:12.540524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.311370+0000","last_change":"2024-09-21T08:55:08.311412+0000","last_active":"2024-09-21T08:55:08.311370+0000","last_peered":"2024-09-21T08:55:08.311370+0000","last_clean":"2024-09-21T08:55:08.311370+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:55:08.311370+0000","last_undegraded":"2024-09-21T08:55:08.311370+0000","last_fullsized":"2024-09-21T08:55:08.311370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.311270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:32.145710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184062+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:54:15.184062+0000","last_peered":"2024-09-21T08:54:15.184062+0000","last_clean":"2024-09-21T08:54:15.184062+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:54:15.184062+0000","last_undegraded":"2024-09-21T08:54:15.184062+0000","last_fullsized":"2024-09-21T08:54:15.184062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541471+0000","last_change":"2024-09-21T08:51:40.132679+0000","last_active":"2024-09-21T08:54:46.541471+0000","last_peered":"2024-09-21T08:54:46.541471+0000","last_clean":"2024-09-21T08:54:46.541471+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:54:46.541471+0000","last_undegraded":"2024-09-21T08:54:46.541471+0000","last_fullsized":"2024-09-21T08:54:46.541471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202533+0000","last_change":"2024-09-21T08:51:38.135280+0000","last_active":"2024-09-21T08:54:53.202533+0000","last_peered":"2024-09-21T08:54:53.202533+0000","last_clean":"2024-09-21T08:54:53.202533+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:54:53.202533+0000","last_undegraded":"2024-09-21T08:54:53.202533+0000","last_fullsized":"2024-09-21T08:54:53.202533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.788065+0000","last_change":"2024-09-21T08:55:13.788099+0000","last_active":"2024-09-21T08:55:13.788065+0000","last_peered":"2024-09-21T08:55:13.788065+0000","last_clean":"2024-09-21T08:55:13.788065+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:55:13.788065+0000","last_undegraded":"2024-09-21T08:55:13.788065+0000","last_fullsized":"2024-09-21T08:55:13.788065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.787969+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:42.737974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.271126+0000","last_change":"2024-09-21T08:55:03.271154+0000","last_active":"2024-09-21T08:55:03.271126+0000","last_peered":"2024-09-21T08:55:03.271126+0000","last_clean":"2024-09-21T08:55:03.271126+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:55:03.271126+0000","last_undegraded":"2024-09-21T08:55:03.271126+0000","last_fullsized":"2024-09-21T08:55:03.271126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.271042+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:48.059788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.283436+0000","last_change":"2024-09-21T08:55:16.283461+0000","last_active":"2024-09-21T08:55:16.283436+0000","last_peered":"2024-09-21T08:55:16.283436+0000","last_clean":"2024-09-21T08:55:16.283436+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:55:16.283436+0000","last_undegraded":"2024-09-21T08:55:16.283436+0000","last_fullsized":"2024-09-21T08:55:16.283436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:56.311040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.803836+0000","last_change":"2024-09-21T08:55:23.803862+0000","last_active":"2024-09-21T08:55:23.803836+0000","last_peered":"2024-09-21T08:55:23.803836+0000","last_clean":"2024-09-21T08:55:23.803836+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:55:23.803836+0000","last_undegraded":"2024-09-21T08:55:23.803836+0000","last_fullsized":"2024-09-21T08:55:23.803836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.803738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:17.468439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541456+0000","last_change":"2024-09-21T08:51:40.134284+0000","last_active":"2024-09-21T08:54:46.541456+0000","last_peered":"2024-09-21T08:54:46.541456+0000","last_clean":"2024-09-21T08:54:46.541456+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:54:46.541456+0000","last_undegraded":"2024-09-21T08:54:46.541456+0000","last_fullsized":"2024-09-21T08:54:46.541456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182223+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:54:00.182223+0000","last_peered":"2024-09-21T08:54:00.182223+0000","last_clean":"2024-09-21T08:54:00.182223+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:54:00.182223+0000","last_undegraded":"2024-09-21T08:54:00.182223+0000","last_fullsized":"2024-09-21T08:54:00.182223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.766522+0000","last_change":"2024-09-21T08:55:16.766565+0000","last_active":"2024-09-21T08:55:16.766522+0000","last_peered":"2024-09-21T08:55:16.766522+0000","last_clean":"2024-09-21T08:55:16.766522+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:55:16.766522+0000","last_undegraded":"2024-09-21T08:55:16.766522+0000","last_fullsized":"2024-09-21T08:55:16.766522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.766426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.846397+0000","last_change":"2024-09-21T08:55:03.846476+0000","last_active":"2024-09-21T08:55:03.846397+0000","last_peered":"2024-09-21T08:55:03.846397+0000","last_clean":"2024-09-21T08:55:03.846397+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:55:03.846397+0000","last_undegraded":"2024-09-21T08:55:03.846397+0000","last_fullsized":"2024-09-21T08:55:03.846397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.846298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.204915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":397,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.800259+0000","last_change":"2024-09-21T08:55:24.800324+0000","last_active":"2024-09-21T08:55:24.800259+0000","last_peered":"2024-09-21T08:55:24.800259+0000","last_clean":"2024-09-21T08:55:24.800259+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:55:24.800259+0000","last_undegraded":"2024-09-21T08:55:24.800259+0000","last_fullsized":"2024-09-21T08:55:24.800259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.800122+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:26.312772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.184863+0000","last_change":"2024-09-21T08:51:48.155844+0000","last_active":"2024-09-21T08:54:20.184863+0000","last_peered":"2024-09-21T08:54:20.184863+0000","last_clean":"2024-09-21T08:54:20.184863+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:54:20.184863+0000","last_undegraded":"2024-09-21T08:54:20.184863+0000","last_fullsized":"2024-09-21T08:54:20.184863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319998+0000","last_change":"2024-09-21T08:51:40.136063+0000","last_active":"2024-09-21T08:54:46.319998+0000","last_peered":"2024-09-21T08:54:46.319998+0000","last_clean":"2024-09-21T08:54:46.319998+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:54:46.319998+0000","last_undegraded":"2024-09-21T08:54:46.319998+0000","last_fullsized":"2024-09-21T08:54:46.319998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181661+0000","last_change":"2024-09-21T08:51:38.130395+0000","last_active":"2024-09-21T08:54:00.181661+0000","last_peered":"2024-09-21T08:54:00.181661+0000","last_clean":"2024-09-21T08:54:00.181661+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:54:00.181661+0000","last_undegraded":"2024-09-21T08:54:00.181661+0000","last_fullsized":"2024-09-21T08:54:00.181661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.844294+0000","last_change":"2024-09-21T08:55:06.844317+0000","last_active":"2024-09-21T08:55:06.844294+0000","last_peered":"2024-09-21T08:55:06.844294+0000","last_clean":"2024-09-21T08:55:06.844294+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:55:06.844294+0000","last_undegraded":"2024-09-21T08:55:06.844294+0000","last_fullsized":"2024-09-21T08:55:06.844294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.844209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:21.913747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.875043+0000","last_change":"2024-09-21T08:55:01.875112+0000","last_active":"2024-09-21T08:55:01.875043+0000","last_peered":"2024-09-21T08:55:01.875043+0000","last_clean":"2024-09-21T08:55:01.875043+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:55:01.875043+0000","last_undegraded":"2024-09-21T08:55:01.875043+0000","last_fullsized":"2024-09-21T08:55:01.875043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.874944+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:51.653141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":412,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.728803+0000","last_change":"2024-09-21T08:54:59.728835+0000","last_active":"2024-09-21T08:54:59.728803+0000","last_peered":"2024-09-21T08:54:59.728803+0000","last_clean":"2024-09-21T08:54:59.728803+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:59.728803+0000","last_undegraded":"2024-09-21T08:54:59.728803+0000","last_fullsized":"2024-09-21T08:54:59.728803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.728698+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:59.656529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.761681+0000","last_change":"2024-09-21T08:55:17.761716+0000","last_active":"2024-09-21T08:55:17.761681+0000","last_peered":"2024-09-21T08:55:17.761681+0000","last_clean":"2024-09-21T08:55:17.761681+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:55:17.761681+0000","last_undegraded":"2024-09-21T08:55:17.761681+0000","last_fullsized":"2024-09-21T08:55:17.761681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.761576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:31.242840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181051+0000","last_change":"2024-09-21T08:51:38.144866+0000","last_active":"2024-09-21T08:53:55.181051+0000","last_peered":"2024-09-21T08:53:55.181051+0000","last_clean":"2024-09-21T08:53:55.181051+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:53:55.181051+0000","last_undegraded":"2024-09-21T08:53:55.181051+0000","last_fullsized":"2024-09-21T08:53:55.181051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.335766+0000","last_change":"2024-09-21T08:55:07.335805+0000","last_active":"2024-09-21T08:55:07.335766+0000","last_peered":"2024-09-21T08:55:07.335766+0000","last_clean":"2024-09-21T08:55:07.335766+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:55:07.335766+0000","last_undegraded":"2024-09-21T08:55:07.335766+0000","last_fullsized":"2024-09-21T08:55:07.335766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.335664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:12.617439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.848147+0000","last_change":"2024-09-21T08:55:05.848218+0000","last_active":"2024-09-21T08:55:05.848147+0000","last_peered":"2024-09-21T08:55:05.848147+0000","last_clean":"2024-09-21T08:55:05.848147+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:55:05.848147+0000","last_undegraded":"2024-09-21T08:55:05.848147+0000","last_fullsized":"2024-09-21T08:55:05.848147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.848037+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:50.214913+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.716703+0000","last_change":"2024-09-21T08:55:15.716764+0000","last_active":"2024-09-21T08:55:15.716703+0000","last_peered":"2024-09-21T08:55:15.716703+0000","last_clean":"2024-09-21T08:55:15.716703+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:55:15.716703+0000","last_undegraded":"2024-09-21T08:55:15.716703+0000","last_fullsized":"2024-09-21T08:55:15.716703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.716602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:42.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180919+0000","last_change":"2024-09-21T08:51:48.157120+0000","last_active":"2024-09-21T08:53:55.180919+0000","last_peered":"2024-09-21T08:53:55.180919+0000","last_clean":"2024-09-21T08:53:55.180919+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:53:55.180919+0000","last_undegraded":"2024-09-21T08:53:55.180919+0000","last_fullsized":"2024-09-21T08:53:55.180919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.368252+0000","last_change":"2024-09-21T08:55:29.368278+0000","last_active":"2024-09-21T08:55:29.368252+0000","last_peered":"2024-09-21T08:55:29.368252+0000","last_clean":"2024-09-21T08:55:29.368252+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:55:29.368252+0000","last_undegraded":"2024-09-21T08:55:29.368252+0000","last_fullsized":"2024-09-21T08:55:29.368252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.368154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:39.906265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.732766+0000","last_change":"2024-09-21T08:55:29.732793+0000","last_active":"2024-09-21T08:55:29.732766+0000","last_peered":"2024-09-21T08:55:29.732766+0000","last_clean":"2024-09-21T08:55:29.732766+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:55:29.732766+0000","last_undegraded":"2024-09-21T08:55:29.732766+0000","last_fullsized":"2024-09-21T08:55:29.732766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:16.861355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.780399+0000","last_change":"2024-09-21T08:55:22.780422+0000","last_active":"2024-09-21T08:55:22.780399+0000","last_peered":"2024-09-21T08:55:22.780399+0000","last_clean":"2024-09-21T08:55:22.780399+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:55:22.780399+0000","last_undegraded":"2024-09-21T08:55:22.780399+0000","last_fullsized":"2024-09-21T08:55:22.780399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.780305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:24.779384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.783317+0000","last_change":"2024-09-21T08:55:02.783357+0000","last_active":"2024-09-21T08:55:02.783317+0000","last_peered":"2024-09-21T08:55:02.783317+0000","last_clean":"2024-09-21T08:55:02.783317+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:55:02.783317+0000","last_undegraded":"2024-09-21T08:55:02.783317+0000","last_fullsized":"2024-09-21T08:55:02.783317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.783222+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:51.818565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.753372+0000","last_change":"2024-09-21T08:54:58.753424+0000","last_active":"2024-09-21T08:54:58.753372+0000","last_peered":"2024-09-21T08:54:58.753372+0000","last_clean":"2024-09-21T08:54:58.753372+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:54:58.753372+0000","last_undegraded":"2024-09-21T08:54:58.753372+0000","last_fullsized":"2024-09-21T08:54:58.753372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.753265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:03.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180995+0000","last_change":"2024-09-21T08:51:48.157880+0000","last_active":"2024-09-21T08:53:55.180995+0000","last_peered":"2024-09-21T08:53:55.180995+0000","last_clean":"2024-09-21T08:53:55.180995+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:53:55.180995+0000","last_undegraded":"2024-09-21T08:53:55.180995+0000","last_fullsized":"2024-09-21T08:53:55.180995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319668+0000","last_change":"2024-09-21T08:51:40.143895+0000","last_active":"2024-09-21T08:54:46.319668+0000","last_peered":"2024-09-21T08:54:46.319668+0000","last_clean":"2024-09-21T08:54:46.319668+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:54:46.319668+0000","last_undegraded":"2024-09-21T08:54:46.319668+0000","last_fullsized":"2024-09-21T08:54:46.319668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181518+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:53:55.181518+0000","last_peered":"2024-09-21T08:53:55.181518+0000","last_clean":"2024-09-21T08:53:55.181518+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:53:55.181518+0000","last_undegraded":"2024-09-21T08:53:55.181518+0000","last_fullsized":"2024-09-21T08:53:55.181518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.760338+0000","last_change":"2024-09-21T08:55:14.760365+0000","last_active":"2024-09-21T08:55:14.760338+0000","last_peered":"2024-09-21T08:55:14.760338+0000","last_clean":"2024-09-21T08:55:14.760338+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:55:14.760338+0000","last_undegraded":"2024-09-21T08:55:14.760338+0000","last_fullsized":"2024-09-21T08:55:14.760338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:36.121650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.804389+0000","last_change":"2024-09-21T08:55:08.804457+0000","last_active":"2024-09-21T08:55:08.804389+0000","last_peered":"2024-09-21T08:55:08.804389+0000","last_clean":"2024-09-21T08:55:08.804389+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:55:08.804389+0000","last_undegraded":"2024-09-21T08:55:08.804389+0000","last_fullsized":"2024-09-21T08:55:08.804389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.804253+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:28.647102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.784943+0000","last_change":"2024-09-21T08:54:57.784970+0000","last_active":"2024-09-21T08:54:57.784943+0000","last_peered":"2024-09-21T08:54:57.784943+0000","last_clean":"2024-09-21T08:54:57.784943+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:57.784943+0000","last_undegraded":"2024-09-21T08:54:57.784943+0000","last_fullsized":"2024-09-21T08:54:57.784943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.784865+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:42.573611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.180055+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:53:59.180055+0000","last_peered":"2024-09-21T08:53:59.180055+0000","last_clean":"2024-09-21T08:53:59.180055+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:53:59.180055+0000","last_undegraded":"2024-09-21T08:53:59.180055+0000","last_fullsized":"2024-09-21T08:53:59.180055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.924856+0000","last_change":"2024-09-21T08:55:20.924903+0000","last_active":"2024-09-21T08:55:20.924856+0000","last_peered":"2024-09-21T08:55:20.924856+0000","last_clean":"2024-09-21T08:55:20.924856+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:55:20.924856+0000","last_undegraded":"2024-09-21T08:55:20.924856+0000","last_fullsized":"2024-09-21T08:55:20.924856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.924750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:02.221123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181448+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:53:55.181448+0000","last_peered":"2024-09-21T08:53:55.181448+0000","last_clean":"2024-09-21T08:53:55.181448+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:53:55.181448+0000","last_undegraded":"2024-09-21T08:53:55.181448+0000","last_fullsized":"2024-09-21T08:53:55.181448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.782185+0000","last_change":"2024-09-21T08:55:20.782208+0000","last_active":"2024-09-21T08:55:20.782185+0000","last_peered":"2024-09-21T08:55:20.782185+0000","last_clean":"2024-09-21T08:55:20.782185+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:55:20.782185+0000","last_undegraded":"2024-09-21T08:55:20.782185+0000","last_fullsized":"2024-09-21T08:55:20.782185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.782093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:39.369522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.756307+0000","last_change":"2024-09-21T08:55:16.756347+0000","last_active":"2024-09-21T08:55:16.756307+0000","last_peered":"2024-09-21T08:55:16.756307+0000","last_clean":"2024-09-21T08:55:16.756307+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:55:16.756307+0000","last_undegraded":"2024-09-21T08:55:16.756307+0000","last_fullsized":"2024-09-21T08:55:16.756307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.756216+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:45.207448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.769611+0000","last_change":"2024-09-21T08:55:03.769638+0000","last_active":"2024-09-21T08:55:03.769611+0000","last_peered":"2024-09-21T08:55:03.769611+0000","last_clean":"2024-09-21T08:55:03.769611+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:55:03.769611+0000","last_undegraded":"2024-09-21T08:55:03.769611+0000","last_fullsized":"2024-09-21T08:55:03.769611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:37.381181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.698737+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.698737+0000","last_peered":"2024-09-21T08:54:46.698737+0000","last_clean":"2024-09-21T08:54:46.698737+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.698737+0000","last_undegraded":"2024-09-21T08:54:46.698737+0000","last_fullsized":"2024-09-21T08:54:46.698737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180964+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:53:55.180964+0000","last_peered":"2024-09-21T08:53:55.180964+0000","last_clean":"2024-09-21T08:53:55.180964+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:53:55.180964+0000","last_undegraded":"2024-09-21T08:53:55.180964+0000","last_fullsized":"2024-09-21T08:53:55.180964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:54.179249+0000","last_change":"2024-09-21T08:51:38.125155+0000","last_active":"2024-09-21T08:53:54.179249+0000","last_peered":"2024-09-21T08:53:54.179249+0000","last_clean":"2024-09-21T08:53:54.179249+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:53:54.179249+0000","last_undegraded":"2024-09-21T08:53:54.179249+0000","last_fullsized":"2024-09-21T08:53:54.179249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.770302+0000","last_change":"2024-09-21T08:55:10.770379+0000","last_active":"2024-09-21T08:55:10.770302+0000","last_peered":"2024-09-21T08:55:10.770302+0000","last_clean":"2024-09-21T08:55:10.770302+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:55:10.770302+0000","last_undegraded":"2024-09-21T08:55:10.770302+0000","last_fullsized":"2024-09-21T08:55:10.770302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.770161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:07.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.337520+0000","last_change":"2024-09-21T08:55:05.337560+0000","last_active":"2024-09-21T08:55:05.337520+0000","last_peered":"2024-09-21T08:55:05.337520+0000","last_clean":"2024-09-21T08:55:05.337520+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:55:05.337520+0000","last_undegraded":"2024-09-21T08:55:05.337520+0000","last_fullsized":"2024-09-21T08:55:05.337520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.337433+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:14.239468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.774148+0000","last_change":"2024-09-21T08:55:21.774171+0000","last_active":"2024-09-21T08:55:21.774148+0000","last_peered":"2024-09-21T08:55:21.774148+0000","last_clean":"2024-09-21T08:55:21.774148+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:55:21.774148+0000","last_undegraded":"2024-09-21T08:55:21.774148+0000","last_fullsized":"2024-09-21T08:55:21.774148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.774029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:30:48.998694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'6","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.819778+0000","last_change":"2024-09-21T08:55:32.819828+0000","last_active":"2024-09-21T08:55:32.819778+0000","last_peered":"2024-09-21T08:55:32.819778+0000","last_clean":"2024-09-21T08:55:32.819778+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:55:32.819778+0000","last_undegraded":"2024-09-21T08:55:32.819778+0000","last_fullsized":"2024-09-21T08:55:32.819778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.819677+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:40.054203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.765704+0000","last_change":"2024-09-21T08:55:14.765733+0000","last_active":"2024-09-21T08:55:14.765704+0000","last_peered":"2024-09-21T08:55:14.765704+0000","last_clean":"2024-09-21T08:55:14.765704+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:55:14.765704+0000","last_undegraded":"2024-09-21T08:55:14.765704+0000","last_fullsized":"2024-09-21T08:55:14.765704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.765635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:45.731851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180658+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:53:50.180658+0000","last_peered":"2024-09-21T08:53:50.180658+0000","last_clean":"2024-09-21T08:53:50.180658+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:53:50.180658+0000","last_undegraded":"2024-09-21T08:53:50.180658+0000","last_fullsized":"2024-09-21T08:53:50.180658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.811875+0000","last_change":"2024-09-21T08:55:18.811916+0000","last_active":"2024-09-21T08:55:18.811875+0000","last_peered":"2024-09-21T08:55:18.811875+0000","last_clean":"2024-09-21T08:55:18.811875+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:55:18.811875+0000","last_undegraded":"2024-09-21T08:55:18.811875+0000","last_fullsized":"2024-09-21T08:55:18.811875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.811773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:45.894080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.869787+0000","last_change":"2024-09-21T08:55:06.869844+0000","last_active":"2024-09-21T08:55:06.869787+0000","last_peered":"2024-09-21T08:55:06.869787+0000","last_clean":"2024-09-21T08:55:06.869787+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:55:06.869787+0000","last_undegraded":"2024-09-21T08:55:06.869787+0000","last_fullsized":"2024-09-21T08:55:06.869787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.869692+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:33.235003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.047021+0000","last_change":"2024-09-21T08:54:57.047051+0000","last_active":"2024-09-21T08:54:57.047021+0000","last_peered":"2024-09-21T08:54:57.047021+0000","last_clean":"2024-09-21T08:54:57.047021+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:57.047021+0000","last_undegraded":"2024-09-21T08:54:57.047021+0000","last_fullsized":"2024-09-21T08:54:57.047021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.046922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:17.104050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.661551+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:54:46.661551+0000","last_peered":"2024-09-21T08:54:46.661551+0000","last_clean":"2024-09-21T08:54:46.661551+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:54:46.661551+0000","last_undegraded":"2024-09-21T08:54:46.661551+0000","last_fullsized":"2024-09-21T08:54:46.661551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.795398+0000","last_change":"2024-09-21T08:55:26.795434+0000","last_active":"2024-09-21T08:55:26.795398+0000","last_peered":"2024-09-21T08:55:26.795398+0000","last_clean":"2024-09-21T08:55:26.795398+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:55:26.795398+0000","last_undegraded":"2024-09-21T08:55:26.795398+0000","last_fullsized":"2024-09-21T08:55:26.795398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.795295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:53.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180609+0000","last_change":"2024-09-21T08:51:38.151368+0000","last_active":"2024-09-21T08:53:50.180609+0000","last_peered":"2024-09-21T08:53:50.180609+0000","last_clean":"2024-09-21T08:53:50.180609+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:53:50.180609+0000","last_undegraded":"2024-09-21T08:53:50.180609+0000","last_fullsized":"2024-09-21T08:53:50.180609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":620,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.275886+0000","last_change":"2024-09-21T08:55:13.275924+0000","last_active":"2024-09-21T08:55:13.275886+0000","last_peered":"2024-09-21T08:55:13.275886+0000","last_clean":"2024-09-21T08:55:13.275886+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:55:13.275886+0000","last_undegraded":"2024-09-21T08:55:13.275886+0000","last_fullsized":"2024-09-21T08:55:13.275886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.275785+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.674831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.785272+0000","last_change":"2024-09-21T08:55:00.785316+0000","last_active":"2024-09-21T08:55:00.785272+0000","last_peered":"2024-09-21T08:55:00.785272+0000","last_clean":"2024-09-21T08:55:00.785272+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:55:00.785272+0000","last_undegraded":"2024-09-21T08:55:00.785272+0000","last_fullsized":"2024-09-21T08:55:00.785272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.785184+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:02.902127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.291164+0000","last_change":"2024-09-21T08:54:57.291227+0000","last_active":"2024-09-21T08:54:57.291164+0000","last_peered":"2024-09-21T08:54:57.291164+0000","last_clean":"2024-09-21T08:54:57.291164+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:57.291164+0000","last_undegraded":"2024-09-21T08:54:57.291164+0000","last_fullsized":"2024-09-21T08:54:57.291164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.291058+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:31.954176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180814+0000","last_change":"2024-09-21T08:51:48.155101+0000","last_active":"2024-09-21T08:53:55.180814+0000","last_peered":"2024-09-21T08:53:55.180814+0000","last_clean":"2024-09-21T08:53:55.180814+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:53:55.180814+0000","last_undegraded":"2024-09-21T08:53:55.180814+0000","last_fullsized":"2024-09-21T08:53:55.180814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.248380+0000","last_change":"2024-09-21T08:55:18.248434+0000","last_active":"2024-09-21T08:55:18.248380+0000","last_peered":"2024-09-21T08:55:18.248380+0000","last_clean":"2024-09-21T08:55:18.248380+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:55:18.248380+0000","last_undegraded":"2024-09-21T08:55:18.248380+0000","last_fullsized":"2024-09-21T08:55:18.248380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.248234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.175858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.520779+0000","last_change":"2024-09-21T08:51:38.146003+0000","last_active":"2024-09-21T08:54:46.520779+0000","last_peered":"2024-09-21T08:54:46.520779+0000","last_clean":"2024-09-21T08:54:46.520779+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:54:46.520779+0000","last_undegraded":"2024-09-21T08:54:46.520779+0000","last_fullsized":"2024-09-21T08:54:46.520779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.789003+0000","last_change":"2024-09-21T08:54:58.789049+0000","last_active":"2024-09-21T08:54:58.789003+0000","last_peered":"2024-09-21T08:54:58.789003+0000","last_clean":"2024-09-21T08:54:58.789003+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:54:58.789003+0000","last_undegraded":"2024-09-21T08:54:58.789003+0000","last_fullsized":"2024-09-21T08:54:58.789003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.788878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:55.506296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.233411+0000","last_change":"2024-09-21T08:55:02.233457+0000","last_active":"2024-09-21T08:55:02.233411+0000","last_peered":"2024-09-21T08:55:02.233411+0000","last_clean":"2024-09-21T08:55:02.233411+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:55:02.233411+0000","last_undegraded":"2024-09-21T08:55:02.233411+0000","last_fullsized":"2024-09-21T08:55:02.233411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.233330+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:49.289271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.914245+0000","last_change":"2024-09-21T08:55:00.914269+0000","last_active":"2024-09-21T08:55:00.914245+0000","last_peered":"2024-09-21T08:55:00.914245+0000","last_clean":"2024-09-21T08:55:00.914245+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:55:00.914245+0000","last_undegraded":"2024-09-21T08:55:00.914245+0000","last_fullsized":"2024-09-21T08:55:00.914245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.914158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:41.840956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.415167+0000","last_change":"2024-09-21T08:55:24.415222+0000","last_active":"2024-09-21T08:55:24.415167+0000","last_peered":"2024-09-21T08:55:24.415167+0000","last_clean":"2024-09-21T08:55:24.415167+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:55:24.415167+0000","last_undegraded":"2024-09-21T08:55:24.415167+0000","last_fullsized":"2024-09-21T08:55:24.415167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.415062+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.497368+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.745563+0000","last_change":"2024-09-21T08:55:15.745614+0000","last_active":"2024-09-21T08:55:15.745563+0000","last_peered":"2024-09-21T08:55:15.745563+0000","last_clean":"2024-09-21T08:55:15.745563+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:55:15.745563+0000","last_undegraded":"2024-09-21T08:55:15.745563+0000","last_fullsized":"2024-09-21T08:55:15.745563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.745464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:56.608749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":209,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.565517+0000","last_change":"2024-09-21T08:51:23.340925+0000","last_active":"2024-09-21T08:54:56.565517+0000","last_peered":"2024-09-21T08:54:56.565517+0000","last_clean":"2024-09-21T08:54:56.565517+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:54:56.565517+0000","last_undegraded":"2024-09-21T08:54:56.565517+0000","last_fullsized":"2024-09-21T08:54:56.565517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:21.493390+0000","last_clean_scrub_stamp":"2024-09-21T08:51:21.493390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178620+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:53:35.178620+0000","last_peered":"2024-09-21T08:53:35.178620+0000","last_clean":"2024-09-21T08:53:35.178620+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:53:35.178620+0000","last_undegraded":"2024-09-21T08:53:35.178620+0000","last_fullsized":"2024-09-21T08:53:35.178620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.200398+0000","last_change":"2024-09-21T08:51:38.151599+0000","last_active":"2024-09-21T08:54:53.200398+0000","last_peered":"2024-09-21T08:54:53.200398+0000","last_clean":"2024-09-21T08:54:53.200398+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:54:53.200398+0000","last_undegraded":"2024-09-21T08:54:53.200398+0000","last_fullsized":"2024-09-21T08:54:53.200398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.277195+0000","last_change":"2024-09-21T08:55:14.277221+0000","last_active":"2024-09-21T08:55:14.277195+0000","last_peered":"2024-09-21T08:55:14.277195+0000","last_clean":"2024-09-21T08:55:14.277195+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:55:14.277195+0000","last_undegraded":"2024-09-21T08:55:14.277195+0000","last_fullsized":"2024-09-21T08:55:14.277195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.277103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:39.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'92","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.791486+0000","last_change":"2024-09-21T08:55:26.791546+0000","last_active":"2024-09-21T08:55:26.791486+0000","last_peered":"2024-09-21T08:55:26.791486+0000","last_clean":"2024-09-21T08:55:26.791486+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:55:26.791486+0000","last_undegraded":"2024-09-21T08:55:26.791486+0000","last_fullsized":"2024-09-21T08:55:26.791486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.791383+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:05.355379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.764985+0000","last_change":"2024-09-21T08:55:02.765010+0000","last_active":"2024-09-21T08:55:02.764985+0000","last_peered":"2024-09-21T08:55:02.764985+0000","last_clean":"2024-09-21T08:55:02.764985+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:55:02.764985+0000","last_undegraded":"2024-09-21T08:55:02.764985+0000","last_fullsized":"2024-09-21T08:55:02.764985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.764887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:26.749713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.857825+0000","last_change":"2024-09-21T08:55:16.857880+0000","last_active":"2024-09-21T08:55:16.857825+0000","last_peered":"2024-09-21T08:55:16.857825+0000","last_clean":"2024-09-21T08:55:16.857825+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:55:16.857825+0000","last_undegraded":"2024-09-21T08:55:16.857825+0000","last_fullsized":"2024-09-21T08:55:16.857825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.857712+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:32.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180755+0000","last_change":"2024-09-21T08:51:40.131994+0000","last_active":"2024-09-21T08:53:50.180755+0000","last_peered":"2024-09-21T08:53:50.180755+0000","last_clean":"2024-09-21T08:53:50.180755+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:53:50.180755+0000","last_undegraded":"2024-09-21T08:53:50.180755+0000","last_fullsized":"2024-09-21T08:53:50.180755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446747+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:54:57.446747+0000","last_peered":"2024-09-21T08:54:57.446747+0000","last_clean":"2024-09-21T08:54:57.446747+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:54:57.446747+0000","last_undegraded":"2024-09-21T08:54:57.446747+0000","last_fullsized":"2024-09-21T08:54:57.446747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177546+0000","last_change":"2024-09-21T08:51:38.137382+0000","last_active":"2024-09-21T08:53:44.177546+0000","last_peered":"2024-09-21T08:53:44.177546+0000","last_clean":"2024-09-21T08:53:44.177546+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:53:44.177546+0000","last_undegraded":"2024-09-21T08:53:44.177546+0000","last_fullsized":"2024-09-21T08:53:44.177546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181617+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:53:55.181617+0000","last_peered":"2024-09-21T08:53:55.181617+0000","last_clean":"2024-09-21T08:53:55.181617+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:53:55.181617+0000","last_undegraded":"2024-09-21T08:53:55.181617+0000","last_fullsized":"2024-09-21T08:53:55.181617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.257895+0000","last_change":"2024-09-21T08:54:59.257947+0000","last_active":"2024-09-21T08:54:59.257895+0000","last_peered":"2024-09-21T08:54:59.257895+0000","last_clean":"2024-09-21T08:54:59.257895+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:59.257895+0000","last_undegraded":"2024-09-21T08:54:59.257895+0000","last_fullsized":"2024-09-21T08:54:59.257895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.257796+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:55.128267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.776033+0000","last_change":"2024-09-21T08:55:19.776067+0000","last_active":"2024-09-21T08:55:19.776033+0000","last_peered":"2024-09-21T08:55:19.776033+0000","last_clean":"2024-09-21T08:55:19.776033+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:55:19.776033+0000","last_undegraded":"2024-09-21T08:55:19.776033+0000","last_fullsized":"2024-09-21T08:55:19.776033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.775947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:14.023176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.181790+0000","last_change":"2024-09-21T08:51:48.156409+0000","last_active":"2024-09-21T08:54:00.181790+0000","last_peered":"2024-09-21T08:54:00.181790+0000","last_clean":"2024-09-21T08:54:00.181790+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:54:00.181790+0000","last_undegraded":"2024-09-21T08:54:00.181790+0000","last_fullsized":"2024-09-21T08:54:00.181790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.541877+0000","last_change":"2024-09-21T08:51:40.136075+0000","last_active":"2024-09-21T08:54:46.541877+0000","last_peered":"2024-09-21T08:54:46.541877+0000","last_clean":"2024-09-21T08:54:46.541877+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:54:46.541877+0000","last_undegraded":"2024-09-21T08:54:46.541877+0000","last_fullsized":"2024-09-21T08:54:46.541877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.753021+0000","last_change":"2024-09-21T08:55:34.753073+0000","last_active":"2024-09-21T08:55:34.753021+0000","last_peered":"2024-09-21T08:55:34.753021+0000","last_clean":"2024-09-21T08:55:34.753021+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:55:34.753021+0000","last_undegraded":"2024-09-21T08:55:34.753021+0000","last_fullsized":"2024-09-21T08:55:34.753021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.752903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.670098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.714315+0000","last_change":"2024-09-21T08:55:32.714370+0000","last_active":"2024-09-21T08:55:32.714315+0000","last_peered":"2024-09-21T08:55:32.714315+0000","last_clean":"2024-09-21T08:55:32.714315+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:55:32.714315+0000","last_undegraded":"2024-09-21T08:55:32.714315+0000","last_fullsized":"2024-09-21T08:55:32.714315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.714206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.680422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180969+0000","last_change":"2024-09-21T08:52:14.244866+0000","last_active":"2024-09-21T08:53:55.180969+0000","last_peered":"2024-09-21T08:53:55.180969+0000","last_clean":"2024-09-21T08:53:55.180969+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:53:55.180969+0000","last_undegraded":"2024-09-21T08:53:55.180969+0000","last_fullsized":"2024-09-21T08:53:55.180969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.818854+0000","last_change":"2024-09-21T08:55:09.818896+0000","last_active":"2024-09-21T08:55:09.818854+0000","last_peered":"2024-09-21T08:55:09.818854+0000","last_clean":"2024-09-21T08:55:09.818854+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:55:09.818854+0000","last_undegraded":"2024-09-21T08:55:09.818854+0000","last_fullsized":"2024-09-21T08:55:09.818854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.818766+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:10.946408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.758952+0000","last_change":"2024-09-21T08:55:01.758991+0000","last_active":"2024-09-21T08:55:01.758952+0000","last_peered":"2024-09-21T08:55:01.758952+0000","last_clean":"2024-09-21T08:55:01.758952+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:55:01.758952+0000","last_undegraded":"2024-09-21T08:55:01.758952+0000","last_fullsized":"2024-09-21T08:55:01.758952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.758844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:27.038728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.183092+0000","last_change":"2024-09-21T08:51:48.162704+0000","last_active":"2024-09-21T08:54:05.183092+0000","last_peered":"2024-09-21T08:54:05.183092+0000","last_clean":"2024-09-21T08:54:05.183092+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:54:05.183092+0000","last_undegraded":"2024-09-21T08:54:05.183092+0000","last_fullsized":"2024-09-21T08:54:05.183092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.735636+0000","last_change":"2024-09-21T08:55:25.735665+0000","last_active":"2024-09-21T08:55:25.735636+0000","last_peered":"2024-09-21T08:55:25.735636+0000","last_clean":"2024-09-21T08:55:25.735636+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:55:25.735636+0000","last_undegraded":"2024-09-21T08:55:25.735636+0000","last_fullsized":"2024-09-21T08:55:25.735636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.735532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:16.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178574+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:53:35.178574+0000","last_peered":"2024-09-21T08:53:35.178574+0000","last_clean":"2024-09-21T08:53:35.178574+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:53:35.178574+0000","last_undegraded":"2024-09-21T08:53:35.178574+0000","last_fullsized":"2024-09-21T08:53:35.178574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179086+0000","last_change":"2024-09-21T08:51:38.144874+0000","last_active":"2024-09-21T08:53:45.179086+0000","last_peered":"2024-09-21T08:53:45.179086+0000","last_clean":"2024-09-21T08:53:45.179086+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:53:45.179086+0000","last_undegraded":"2024-09-21T08:53:45.179086+0000","last_fullsized":"2024-09-21T08:53:45.179086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.772814+0000","last_change":"2024-09-21T08:55:12.772851+0000","last_active":"2024-09-21T08:55:12.772814+0000","last_peered":"2024-09-21T08:55:12.772814+0000","last_clean":"2024-09-21T08:55:12.772814+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:55:12.772814+0000","last_undegraded":"2024-09-21T08:55:12.772814+0000","last_fullsized":"2024-09-21T08:55:12.772814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.772717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:25.700341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.753243+0000","last_change":"2024-09-21T08:54:57.753327+0000","last_active":"2024-09-21T08:54:57.753243+0000","last_peered":"2024-09-21T08:54:57.753243+0000","last_clean":"2024-09-21T08:54:57.753243+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:57.753243+0000","last_undegraded":"2024-09-21T08:54:57.753243+0000","last_fullsized":"2024-09-21T08:54:57.753243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.753140+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:11.199581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.789663+0000","last_change":"2024-09-21T08:55:22.789686+0000","last_active":"2024-09-21T08:55:22.789663+0000","last_peered":"2024-09-21T08:55:22.789663+0000","last_clean":"2024-09-21T08:55:22.789663+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:55:22.789663+0000","last_undegraded":"2024-09-21T08:55:22.789663+0000","last_fullsized":"2024-09-21T08:55:22.789663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.789579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:47.777856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.606666+0000","last_change":"2024-09-21T08:51:48.161011+0000","last_active":"2024-09-21T08:54:46.606666+0000","last_peered":"2024-09-21T08:54:46.606666+0000","last_clean":"2024-09-21T08:54:46.606666+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:54:46.606666+0000","last_undegraded":"2024-09-21T08:54:46.606666+0000","last_fullsized":"2024-09-21T08:54:46.606666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.328489+0000","last_change":"2024-09-21T08:55:21.328523+0000","last_active":"2024-09-21T08:55:21.328489+0000","last_peered":"2024-09-21T08:55:21.328489+0000","last_clean":"2024-09-21T08:55:21.328489+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:55:21.328489+0000","last_undegraded":"2024-09-21T08:55:21.328489+0000","last_fullsized":"2024-09-21T08:55:21.328489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.328401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:48.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.738137+0000","last_change":"2024-09-21T08:55:31.738169+0000","last_active":"2024-09-21T08:55:31.738137+0000","last_peered":"2024-09-21T08:55:31.738137+0000","last_clean":"2024-09-21T08:55:31.738137+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:55:31.738137+0000","last_undegraded":"2024-09-21T08:55:31.738137+0000","last_fullsized":"2024-09-21T08:55:31.738137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.738045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:13.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:34.176333+0000","last_change":"2024-09-21T08:51:28.519668+0000","last_active":"2024-09-21T08:53:34.176333+0000","last_peered":"2024-09-21T08:53:34.176333+0000","last_clean":"2024-09-21T08:53:34.176333+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:53:34.176333+0000","last_undegraded":"2024-09-21T08:53:34.176333+0000","last_fullsized":"2024-09-21T08:53:34.176333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.769285+0000","last_change":"2024-09-21T08:55:17.769332+0000","last_active":"2024-09-21T08:55:17.769285+0000","last_peered":"2024-09-21T08:55:17.769285+0000","last_clean":"2024-09-21T08:55:17.769285+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:55:17.769285+0000","last_undegraded":"2024-09-21T08:55:17.769285+0000","last_fullsized":"2024-09-21T08:55:17.769285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.769154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:19.212681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.852327+0000","last_change":"2024-09-21T08:55:05.852373+0000","last_active":"2024-09-21T08:55:05.852327+0000","last_peered":"2024-09-21T08:55:05.852327+0000","last_clean":"2024-09-21T08:55:05.852327+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:55:05.852327+0000","last_undegraded":"2024-09-21T08:55:05.852327+0000","last_fullsized":"2024-09-21T08:55:05.852327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.852239+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.553041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.982915+0000","last_change":"2024-09-21T08:54:58.982940+0000","last_active":"2024-09-21T08:54:58.982915+0000","last_peered":"2024-09-21T08:54:58.982915+0000","last_clean":"2024-09-21T08:54:58.982915+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:54:58.982915+0000","last_undegraded":"2024-09-21T08:54:58.982915+0000","last_fullsized":"2024-09-21T08:54:58.982915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.982822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:26.322430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180896+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:54:04.180896+0000","last_peered":"2024-09-21T08:54:04.180896+0000","last_clean":"2024-09-21T08:54:04.180896+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:54:04.180896+0000","last_undegraded":"2024-09-21T08:54:04.180896+0000","last_fullsized":"2024-09-21T08:54:04.180896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.353640+0000","last_change":"2024-09-21T08:55:27.353664+0000","last_active":"2024-09-21T08:55:27.353640+0000","last_peered":"2024-09-21T08:55:27.353640+0000","last_clean":"2024-09-21T08:55:27.353640+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:55:27.353640+0000","last_undegraded":"2024-09-21T08:55:27.353640+0000","last_fullsized":"2024-09-21T08:55:27.353640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.353550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:16.388892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177661+0000","last_change":"2024-09-21T08:51:38.133075+0000","last_active":"2024-09-21T08:53:44.177661+0000","last_peered":"2024-09-21T08:53:44.177661+0000","last_clean":"2024-09-21T08:53:44.177661+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:53:44.177661+0000","last_undegraded":"2024-09-21T08:53:44.177661+0000","last_fullsized":"2024-09-21T08:53:44.177661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:35.178655+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:53:35.178655+0000","last_peered":"2024-09-21T08:53:35.178655+0000","last_clean":"2024-09-21T08:53:35.178655+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:53:35.178655+0000","last_undegraded":"2024-09-21T08:53:35.178655+0000","last_fullsized":"2024-09-21T08:53:35.178655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.847393+0000","last_change":"2024-09-21T08:55:05.847420+0000","last_active":"2024-09-21T08:55:05.847393+0000","last_peered":"2024-09-21T08:55:05.847393+0000","last_clean":"2024-09-21T08:55:05.847393+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:55:05.847393+0000","last_undegraded":"2024-09-21T08:55:05.847393+0000","last_fullsized":"2024-09-21T08:55:05.847393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.847290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:42:43.812529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.280580+0000","last_change":"2024-09-21T08:54:58.280639+0000","last_active":"2024-09-21T08:54:58.280580+0000","last_peered":"2024-09-21T08:54:58.280580+0000","last_clean":"2024-09-21T08:54:58.280580+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:54:58.280580+0000","last_undegraded":"2024-09-21T08:54:58.280580+0000","last_fullsized":"2024-09-21T08:54:58.280580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.280470+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:25.040327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":366,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.299126+0000","last_change":"2024-09-21T08:55:00.299155+0000","last_active":"2024-09-21T08:55:00.299126+0000","last_peered":"2024-09-21T08:55:00.299126+0000","last_clean":"2024-09-21T08:55:00.299126+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:55:00.299126+0000","last_undegraded":"2024-09-21T08:55:00.299126+0000","last_fullsized":"2024-09-21T08:55:00.299126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.299020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:39.253241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.183207+0000","last_change":"2024-09-21T08:51:48.166274+0000","last_active":"2024-09-21T08:54:05.183207+0000","last_peered":"2024-09-21T08:54:05.183207+0000","last_clean":"2024-09-21T08:54:05.183207+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:54:05.183207+0000","last_undegraded":"2024-09-21T08:54:05.183207+0000","last_fullsized":"2024-09-21T08:54:05.183207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.768121+0000","last_change":"2024-09-21T08:55:11.768148+0000","last_active":"2024-09-21T08:55:11.768121+0000","last_peered":"2024-09-21T08:55:11.768121+0000","last_clean":"2024-09-21T08:55:11.768121+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:55:11.768121+0000","last_undegraded":"2024-09-21T08:55:11.768121+0000","last_fullsized":"2024-09-21T08:55:11.768121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.768028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:52.506242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.533077+0000","last_change":"2024-09-21T08:51:38.145577+0000","last_active":"2024-09-21T08:54:46.533077+0000","last_peered":"2024-09-21T08:54:46.533077+0000","last_clean":"2024-09-21T08:54:46.533077+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:54:46.533077+0000","last_undegraded":"2024-09-21T08:54:46.533077+0000","last_fullsized":"2024-09-21T08:54:46.533077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:39.177090+0000","last_change":"2024-09-21T08:51:28.519786+0000","last_active":"2024-09-21T08:53:39.177090+0000","last_peered":"2024-09-21T08:53:39.177090+0000","last_clean":"2024-09-21T08:53:39.177090+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:53:39.177090+0000","last_undegraded":"2024-09-21T08:53:39.177090+0000","last_fullsized":"2024-09-21T08:53:39.177090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.822697+0000","last_change":"2024-09-21T08:55:03.822721+0000","last_active":"2024-09-21T08:55:03.822697+0000","last_peered":"2024-09-21T08:55:03.822697+0000","last_clean":"2024-09-21T08:55:03.822697+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:55:03.822697+0000","last_undegraded":"2024-09-21T08:55:03.822697+0000","last_fullsized":"2024-09-21T08:55:03.822697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:17.459600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.863882+0000","last_change":"2024-09-21T08:55:29.863917+0000","last_active":"2024-09-21T08:55:29.863882+0000","last_peered":"2024-09-21T08:55:29.863882+0000","last_clean":"2024-09-21T08:55:29.863882+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:55:29.863882+0000","last_undegraded":"2024-09-21T08:55:29.863882+0000","last_fullsized":"2024-09-21T08:55:29.863882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.863791+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:04.357452+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.791406+0000","last_change":"2024-09-21T08:55:11.791438+0000","last_active":"2024-09-21T08:55:11.791406+0000","last_peered":"2024-09-21T08:55:11.791406+0000","last_clean":"2024-09-21T08:55:11.791406+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:55:11.791406+0000","last_undegraded":"2024-09-21T08:55:11.791406+0000","last_fullsized":"2024-09-21T08:55:11.791406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.791309+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:31.481073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182548+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:54:05.182548+0000","last_peered":"2024-09-21T08:54:05.182548+0000","last_clean":"2024-09-21T08:54:05.182548+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:54:05.182548+0000","last_undegraded":"2024-09-21T08:54:05.182548+0000","last_fullsized":"2024-09-21T08:54:05.182548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.750241+0000","last_change":"2024-09-21T08:55:30.750304+0000","last_active":"2024-09-21T08:55:30.750241+0000","last_peered":"2024-09-21T08:55:30.750241+0000","last_clean":"2024-09-21T08:55:30.750241+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:55:30.750241+0000","last_undegraded":"2024-09-21T08:55:30.750241+0000","last_fullsized":"2024-09-21T08:55:30.750241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.750144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:34.425604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180129+0000","last_change":"2024-09-21T08:51:38.137889+0000","last_active":"2024-09-21T08:53:50.180129+0000","last_peered":"2024-09-21T08:53:50.180129+0000","last_clean":"2024-09-21T08:53:50.180129+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:53:50.180129+0000","last_undegraded":"2024-09-21T08:53:50.180129+0000","last_fullsized":"2024-09-21T08:53:50.180129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:40.179309+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:53:40.179309+0000","last_peered":"2024-09-21T08:53:40.179309+0000","last_clean":"2024-09-21T08:53:40.179309+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:53:40.179309+0000","last_undegraded":"2024-09-21T08:53:40.179309+0000","last_fullsized":"2024-09-21T08:53:40.179309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179813+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:53:45.179813+0000","last_peered":"2024-09-21T08:53:45.179813+0000","last_clean":"2024-09-21T08:53:45.179813+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:53:45.179813+0000","last_undegraded":"2024-09-21T08:53:45.179813+0000","last_fullsized":"2024-09-21T08:53:45.179813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":189,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.829236+0000","last_change":"2024-09-21T08:55:02.829284+0000","last_active":"2024-09-21T08:55:02.829236+0000","last_peered":"2024-09-21T08:55:02.829236+0000","last_clean":"2024-09-21T08:55:02.829236+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:55:02.829236+0000","last_undegraded":"2024-09-21T08:55:02.829236+0000","last_fullsized":"2024-09-21T08:55:02.829236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.829144+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.593879+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.820049+0000","last_change":"2024-09-21T08:55:04.820070+0000","last_active":"2024-09-21T08:55:04.820049+0000","last_peered":"2024-09-21T08:55:04.820049+0000","last_clean":"2024-09-21T08:55:04.820049+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:55:04.820049+0000","last_undegraded":"2024-09-21T08:55:04.820049+0000","last_fullsized":"2024-09-21T08:55:04.820049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.819955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:13.094734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.834090+0000","last_change":"2024-09-21T08:55:12.834113+0000","last_active":"2024-09-21T08:55:12.834090+0000","last_peered":"2024-09-21T08:55:12.834090+0000","last_clean":"2024-09-21T08:55:12.834090+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:55:12.834090+0000","last_undegraded":"2024-09-21T08:55:12.834090+0000","last_fullsized":"2024-09-21T08:55:12.834090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.833970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:00.715535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.539257+0000","last_change":"2024-09-21T08:51:48.159203+0000","last_active":"2024-09-21T08:54:46.539257+0000","last_peered":"2024-09-21T08:54:46.539257+0000","last_clean":"2024-09-21T08:54:46.539257+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:54:46.539257+0000","last_undegraded":"2024-09-21T08:54:46.539257+0000","last_fullsized":"2024-09-21T08:54:46.539257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.834367+0000","last_change":"2024-09-21T08:55:17.834410+0000","last_active":"2024-09-21T08:55:17.834367+0000","last_peered":"2024-09-21T08:55:17.834367+0000","last_clean":"2024-09-21T08:55:17.834367+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:55:17.834367+0000","last_undegraded":"2024-09-21T08:55:17.834367+0000","last_fullsized":"2024-09-21T08:55:17.834367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.834243+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:49.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182315+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:54:00.182315+0000","last_peered":"2024-09-21T08:54:00.182315+0000","last_clean":"2024-09-21T08:54:00.182315+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:54:00.182315+0000","last_undegraded":"2024-09-21T08:54:00.182315+0000","last_fullsized":"2024-09-21T08:54:00.182315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.275010+0000","last_change":"2024-09-21T08:55:15.275037+0000","last_active":"2024-09-21T08:55:15.275010+0000","last_peered":"2024-09-21T08:55:15.275010+0000","last_clean":"2024-09-21T08:55:15.275010+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:55:15.275010+0000","last_undegraded":"2024-09-21T08:55:15.275010+0000","last_fullsized":"2024-09-21T08:55:15.275010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.274919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:38.364271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.810730+0000","last_change":"2024-09-21T08:55:04.810792+0000","last_active":"2024-09-21T08:55:04.810730+0000","last_peered":"2024-09-21T08:55:04.810730+0000","last_clean":"2024-09-21T08:55:04.810730+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:55:04.810730+0000","last_undegraded":"2024-09-21T08:55:04.810730+0000","last_fullsized":"2024-09-21T08:55:04.810730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.810614+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:15.348725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.814729+0000","last_change":"2024-09-21T08:55:28.814755+0000","last_active":"2024-09-21T08:55:28.814729+0000","last_peered":"2024-09-21T08:55:28.814729+0000","last_clean":"2024-09-21T08:55:28.814729+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:55:28.814729+0000","last_undegraded":"2024-09-21T08:55:28.814729+0000","last_fullsized":"2024-09-21T08:55:28.814729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.814626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178433+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:53:49.178433+0000","last_peered":"2024-09-21T08:53:49.178433+0000","last_clean":"2024-09-21T08:53:49.178433+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:53:49.178433+0000","last_undegraded":"2024-09-21T08:53:49.178433+0000","last_fullsized":"2024-09-21T08:53:49.178433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.379173+0000","last_change":"2024-09-21T08:55:22.379222+0000","last_active":"2024-09-21T08:55:22.379173+0000","last_peered":"2024-09-21T08:55:22.379173+0000","last_clean":"2024-09-21T08:55:22.379173+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:55:22.379173+0000","last_undegraded":"2024-09-21T08:55:22.379173+0000","last_fullsized":"2024-09-21T08:55:22.379173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.379069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:35.825511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.296889+0000","last_change":"2024-09-21T08:51:38.143315+0000","last_active":"2024-09-21T08:54:46.296889+0000","last_peered":"2024-09-21T08:54:46.296889+0000","last_clean":"2024-09-21T08:54:46.296889+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:54:46.296889+0000","last_undegraded":"2024-09-21T08:54:46.296889+0000","last_fullsized":"2024-09-21T08:54:46.296889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.817707+0000","last_change":"2024-09-21T08:55:07.817734+0000","last_active":"2024-09-21T08:55:07.817707+0000","last_peered":"2024-09-21T08:55:07.817707+0000","last_clean":"2024-09-21T08:55:07.817707+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:55:07.817707+0000","last_undegraded":"2024-09-21T08:55:07.817707+0000","last_fullsized":"2024-09-21T08:55:07.817707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.817604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:06.637277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.835986+0000","last_change":"2024-09-21T08:54:56.836033+0000","last_active":"2024-09-21T08:54:56.835986+0000","last_peered":"2024-09-21T08:54:56.835986+0000","last_clean":"2024-09-21T08:54:56.835986+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:56.835986+0000","last_undegraded":"2024-09-21T08:54:56.835986+0000","last_fullsized":"2024-09-21T08:54:56.835986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_clean_scrub_stamp":"2024-09-21T08:54:56.835862+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.916858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.824181+0000","last_change":"2024-09-21T08:55:04.824228+0000","last_active":"2024-09-21T08:55:04.824181+0000","last_peered":"2024-09-21T08:55:04.824181+0000","last_clean":"2024-09-21T08:55:04.824181+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:55:04.824181+0000","last_undegraded":"2024-09-21T08:55:04.824181+0000","last_fullsized":"2024-09-21T08:55:04.824181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.824082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:20.883736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.734522+0000","last_change":"2024-09-21T08:55:27.734551+0000","last_active":"2024-09-21T08:55:27.734522+0000","last_peered":"2024-09-21T08:55:27.734522+0000","last_clean":"2024-09-21T08:55:27.734522+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:55:27.734522+0000","last_undegraded":"2024-09-21T08:55:27.734522+0000","last_fullsized":"2024-09-21T08:55:27.734522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.734430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:25.498043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.674293+0000","last_change":"2024-09-21T08:55:29.674323+0000","last_active":"2024-09-21T08:55:29.674293+0000","last_peered":"2024-09-21T08:55:29.674293+0000","last_clean":"2024-09-21T08:55:29.674293+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:55:29.674293+0000","last_undegraded":"2024-09-21T08:55:29.674293+0000","last_fullsized":"2024-09-21T08:55:29.674293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.674182+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:31.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182655+0000","last_change":"2024-09-21T08:51:38.145615+0000","last_active":"2024-09-21T08:54:05.182655+0000","last_peered":"2024-09-21T08:54:05.182655+0000","last_clean":"2024-09-21T08:54:05.182655+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:54:05.182655+0000","last_undegraded":"2024-09-21T08:54:05.182655+0000","last_fullsized":"2024-09-21T08:54:05.182655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.849013+0000","last_change":"2024-09-21T08:55:13.849035+0000","last_active":"2024-09-21T08:55:13.849013+0000","last_peered":"2024-09-21T08:55:13.849013+0000","last_clean":"2024-09-21T08:55:13.849013+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:55:13.849013+0000","last_undegraded":"2024-09-21T08:55:13.849013+0000","last_fullsized":"2024-09-21T08:55:13.849013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.848927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.202435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'47","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.833227+0000","last_change":"2024-09-21T08:55:09.833272+0000","last_active":"2024-09-21T08:55:09.833227+0000","last_peered":"2024-09-21T08:55:09.833227+0000","last_clean":"2024-09-21T08:55:09.833227+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:55:09.833227+0000","last_undegraded":"2024-09-21T08:55:09.833227+0000","last_fullsized":"2024-09-21T08:55:09.833227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.833131+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:32.922483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.298583+0000","last_change":"2024-09-21T08:55:04.298628+0000","last_active":"2024-09-21T08:55:04.298583+0000","last_peered":"2024-09-21T08:55:04.298583+0000","last_clean":"2024-09-21T08:55:04.298583+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:55:04.298583+0000","last_undegraded":"2024-09-21T08:55:04.298583+0000","last_fullsized":"2024-09-21T08:55:04.298583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.298475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.675637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.185462+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:54:20.185462+0000","last_peered":"2024-09-21T08:54:20.185462+0000","last_clean":"2024-09-21T08:54:20.185462+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:54:20.185462+0000","last_undegraded":"2024-09-21T08:54:20.185462+0000","last_fullsized":"2024-09-21T08:54:20.185462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.759091+0000","last_change":"2024-09-21T08:55:09.759114+0000","last_active":"2024-09-21T08:55:09.759091+0000","last_peered":"2024-09-21T08:55:09.759091+0000","last_clean":"2024-09-21T08:55:09.759091+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:55:09.759091+0000","last_undegraded":"2024-09-21T08:55:09.759091+0000","last_fullsized":"2024-09-21T08:55:09.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.759005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:03.833615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182670+0000","last_change":"2024-09-21T08:51:38.136666+0000","last_active":"2024-09-21T08:54:05.182670+0000","last_peered":"2024-09-21T08:54:05.182670+0000","last_clean":"2024-09-21T08:54:05.182670+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:54:05.182670+0000","last_undegraded":"2024-09-21T08:54:05.182670+0000","last_fullsized":"2024-09-21T08:54:05.182670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.791688+0000","last_change":"2024-09-21T08:55:01.791713+0000","last_active":"2024-09-21T08:55:01.791688+0000","last_peered":"2024-09-21T08:55:01.791688+0000","last_clean":"2024-09-21T08:55:01.791688+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:55:01.791688+0000","last_undegraded":"2024-09-21T08:55:01.791688+0000","last_fullsized":"2024-09-21T08:55:01.791688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.791549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.781022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.862851+0000","last_change":"2024-09-21T08:55:07.862890+0000","last_active":"2024-09-21T08:55:07.862851+0000","last_peered":"2024-09-21T08:55:07.862851+0000","last_clean":"2024-09-21T08:55:07.862851+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:55:07.862851+0000","last_undegraded":"2024-09-21T08:55:07.862851+0000","last_fullsized":"2024-09-21T08:55:07.862851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.862752+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:51.564071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.950779+0000","last_change":"2024-09-21T08:54:59.950823+0000","last_active":"2024-09-21T08:54:59.950779+0000","last_peered":"2024-09-21T08:54:59.950779+0000","last_clean":"2024-09-21T08:54:59.950779+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:54:59.950779+0000","last_undegraded":"2024-09-21T08:54:59.950779+0000","last_fullsized":"2024-09-21T08:54:59.950779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.950635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:23.543628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.656790+0000","last_change":"2024-09-21T08:51:40.131272+0000","last_active":"2024-09-21T08:54:46.656790+0000","last_peered":"2024-09-21T08:54:46.656790+0000","last_clean":"2024-09-21T08:54:46.656790+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:54:46.656790+0000","last_undegraded":"2024-09-21T08:54:46.656790+0000","last_fullsized":"2024-09-21T08:54:46.656790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182949+0000","last_change":"2024-09-21T08:51:38.140216+0000","last_active":"2024-09-21T08:54:05.182949+0000","last_peered":"2024-09-21T08:54:05.182949+0000","last_clean":"2024-09-21T08:54:05.182949+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:54:05.182949+0000","last_undegraded":"2024-09-21T08:54:05.182949+0000","last_fullsized":"2024-09-21T08:54:05.182949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.787959+0000","last_change":"2024-09-21T08:55:21.788002+0000","last_active":"2024-09-21T08:55:21.787959+0000","last_peered":"2024-09-21T08:55:21.787959+0000","last_clean":"2024-09-21T08:55:21.787959+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:55:21.787959+0000","last_undegraded":"2024-09-21T08:55:21.787959+0000","last_fullsized":"2024-09-21T08:55:21.787959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.787814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:10.823157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'65","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.807924+0000","last_change":"2024-09-21T08:55:08.807971+0000","last_active":"2024-09-21T08:55:08.807924+0000","last_peered":"2024-09-21T08:55:08.807924+0000","last_clean":"2024-09-21T08:55:08.807924+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:55:08.807924+0000","last_undegraded":"2024-09-21T08:55:08.807924+0000","last_fullsized":"2024-09-21T08:55:08.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'65","last_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_deep_scrub":"36'65","last_deep_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.807820+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:33.816177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.013839+0000","last_change":"2024-09-21T08:54:58.013862+0000","last_active":"2024-09-21T08:54:58.013839+0000","last_peered":"2024-09-21T08:54:58.013839+0000","last_clean":"2024-09-21T08:54:58.013839+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:54:58.013839+0000","last_undegraded":"2024-09-21T08:54:58.013839+0000","last_fullsized":"2024-09-21T08:54:58.013839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.013702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:15.698435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181620+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:54:09.181620+0000","last_peered":"2024-09-21T08:54:09.181620+0000","last_clean":"2024-09-21T08:54:09.181620+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:54:09.181620+0000","last_undegraded":"2024-09-21T08:54:09.181620+0000","last_fullsized":"2024-09-21T08:54:09.181620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.320013+0000","last_change":"2024-09-21T08:51:40.136061+0000","last_active":"2024-09-21T08:54:46.320013+0000","last_peered":"2024-09-21T08:54:46.320013+0000","last_clean":"2024-09-21T08:54:46.320013+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:54:46.320013+0000","last_undegraded":"2024-09-21T08:54:46.320013+0000","last_fullsized":"2024-09-21T08:54:46.320013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202409+0000","last_change":"2024-09-21T08:51:38.135710+0000","last_active":"2024-09-21T08:54:53.202409+0000","last_peered":"2024-09-21T08:54:53.202409+0000","last_clean":"2024-09-21T08:54:53.202409+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:54:53.202409+0000","last_undegraded":"2024-09-21T08:54:53.202409+0000","last_fullsized":"2024-09-21T08:54:53.202409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.841332+0000","last_change":"2024-09-21T08:55:15.841357+0000","last_active":"2024-09-21T08:55:15.841332+0000","last_peered":"2024-09-21T08:55:15.841332+0000","last_clean":"2024-09-21T08:55:15.841332+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:55:15.841332+0000","last_undegraded":"2024-09-21T08:55:15.841332+0000","last_fullsized":"2024-09-21T08:55:15.841332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.841239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:07.982245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.796107+0000","last_change":"2024-09-21T08:55:12.796146+0000","last_active":"2024-09-21T08:55:12.796107+0000","last_peered":"2024-09-21T08:55:12.796107+0000","last_clean":"2024-09-21T08:55:12.796107+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:55:12.796107+0000","last_undegraded":"2024-09-21T08:55:12.796107+0000","last_fullsized":"2024-09-21T08:55:12.796107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.796020+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:06.530723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.286766+0000","last_change":"2024-09-21T08:55:12.286792+0000","last_active":"2024-09-21T08:55:12.286766+0000","last_peered":"2024-09-21T08:55:12.286766+0000","last_clean":"2024-09-21T08:55:12.286766+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:55:12.286766+0000","last_undegraded":"2024-09-21T08:55:12.286766+0000","last_fullsized":"2024-09-21T08:55:12.286766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.286668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:03.780340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183893+0000","last_change":"2024-09-21T08:51:48.163944+0000","last_active":"2024-09-21T08:54:10.183893+0000","last_peered":"2024-09-21T08:54:10.183893+0000","last_clean":"2024-09-21T08:54:10.183893+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:54:10.183893+0000","last_undegraded":"2024-09-21T08:54:10.183893+0000","last_fullsized":"2024-09-21T08:54:10.183893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.799865+0000","last_change":"2024-09-21T08:55:13.799916+0000","last_active":"2024-09-21T08:55:13.799865+0000","last_peered":"2024-09-21T08:55:13.799865+0000","last_clean":"2024-09-21T08:55:13.799865+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:55:13.799865+0000","last_undegraded":"2024-09-21T08:55:13.799865+0000","last_fullsized":"2024-09-21T08:55:13.799865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.799748+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.649021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.202364+0000","last_change":"2024-09-21T08:51:38.127791+0000","last_active":"2024-09-21T08:54:53.202364+0000","last_peered":"2024-09-21T08:54:53.202364+0000","last_clean":"2024-09-21T08:54:53.202364+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:54:53.202364+0000","last_undegraded":"2024-09-21T08:54:53.202364+0000","last_fullsized":"2024-09-21T08:54:53.202364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.846050+0000","last_change":"2024-09-21T08:55:14.846074+0000","last_active":"2024-09-21T08:55:14.846050+0000","last_peered":"2024-09-21T08:55:14.846050+0000","last_clean":"2024-09-21T08:55:14.846050+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:55:14.846050+0000","last_undegraded":"2024-09-21T08:55:14.846050+0000","last_fullsized":"2024-09-21T08:55:14.846050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.845959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:24.445746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.829303+0000","last_change":"2024-09-21T08:55:10.829399+0000","last_active":"2024-09-21T08:55:10.829303+0000","last_peered":"2024-09-21T08:55:10.829303+0000","last_clean":"2024-09-21T08:55:10.829303+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:55:10.829303+0000","last_undegraded":"2024-09-21T08:55:10.829303+0000","last_fullsized":"2024-09-21T08:55:10.829303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.829198+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:50.856893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.802341+0000","last_change":"2024-09-21T08:55:19.802367+0000","last_active":"2024-09-21T08:55:19.802341+0000","last_peered":"2024-09-21T08:55:19.802341+0000","last_clean":"2024-09-21T08:55:19.802341+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:55:19.802341+0000","last_undegraded":"2024-09-21T08:55:19.802341+0000","last_fullsized":"2024-09-21T08:55:19.802341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.802246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:41.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708384+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.708384+0000","last_peered":"2024-09-21T08:54:46.708384+0000","last_clean":"2024-09-21T08:54:46.708384+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.708384+0000","last_undegraded":"2024-09-21T08:54:46.708384+0000","last_fullsized":"2024-09-21T08:54:46.708384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.775852+0000","last_change":"2024-09-21T08:55:24.775881+0000","last_active":"2024-09-21T08:55:24.775852+0000","last_peered":"2024-09-21T08:55:24.775852+0000","last_clean":"2024-09-21T08:55:24.775852+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:55:24.775852+0000","last_undegraded":"2024-09-21T08:55:24.775852+0000","last_fullsized":"2024-09-21T08:55:24.775852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.775748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:55.003623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183940+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:54:10.183940+0000","last_peered":"2024-09-21T08:54:10.183940+0000","last_clean":"2024-09-21T08:54:10.183940+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:54:10.183940+0000","last_undegraded":"2024-09-21T08:54:10.183940+0000","last_fullsized":"2024-09-21T08:54:10.183940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.214468+0000","last_change":"2024-09-21T08:55:10.214510+0000","last_active":"2024-09-21T08:55:10.214468+0000","last_peered":"2024-09-21T08:55:10.214468+0000","last_clean":"2024-09-21T08:55:10.214468+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:55:10.214468+0000","last_undegraded":"2024-09-21T08:55:10.214468+0000","last_fullsized":"2024-09-21T08:55:10.214468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.214364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:53.485342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.804679+0000","last_change":"2024-09-21T08:55:23.804730+0000","last_active":"2024-09-21T08:55:23.804679+0000","last_peered":"2024-09-21T08:55:23.804679+0000","last_clean":"2024-09-21T08:55:23.804679+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:55:23.804679+0000","last_undegraded":"2024-09-21T08:55:23.804679+0000","last_fullsized":"2024-09-21T08:55:23.804679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.804588+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.579024+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.852926+0000","last_change":"2024-09-21T08:55:08.852971+0000","last_active":"2024-09-21T08:55:08.852926+0000","last_peered":"2024-09-21T08:55:08.852926+0000","last_clean":"2024-09-21T08:55:08.852926+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:55:08.852926+0000","last_undegraded":"2024-09-21T08:55:08.852926+0000","last_fullsized":"2024-09-21T08:55:08.852926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.852812+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:10.217991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183734+0000","last_change":"2024-09-21T08:51:48.164130+0000","last_active":"2024-09-21T08:54:10.183734+0000","last_peered":"2024-09-21T08:54:10.183734+0000","last_clean":"2024-09-21T08:54:10.183734+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:54:10.183734+0000","last_undegraded":"2024-09-21T08:54:10.183734+0000","last_fullsized":"2024-09-21T08:54:10.183734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'20","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.912827+0000","last_change":"2024-09-21T08:55:22.912859+0000","last_active":"2024-09-21T08:55:22.912827+0000","last_peered":"2024-09-21T08:55:22.912827+0000","last_clean":"2024-09-21T08:55:22.912827+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:55:22.912827+0000","last_undegraded":"2024-09-21T08:55:22.912827+0000","last_fullsized":"2024-09-21T08:55:22.912827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.912725+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:41.989671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183358+0000","last_change":"2024-09-21T08:51:38.126352+0000","last_active":"2024-09-21T08:54:10.183358+0000","last_peered":"2024-09-21T08:54:10.183358+0000","last_clean":"2024-09-21T08:54:10.183358+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:54:10.183358+0000","last_undegraded":"2024-09-21T08:54:10.183358+0000","last_fullsized":"2024-09-21T08:54:10.183358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.250725+0000","last_change":"2024-09-21T08:55:11.250750+0000","last_active":"2024-09-21T08:55:11.250725+0000","last_peered":"2024-09-21T08:55:11.250725+0000","last_clean":"2024-09-21T08:55:11.250725+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:55:11.250725+0000","last_undegraded":"2024-09-21T08:55:11.250725+0000","last_fullsized":"2024-09-21T08:55:11.250725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:35.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.282349+0000","last_change":"2024-09-21T08:55:01.282405+0000","last_active":"2024-09-21T08:55:01.282349+0000","last_peered":"2024-09-21T08:55:01.282349+0000","last_clean":"2024-09-21T08:55:01.282349+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:55:01.282349+0000","last_undegraded":"2024-09-21T08:55:01.282349+0000","last_fullsized":"2024-09-21T08:55:01.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.282245+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:55.435995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.731794+0000","last_change":"2024-09-21T08:55:00.731817+0000","last_active":"2024-09-21T08:55:00.731794+0000","last_peered":"2024-09-21T08:55:00.731794+0000","last_clean":"2024-09-21T08:55:00.731794+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:55:00.731794+0000","last_undegraded":"2024-09-21T08:55:00.731794+0000","last_fullsized":"2024-09-21T08:55:00.731794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.731703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:33.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.329562+0000","last_change":"2024-09-21T08:55:20.329590+0000","last_active":"2024-09-21T08:55:20.329562+0000","last_peered":"2024-09-21T08:55:20.329562+0000","last_clean":"2024-09-21T08:55:20.329562+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:55:20.329562+0000","last_undegraded":"2024-09-21T08:55:20.329562+0000","last_fullsized":"2024-09-21T08:55:20.329562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.329430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:41.690836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.870236+0000","last_change":"2024-09-21T08:55:18.870267+0000","last_active":"2024-09-21T08:55:18.870236+0000","last_peered":"2024-09-21T08:55:18.870236+0000","last_clean":"2024-09-21T08:55:18.870236+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:55:18.870236+0000","last_undegraded":"2024-09-21T08:55:18.870236+0000","last_fullsized":"2024-09-21T08:55:18.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.870118+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:22.956813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.184027+0000","last_change":"2024-09-21T08:51:38.151763+0000","last_active":"2024-09-21T08:54:10.184027+0000","last_peered":"2024-09-21T08:54:10.184027+0000","last_clean":"2024-09-21T08:54:10.184027+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:54:10.184027+0000","last_undegraded":"2024-09-21T08:54:10.184027+0000","last_fullsized":"2024-09-21T08:54:10.184027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.806832+0000","last_change":"2024-09-21T08:55:11.806872+0000","last_active":"2024-09-21T08:55:11.806832+0000","last_peered":"2024-09-21T08:55:11.806832+0000","last_clean":"2024-09-21T08:55:11.806832+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:55:11.806832+0000","last_undegraded":"2024-09-21T08:55:11.806832+0000","last_fullsized":"2024-09-21T08:55:11.806832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.806716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:26.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.872312+0000","last_change":"2024-09-21T08:55:06.872367+0000","last_active":"2024-09-21T08:55:06.872312+0000","last_peered":"2024-09-21T08:55:06.872312+0000","last_clean":"2024-09-21T08:55:06.872312+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:55:06.872312+0000","last_undegraded":"2024-09-21T08:55:06.872312+0000","last_fullsized":"2024-09-21T08:55:06.872312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.872210+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:58.365881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.754358+0000","last_change":"2024-09-21T08:55:18.754399+0000","last_active":"2024-09-21T08:55:18.754358+0000","last_peered":"2024-09-21T08:55:18.754358+0000","last_clean":"2024-09-21T08:55:18.754358+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:55:18.754358+0000","last_undegraded":"2024-09-21T08:55:18.754358+0000","last_fullsized":"2024-09-21T08:55:18.754358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.754246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:42.773601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184844+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:54:15.184844+0000","last_peered":"2024-09-21T08:54:15.184844+0000","last_clean":"2024-09-21T08:54:15.184844+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:54:15.184844+0000","last_undegraded":"2024-09-21T08:54:15.184844+0000","last_fullsized":"2024-09-21T08:54:15.184844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.608985+0000","last_change":"2024-09-21T08:51:40.131478+0000","last_active":"2024-09-21T08:54:46.608985+0000","last_peered":"2024-09-21T08:54:46.608985+0000","last_clean":"2024-09-21T08:54:46.608985+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:54:46.608985+0000","last_undegraded":"2024-09-21T08:54:46.608985+0000","last_fullsized":"2024-09-21T08:54:46.608985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:39.177104+0000","last_change":"2024-09-21T08:51:38.137188+0000","last_active":"2024-09-21T08:53:39.177104+0000","last_peered":"2024-09-21T08:53:39.177104+0000","last_clean":"2024-09-21T08:53:39.177104+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:53:39.177104+0000","last_undegraded":"2024-09-21T08:53:39.177104+0000","last_fullsized":"2024-09-21T08:53:39.177104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.263419+0000","last_change":"2024-09-21T08:55:09.263468+0000","last_active":"2024-09-21T08:55:09.263419+0000","last_peered":"2024-09-21T08:55:09.263419+0000","last_clean":"2024-09-21T08:55:09.263419+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:55:09.263419+0000","last_undegraded":"2024-09-21T08:55:09.263419+0000","last_fullsized":"2024-09-21T08:55:09.263419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.263316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:55.833766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'31","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.779617+0000","last_change":"2024-09-21T08:55:10.779651+0000","last_active":"2024-09-21T08:55:10.779617+0000","last_peered":"2024-09-21T08:55:10.779617+0000","last_clean":"2024-09-21T08:55:10.779617+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:55:10.779617+0000","last_undegraded":"2024-09-21T08:55:10.779617+0000","last_fullsized":"2024-09-21T08:55:10.779617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'31","last_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_deep_scrub":"36'31","last_deep_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.779521+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:53.739000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.738161+0000","last_change":"2024-09-21T08:55:20.738188+0000","last_active":"2024-09-21T08:55:20.738161+0000","last_peered":"2024-09-21T08:55:20.738161+0000","last_clean":"2024-09-21T08:55:20.738161+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:55:20.738161+0000","last_undegraded":"2024-09-21T08:55:20.738161+0000","last_fullsized":"2024-09-21T08:55:20.738161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.738067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:07.544426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184813+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:54:15.184813+0000","last_peered":"2024-09-21T08:54:15.184813+0000","last_clean":"2024-09-21T08:54:15.184813+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:54:15.184813+0000","last_undegraded":"2024-09-21T08:54:15.184813+0000","last_fullsized":"2024-09-21T08:54:15.184813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.896750+0000","last_change":"2024-09-21T08:55:19.896791+0000","last_active":"2024-09-21T08:55:19.896750+0000","last_peered":"2024-09-21T08:55:19.896750+0000","last_clean":"2024-09-21T08:55:19.896750+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:55:19.896750+0000","last_undegraded":"2024-09-21T08:55:19.896750+0000","last_fullsized":"2024-09-21T08:55:19.896750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.896662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.710664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179200+0000","last_change":"2024-09-21T08:51:38.136926+0000","last_active":"2024-09-21T08:53:45.179200+0000","last_peered":"2024-09-21T08:53:45.179200+0000","last_clean":"2024-09-21T08:53:45.179200+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:53:45.179200+0000","last_undegraded":"2024-09-21T08:53:45.179200+0000","last_fullsized":"2024-09-21T08:53:45.179200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.318908+0000","last_change":"2024-09-21T08:55:06.318938+0000","last_active":"2024-09-21T08:55:06.318908+0000","last_peered":"2024-09-21T08:55:06.318908+0000","last_clean":"2024-09-21T08:55:06.318908+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:55:06.318908+0000","last_undegraded":"2024-09-21T08:55:06.318908+0000","last_fullsized":"2024-09-21T08:55:06.318908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.318814+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:39.323163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.769310+0000","last_change":"2024-09-21T08:55:27.769355+0000","last_active":"2024-09-21T08:55:27.769310+0000","last_peered":"2024-09-21T08:55:27.769310+0000","last_clean":"2024-09-21T08:55:27.769310+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:55:27.769310+0000","last_undegraded":"2024-09-21T08:55:27.769310+0000","last_fullsized":"2024-09-21T08:55:27.769310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.769209+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.299421+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.839335+0000","last_change":"2024-09-21T08:55:07.839358+0000","last_active":"2024-09-21T08:55:07.839335+0000","last_peered":"2024-09-21T08:55:07.839335+0000","last_clean":"2024-09-21T08:55:07.839335+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:55:07.839335+0000","last_undegraded":"2024-09-21T08:55:07.839335+0000","last_fullsized":"2024-09-21T08:55:07.839335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.839244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:46.238290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183990+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:54:10.183990+0000","last_peered":"2024-09-21T08:54:10.183990+0000","last_clean":"2024-09-21T08:54:10.183990+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:54:10.183990+0000","last_undegraded":"2024-09-21T08:54:10.183990+0000","last_fullsized":"2024-09-21T08:54:10.183990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.280328+0000","last_change":"2024-09-21T08:55:19.280368+0000","last_active":"2024-09-21T08:55:19.280328+0000","last_peered":"2024-09-21T08:55:19.280328+0000","last_clean":"2024-09-21T08:55:19.280328+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:55:19.280328+0000","last_undegraded":"2024-09-21T08:55:19.280328+0000","last_fullsized":"2024-09-21T08:55:19.280328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.280205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:48.230211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:45.179002+0000","last_change":"2024-09-21T08:51:38.141713+0000","last_active":"2024-09-21T08:53:45.179002+0000","last_peered":"2024-09-21T08:53:45.179002+0000","last_clean":"2024-09-21T08:53:45.179002+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:53:45.179002+0000","last_undegraded":"2024-09-21T08:53:45.179002+0000","last_fullsized":"2024-09-21T08:53:45.179002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178463+0000","last_change":"2024-09-21T08:51:40.134248+0000","last_active":"2024-09-21T08:53:49.178463+0000","last_peered":"2024-09-21T08:53:49.178463+0000","last_clean":"2024-09-21T08:53:49.178463+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:53:49.178463+0000","last_undegraded":"2024-09-21T08:53:49.178463+0000","last_fullsized":"2024-09-21T08:53:49.178463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.524445+0000","last_change":"2024-09-21T08:51:38.129928+0000","last_active":"2024-09-21T08:54:46.524445+0000","last_peered":"2024-09-21T08:54:46.524445+0000","last_clean":"2024-09-21T08:54:46.524445+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:54:46.524445+0000","last_undegraded":"2024-09-21T08:54:46.524445+0000","last_fullsized":"2024-09-21T08:54:46.524445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180717+0000","last_change":"2024-09-21T08:51:40.131339+0000","last_active":"2024-09-21T08:53:50.180717+0000","last_peered":"2024-09-21T08:53:50.180717+0000","last_clean":"2024-09-21T08:53:50.180717+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:53:50.180717+0000","last_undegraded":"2024-09-21T08:53:50.180717+0000","last_fullsized":"2024-09-21T08:53:50.180717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:53.200378+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:54:53.200378+0000","last_peered":"2024-09-21T08:54:53.200378+0000","last_clean":"2024-09-21T08:54:53.200378+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:54:53.200378+0000","last_undegraded":"2024-09-21T08:54:53.200378+0000","last_fullsized":"2024-09-21T08:54:53.200378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.729640+0000","last_change":"2024-09-21T08:55:26.729668+0000","last_active":"2024-09-21T08:55:26.729640+0000","last_peered":"2024-09-21T08:55:26.729640+0000","last_clean":"2024-09-21T08:55:26.729640+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:55:26.729640+0000","last_undegraded":"2024-09-21T08:55:26.729640+0000","last_fullsized":"2024-09-21T08:55:26.729640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.729534+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:03.131761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177624+0000","last_change":"2024-09-21T08:51:38.137515+0000","last_active":"2024-09-21T08:53:44.177624+0000","last_peered":"2024-09-21T08:53:44.177624+0000","last_clean":"2024-09-21T08:53:44.177624+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:53:44.177624+0000","last_undegraded":"2024-09-21T08:53:44.177624+0000","last_fullsized":"2024-09-21T08:53:44.177624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.701570+0000","last_change":"2024-09-21T08:55:33.701599+0000","last_active":"2024-09-21T08:55:33.701570+0000","last_peered":"2024-09-21T08:55:33.701570+0000","last_clean":"2024-09-21T08:55:33.701570+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:55:33.701570+0000","last_undegraded":"2024-09-21T08:55:33.701570+0000","last_fullsized":"2024-09-21T08:55:33.701570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.701471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:14.564757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178400+0000","last_change":"2024-09-21T08:51:38.133157+0000","last_active":"2024-09-21T08:53:49.178400+0000","last_peered":"2024-09-21T08:53:49.178400+0000","last_clean":"2024-09-21T08:53:49.178400+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:53:49.178400+0000","last_undegraded":"2024-09-21T08:53:49.178400+0000","last_fullsized":"2024-09-21T08:53:49.178400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609679+0000","last_change":"2024-09-21T08:52:14.239142+0000","last_active":"2024-09-21T08:54:46.609679+0000","last_peered":"2024-09-21T08:54:46.609679+0000","last_clean":"2024-09-21T08:54:46.609679+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:54:46.609679+0000","last_undegraded":"2024-09-21T08:54:46.609679+0000","last_fullsized":"2024-09-21T08:54:46.609679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.366046+0000","last_change":"2024-09-21T08:55:31.366070+0000","last_active":"2024-09-21T08:55:31.366046+0000","last_peered":"2024-09-21T08:55:31.366046+0000","last_clean":"2024-09-21T08:55:31.366046+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:55:31.366046+0000","last_undegraded":"2024-09-21T08:55:31.366046+0000","last_fullsized":"2024-09-21T08:55:31.366046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.365957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:46.435495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:44.177569+0000","last_change":"2024-09-21T08:51:40.135881+0000","last_active":"2024-09-21T08:53:44.177569+0000","last_peered":"2024-09-21T08:53:44.177569+0000","last_clean":"2024-09-21T08:53:44.177569+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:53:44.177569+0000","last_undegraded":"2024-09-21T08:53:44.177569+0000","last_fullsized":"2024-09-21T08:53:44.177569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.745341+0000","last_change":"2024-09-21T08:55:33.745413+0000","last_active":"2024-09-21T08:55:33.745341+0000","last_peered":"2024-09-21T08:55:33.745341+0000","last_clean":"2024-09-21T08:55:33.745341+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:55:33.745341+0000","last_undegraded":"2024-09-21T08:55:33.745341+0000","last_fullsized":"2024-09-21T08:55:33.745341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.745214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:50.076591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.609115+0000","last_change":"2024-09-21T08:51:40.139551+0000","last_active":"2024-09-21T08:54:46.609115+0000","last_peered":"2024-09-21T08:54:46.609115+0000","last_clean":"2024-09-21T08:54:46.609115+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:54:46.609115+0000","last_undegraded":"2024-09-21T08:54:46.609115+0000","last_fullsized":"2024-09-21T08:54:46.609115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:49.178488+0000","last_change":"2024-09-21T08:51:38.131482+0000","last_active":"2024-09-21T08:53:49.178488+0000","last_peered":"2024-09-21T08:53:49.178488+0000","last_clean":"2024-09-21T08:53:49.178488+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:53:49.178488+0000","last_undegraded":"2024-09-21T08:53:49.178488+0000","last_fullsized":"2024-09-21T08:53:49.178488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.381065+0000","last_change":"2024-09-21T08:55:28.381089+0000","last_active":"2024-09-21T08:55:28.381065+0000","last_peered":"2024-09-21T08:55:28.381065+0000","last_clean":"2024-09-21T08:55:28.381065+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:55:28.381065+0000","last_undegraded":"2024-09-21T08:55:28.381065+0000","last_fullsized":"2024-09-21T08:55:28.381065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.380951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.017937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180543+0000","last_change":"2024-09-21T08:51:38.142160+0000","last_active":"2024-09-21T08:53:50.180543+0000","last_peered":"2024-09-21T08:53:50.180543+0000","last_clean":"2024-09-21T08:53:50.180543+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:53:50.180543+0000","last_undegraded":"2024-09-21T08:53:50.180543+0000","last_fullsized":"2024-09-21T08:53:50.180543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.895356+0000","last_change":"2024-09-21T08:55:30.895412+0000","last_active":"2024-09-21T08:55:30.895356+0000","last_peered":"2024-09-21T08:55:30.895356+0000","last_clean":"2024-09-21T08:55:30.895356+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:55:30.895356+0000","last_undegraded":"2024-09-21T08:55:30.895356+0000","last_fullsized":"2024-09-21T08:55:30.895356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.895250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:29.408246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.517739+0000","last_change":"2024-09-21T08:51:38.137583+0000","last_active":"2024-09-21T08:54:46.517739+0000","last_peered":"2024-09-21T08:54:46.517739+0000","last_clean":"2024-09-21T08:54:46.517739+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:54:46.517739+0000","last_undegraded":"2024-09-21T08:54:46.517739+0000","last_fullsized":"2024-09-21T08:54:46.517739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.664541+0000","last_change":"2024-09-21T08:55:31.664590+0000","last_active":"2024-09-21T08:55:31.664541+0000","last_peered":"2024-09-21T08:55:31.664541+0000","last_clean":"2024-09-21T08:55:31.664541+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:55:31.664541+0000","last_undegraded":"2024-09-21T08:55:31.664541+0000","last_fullsized":"2024-09-21T08:55:31.664541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.664444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:52.492905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180882+0000","last_change":"2024-09-21T08:51:38.129753+0000","last_active":"2024-09-21T08:53:55.180882+0000","last_peered":"2024-09-21T08:53:55.180882+0000","last_clean":"2024-09-21T08:53:55.180882+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:53:55.180882+0000","last_undegraded":"2024-09-21T08:53:55.180882+0000","last_fullsized":"2024-09-21T08:53:55.180882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.319563+0000","last_change":"2024-09-21T08:51:40.138789+0000","last_active":"2024-09-21T08:54:46.319563+0000","last_peered":"2024-09-21T08:54:46.319563+0000","last_clean":"2024-09-21T08:54:46.319563+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:54:46.319563+0000","last_undegraded":"2024-09-21T08:54:46.319563+0000","last_fullsized":"2024-09-21T08:54:46.319563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180926+0000","last_change":"2024-09-21T08:51:38.131796+0000","last_active":"2024-09-21T08:53:55.180926+0000","last_peered":"2024-09-21T08:53:55.180926+0000","last_clean":"2024-09-21T08:53:55.180926+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:53:55.180926+0000","last_undegraded":"2024-09-21T08:53:55.180926+0000","last_fullsized":"2024-09-21T08:53:55.180926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.415358+0000","last_change":"2024-09-21T08:55:23.415391+0000","last_active":"2024-09-21T08:55:23.415358+0000","last_peered":"2024-09-21T08:55:23.415358+0000","last_clean":"2024-09-21T08:55:23.415358+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:55:23.415358+0000","last_undegraded":"2024-09-21T08:55:23.415358+0000","last_fullsized":"2024-09-21T08:55:23.415358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.415266+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:24.858792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181475+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:53:55.181475+0000","last_peered":"2024-09-21T08:53:55.181475+0000","last_clean":"2024-09-21T08:53:55.181475+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:53:55.181475+0000","last_undegraded":"2024-09-21T08:53:55.181475+0000","last_fullsized":"2024-09-21T08:53:55.181475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.320467+0000","last_change":"2024-09-21T08:55:32.320495+0000","last_active":"2024-09-21T08:55:32.320467+0000","last_peered":"2024-09-21T08:55:32.320467+0000","last_clean":"2024-09-21T08:55:32.320467+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:55:32.320467+0000","last_undegraded":"2024-09-21T08:55:32.320467+0000","last_fullsized":"2024-09-21T08:55:32.320467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.320370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:31.140044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528401+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.528401+0000","last_peered":"2024-09-21T08:54:46.528401+0000","last_clean":"2024-09-21T08:54:46.528401+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.528401+0000","last_undegraded":"2024-09-21T08:54:46.528401+0000","last_fullsized":"2024-09-21T08:54:46.528401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.853353+0000","last_change":"2024-09-21T08:55:31.853399+0000","last_active":"2024-09-21T08:55:31.853353+0000","last_peered":"2024-09-21T08:55:31.853353+0000","last_clean":"2024-09-21T08:55:31.853353+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:55:31.853353+0000","last_undegraded":"2024-09-21T08:55:31.853353+0000","last_fullsized":"2024-09-21T08:55:31.853353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.853253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.874388+0000","last_change":"2024-09-21T08:55:23.874414+0000","last_active":"2024-09-21T08:55:23.874388+0000","last_peered":"2024-09-21T08:55:23.874388+0000","last_clean":"2024-09-21T08:55:23.874388+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:55:23.874388+0000","last_undegraded":"2024-09-21T08:55:23.874388+0000","last_fullsized":"2024-09-21T08:55:23.874388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.874282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:43.324372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.375679+0000","last_change":"2024-09-21T08:55:25.375781+0000","last_active":"2024-09-21T08:55:25.375679+0000","last_peered":"2024-09-21T08:55:25.375679+0000","last_clean":"2024-09-21T08:55:25.375679+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:55:25.375679+0000","last_undegraded":"2024-09-21T08:55:25.375679+0000","last_fullsized":"2024-09-21T08:55:25.375679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.375567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:46.793767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182422+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:54:00.182422+0000","last_peered":"2024-09-21T08:54:00.182422+0000","last_clean":"2024-09-21T08:54:00.182422+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:54:00.182422+0000","last_undegraded":"2024-09-21T08:54:00.182422+0000","last_fullsized":"2024-09-21T08:54:00.182422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182174+0000","last_change":"2024-09-21T08:51:38.140468+0000","last_active":"2024-09-21T08:54:00.182174+0000","last_peered":"2024-09-21T08:54:00.182174+0000","last_clean":"2024-09-21T08:54:00.182174+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:54:00.182174+0000","last_undegraded":"2024-09-21T08:54:00.182174+0000","last_fullsized":"2024-09-21T08:54:00.182174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.688523+0000","last_change":"2024-09-21T08:55:28.688551+0000","last_active":"2024-09-21T08:55:28.688523+0000","last_peered":"2024-09-21T08:55:28.688523+0000","last_clean":"2024-09-21T08:55:28.688523+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:55:28.688523+0000","last_undegraded":"2024-09-21T08:55:28.688523+0000","last_fullsized":"2024-09-21T08:55:28.688523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.688436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:11.647915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.696898+0000","last_change":"2024-09-21T08:55:30.696969+0000","last_active":"2024-09-21T08:55:30.696898+0000","last_peered":"2024-09-21T08:55:30.696898+0000","last_clean":"2024-09-21T08:55:30.696898+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:55:30.696898+0000","last_undegraded":"2024-09-21T08:55:30.696898+0000","last_fullsized":"2024-09-21T08:55:30.696898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.696780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:08.152392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.239875+0000","last_change":"2024-09-21T08:55:17.239922+0000","last_active":"2024-09-21T08:55:17.239875+0000","last_peered":"2024-09-21T08:55:17.239875+0000","last_clean":"2024-09-21T08:55:17.239875+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:55:17.239875+0000","last_undegraded":"2024-09-21T08:55:17.239875+0000","last_fullsized":"2024-09-21T08:55:17.239875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.239755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.929519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673016,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39992,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331848,"statfs":{"total":96636764160,"available":96595812352,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673014,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.568 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.569 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.569 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.569 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.569 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.569 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.570 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.571 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.572 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.573 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T08:51:21.493390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.574 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.575 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.576 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.577 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.578 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.579 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.580 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.581 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:38.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T08:55:58.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:55:58.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0292a6640 1 Processor -- start 2024-09-21T08:55:58.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0292a6640 1 -- start start 2024-09-21T08:55:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0292a6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd02412f9d0 0x7fd024131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0292a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd024071f70 con 0x7fd02412cca0 2024-09-21T08:55:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0292a6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd02406e350 con 0x7fd02412f9d0 2024-09-21T08:55:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd0227fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd02412f9d0 0x7fd024131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd022ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd02412cca0 0x7fd02412d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:40614/0 (socket says 172.21.15.29:40614) 2024-09-21T08:55:58.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.696+0000 7fd022ffd640 1 -- 172.21.15.29:0/1367413080 learned_addr learned my addr 172.21.15.29:0/1367413080 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:55:58.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.697+0000 7fd0227fc640 1 -- 172.21.15.29:0/1367413080 >> v1:172.21.15.29:6789/0 conn(0x7fd02412cca0 legacy=0x7fd02412d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:58.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.697+0000 7fd0227fc640 1 -- 172.21.15.29:0/1367413080 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0240715c0 con 0x7fd02412f9d0 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.697+0000 7fd0227fc640 1 --2- 172.21.15.29:0/1367413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412f9d0 0x7fd024131dc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd018009720 tx=0x7fd01802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ae0e79f5ba4dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd021ffb640 1 -- 172.21.15.29:0/1367413080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd018037070 con 0x7fd02412f9d0 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd021ffb640 1 -- 172.21.15.29:0/1367413080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01802ad90 con 0x7fd02412f9d0 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd021ffb640 1 -- 172.21.15.29:0/1367413080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd018032590 con 0x7fd02412f9d0 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 -- 172.21.15.29:0/1367413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412f9d0 msgr2=0x7fd024131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 --2- 172.21.15.29:0/1367413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412f9d0 0x7fd024131dc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd018009720 tx=0x7fd01802a110 comp rx=0 tx=0).stop 2024-09-21T08:55:58.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 -- 172.21.15.29:0/1367413080 shutdown_connections 2024-09-21T08:55:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 --2- 172.21.15.29:0/1367413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412f9d0 0x7fd024131dc0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 -- 172.21.15.29:0/1367413080 >> 172.21.15.29:0/1367413080 conn(0x7fd02409a890 msgr2=0x7fd02409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 -- 172.21.15.29:0/1367413080 shutdown_connections 2024-09-21T08:55:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.698+0000 7fd0292a6640 1 -- 172.21.15.29:0/1367413080 wait complete. 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.699+0000 7fd0292a6640 1 Processor -- start 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.699+0000 7fd0292a6640 1 -- start start 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd0292a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd0292a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd02412ca50 con 0x7fd02412cca0 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58844/0 (socket says 172.21.15.29:58844) 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd022ffd640 1 -- 172.21.15.29:0/3080702383 learned_addr learned my addr 172.21.15.29:0/3080702383 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd022ffd640 1 -- 172.21.15.29:0/3080702383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd024123af0 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd022ffd640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c480 tx=0x7fd01400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd014017070 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd014005c10 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd024126db0 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0140070d0 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.700+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd024125df0 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.701+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd01401a070 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.701+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd024073120 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.702+0000 7fd00b7fe640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 0x7fd01003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.702+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd01404af90 con 0x7fd02412cca0 2024-09-21T08:55:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.702+0000 7fd0227fc640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 0x7fd01003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:55:58.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.703+0000 7fd0227fc640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 0x7fd01003a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd018009720 tx=0x7fd01802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:55:58.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.706+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd024073120 con 0x7fd02412cca0 2024-09-21T08:55:58.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.878+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd024124af0 con 0x7fd0100382a0 2024-09-21T08:55:58.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.894+0000 7fd00b7fe640 1 -- 172.21.15.29:0/3080702383 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664765 (secure 0 0 0) 0x7fd024124af0 con 0x7fd0100382a0 2024-09-21T08:55:58.903 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:55:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 msgr2=0x7fd01003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 0x7fd01003a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd018009720 tx=0x7fd01802e000 comp rx=0 tx=0).stop 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 msgr2=0x7fd0241258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c480 tx=0x7fd01400c940 comp rx=0 tx=0).stop 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 shutdown_connections 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7fd0100382a0 0x7fd01003a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 --2- 172.21.15.29:0/3080702383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02412cca0 0x7fd0241258b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 >> 172.21.15.29:0/3080702383 conn(0x7fd02409a890 msgr2=0x7fd024097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 shutdown_connections 2024-09-21T08:55:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:55:58.899+0000 7fd0292a6640 1 -- 172.21.15.29:0/3080702383 wait complete. 2024-09-21T08:55:58.912 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-21T08:55:57.234622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4784,"ondisk_log_size":4784,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148512,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338848,"statfs":{"total":386547056640,"available":386394980352,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004727"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.758671+0000","last_change":"2024-09-21T08:55:27.758671+0000","last_active":"2024-09-21T08:55:27.758671+0000","last_peered":"2024-09-21T08:55:27.758671+0000","last_clean":"2024-09-21T08:55:27.758671+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:55:27.758671+0000","last_undegraded":"2024-09-21T08:55:27.758671+0000","last_fullsized":"2024-09-21T08:55:27.758671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.758533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:27.669521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.300692+0000","last_change":"2024-09-21T08:55:36.300724+0000","last_active":"2024-09-21T08:55:36.300692+0000","last_peered":"2024-09-21T08:55:36.300692+0000","last_clean":"2024-09-21T08:55:36.300692+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:55:36.300692+0000","last_undegraded":"2024-09-21T08:55:36.300692+0000","last_fullsized":"2024-09-21T08:55:36.300692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.300596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.904691+0000","last_change":"2024-09-21T08:55:50.904720+0000","last_active":"2024-09-21T08:55:50.904691+0000","last_peered":"2024-09-21T08:55:50.904691+0000","last_clean":"2024-09-21T08:55:50.904691+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:55:50.904691+0000","last_undegraded":"2024-09-21T08:55:50.904691+0000","last_fullsized":"2024-09-21T08:55:50.904691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.904587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:11.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.803865+0000","last_change":"2024-09-21T08:55:33.803907+0000","last_active":"2024-09-21T08:55:33.803865+0000","last_peered":"2024-09-21T08:55:33.803865+0000","last_clean":"2024-09-21T08:55:33.803865+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:55:33.803865+0000","last_undegraded":"2024-09-21T08:55:33.803865+0000","last_fullsized":"2024-09-21T08:55:33.803865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.803741+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:25.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.447245+0000","last_change":"2024-09-21T08:51:38.139030+0000","last_active":"2024-09-21T08:54:57.447245+0000","last_peered":"2024-09-21T08:54:57.447245+0000","last_clean":"2024-09-21T08:54:57.447245+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:54:57.447245+0000","last_undegraded":"2024-09-21T08:54:57.447245+0000","last_fullsized":"2024-09-21T08:54:57.447245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:44.186519+0000","last_change":"2024-09-21T08:52:14.238999+0000","last_active":"2024-09-21T08:54:44.186519+0000","last_peered":"2024-09-21T08:54:44.186519+0000","last_clean":"2024-09-21T08:54:44.186519+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:54:44.186519+0000","last_undegraded":"2024-09-21T08:54:44.186519+0000","last_fullsized":"2024-09-21T08:54:44.186519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.752161+0000","last_change":"2024-09-21T08:55:36.752161+0000","last_active":"2024-09-21T08:55:36.752161+0000","last_peered":"2024-09-21T08:55:36.752161+0000","last_clean":"2024-09-21T08:55:36.752161+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:55:36.752161+0000","last_undegraded":"2024-09-21T08:55:36.752161+0000","last_fullsized":"2024-09-21T08:55:36.752161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.752039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:30.109665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.800094+0000","last_change":"2024-09-21T08:55:37.800125+0000","last_active":"2024-09-21T08:55:37.800094+0000","last_peered":"2024-09-21T08:55:37.800094+0000","last_clean":"2024-09-21T08:55:37.800094+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:55:37.800094+0000","last_undegraded":"2024-09-21T08:55:37.800094+0000","last_fullsized":"2024-09-21T08:55:37.800094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.799961+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:11.784216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183955+0000","last_change":"2024-09-21T08:51:38.151067+0000","last_active":"2024-09-21T08:54:10.183955+0000","last_peered":"2024-09-21T08:54:10.183955+0000","last_clean":"2024-09-21T08:54:10.183955+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:54:10.183955+0000","last_undegraded":"2024-09-21T08:54:10.183955+0000","last_fullsized":"2024-09-21T08:54:10.183955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.436421+0000","last_change":"2024-09-21T08:55:40.436449+0000","last_active":"2024-09-21T08:55:40.436421+0000","last_peered":"2024-09-21T08:55:40.436421+0000","last_clean":"2024-09-21T08:55:40.436421+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:55:40.436421+0000","last_undegraded":"2024-09-21T08:55:40.436421+0000","last_fullsized":"2024-09-21T08:55:40.436421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.436329+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:51.918514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.824531+0000","last_change":"2024-09-21T08:55:25.824569+0000","last_active":"2024-09-21T08:55:25.824531+0000","last_peered":"2024-09-21T08:55:25.824531+0000","last_clean":"2024-09-21T08:55:25.824531+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:55:25.824531+0000","last_undegraded":"2024-09-21T08:55:25.824531+0000","last_fullsized":"2024-09-21T08:55:25.824531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.824445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.554324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.633950+0000","last_change":"2024-09-21T08:55:48.633982+0000","last_active":"2024-09-21T08:55:48.633950+0000","last_peered":"2024-09-21T08:55:48.633950+0000","last_clean":"2024-09-21T08:55:48.633950+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:55:48.633950+0000","last_undegraded":"2024-09-21T08:55:48.633950+0000","last_fullsized":"2024-09-21T08:55:48.633950+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.633864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:18.768417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183836+0000","last_change":"2024-09-21T08:51:38.125600+0000","last_active":"2024-09-21T08:54:10.183836+0000","last_peered":"2024-09-21T08:54:10.183836+0000","last_clean":"2024-09-21T08:54:10.183836+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:54:10.183836+0000","last_undegraded":"2024-09-21T08:54:10.183836+0000","last_fullsized":"2024-09-21T08:54:10.183836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.870515+0000","last_change":"2024-09-21T08:55:24.870515+0000","last_active":"2024-09-21T08:55:24.870515+0000","last_peered":"2024-09-21T08:55:24.870515+0000","last_clean":"2024-09-21T08:55:24.870515+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:55:24.870515+0000","last_undegraded":"2024-09-21T08:55:24.870515+0000","last_fullsized":"2024-09-21T08:55:24.870515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.870353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:25.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.719282+0000","last_change":"2024-09-21T08:55:34.719335+0000","last_active":"2024-09-21T08:55:34.719282+0000","last_peered":"2024-09-21T08:55:34.719282+0000","last_clean":"2024-09-21T08:55:34.719282+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:55:34.719282+0000","last_undegraded":"2024-09-21T08:55:34.719282+0000","last_fullsized":"2024-09-21T08:55:34.719282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.719148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:22.580263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.709517+0000","last_change":"2024-09-21T08:55:28.709517+0000","last_active":"2024-09-21T08:55:28.709517+0000","last_peered":"2024-09-21T08:55:28.709517+0000","last_clean":"2024-09-21T08:55:28.709517+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:55:28.709517+0000","last_undegraded":"2024-09-21T08:55:28.709517+0000","last_fullsized":"2024-09-21T08:55:28.709517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.709347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:36.913750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.776513+0000","last_change":"2024-09-21T08:55:34.776552+0000","last_active":"2024-09-21T08:55:34.776513+0000","last_peered":"2024-09-21T08:55:34.776513+0000","last_clean":"2024-09-21T08:55:34.776513+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:55:34.776513+0000","last_undegraded":"2024-09-21T08:55:34.776513+0000","last_fullsized":"2024-09-21T08:55:34.776513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.776428+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:14.086199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.302630+0000","last_change":"2024-09-21T08:55:33.302654+0000","last_active":"2024-09-21T08:55:33.302630+0000","last_peered":"2024-09-21T08:55:33.302630+0000","last_clean":"2024-09-21T08:55:33.302630+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:55:33.302630+0000","last_undegraded":"2024-09-21T08:55:33.302630+0000","last_fullsized":"2024-09-21T08:55:33.302630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.302523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:33.718305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.388837+0000","last_change":"2024-09-21T08:55:30.388861+0000","last_active":"2024-09-21T08:55:30.388837+0000","last_peered":"2024-09-21T08:55:30.388837+0000","last_clean":"2024-09-21T08:55:30.388837+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:55:30.388837+0000","last_undegraded":"2024-09-21T08:55:30.388837+0000","last_fullsized":"2024-09-21T08:55:30.388837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.388729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:08.353968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.912250+0000","last_change":"2024-09-21T08:55:21.912281+0000","last_active":"2024-09-21T08:55:21.912250+0000","last_peered":"2024-09-21T08:55:21.912250+0000","last_clean":"2024-09-21T08:55:21.912250+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:55:21.912250+0000","last_undegraded":"2024-09-21T08:55:21.912250+0000","last_fullsized":"2024-09-21T08:55:21.912250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.912160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:04.573712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.328948+0000","last_change":"2024-09-21T08:55:26.328976+0000","last_active":"2024-09-21T08:55:26.328948+0000","last_peered":"2024-09-21T08:55:26.328948+0000","last_clean":"2024-09-21T08:55:26.328948+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:55:26.328948+0000","last_undegraded":"2024-09-21T08:55:26.328948+0000","last_fullsized":"2024-09-21T08:55:26.328948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.328860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.318333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.330341+0000","last_change":"2024-09-21T08:55:35.330395+0000","last_active":"2024-09-21T08:55:35.330341+0000","last_peered":"2024-09-21T08:55:35.330341+0000","last_clean":"2024-09-21T08:55:35.330341+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:55:35.330341+0000","last_undegraded":"2024-09-21T08:55:35.330341+0000","last_fullsized":"2024-09-21T08:55:35.330341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.330235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.621412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.676895+0000","last_change":"2024-09-21T08:55:35.676928+0000","last_active":"2024-09-21T08:55:35.676895+0000","last_peered":"2024-09-21T08:55:35.676895+0000","last_clean":"2024-09-21T08:55:35.676895+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:55:35.676895+0000","last_undegraded":"2024-09-21T08:55:35.676895+0000","last_fullsized":"2024-09-21T08:55:35.676895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.676798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:17.765037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.440867+0000","last_change":"2024-09-21T08:55:48.440895+0000","last_active":"2024-09-21T08:55:48.440867+0000","last_peered":"2024-09-21T08:55:48.440867+0000","last_clean":"2024-09-21T08:55:48.440867+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:55:48.440867+0000","last_undegraded":"2024-09-21T08:55:48.440867+0000","last_fullsized":"2024-09-21T08:55:48.440867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.440751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:09.215187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.724429+0000","last_change":"2024-09-21T08:55:32.724453+0000","last_active":"2024-09-21T08:55:32.724429+0000","last_peered":"2024-09-21T08:55:32.724429+0000","last_clean":"2024-09-21T08:55:32.724429+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:55:32.724429+0000","last_undegraded":"2024-09-21T08:55:32.724429+0000","last_fullsized":"2024-09-21T08:55:32.724429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.724341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:18.603732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.835379+0000","last_change":"2024-09-21T08:55:40.835407+0000","last_active":"2024-09-21T08:55:40.835379+0000","last_peered":"2024-09-21T08:55:40.835379+0000","last_clean":"2024-09-21T08:55:40.835379+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:55:40.835379+0000","last_undegraded":"2024-09-21T08:55:40.835379+0000","last_fullsized":"2024-09-21T08:55:40.835379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.835288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:34.317951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.328611+0000","last_change":"2024-09-21T08:55:34.328639+0000","last_active":"2024-09-21T08:55:34.328611+0000","last_peered":"2024-09-21T08:55:34.328611+0000","last_clean":"2024-09-21T08:55:34.328611+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:55:34.328611+0000","last_undegraded":"2024-09-21T08:55:34.328611+0000","last_fullsized":"2024-09-21T08:55:34.328611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.328524+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:28.403133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182261+0000","last_change":"2024-09-21T08:51:38.126946+0000","last_active":"2024-09-21T08:54:00.182261+0000","last_peered":"2024-09-21T08:54:00.182261+0000","last_clean":"2024-09-21T08:54:00.182261+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:54:00.182261+0000","last_undegraded":"2024-09-21T08:54:00.182261+0000","last_fullsized":"2024-09-21T08:54:00.182261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.615162+0000","last_change":"2024-09-21T08:55:53.615189+0000","last_active":"2024-09-21T08:55:53.615162+0000","last_peered":"2024-09-21T08:55:53.615162+0000","last_clean":"2024-09-21T08:55:53.615162+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:55:53.615162+0000","last_undegraded":"2024-09-21T08:55:53.615162+0000","last_fullsized":"2024-09-21T08:55:53.615162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.615080+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:40.609106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.875580+0000","last_change":"2024-09-21T08:55:39.875606+0000","last_active":"2024-09-21T08:55:39.875580+0000","last_peered":"2024-09-21T08:55:39.875580+0000","last_clean":"2024-09-21T08:55:39.875580+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:55:39.875580+0000","last_undegraded":"2024-09-21T08:55:39.875580+0000","last_fullsized":"2024-09-21T08:55:39.875580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.875491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:41.825808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182291+0000","last_change":"2024-09-21T08:51:38.151052+0000","last_active":"2024-09-21T08:54:00.182291+0000","last_peered":"2024-09-21T08:54:00.182291+0000","last_clean":"2024-09-21T08:54:00.182291+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:54:00.182291+0000","last_undegraded":"2024-09-21T08:54:00.182291+0000","last_fullsized":"2024-09-21T08:54:00.182291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.798158+0000","last_change":"2024-09-21T08:54:59.798211+0000","last_active":"2024-09-21T08:54:59.798158+0000","last_peered":"2024-09-21T08:54:59.798158+0000","last_clean":"2024-09-21T08:54:59.798158+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:54:59.798158+0000","last_undegraded":"2024-09-21T08:54:59.798158+0000","last_fullsized":"2024-09-21T08:54:59.798158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.798019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:26.891797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'42","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.790948+0000","last_change":"2024-09-21T08:55:25.791003+0000","last_active":"2024-09-21T08:55:25.790948+0000","last_peered":"2024-09-21T08:55:25.790948+0000","last_clean":"2024-09-21T08:55:25.790948+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:55:25.790948+0000","last_undegraded":"2024-09-21T08:55:25.790948+0000","last_fullsized":"2024-09-21T08:55:25.790948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'42","last_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_deep_scrub":"36'42","last_deep_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.790847+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:12.540524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.311370+0000","last_change":"2024-09-21T08:55:08.311412+0000","last_active":"2024-09-21T08:55:08.311370+0000","last_peered":"2024-09-21T08:55:08.311370+0000","last_clean":"2024-09-21T08:55:08.311370+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:55:08.311370+0000","last_undegraded":"2024-09-21T08:55:08.311370+0000","last_fullsized":"2024-09-21T08:55:08.311370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.311270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:32.145710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184062+0000","last_change":"2024-09-21T08:51:48.165478+0000","last_active":"2024-09-21T08:54:15.184062+0000","last_peered":"2024-09-21T08:54:15.184062+0000","last_clean":"2024-09-21T08:54:15.184062+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:54:15.184062+0000","last_undegraded":"2024-09-21T08:54:15.184062+0000","last_fullsized":"2024-09-21T08:54:15.184062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.846905+0000","last_change":"2024-09-21T08:55:38.846931+0000","last_active":"2024-09-21T08:55:38.846905+0000","last_peered":"2024-09-21T08:55:38.846905+0000","last_clean":"2024-09-21T08:55:38.846905+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:55:38.846905+0000","last_undegraded":"2024-09-21T08:55:38.846905+0000","last_fullsized":"2024-09-21T08:55:38.846905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.846819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:19.411878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.717883+0000","last_change":"2024-09-21T08:55:35.717928+0000","last_active":"2024-09-21T08:55:35.717883+0000","last_peered":"2024-09-21T08:55:35.717883+0000","last_clean":"2024-09-21T08:55:35.717883+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:55:35.717883+0000","last_undegraded":"2024-09-21T08:55:35.717883+0000","last_fullsized":"2024-09-21T08:55:35.717883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.717771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.729351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.788065+0000","last_change":"2024-09-21T08:55:13.788099+0000","last_active":"2024-09-21T08:55:13.788065+0000","last_peered":"2024-09-21T08:55:13.788065+0000","last_clean":"2024-09-21T08:55:13.788065+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:55:13.788065+0000","last_undegraded":"2024-09-21T08:55:13.788065+0000","last_fullsized":"2024-09-21T08:55:13.788065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.787969+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:42.737974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.271126+0000","last_change":"2024-09-21T08:55:03.271154+0000","last_active":"2024-09-21T08:55:03.271126+0000","last_peered":"2024-09-21T08:55:03.271126+0000","last_clean":"2024-09-21T08:55:03.271126+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:55:03.271126+0000","last_undegraded":"2024-09-21T08:55:03.271126+0000","last_fullsized":"2024-09-21T08:55:03.271126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.271042+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:48.059788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.283436+0000","last_change":"2024-09-21T08:55:16.283461+0000","last_active":"2024-09-21T08:55:16.283436+0000","last_peered":"2024-09-21T08:55:16.283436+0000","last_clean":"2024-09-21T08:55:16.283436+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:55:16.283436+0000","last_undegraded":"2024-09-21T08:55:16.283436+0000","last_fullsized":"2024-09-21T08:55:16.283436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:56.311040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.803836+0000","last_change":"2024-09-21T08:55:23.803862+0000","last_active":"2024-09-21T08:55:23.803836+0000","last_peered":"2024-09-21T08:55:23.803836+0000","last_clean":"2024-09-21T08:55:23.803836+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:55:23.803836+0000","last_undegraded":"2024-09-21T08:55:23.803836+0000","last_fullsized":"2024-09-21T08:55:23.803836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.803738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:17.468439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.729621+0000","last_change":"2024-09-21T08:55:35.729650+0000","last_active":"2024-09-21T08:55:35.729621+0000","last_peered":"2024-09-21T08:55:35.729621+0000","last_clean":"2024-09-21T08:55:35.729621+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:55:35.729621+0000","last_undegraded":"2024-09-21T08:55:35.729621+0000","last_fullsized":"2024-09-21T08:55:35.729621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.729524+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:50.337054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182223+0000","last_change":"2024-09-21T08:51:38.137733+0000","last_active":"2024-09-21T08:54:00.182223+0000","last_peered":"2024-09-21T08:54:00.182223+0000","last_clean":"2024-09-21T08:54:00.182223+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:54:00.182223+0000","last_undegraded":"2024-09-21T08:54:00.182223+0000","last_fullsized":"2024-09-21T08:54:00.182223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.766522+0000","last_change":"2024-09-21T08:55:16.766565+0000","last_active":"2024-09-21T08:55:16.766522+0000","last_peered":"2024-09-21T08:55:16.766522+0000","last_clean":"2024-09-21T08:55:16.766522+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:55:16.766522+0000","last_undegraded":"2024-09-21T08:55:16.766522+0000","last_fullsized":"2024-09-21T08:55:16.766522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.766426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.846397+0000","last_change":"2024-09-21T08:55:03.846476+0000","last_active":"2024-09-21T08:55:03.846397+0000","last_peered":"2024-09-21T08:55:03.846397+0000","last_clean":"2024-09-21T08:55:03.846397+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:55:03.846397+0000","last_undegraded":"2024-09-21T08:55:03.846397+0000","last_fullsized":"2024-09-21T08:55:03.846397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.846298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.204915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":397,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.800259+0000","last_change":"2024-09-21T08:55:24.800324+0000","last_active":"2024-09-21T08:55:24.800259+0000","last_peered":"2024-09-21T08:55:24.800259+0000","last_clean":"2024-09-21T08:55:24.800259+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:55:24.800259+0000","last_undegraded":"2024-09-21T08:55:24.800259+0000","last_fullsized":"2024-09-21T08:55:24.800259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.800122+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:26.312772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.730235+0000","last_change":"2024-09-21T08:55:44.730260+0000","last_active":"2024-09-21T08:55:44.730235+0000","last_peered":"2024-09-21T08:55:44.730235+0000","last_clean":"2024-09-21T08:55:44.730235+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:55:44.730235+0000","last_undegraded":"2024-09-21T08:55:44.730235+0000","last_fullsized":"2024-09-21T08:55:44.730235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.730154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:15.236835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.784611+0000","last_change":"2024-09-21T08:55:43.784636+0000","last_active":"2024-09-21T08:55:43.784611+0000","last_peered":"2024-09-21T08:55:43.784611+0000","last_clean":"2024-09-21T08:55:43.784611+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:55:43.784611+0000","last_undegraded":"2024-09-21T08:55:43.784611+0000","last_fullsized":"2024-09-21T08:55:43.784611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.784505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:53.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.512513+0000","last_change":"2024-09-21T08:55:46.512542+0000","last_active":"2024-09-21T08:55:46.512513+0000","last_peered":"2024-09-21T08:55:46.512513+0000","last_clean":"2024-09-21T08:55:46.512513+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:55:46.512513+0000","last_undegraded":"2024-09-21T08:55:46.512513+0000","last_fullsized":"2024-09-21T08:55:46.512513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.512417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:13.737081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.844294+0000","last_change":"2024-09-21T08:55:06.844317+0000","last_active":"2024-09-21T08:55:06.844294+0000","last_peered":"2024-09-21T08:55:06.844294+0000","last_clean":"2024-09-21T08:55:06.844294+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:55:06.844294+0000","last_undegraded":"2024-09-21T08:55:06.844294+0000","last_fullsized":"2024-09-21T08:55:06.844294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.844209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:21.913747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.875043+0000","last_change":"2024-09-21T08:55:01.875112+0000","last_active":"2024-09-21T08:55:01.875043+0000","last_peered":"2024-09-21T08:55:01.875043+0000","last_clean":"2024-09-21T08:55:01.875043+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:55:01.875043+0000","last_undegraded":"2024-09-21T08:55:01.875043+0000","last_fullsized":"2024-09-21T08:55:01.875043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.874944+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:51.653141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":412,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.728803+0000","last_change":"2024-09-21T08:54:59.728835+0000","last_active":"2024-09-21T08:54:59.728803+0000","last_peered":"2024-09-21T08:54:59.728803+0000","last_clean":"2024-09-21T08:54:59.728803+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:59.728803+0000","last_undegraded":"2024-09-21T08:54:59.728803+0000","last_fullsized":"2024-09-21T08:54:59.728803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.728698+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:59.656529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.761681+0000","last_change":"2024-09-21T08:55:17.761716+0000","last_active":"2024-09-21T08:55:17.761681+0000","last_peered":"2024-09-21T08:55:17.761681+0000","last_clean":"2024-09-21T08:55:17.761681+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:55:17.761681+0000","last_undegraded":"2024-09-21T08:55:17.761681+0000","last_fullsized":"2024-09-21T08:55:17.761681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.761576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:31.242840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.695969+0000","last_change":"2024-09-21T08:55:39.695994+0000","last_active":"2024-09-21T08:55:39.695969+0000","last_peered":"2024-09-21T08:55:39.695969+0000","last_clean":"2024-09-21T08:55:39.695969+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:55:39.695969+0000","last_undegraded":"2024-09-21T08:55:39.695969+0000","last_fullsized":"2024-09-21T08:55:39.695969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.695871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:43.205570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.335766+0000","last_change":"2024-09-21T08:55:07.335805+0000","last_active":"2024-09-21T08:55:07.335766+0000","last_peered":"2024-09-21T08:55:07.335766+0000","last_clean":"2024-09-21T08:55:07.335766+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:55:07.335766+0000","last_undegraded":"2024-09-21T08:55:07.335766+0000","last_fullsized":"2024-09-21T08:55:07.335766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.335664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:12.617439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.848147+0000","last_change":"2024-09-21T08:55:05.848218+0000","last_active":"2024-09-21T08:55:05.848147+0000","last_peered":"2024-09-21T08:55:05.848147+0000","last_clean":"2024-09-21T08:55:05.848147+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:55:05.848147+0000","last_undegraded":"2024-09-21T08:55:05.848147+0000","last_fullsized":"2024-09-21T08:55:05.848147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.848037+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:50.214913+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.716703+0000","last_change":"2024-09-21T08:55:15.716764+0000","last_active":"2024-09-21T08:55:15.716703+0000","last_peered":"2024-09-21T08:55:15.716703+0000","last_clean":"2024-09-21T08:55:15.716703+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:55:15.716703+0000","last_undegraded":"2024-09-21T08:55:15.716703+0000","last_fullsized":"2024-09-21T08:55:15.716703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.716602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:42.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.718829+0000","last_change":"2024-09-21T08:55:45.718870+0000","last_active":"2024-09-21T08:55:45.718829+0000","last_peered":"2024-09-21T08:55:45.718829+0000","last_clean":"2024-09-21T08:55:45.718829+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:55:45.718829+0000","last_undegraded":"2024-09-21T08:55:45.718829+0000","last_fullsized":"2024-09-21T08:55:45.718829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.718731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:25.241247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.368252+0000","last_change":"2024-09-21T08:55:29.368278+0000","last_active":"2024-09-21T08:55:29.368252+0000","last_peered":"2024-09-21T08:55:29.368252+0000","last_clean":"2024-09-21T08:55:29.368252+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:55:29.368252+0000","last_undegraded":"2024-09-21T08:55:29.368252+0000","last_fullsized":"2024-09-21T08:55:29.368252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.368154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:39.906265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.732766+0000","last_change":"2024-09-21T08:55:29.732793+0000","last_active":"2024-09-21T08:55:29.732766+0000","last_peered":"2024-09-21T08:55:29.732766+0000","last_clean":"2024-09-21T08:55:29.732766+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:55:29.732766+0000","last_undegraded":"2024-09-21T08:55:29.732766+0000","last_fullsized":"2024-09-21T08:55:29.732766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:16.861355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.780399+0000","last_change":"2024-09-21T08:55:22.780422+0000","last_active":"2024-09-21T08:55:22.780399+0000","last_peered":"2024-09-21T08:55:22.780399+0000","last_clean":"2024-09-21T08:55:22.780399+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:55:22.780399+0000","last_undegraded":"2024-09-21T08:55:22.780399+0000","last_fullsized":"2024-09-21T08:55:22.780399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.780305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:24.779384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.783317+0000","last_change":"2024-09-21T08:55:02.783357+0000","last_active":"2024-09-21T08:55:02.783317+0000","last_peered":"2024-09-21T08:55:02.783317+0000","last_clean":"2024-09-21T08:55:02.783317+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:55:02.783317+0000","last_undegraded":"2024-09-21T08:55:02.783317+0000","last_fullsized":"2024-09-21T08:55:02.783317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.783222+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:51.818565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.753372+0000","last_change":"2024-09-21T08:54:58.753424+0000","last_active":"2024-09-21T08:54:58.753372+0000","last_peered":"2024-09-21T08:54:58.753372+0000","last_clean":"2024-09-21T08:54:58.753372+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:54:58.753372+0000","last_undegraded":"2024-09-21T08:54:58.753372+0000","last_fullsized":"2024-09-21T08:54:58.753372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.753265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:03.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.585200+0000","last_change":"2024-09-21T08:55:52.585257+0000","last_active":"2024-09-21T08:55:52.585200+0000","last_peered":"2024-09-21T08:55:52.585200+0000","last_clean":"2024-09-21T08:55:52.585200+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:55:52.585200+0000","last_undegraded":"2024-09-21T08:55:52.585200+0000","last_fullsized":"2024-09-21T08:55:52.585200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.585105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:30.427159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.748686+0000","last_change":"2024-09-21T08:55:42.748713+0000","last_active":"2024-09-21T08:55:42.748686+0000","last_peered":"2024-09-21T08:55:42.748686+0000","last_clean":"2024-09-21T08:55:42.748686+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:55:42.748686+0000","last_undegraded":"2024-09-21T08:55:42.748686+0000","last_fullsized":"2024-09-21T08:55:42.748686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.748598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.005211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181518+0000","last_change":"2024-09-21T08:51:38.146240+0000","last_active":"2024-09-21T08:53:55.181518+0000","last_peered":"2024-09-21T08:53:55.181518+0000","last_clean":"2024-09-21T08:53:55.181518+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:53:55.181518+0000","last_undegraded":"2024-09-21T08:53:55.181518+0000","last_fullsized":"2024-09-21T08:53:55.181518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.760338+0000","last_change":"2024-09-21T08:55:14.760365+0000","last_active":"2024-09-21T08:55:14.760338+0000","last_peered":"2024-09-21T08:55:14.760338+0000","last_clean":"2024-09-21T08:55:14.760338+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:55:14.760338+0000","last_undegraded":"2024-09-21T08:55:14.760338+0000","last_fullsized":"2024-09-21T08:55:14.760338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:36.121650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.804389+0000","last_change":"2024-09-21T08:55:08.804457+0000","last_active":"2024-09-21T08:55:08.804389+0000","last_peered":"2024-09-21T08:55:08.804389+0000","last_clean":"2024-09-21T08:55:08.804389+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:55:08.804389+0000","last_undegraded":"2024-09-21T08:55:08.804389+0000","last_fullsized":"2024-09-21T08:55:08.804389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.804253+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:28.647102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.784943+0000","last_change":"2024-09-21T08:54:57.784970+0000","last_active":"2024-09-21T08:54:57.784943+0000","last_peered":"2024-09-21T08:54:57.784943+0000","last_clean":"2024-09-21T08:54:57.784943+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:57.784943+0000","last_undegraded":"2024-09-21T08:54:57.784943+0000","last_fullsized":"2024-09-21T08:54:57.784943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.784865+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:42.573611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:59.180055+0000","last_change":"2024-09-21T08:51:48.157013+0000","last_active":"2024-09-21T08:53:59.180055+0000","last_peered":"2024-09-21T08:53:59.180055+0000","last_clean":"2024-09-21T08:53:59.180055+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:53:59.180055+0000","last_undegraded":"2024-09-21T08:53:59.180055+0000","last_fullsized":"2024-09-21T08:53:59.180055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.924856+0000","last_change":"2024-09-21T08:55:20.924903+0000","last_active":"2024-09-21T08:55:20.924856+0000","last_peered":"2024-09-21T08:55:20.924856+0000","last_clean":"2024-09-21T08:55:20.924856+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:55:20.924856+0000","last_undegraded":"2024-09-21T08:55:20.924856+0000","last_fullsized":"2024-09-21T08:55:20.924856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.924750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:02.221123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181448+0000","last_change":"2024-09-21T08:51:38.150406+0000","last_active":"2024-09-21T08:53:55.181448+0000","last_peered":"2024-09-21T08:53:55.181448+0000","last_clean":"2024-09-21T08:53:55.181448+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:53:55.181448+0000","last_undegraded":"2024-09-21T08:53:55.181448+0000","last_fullsized":"2024-09-21T08:53:55.181448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.782185+0000","last_change":"2024-09-21T08:55:20.782208+0000","last_active":"2024-09-21T08:55:20.782185+0000","last_peered":"2024-09-21T08:55:20.782185+0000","last_clean":"2024-09-21T08:55:20.782185+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:55:20.782185+0000","last_undegraded":"2024-09-21T08:55:20.782185+0000","last_fullsized":"2024-09-21T08:55:20.782185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.782093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:39.369522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.756307+0000","last_change":"2024-09-21T08:55:16.756347+0000","last_active":"2024-09-21T08:55:16.756307+0000","last_peered":"2024-09-21T08:55:16.756307+0000","last_clean":"2024-09-21T08:55:16.756307+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:55:16.756307+0000","last_undegraded":"2024-09-21T08:55:16.756307+0000","last_fullsized":"2024-09-21T08:55:16.756307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.756216+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:45.207448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.769611+0000","last_change":"2024-09-21T08:55:03.769638+0000","last_active":"2024-09-21T08:55:03.769611+0000","last_peered":"2024-09-21T08:55:03.769611+0000","last_clean":"2024-09-21T08:55:03.769611+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:55:03.769611+0000","last_undegraded":"2024-09-21T08:55:03.769611+0000","last_fullsized":"2024-09-21T08:55:03.769611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:37.381181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.698737+0000","last_change":"2024-09-21T08:51:48.165086+0000","last_active":"2024-09-21T08:54:46.698737+0000","last_peered":"2024-09-21T08:54:46.698737+0000","last_clean":"2024-09-21T08:54:46.698737+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:54:46.698737+0000","last_undegraded":"2024-09-21T08:54:46.698737+0000","last_fullsized":"2024-09-21T08:54:46.698737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.180964+0000","last_change":"2024-09-21T08:52:14.236551+0000","last_active":"2024-09-21T08:53:55.180964+0000","last_peered":"2024-09-21T08:53:55.180964+0000","last_clean":"2024-09-21T08:53:55.180964+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:53:55.180964+0000","last_undegraded":"2024-09-21T08:53:55.180964+0000","last_fullsized":"2024-09-21T08:53:55.180964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:39.108777+0000","last_clean_scrub_stamp":"2024-09-21T08:51:39.108777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.849988+0000","last_change":"2024-09-21T08:55:47.850043+0000","last_active":"2024-09-21T08:55:47.849988+0000","last_peered":"2024-09-21T08:55:47.849988+0000","last_clean":"2024-09-21T08:55:47.849988+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:55:47.849988+0000","last_undegraded":"2024-09-21T08:55:47.849988+0000","last_fullsized":"2024-09-21T08:55:47.849988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.849880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:03.295159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.770302+0000","last_change":"2024-09-21T08:55:10.770379+0000","last_active":"2024-09-21T08:55:10.770302+0000","last_peered":"2024-09-21T08:55:10.770302+0000","last_clean":"2024-09-21T08:55:10.770302+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:55:10.770302+0000","last_undegraded":"2024-09-21T08:55:10.770302+0000","last_fullsized":"2024-09-21T08:55:10.770302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.770161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:07.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.337520+0000","last_change":"2024-09-21T08:55:05.337560+0000","last_active":"2024-09-21T08:55:05.337520+0000","last_peered":"2024-09-21T08:55:05.337520+0000","last_clean":"2024-09-21T08:55:05.337520+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:55:05.337520+0000","last_undegraded":"2024-09-21T08:55:05.337520+0000","last_fullsized":"2024-09-21T08:55:05.337520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.337433+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:14.239468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.774148+0000","last_change":"2024-09-21T08:55:21.774171+0000","last_active":"2024-09-21T08:55:21.774148+0000","last_peered":"2024-09-21T08:55:21.774148+0000","last_clean":"2024-09-21T08:55:21.774148+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:55:21.774148+0000","last_undegraded":"2024-09-21T08:55:21.774148+0000","last_fullsized":"2024-09-21T08:55:21.774148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.774029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:30:48.998694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.819828+0000","last_change":"2024-09-21T08:55:32.819828+0000","last_active":"2024-09-21T08:55:32.819828+0000","last_peered":"2024-09-21T08:55:32.819828+0000","last_clean":"2024-09-21T08:55:32.819828+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:55:32.819828+0000","last_undegraded":"2024-09-21T08:55:32.819828+0000","last_fullsized":"2024-09-21T08:55:32.819828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.819677+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:40.054203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.765704+0000","last_change":"2024-09-21T08:55:14.765733+0000","last_active":"2024-09-21T08:55:14.765704+0000","last_peered":"2024-09-21T08:55:14.765704+0000","last_clean":"2024-09-21T08:55:14.765704+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:55:14.765704+0000","last_undegraded":"2024-09-21T08:55:14.765704+0000","last_fullsized":"2024-09-21T08:55:14.765704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.765635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:45.731851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:50.180658+0000","last_change":"2024-09-21T08:51:38.147431+0000","last_active":"2024-09-21T08:53:50.180658+0000","last_peered":"2024-09-21T08:53:50.180658+0000","last_clean":"2024-09-21T08:53:50.180658+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:53:50.180658+0000","last_undegraded":"2024-09-21T08:53:50.180658+0000","last_fullsized":"2024-09-21T08:53:50.180658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.811875+0000","last_change":"2024-09-21T08:55:18.811916+0000","last_active":"2024-09-21T08:55:18.811875+0000","last_peered":"2024-09-21T08:55:18.811875+0000","last_clean":"2024-09-21T08:55:18.811875+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:55:18.811875+0000","last_undegraded":"2024-09-21T08:55:18.811875+0000","last_fullsized":"2024-09-21T08:55:18.811875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.811773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:45.894080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.869787+0000","last_change":"2024-09-21T08:55:06.869844+0000","last_active":"2024-09-21T08:55:06.869787+0000","last_peered":"2024-09-21T08:55:06.869787+0000","last_clean":"2024-09-21T08:55:06.869787+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:55:06.869787+0000","last_undegraded":"2024-09-21T08:55:06.869787+0000","last_fullsized":"2024-09-21T08:55:06.869787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.869692+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:33.235003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.047021+0000","last_change":"2024-09-21T08:54:57.047051+0000","last_active":"2024-09-21T08:54:57.047021+0000","last_peered":"2024-09-21T08:54:57.047021+0000","last_clean":"2024-09-21T08:54:57.047021+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:57.047021+0000","last_undegraded":"2024-09-21T08:54:57.047021+0000","last_fullsized":"2024-09-21T08:54:57.047021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.046922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:17.104050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.661551+0000","last_change":"2024-09-21T08:51:48.156797+0000","last_active":"2024-09-21T08:54:46.661551+0000","last_peered":"2024-09-21T08:54:46.661551+0000","last_clean":"2024-09-21T08:54:46.661551+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:54:46.661551+0000","last_undegraded":"2024-09-21T08:54:46.661551+0000","last_fullsized":"2024-09-21T08:54:46.661551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.795398+0000","last_change":"2024-09-21T08:55:26.795434+0000","last_active":"2024-09-21T08:55:26.795398+0000","last_peered":"2024-09-21T08:55:26.795398+0000","last_clean":"2024-09-21T08:55:26.795398+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:55:26.795398+0000","last_undegraded":"2024-09-21T08:55:26.795398+0000","last_fullsized":"2024-09-21T08:55:26.795398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.795295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:53.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.898110+0000","last_change":"2024-09-21T08:55:47.898149+0000","last_active":"2024-09-21T08:55:47.898110+0000","last_peered":"2024-09-21T08:55:47.898110+0000","last_clean":"2024-09-21T08:55:47.898110+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:55:47.898110+0000","last_undegraded":"2024-09-21T08:55:47.898110+0000","last_fullsized":"2024-09-21T08:55:47.898110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.897995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:38.549881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":620,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.275886+0000","last_change":"2024-09-21T08:55:13.275924+0000","last_active":"2024-09-21T08:55:13.275886+0000","last_peered":"2024-09-21T08:55:13.275886+0000","last_clean":"2024-09-21T08:55:13.275886+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:55:13.275886+0000","last_undegraded":"2024-09-21T08:55:13.275886+0000","last_fullsized":"2024-09-21T08:55:13.275886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.275785+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.674831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.785272+0000","last_change":"2024-09-21T08:55:00.785316+0000","last_active":"2024-09-21T08:55:00.785272+0000","last_peered":"2024-09-21T08:55:00.785272+0000","last_clean":"2024-09-21T08:55:00.785272+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:55:00.785272+0000","last_undegraded":"2024-09-21T08:55:00.785272+0000","last_fullsized":"2024-09-21T08:55:00.785272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.785184+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:02.902127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.291164+0000","last_change":"2024-09-21T08:54:57.291227+0000","last_active":"2024-09-21T08:54:57.291164+0000","last_peered":"2024-09-21T08:54:57.291164+0000","last_clean":"2024-09-21T08:54:57.291164+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:57.291164+0000","last_undegraded":"2024-09-21T08:54:57.291164+0000","last_fullsized":"2024-09-21T08:54:57.291164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.291058+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:31.954176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.713571+0000","last_change":"2024-09-21T08:55:43.713606+0000","last_active":"2024-09-21T08:55:43.713571+0000","last_peered":"2024-09-21T08:55:43.713571+0000","last_clean":"2024-09-21T08:55:43.713571+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:55:43.713571+0000","last_undegraded":"2024-09-21T08:55:43.713571+0000","last_fullsized":"2024-09-21T08:55:43.713571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.713484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:38.539015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.248380+0000","last_change":"2024-09-21T08:55:18.248434+0000","last_active":"2024-09-21T08:55:18.248380+0000","last_peered":"2024-09-21T08:55:18.248380+0000","last_clean":"2024-09-21T08:55:18.248380+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:55:18.248380+0000","last_undegraded":"2024-09-21T08:55:18.248380+0000","last_fullsized":"2024-09-21T08:55:18.248380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.248234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.175858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.821644+0000","last_change":"2024-09-21T08:55:54.821675+0000","last_active":"2024-09-21T08:55:54.821644+0000","last_peered":"2024-09-21T08:55:54.821644+0000","last_clean":"2024-09-21T08:55:54.821644+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:55:54.821644+0000","last_undegraded":"2024-09-21T08:55:54.821644+0000","last_fullsized":"2024-09-21T08:55:54.821644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.821560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.789003+0000","last_change":"2024-09-21T08:54:58.789049+0000","last_active":"2024-09-21T08:54:58.789003+0000","last_peered":"2024-09-21T08:54:58.789003+0000","last_clean":"2024-09-21T08:54:58.789003+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:54:58.789003+0000","last_undegraded":"2024-09-21T08:54:58.789003+0000","last_fullsized":"2024-09-21T08:54:58.789003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.788878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:55.506296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.233411+0000","last_change":"2024-09-21T08:55:02.233457+0000","last_active":"2024-09-21T08:55:02.233411+0000","last_peered":"2024-09-21T08:55:02.233411+0000","last_clean":"2024-09-21T08:55:02.233411+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:55:02.233411+0000","last_undegraded":"2024-09-21T08:55:02.233411+0000","last_fullsized":"2024-09-21T08:55:02.233411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.233330+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:49.289271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.914245+0000","last_change":"2024-09-21T08:55:00.914269+0000","last_active":"2024-09-21T08:55:00.914245+0000","last_peered":"2024-09-21T08:55:00.914245+0000","last_clean":"2024-09-21T08:55:00.914245+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:55:00.914245+0000","last_undegraded":"2024-09-21T08:55:00.914245+0000","last_fullsized":"2024-09-21T08:55:00.914245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.914158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:41.840956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.415167+0000","last_change":"2024-09-21T08:55:24.415222+0000","last_active":"2024-09-21T08:55:24.415167+0000","last_peered":"2024-09-21T08:55:24.415167+0000","last_clean":"2024-09-21T08:55:24.415167+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:55:24.415167+0000","last_undegraded":"2024-09-21T08:55:24.415167+0000","last_fullsized":"2024-09-21T08:55:24.415167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.415062+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.497368+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.745614+0000","last_change":"2024-09-21T08:55:15.745614+0000","last_active":"2024-09-21T08:55:15.745614+0000","last_peered":"2024-09-21T08:55:15.745614+0000","last_clean":"2024-09-21T08:55:15.745614+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:55:15.745614+0000","last_undegraded":"2024-09-21T08:55:15.745614+0000","last_fullsized":"2024-09-21T08:55:15.745614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.745464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:56.608749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.487186+0000","last_change":"2024-09-21T08:55:42.487237+0000","last_active":"2024-09-21T08:55:42.487186+0000","last_peered":"2024-09-21T08:55:42.487186+0000","last_clean":"2024-09-21T08:55:42.487186+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:55:42.487186+0000","last_undegraded":"2024-09-21T08:55:42.487186+0000","last_fullsized":"2024-09-21T08:55:42.487186+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.487068+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:00.435324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446810+0000","last_change":"2024-09-21T08:51:28.517984+0000","last_active":"2024-09-21T08:54:57.446810+0000","last_peered":"2024-09-21T08:54:57.446810+0000","last_clean":"2024-09-21T08:54:57.446810+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:54:57.446810+0000","last_undegraded":"2024-09-21T08:54:57.446810+0000","last_fullsized":"2024-09-21T08:54:57.446810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.827630+0000","last_change":"2024-09-21T08:55:49.827630+0000","last_active":"2024-09-21T08:55:49.827630+0000","last_peered":"2024-09-21T08:55:49.827630+0000","last_clean":"2024-09-21T08:55:49.827630+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:55:49.827630+0000","last_undegraded":"2024-09-21T08:55:49.827630+0000","last_fullsized":"2024-09-21T08:55:49.827630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.827461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:54.174951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.277221+0000","last_change":"2024-09-21T08:55:14.277221+0000","last_active":"2024-09-21T08:55:14.277221+0000","last_peered":"2024-09-21T08:55:14.277221+0000","last_clean":"2024-09-21T08:55:14.277221+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:55:14.277221+0000","last_undegraded":"2024-09-21T08:55:14.277221+0000","last_fullsized":"2024-09-21T08:55:14.277221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.277103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:39.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'92","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.791486+0000","last_change":"2024-09-21T08:55:26.791546+0000","last_active":"2024-09-21T08:55:26.791486+0000","last_peered":"2024-09-21T08:55:26.791486+0000","last_clean":"2024-09-21T08:55:26.791486+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:55:26.791486+0000","last_undegraded":"2024-09-21T08:55:26.791486+0000","last_fullsized":"2024-09-21T08:55:26.791486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.791383+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:05.355379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.764985+0000","last_change":"2024-09-21T08:55:02.765010+0000","last_active":"2024-09-21T08:55:02.764985+0000","last_peered":"2024-09-21T08:55:02.764985+0000","last_clean":"2024-09-21T08:55:02.764985+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:55:02.764985+0000","last_undegraded":"2024-09-21T08:55:02.764985+0000","last_fullsized":"2024-09-21T08:55:02.764985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.764887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:26.749713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.857825+0000","last_change":"2024-09-21T08:55:16.857880+0000","last_active":"2024-09-21T08:55:16.857825+0000","last_peered":"2024-09-21T08:55:16.857825+0000","last_clean":"2024-09-21T08:55:16.857825+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:55:16.857825+0000","last_undegraded":"2024-09-21T08:55:16.857825+0000","last_fullsized":"2024-09-21T08:55:16.857825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.857712+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:32.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.907730+0000","last_change":"2024-09-21T08:55:41.907754+0000","last_active":"2024-09-21T08:55:41.907730+0000","last_peered":"2024-09-21T08:55:41.907730+0000","last_clean":"2024-09-21T08:55:41.907730+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:55:41.907730+0000","last_undegraded":"2024-09-21T08:55:41.907730+0000","last_fullsized":"2024-09-21T08:55:41.907730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.907611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.998429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446747+0000","last_change":"2024-09-21T08:51:28.517190+0000","last_active":"2024-09-21T08:54:57.446747+0000","last_peered":"2024-09-21T08:54:57.446747+0000","last_clean":"2024-09-21T08:54:57.446747+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:54:57.446747+0000","last_undegraded":"2024-09-21T08:54:57.446747+0000","last_fullsized":"2024-09-21T08:54:57.446747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.817388+0000","last_change":"2024-09-21T08:55:42.817388+0000","last_active":"2024-09-21T08:55:42.817388+0000","last_peered":"2024-09-21T08:55:42.817388+0000","last_clean":"2024-09-21T08:55:42.817388+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:55:42.817388+0000","last_undegraded":"2024-09-21T08:55:42.817388+0000","last_fullsized":"2024-09-21T08:55:42.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.817206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:50.764942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181617+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:53:55.181617+0000","last_peered":"2024-09-21T08:53:55.181617+0000","last_clean":"2024-09-21T08:53:55.181617+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:53:55.181617+0000","last_undegraded":"2024-09-21T08:53:55.181617+0000","last_fullsized":"2024-09-21T08:53:55.181617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.257947+0000","last_change":"2024-09-21T08:54:59.257947+0000","last_active":"2024-09-21T08:54:59.257947+0000","last_peered":"2024-09-21T08:54:59.257947+0000","last_clean":"2024-09-21T08:54:59.257947+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:59.257947+0000","last_undegraded":"2024-09-21T08:54:59.257947+0000","last_fullsized":"2024-09-21T08:54:59.257947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.257796+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:55.128267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.776067+0000","last_change":"2024-09-21T08:55:19.776067+0000","last_active":"2024-09-21T08:55:19.776067+0000","last_peered":"2024-09-21T08:55:19.776067+0000","last_clean":"2024-09-21T08:55:19.776067+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:55:19.776067+0000","last_undegraded":"2024-09-21T08:55:19.776067+0000","last_fullsized":"2024-09-21T08:55:19.776067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.775947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:14.023176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.562676+0000","last_change":"2024-09-21T08:55:51.562701+0000","last_active":"2024-09-21T08:55:51.562676+0000","last_peered":"2024-09-21T08:55:51.562676+0000","last_clean":"2024-09-21T08:55:51.562676+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:55:51.562676+0000","last_undegraded":"2024-09-21T08:55:51.562676+0000","last_fullsized":"2024-09-21T08:55:51.562676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.562587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:30.126583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.862443+0000","last_change":"2024-09-21T08:55:53.862467+0000","last_active":"2024-09-21T08:55:53.862443+0000","last_peered":"2024-09-21T08:55:53.862443+0000","last_clean":"2024-09-21T08:55:53.862443+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:55:53.862443+0000","last_undegraded":"2024-09-21T08:55:53.862443+0000","last_fullsized":"2024-09-21T08:55:53.862443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.862350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:33.172121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.753073+0000","last_change":"2024-09-21T08:55:34.753073+0000","last_active":"2024-09-21T08:55:34.753073+0000","last_peered":"2024-09-21T08:55:34.753073+0000","last_clean":"2024-09-21T08:55:34.753073+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:55:34.753073+0000","last_undegraded":"2024-09-21T08:55:34.753073+0000","last_fullsized":"2024-09-21T08:55:34.753073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.752903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.670098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.714370+0000","last_change":"2024-09-21T08:55:32.714370+0000","last_active":"2024-09-21T08:55:32.714370+0000","last_peered":"2024-09-21T08:55:32.714370+0000","last_clean":"2024-09-21T08:55:32.714370+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:55:32.714370+0000","last_undegraded":"2024-09-21T08:55:32.714370+0000","last_fullsized":"2024-09-21T08:55:32.714370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.714206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.680422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.647459+0000","last_change":"2024-09-21T08:55:49.647486+0000","last_active":"2024-09-21T08:55:49.647459+0000","last_peered":"2024-09-21T08:55:49.647459+0000","last_clean":"2024-09-21T08:55:49.647459+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:55:49.647459+0000","last_undegraded":"2024-09-21T08:55:49.647459+0000","last_fullsized":"2024-09-21T08:55:49.647459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.647372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:21.810649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.818896+0000","last_change":"2024-09-21T08:55:09.818896+0000","last_active":"2024-09-21T08:55:09.818896+0000","last_peered":"2024-09-21T08:55:09.818896+0000","last_clean":"2024-09-21T08:55:09.818896+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:55:09.818896+0000","last_undegraded":"2024-09-21T08:55:09.818896+0000","last_fullsized":"2024-09-21T08:55:09.818896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.818766+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:10.946408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.758952+0000","last_change":"2024-09-21T08:55:01.758991+0000","last_active":"2024-09-21T08:55:01.758952+0000","last_peered":"2024-09-21T08:55:01.758952+0000","last_clean":"2024-09-21T08:55:01.758952+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:55:01.758952+0000","last_undegraded":"2024-09-21T08:55:01.758952+0000","last_fullsized":"2024-09-21T08:55:01.758952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.758844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:27.038728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.770163+0000","last_change":"2024-09-21T08:55:36.770188+0000","last_active":"2024-09-21T08:55:36.770163+0000","last_peered":"2024-09-21T08:55:36.770163+0000","last_clean":"2024-09-21T08:55:36.770163+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:55:36.770163+0000","last_undegraded":"2024-09-21T08:55:36.770163+0000","last_fullsized":"2024-09-21T08:55:36.770163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.770077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:44.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.735665+0000","last_change":"2024-09-21T08:55:25.735665+0000","last_active":"2024-09-21T08:55:25.735665+0000","last_peered":"2024-09-21T08:55:25.735665+0000","last_clean":"2024-09-21T08:55:25.735665+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:55:25.735665+0000","last_undegraded":"2024-09-21T08:55:25.735665+0000","last_fullsized":"2024-09-21T08:55:25.735665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.735532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:16.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446863+0000","last_change":"2024-09-21T08:51:28.517677+0000","last_active":"2024-09-21T08:54:57.446863+0000","last_peered":"2024-09-21T08:54:57.446863+0000","last_clean":"2024-09-21T08:54:57.446863+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:54:57.446863+0000","last_undegraded":"2024-09-21T08:54:57.446863+0000","last_fullsized":"2024-09-21T08:54:57.446863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.740384+0000","last_change":"2024-09-21T08:55:40.740384+0000","last_active":"2024-09-21T08:55:40.740384+0000","last_peered":"2024-09-21T08:55:40.740384+0000","last_clean":"2024-09-21T08:55:40.740384+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:55:40.740384+0000","last_undegraded":"2024-09-21T08:55:40.740384+0000","last_fullsized":"2024-09-21T08:55:40.740384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.740241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:23.556756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.772851+0000","last_change":"2024-09-21T08:55:12.772851+0000","last_active":"2024-09-21T08:55:12.772851+0000","last_peered":"2024-09-21T08:55:12.772851+0000","last_clean":"2024-09-21T08:55:12.772851+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:55:12.772851+0000","last_undegraded":"2024-09-21T08:55:12.772851+0000","last_fullsized":"2024-09-21T08:55:12.772851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.772717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:25.700341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.753243+0000","last_change":"2024-09-21T08:54:57.753327+0000","last_active":"2024-09-21T08:54:57.753243+0000","last_peered":"2024-09-21T08:54:57.753243+0000","last_clean":"2024-09-21T08:54:57.753243+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:57.753243+0000","last_undegraded":"2024-09-21T08:54:57.753243+0000","last_fullsized":"2024-09-21T08:54:57.753243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.753140+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:11.199581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.789663+0000","last_change":"2024-09-21T08:55:22.789686+0000","last_active":"2024-09-21T08:55:22.789663+0000","last_peered":"2024-09-21T08:55:22.789663+0000","last_clean":"2024-09-21T08:55:22.789663+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:55:22.789663+0000","last_undegraded":"2024-09-21T08:55:22.789663+0000","last_fullsized":"2024-09-21T08:55:22.789663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.789579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:47.777856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.650172+0000","last_change":"2024-09-21T08:55:54.650198+0000","last_active":"2024-09-21T08:55:54.650172+0000","last_peered":"2024-09-21T08:55:54.650172+0000","last_clean":"2024-09-21T08:55:54.650172+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:55:54.650172+0000","last_undegraded":"2024-09-21T08:55:54.650172+0000","last_fullsized":"2024-09-21T08:55:54.650172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.650076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:10.095355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.328523+0000","last_change":"2024-09-21T08:55:21.328523+0000","last_active":"2024-09-21T08:55:21.328523+0000","last_peered":"2024-09-21T08:55:21.328523+0000","last_clean":"2024-09-21T08:55:21.328523+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:55:21.328523+0000","last_undegraded":"2024-09-21T08:55:21.328523+0000","last_fullsized":"2024-09-21T08:55:21.328523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.328401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:48.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.738169+0000","last_change":"2024-09-21T08:55:31.738169+0000","last_active":"2024-09-21T08:55:31.738169+0000","last_peered":"2024-09-21T08:55:31.738169+0000","last_clean":"2024-09-21T08:55:31.738169+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:55:31.738169+0000","last_undegraded":"2024-09-21T08:55:31.738169+0000","last_fullsized":"2024-09-21T08:55:31.738169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.738045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:13.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.819976+0000","last_change":"2024-09-21T08:55:46.820002+0000","last_active":"2024-09-21T08:55:46.819976+0000","last_peered":"2024-09-21T08:55:46.819976+0000","last_clean":"2024-09-21T08:55:46.819976+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:55:46.819976+0000","last_undegraded":"2024-09-21T08:55:46.819976+0000","last_fullsized":"2024-09-21T08:55:46.819976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.819884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:05.525223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.769332+0000","last_change":"2024-09-21T08:55:17.769332+0000","last_active":"2024-09-21T08:55:17.769332+0000","last_peered":"2024-09-21T08:55:17.769332+0000","last_clean":"2024-09-21T08:55:17.769332+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:55:17.769332+0000","last_undegraded":"2024-09-21T08:55:17.769332+0000","last_fullsized":"2024-09-21T08:55:17.769332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.769154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:19.212681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.852373+0000","last_change":"2024-09-21T08:55:05.852373+0000","last_active":"2024-09-21T08:55:05.852373+0000","last_peered":"2024-09-21T08:55:05.852373+0000","last_clean":"2024-09-21T08:55:05.852373+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:55:05.852373+0000","last_undegraded":"2024-09-21T08:55:05.852373+0000","last_fullsized":"2024-09-21T08:55:05.852373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.852239+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.553041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.982940+0000","last_change":"2024-09-21T08:54:58.982940+0000","last_active":"2024-09-21T08:54:58.982940+0000","last_peered":"2024-09-21T08:54:58.982940+0000","last_clean":"2024-09-21T08:54:58.982940+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:54:58.982940+0000","last_undegraded":"2024-09-21T08:54:58.982940+0000","last_fullsized":"2024-09-21T08:54:58.982940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.982822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:26.322430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:04.180896+0000","last_change":"2024-09-21T08:51:48.155643+0000","last_active":"2024-09-21T08:54:04.180896+0000","last_peered":"2024-09-21T08:54:04.180896+0000","last_clean":"2024-09-21T08:54:04.180896+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:54:04.180896+0000","last_undegraded":"2024-09-21T08:54:04.180896+0000","last_fullsized":"2024-09-21T08:54:04.180896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.353664+0000","last_change":"2024-09-21T08:55:27.353664+0000","last_active":"2024-09-21T08:55:27.353664+0000","last_peered":"2024-09-21T08:55:27.353664+0000","last_clean":"2024-09-21T08:55:27.353664+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:55:27.353664+0000","last_undegraded":"2024-09-21T08:55:27.353664+0000","last_fullsized":"2024-09-21T08:55:27.353664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.353550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:16.388892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.875753+0000","last_change":"2024-09-21T08:55:51.875789+0000","last_active":"2024-09-21T08:55:51.875753+0000","last_peered":"2024-09-21T08:55:51.875753+0000","last_clean":"2024-09-21T08:55:51.875753+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:55:51.875753+0000","last_undegraded":"2024-09-21T08:55:51.875753+0000","last_fullsized":"2024-09-21T08:55:51.875753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.875661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:15.984515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446860+0000","last_change":"2024-09-21T08:51:28.517131+0000","last_active":"2024-09-21T08:54:57.446860+0000","last_peered":"2024-09-21T08:54:57.446860+0000","last_clean":"2024-09-21T08:54:57.446860+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:54:57.446860+0000","last_undegraded":"2024-09-21T08:54:57.446860+0000","last_fullsized":"2024-09-21T08:54:57.446860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.847420+0000","last_change":"2024-09-21T08:55:05.847420+0000","last_active":"2024-09-21T08:55:05.847420+0000","last_peered":"2024-09-21T08:55:05.847420+0000","last_clean":"2024-09-21T08:55:05.847420+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:55:05.847420+0000","last_undegraded":"2024-09-21T08:55:05.847420+0000","last_fullsized":"2024-09-21T08:55:05.847420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.847290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:42:43.812529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.280639+0000","last_change":"2024-09-21T08:54:58.280639+0000","last_active":"2024-09-21T08:54:58.280639+0000","last_peered":"2024-09-21T08:54:58.280639+0000","last_clean":"2024-09-21T08:54:58.280639+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:54:58.280639+0000","last_undegraded":"2024-09-21T08:54:58.280639+0000","last_fullsized":"2024-09-21T08:54:58.280639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.280470+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:25.040327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":367,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.299155+0000","last_change":"2024-09-21T08:55:00.299155+0000","last_active":"2024-09-21T08:55:00.299155+0000","last_peered":"2024-09-21T08:55:00.299155+0000","last_clean":"2024-09-21T08:55:00.299155+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:55:00.299155+0000","last_undegraded":"2024-09-21T08:55:00.299155+0000","last_fullsized":"2024-09-21T08:55:00.299155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.299020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:39.253241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.862205+0000","last_change":"2024-09-21T08:55:48.862230+0000","last_active":"2024-09-21T08:55:48.862205+0000","last_peered":"2024-09-21T08:55:48.862205+0000","last_clean":"2024-09-21T08:55:48.862205+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:55:48.862205+0000","last_undegraded":"2024-09-21T08:55:48.862205+0000","last_fullsized":"2024-09-21T08:55:48.862205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.862116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:22.856674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.768148+0000","last_change":"2024-09-21T08:55:11.768148+0000","last_active":"2024-09-21T08:55:11.768148+0000","last_peered":"2024-09-21T08:55:11.768148+0000","last_clean":"2024-09-21T08:55:11.768148+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:55:11.768148+0000","last_undegraded":"2024-09-21T08:55:11.768148+0000","last_fullsized":"2024-09-21T08:55:11.768148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.768028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:52.506242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.810376+0000","last_change":"2024-09-21T08:55:52.810409+0000","last_active":"2024-09-21T08:55:52.810376+0000","last_peered":"2024-09-21T08:55:52.810376+0000","last_clean":"2024-09-21T08:55:52.810376+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:55:52.810376+0000","last_undegraded":"2024-09-21T08:55:52.810376+0000","last_fullsized":"2024-09-21T08:55:52.810376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.810289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.050909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.830117+0000","last_change":"2024-09-21T08:55:45.830117+0000","last_active":"2024-09-21T08:55:45.830117+0000","last_peered":"2024-09-21T08:55:45.830117+0000","last_clean":"2024-09-21T08:55:45.830117+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:55:45.830117+0000","last_undegraded":"2024-09-21T08:55:45.830117+0000","last_fullsized":"2024-09-21T08:55:45.830117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.829992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:23.672046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.822721+0000","last_change":"2024-09-21T08:55:03.822721+0000","last_active":"2024-09-21T08:55:03.822721+0000","last_peered":"2024-09-21T08:55:03.822721+0000","last_clean":"2024-09-21T08:55:03.822721+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:55:03.822721+0000","last_undegraded":"2024-09-21T08:55:03.822721+0000","last_fullsized":"2024-09-21T08:55:03.822721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:17.459600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.863917+0000","last_change":"2024-09-21T08:55:29.863917+0000","last_active":"2024-09-21T08:55:29.863917+0000","last_peered":"2024-09-21T08:55:29.863917+0000","last_clean":"2024-09-21T08:55:29.863917+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:55:29.863917+0000","last_undegraded":"2024-09-21T08:55:29.863917+0000","last_fullsized":"2024-09-21T08:55:29.863917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.863791+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:04.357452+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.791406+0000","last_change":"2024-09-21T08:55:11.791438+0000","last_active":"2024-09-21T08:55:11.791406+0000","last_peered":"2024-09-21T08:55:11.791406+0000","last_clean":"2024-09-21T08:55:11.791406+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:55:11.791406+0000","last_undegraded":"2024-09-21T08:55:11.791406+0000","last_fullsized":"2024-09-21T08:55:11.791406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.791309+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:31.481073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:05.182548+0000","last_change":"2024-09-21T08:51:48.162399+0000","last_active":"2024-09-21T08:54:05.182548+0000","last_peered":"2024-09-21T08:54:05.182548+0000","last_clean":"2024-09-21T08:54:05.182548+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:54:05.182548+0000","last_undegraded":"2024-09-21T08:54:05.182548+0000","last_fullsized":"2024-09-21T08:54:05.182548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.750304+0000","last_change":"2024-09-21T08:55:30.750304+0000","last_active":"2024-09-21T08:55:30.750304+0000","last_peered":"2024-09-21T08:55:30.750304+0000","last_clean":"2024-09-21T08:55:30.750304+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:55:30.750304+0000","last_undegraded":"2024-09-21T08:55:30.750304+0000","last_fullsized":"2024-09-21T08:55:30.750304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.750144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:34.425604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.343092+0000","last_change":"2024-09-21T08:55:37.343120+0000","last_active":"2024-09-21T08:55:37.343092+0000","last_peered":"2024-09-21T08:55:37.343092+0000","last_clean":"2024-09-21T08:55:37.343092+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:55:37.343092+0000","last_undegraded":"2024-09-21T08:55:37.343092+0000","last_fullsized":"2024-09-21T08:55:37.343092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.342994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:14.798606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.446807+0000","last_change":"2024-09-21T08:51:28.517728+0000","last_active":"2024-09-21T08:54:57.446807+0000","last_peered":"2024-09-21T08:54:57.446807+0000","last_clean":"2024-09-21T08:54:57.446807+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:54:57.446807+0000","last_undegraded":"2024-09-21T08:54:57.446807+0000","last_fullsized":"2024-09-21T08:54:57.446807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:25.502114+0000","last_clean_scrub_stamp":"2024-09-21T08:51:25.502114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.447597+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:54:57.447597+0000","last_peered":"2024-09-21T08:54:57.447597+0000","last_clean":"2024-09-21T08:54:57.447597+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:54:57.447597+0000","last_undegraded":"2024-09-21T08:54:57.447597+0000","last_fullsized":"2024-09-21T08:54:57.447597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.829284+0000","last_change":"2024-09-21T08:55:02.829284+0000","last_active":"2024-09-21T08:55:02.829284+0000","last_peered":"2024-09-21T08:55:02.829284+0000","last_clean":"2024-09-21T08:55:02.829284+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:55:02.829284+0000","last_undegraded":"2024-09-21T08:55:02.829284+0000","last_fullsized":"2024-09-21T08:55:02.829284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.829144+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.593879+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.820049+0000","last_change":"2024-09-21T08:55:04.820070+0000","last_active":"2024-09-21T08:55:04.820049+0000","last_peered":"2024-09-21T08:55:04.820049+0000","last_clean":"2024-09-21T08:55:04.820049+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:55:04.820049+0000","last_undegraded":"2024-09-21T08:55:04.820049+0000","last_fullsized":"2024-09-21T08:55:04.820049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.819955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:13.094734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.834090+0000","last_change":"2024-09-21T08:55:12.834113+0000","last_active":"2024-09-21T08:55:12.834090+0000","last_peered":"2024-09-21T08:55:12.834090+0000","last_clean":"2024-09-21T08:55:12.834090+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:55:12.834090+0000","last_undegraded":"2024-09-21T08:55:12.834090+0000","last_fullsized":"2024-09-21T08:55:12.834090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.833970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:00.715535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.696852+0000","last_change":"2024-09-21T08:55:46.696909+0000","last_active":"2024-09-21T08:55:46.696852+0000","last_peered":"2024-09-21T08:55:46.696852+0000","last_clean":"2024-09-21T08:55:46.696852+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:55:46.696852+0000","last_undegraded":"2024-09-21T08:55:46.696852+0000","last_fullsized":"2024-09-21T08:55:46.696852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.696741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:14.571486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.834367+0000","last_change":"2024-09-21T08:55:17.834410+0000","last_active":"2024-09-21T08:55:17.834367+0000","last_peered":"2024-09-21T08:55:17.834367+0000","last_clean":"2024-09-21T08:55:17.834367+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:55:17.834367+0000","last_undegraded":"2024-09-21T08:55:17.834367+0000","last_fullsized":"2024-09-21T08:55:17.834367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.834243+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:49.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182315+0000","last_change":"2024-09-21T08:51:38.138145+0000","last_active":"2024-09-21T08:54:00.182315+0000","last_peered":"2024-09-21T08:54:00.182315+0000","last_clean":"2024-09-21T08:54:00.182315+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:54:00.182315+0000","last_undegraded":"2024-09-21T08:54:00.182315+0000","last_fullsized":"2024-09-21T08:54:00.182315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.275010+0000","last_change":"2024-09-21T08:55:15.275037+0000","last_active":"2024-09-21T08:55:15.275010+0000","last_peered":"2024-09-21T08:55:15.275010+0000","last_clean":"2024-09-21T08:55:15.275010+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:55:15.275010+0000","last_undegraded":"2024-09-21T08:55:15.275010+0000","last_fullsized":"2024-09-21T08:55:15.275010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.274919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:38.364271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.810730+0000","last_change":"2024-09-21T08:55:04.810792+0000","last_active":"2024-09-21T08:55:04.810730+0000","last_peered":"2024-09-21T08:55:04.810730+0000","last_clean":"2024-09-21T08:55:04.810730+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:55:04.810730+0000","last_undegraded":"2024-09-21T08:55:04.810730+0000","last_fullsized":"2024-09-21T08:55:04.810730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.810614+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:15.348725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.814729+0000","last_change":"2024-09-21T08:55:28.814755+0000","last_active":"2024-09-21T08:55:28.814729+0000","last_peered":"2024-09-21T08:55:28.814729+0000","last_clean":"2024-09-21T08:55:28.814729+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:55:28.814729+0000","last_undegraded":"2024-09-21T08:55:28.814729+0000","last_fullsized":"2024-09-21T08:55:28.814729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.814626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.129248+0000","last_change":"2024-09-21T08:51:48.157053+0000","last_active":"2024-09-21T08:54:56.129248+0000","last_peered":"2024-09-21T08:54:56.129248+0000","last_clean":"2024-09-21T08:54:56.129248+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:54:56.129248+0000","last_undegraded":"2024-09-21T08:54:56.129248+0000","last_fullsized":"2024-09-21T08:54:56.129248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.379173+0000","last_change":"2024-09-21T08:55:22.379222+0000","last_active":"2024-09-21T08:55:22.379173+0000","last_peered":"2024-09-21T08:55:22.379173+0000","last_clean":"2024-09-21T08:55:22.379173+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:55:22.379173+0000","last_undegraded":"2024-09-21T08:55:22.379173+0000","last_fullsized":"2024-09-21T08:55:22.379173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.379069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:35.825511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.686421+0000","last_change":"2024-09-21T08:55:38.686447+0000","last_active":"2024-09-21T08:55:38.686421+0000","last_peered":"2024-09-21T08:55:38.686421+0000","last_clean":"2024-09-21T08:55:38.686421+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:55:38.686421+0000","last_undegraded":"2024-09-21T08:55:38.686421+0000","last_fullsized":"2024-09-21T08:55:38.686421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.686327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:51.215101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.817707+0000","last_change":"2024-09-21T08:55:07.817734+0000","last_active":"2024-09-21T08:55:07.817707+0000","last_peered":"2024-09-21T08:55:07.817707+0000","last_clean":"2024-09-21T08:55:07.817707+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:55:07.817707+0000","last_undegraded":"2024-09-21T08:55:07.817707+0000","last_fullsized":"2024-09-21T08:55:07.817707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.817604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:06.637277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.835986+0000","last_change":"2024-09-21T08:54:56.836033+0000","last_active":"2024-09-21T08:54:56.835986+0000","last_peered":"2024-09-21T08:54:56.835986+0000","last_clean":"2024-09-21T08:54:56.835986+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:56.835986+0000","last_undegraded":"2024-09-21T08:54:56.835986+0000","last_fullsized":"2024-09-21T08:54:56.835986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_clean_scrub_stamp":"2024-09-21T08:54:56.835862+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.916858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.824181+0000","last_change":"2024-09-21T08:55:04.824228+0000","last_active":"2024-09-21T08:55:04.824181+0000","last_peered":"2024-09-21T08:55:04.824181+0000","last_clean":"2024-09-21T08:55:04.824181+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:55:04.824181+0000","last_undegraded":"2024-09-21T08:55:04.824181+0000","last_fullsized":"2024-09-21T08:55:04.824181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.824082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:20.883736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.734522+0000","last_change":"2024-09-21T08:55:27.734551+0000","last_active":"2024-09-21T08:55:27.734522+0000","last_peered":"2024-09-21T08:55:27.734522+0000","last_clean":"2024-09-21T08:55:27.734522+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:55:27.734522+0000","last_undegraded":"2024-09-21T08:55:27.734522+0000","last_fullsized":"2024-09-21T08:55:27.734522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.734430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:25.498043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.674293+0000","last_change":"2024-09-21T08:55:29.674323+0000","last_active":"2024-09-21T08:55:29.674293+0000","last_peered":"2024-09-21T08:55:29.674293+0000","last_clean":"2024-09-21T08:55:29.674293+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:55:29.674293+0000","last_undegraded":"2024-09-21T08:55:29.674293+0000","last_fullsized":"2024-09-21T08:55:29.674293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.674182+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:31.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.786099+0000","last_change":"2024-09-21T08:55:41.786127+0000","last_active":"2024-09-21T08:55:41.786099+0000","last_peered":"2024-09-21T08:55:41.786099+0000","last_clean":"2024-09-21T08:55:41.786099+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:55:41.786099+0000","last_undegraded":"2024-09-21T08:55:41.786099+0000","last_fullsized":"2024-09-21T08:55:41.786099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.786001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:58.913913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.849013+0000","last_change":"2024-09-21T08:55:13.849035+0000","last_active":"2024-09-21T08:55:13.849013+0000","last_peered":"2024-09-21T08:55:13.849013+0000","last_clean":"2024-09-21T08:55:13.849013+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:55:13.849013+0000","last_undegraded":"2024-09-21T08:55:13.849013+0000","last_fullsized":"2024-09-21T08:55:13.849013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.848927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.202435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'47","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.833227+0000","last_change":"2024-09-21T08:55:09.833272+0000","last_active":"2024-09-21T08:55:09.833227+0000","last_peered":"2024-09-21T08:55:09.833227+0000","last_clean":"2024-09-21T08:55:09.833227+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:55:09.833227+0000","last_undegraded":"2024-09-21T08:55:09.833227+0000","last_fullsized":"2024-09-21T08:55:09.833227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.833131+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:32.922483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.298583+0000","last_change":"2024-09-21T08:55:04.298628+0000","last_active":"2024-09-21T08:55:04.298583+0000","last_peered":"2024-09-21T08:55:04.298583+0000","last_clean":"2024-09-21T08:55:04.298583+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:55:04.298583+0000","last_undegraded":"2024-09-21T08:55:04.298583+0000","last_fullsized":"2024-09-21T08:55:04.298583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.298475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.675637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.185462+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:54:20.185462+0000","last_peered":"2024-09-21T08:54:20.185462+0000","last_clean":"2024-09-21T08:54:20.185462+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:54:20.185462+0000","last_undegraded":"2024-09-21T08:54:20.185462+0000","last_fullsized":"2024-09-21T08:54:20.185462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.759091+0000","last_change":"2024-09-21T08:55:09.759114+0000","last_active":"2024-09-21T08:55:09.759091+0000","last_peered":"2024-09-21T08:55:09.759091+0000","last_clean":"2024-09-21T08:55:09.759091+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:55:09.759091+0000","last_undegraded":"2024-09-21T08:55:09.759091+0000","last_fullsized":"2024-09-21T08:55:09.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.759005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:03.833615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.445455+0000","last_change":"2024-09-21T08:55:41.445493+0000","last_active":"2024-09-21T08:55:41.445455+0000","last_peered":"2024-09-21T08:55:41.445455+0000","last_clean":"2024-09-21T08:55:41.445455+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:55:41.445455+0000","last_undegraded":"2024-09-21T08:55:41.445455+0000","last_fullsized":"2024-09-21T08:55:41.445455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.445334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:29.306449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.791688+0000","last_change":"2024-09-21T08:55:01.791713+0000","last_active":"2024-09-21T08:55:01.791688+0000","last_peered":"2024-09-21T08:55:01.791688+0000","last_clean":"2024-09-21T08:55:01.791688+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:55:01.791688+0000","last_undegraded":"2024-09-21T08:55:01.791688+0000","last_fullsized":"2024-09-21T08:55:01.791688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.791549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.781022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.862851+0000","last_change":"2024-09-21T08:55:07.862890+0000","last_active":"2024-09-21T08:55:07.862851+0000","last_peered":"2024-09-21T08:55:07.862851+0000","last_clean":"2024-09-21T08:55:07.862851+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:55:07.862851+0000","last_undegraded":"2024-09-21T08:55:07.862851+0000","last_fullsized":"2024-09-21T08:55:07.862851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.862752+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:51.564071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.950779+0000","last_change":"2024-09-21T08:54:59.950823+0000","last_active":"2024-09-21T08:54:59.950779+0000","last_peered":"2024-09-21T08:54:59.950779+0000","last_clean":"2024-09-21T08:54:59.950779+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:54:59.950779+0000","last_undegraded":"2024-09-21T08:54:59.950779+0000","last_fullsized":"2024-09-21T08:54:59.950779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.950635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:23.543628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.930606+0000","last_change":"2024-09-21T08:55:45.930606+0000","last_active":"2024-09-21T08:55:45.930606+0000","last_peered":"2024-09-21T08:55:45.930606+0000","last_clean":"2024-09-21T08:55:45.930606+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:55:45.930606+0000","last_undegraded":"2024-09-21T08:55:45.930606+0000","last_fullsized":"2024-09-21T08:55:45.930606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.930470+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.552172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.771531+0000","last_change":"2024-09-21T08:55:53.771575+0000","last_active":"2024-09-21T08:55:53.771531+0000","last_peered":"2024-09-21T08:55:53.771531+0000","last_clean":"2024-09-21T08:55:53.771531+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:55:53.771531+0000","last_undegraded":"2024-09-21T08:55:53.771531+0000","last_fullsized":"2024-09-21T08:55:53.771531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.771415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.063865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.788002+0000","last_change":"2024-09-21T08:55:21.788002+0000","last_active":"2024-09-21T08:55:21.788002+0000","last_peered":"2024-09-21T08:55:21.788002+0000","last_clean":"2024-09-21T08:55:21.788002+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:55:21.788002+0000","last_undegraded":"2024-09-21T08:55:21.788002+0000","last_fullsized":"2024-09-21T08:55:21.788002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.787814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:10.823157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'65","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.807924+0000","last_change":"2024-09-21T08:55:08.807971+0000","last_active":"2024-09-21T08:55:08.807924+0000","last_peered":"2024-09-21T08:55:08.807924+0000","last_clean":"2024-09-21T08:55:08.807924+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:55:08.807924+0000","last_undegraded":"2024-09-21T08:55:08.807924+0000","last_fullsized":"2024-09-21T08:55:08.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'65","last_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_deep_scrub":"36'65","last_deep_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.807820+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:33.816177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.013839+0000","last_change":"2024-09-21T08:54:58.013862+0000","last_active":"2024-09-21T08:54:58.013839+0000","last_peered":"2024-09-21T08:54:58.013839+0000","last_clean":"2024-09-21T08:54:58.013839+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:54:58.013839+0000","last_undegraded":"2024-09-21T08:54:58.013839+0000","last_fullsized":"2024-09-21T08:54:58.013839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.013702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:15.698435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:09.181620+0000","last_change":"2024-09-21T08:51:48.156793+0000","last_active":"2024-09-21T08:54:09.181620+0000","last_peered":"2024-09-21T08:54:09.181620+0000","last_clean":"2024-09-21T08:54:09.181620+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:54:09.181620+0000","last_undegraded":"2024-09-21T08:54:09.181620+0000","last_fullsized":"2024-09-21T08:54:09.181620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.822947+0000","last_change":"2024-09-21T08:55:41.822974+0000","last_active":"2024-09-21T08:55:41.822947+0000","last_peered":"2024-09-21T08:55:41.822947+0000","last_clean":"2024-09-21T08:55:41.822947+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:55:41.822947+0000","last_undegraded":"2024-09-21T08:55:41.822947+0000","last_fullsized":"2024-09-21T08:55:41.822947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.822847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:42.546644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.488369+0000","last_change":"2024-09-21T08:55:49.488396+0000","last_active":"2024-09-21T08:55:49.488369+0000","last_peered":"2024-09-21T08:55:49.488369+0000","last_clean":"2024-09-21T08:55:49.488369+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:55:49.488369+0000","last_undegraded":"2024-09-21T08:55:49.488369+0000","last_fullsized":"2024-09-21T08:55:49.488369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.488278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:42.503251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.841357+0000","last_change":"2024-09-21T08:55:15.841357+0000","last_active":"2024-09-21T08:55:15.841357+0000","last_peered":"2024-09-21T08:55:15.841357+0000","last_clean":"2024-09-21T08:55:15.841357+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:55:15.841357+0000","last_undegraded":"2024-09-21T08:55:15.841357+0000","last_fullsized":"2024-09-21T08:55:15.841357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.841239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:07.982245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.796107+0000","last_change":"2024-09-21T08:55:12.796146+0000","last_active":"2024-09-21T08:55:12.796107+0000","last_peered":"2024-09-21T08:55:12.796107+0000","last_clean":"2024-09-21T08:55:12.796107+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:55:12.796107+0000","last_undegraded":"2024-09-21T08:55:12.796107+0000","last_fullsized":"2024-09-21T08:55:12.796107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.796020+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:06.530723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.286766+0000","last_change":"2024-09-21T08:55:12.286792+0000","last_active":"2024-09-21T08:55:12.286766+0000","last_peered":"2024-09-21T08:55:12.286766+0000","last_clean":"2024-09-21T08:55:12.286766+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:55:12.286766+0000","last_undegraded":"2024-09-21T08:55:12.286766+0000","last_fullsized":"2024-09-21T08:55:12.286766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.286668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:03.780340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.858572+0000","last_change":"2024-09-21T08:55:40.858621+0000","last_active":"2024-09-21T08:55:40.858572+0000","last_peered":"2024-09-21T08:55:40.858572+0000","last_clean":"2024-09-21T08:55:40.858572+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:55:40.858572+0000","last_undegraded":"2024-09-21T08:55:40.858572+0000","last_fullsized":"2024-09-21T08:55:40.858572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.858468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.799865+0000","last_change":"2024-09-21T08:55:13.799916+0000","last_active":"2024-09-21T08:55:13.799865+0000","last_peered":"2024-09-21T08:55:13.799865+0000","last_clean":"2024-09-21T08:55:13.799865+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:55:13.799865+0000","last_undegraded":"2024-09-21T08:55:13.799865+0000","last_fullsized":"2024-09-21T08:55:13.799865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.799748+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.649021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.495607+0000","last_change":"2024-09-21T08:55:44.495655+0000","last_active":"2024-09-21T08:55:44.495607+0000","last_peered":"2024-09-21T08:55:44.495607+0000","last_clean":"2024-09-21T08:55:44.495607+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:55:44.495607+0000","last_undegraded":"2024-09-21T08:55:44.495607+0000","last_fullsized":"2024-09-21T08:55:44.495607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.495495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:38.742724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.846050+0000","last_change":"2024-09-21T08:55:14.846074+0000","last_active":"2024-09-21T08:55:14.846050+0000","last_peered":"2024-09-21T08:55:14.846050+0000","last_clean":"2024-09-21T08:55:14.846050+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:55:14.846050+0000","last_undegraded":"2024-09-21T08:55:14.846050+0000","last_fullsized":"2024-09-21T08:55:14.846050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.845959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:24.445746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.829399+0000","last_change":"2024-09-21T08:55:10.829399+0000","last_active":"2024-09-21T08:55:10.829399+0000","last_peered":"2024-09-21T08:55:10.829399+0000","last_clean":"2024-09-21T08:55:10.829399+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:55:10.829399+0000","last_undegraded":"2024-09-21T08:55:10.829399+0000","last_fullsized":"2024-09-21T08:55:10.829399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.829198+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:50.856893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.802367+0000","last_change":"2024-09-21T08:55:19.802367+0000","last_active":"2024-09-21T08:55:19.802367+0000","last_peered":"2024-09-21T08:55:19.802367+0000","last_clean":"2024-09-21T08:55:19.802367+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:55:19.802367+0000","last_undegraded":"2024-09-21T08:55:19.802367+0000","last_fullsized":"2024-09-21T08:55:19.802367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.802246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:41.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708384+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.708384+0000","last_peered":"2024-09-21T08:54:46.708384+0000","last_clean":"2024-09-21T08:54:46.708384+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.708384+0000","last_undegraded":"2024-09-21T08:54:46.708384+0000","last_fullsized":"2024-09-21T08:54:46.708384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.775852+0000","last_change":"2024-09-21T08:55:24.775881+0000","last_active":"2024-09-21T08:55:24.775852+0000","last_peered":"2024-09-21T08:55:24.775852+0000","last_clean":"2024-09-21T08:55:24.775852+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:55:24.775852+0000","last_undegraded":"2024-09-21T08:55:24.775852+0000","last_fullsized":"2024-09-21T08:55:24.775852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.775748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:55.003623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183940+0000","last_change":"2024-09-21T08:51:38.149973+0000","last_active":"2024-09-21T08:54:10.183940+0000","last_peered":"2024-09-21T08:54:10.183940+0000","last_clean":"2024-09-21T08:54:10.183940+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:54:10.183940+0000","last_undegraded":"2024-09-21T08:54:10.183940+0000","last_fullsized":"2024-09-21T08:54:10.183940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.214468+0000","last_change":"2024-09-21T08:55:10.214510+0000","last_active":"2024-09-21T08:55:10.214468+0000","last_peered":"2024-09-21T08:55:10.214468+0000","last_clean":"2024-09-21T08:55:10.214468+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:55:10.214468+0000","last_undegraded":"2024-09-21T08:55:10.214468+0000","last_fullsized":"2024-09-21T08:55:10.214468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.214364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:53.485342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.804730+0000","last_change":"2024-09-21T08:55:23.804730+0000","last_active":"2024-09-21T08:55:23.804730+0000","last_peered":"2024-09-21T08:55:23.804730+0000","last_clean":"2024-09-21T08:55:23.804730+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:55:23.804730+0000","last_undegraded":"2024-09-21T08:55:23.804730+0000","last_fullsized":"2024-09-21T08:55:23.804730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.804588+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.579024+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.852971+0000","last_change":"2024-09-21T08:55:08.852971+0000","last_active":"2024-09-21T08:55:08.852971+0000","last_peered":"2024-09-21T08:55:08.852971+0000","last_clean":"2024-09-21T08:55:08.852971+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:55:08.852971+0000","last_undegraded":"2024-09-21T08:55:08.852971+0000","last_fullsized":"2024-09-21T08:55:08.852971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.852812+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:10.217991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.883609+0000","last_change":"2024-09-21T08:55:44.883638+0000","last_active":"2024-09-21T08:55:44.883609+0000","last_peered":"2024-09-21T08:55:44.883609+0000","last_clean":"2024-09-21T08:55:44.883609+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:55:44.883609+0000","last_undegraded":"2024-09-21T08:55:44.883609+0000","last_fullsized":"2024-09-21T08:55:44.883609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.883511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:00.980965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'20","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.912827+0000","last_change":"2024-09-21T08:55:22.912859+0000","last_active":"2024-09-21T08:55:22.912827+0000","last_peered":"2024-09-21T08:55:22.912827+0000","last_clean":"2024-09-21T08:55:22.912827+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:55:22.912827+0000","last_undegraded":"2024-09-21T08:55:22.912827+0000","last_fullsized":"2024-09-21T08:55:22.912827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.912725+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:41.989671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.507430+0000","last_change":"2024-09-21T08:55:43.507456+0000","last_active":"2024-09-21T08:55:43.507430+0000","last_peered":"2024-09-21T08:55:43.507430+0000","last_clean":"2024-09-21T08:55:43.507430+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:55:43.507430+0000","last_undegraded":"2024-09-21T08:55:43.507430+0000","last_fullsized":"2024-09-21T08:55:43.507430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.507314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:19.260233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.250725+0000","last_change":"2024-09-21T08:55:11.250750+0000","last_active":"2024-09-21T08:55:11.250725+0000","last_peered":"2024-09-21T08:55:11.250725+0000","last_clean":"2024-09-21T08:55:11.250725+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:55:11.250725+0000","last_undegraded":"2024-09-21T08:55:11.250725+0000","last_fullsized":"2024-09-21T08:55:11.250725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:35.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.282349+0000","last_change":"2024-09-21T08:55:01.282405+0000","last_active":"2024-09-21T08:55:01.282349+0000","last_peered":"2024-09-21T08:55:01.282349+0000","last_clean":"2024-09-21T08:55:01.282349+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:55:01.282349+0000","last_undegraded":"2024-09-21T08:55:01.282349+0000","last_fullsized":"2024-09-21T08:55:01.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.282245+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:55.435995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.731794+0000","last_change":"2024-09-21T08:55:00.731817+0000","last_active":"2024-09-21T08:55:00.731794+0000","last_peered":"2024-09-21T08:55:00.731794+0000","last_clean":"2024-09-21T08:55:00.731794+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:55:00.731794+0000","last_undegraded":"2024-09-21T08:55:00.731794+0000","last_fullsized":"2024-09-21T08:55:00.731794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.731703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:33.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.329562+0000","last_change":"2024-09-21T08:55:20.329590+0000","last_active":"2024-09-21T08:55:20.329562+0000","last_peered":"2024-09-21T08:55:20.329562+0000","last_clean":"2024-09-21T08:55:20.329562+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:55:20.329562+0000","last_undegraded":"2024-09-21T08:55:20.329562+0000","last_fullsized":"2024-09-21T08:55:20.329562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.329430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:41.690836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.870236+0000","last_change":"2024-09-21T08:55:18.870267+0000","last_active":"2024-09-21T08:55:18.870236+0000","last_peered":"2024-09-21T08:55:18.870236+0000","last_clean":"2024-09-21T08:55:18.870236+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:55:18.870236+0000","last_undegraded":"2024-09-21T08:55:18.870236+0000","last_fullsized":"2024-09-21T08:55:18.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.870118+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:22.956813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.924625+0000","last_change":"2024-09-21T08:55:46.924649+0000","last_active":"2024-09-21T08:55:46.924625+0000","last_peered":"2024-09-21T08:55:46.924625+0000","last_clean":"2024-09-21T08:55:46.924625+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:55:46.924625+0000","last_undegraded":"2024-09-21T08:55:46.924625+0000","last_fullsized":"2024-09-21T08:55:46.924625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.924493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:22.780740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.806832+0000","last_change":"2024-09-21T08:55:11.806872+0000","last_active":"2024-09-21T08:55:11.806832+0000","last_peered":"2024-09-21T08:55:11.806832+0000","last_clean":"2024-09-21T08:55:11.806832+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:55:11.806832+0000","last_undegraded":"2024-09-21T08:55:11.806832+0000","last_fullsized":"2024-09-21T08:55:11.806832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.806716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:26.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.872312+0000","last_change":"2024-09-21T08:55:06.872367+0000","last_active":"2024-09-21T08:55:06.872312+0000","last_peered":"2024-09-21T08:55:06.872312+0000","last_clean":"2024-09-21T08:55:06.872312+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:55:06.872312+0000","last_undegraded":"2024-09-21T08:55:06.872312+0000","last_fullsized":"2024-09-21T08:55:06.872312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.872210+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:58.365881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.754358+0000","last_change":"2024-09-21T08:55:18.754399+0000","last_active":"2024-09-21T08:55:18.754358+0000","last_peered":"2024-09-21T08:55:18.754358+0000","last_clean":"2024-09-21T08:55:18.754358+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:55:18.754358+0000","last_undegraded":"2024-09-21T08:55:18.754358+0000","last_fullsized":"2024-09-21T08:55:18.754358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.754246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:42.773601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184844+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:54:15.184844+0000","last_peered":"2024-09-21T08:54:15.184844+0000","last_clean":"2024-09-21T08:54:15.184844+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:54:15.184844+0000","last_undegraded":"2024-09-21T08:54:15.184844+0000","last_fullsized":"2024-09-21T08:54:15.184844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.929774+0000","last_change":"2024-09-21T08:55:42.929800+0000","last_active":"2024-09-21T08:55:42.929774+0000","last_peered":"2024-09-21T08:55:42.929774+0000","last_clean":"2024-09-21T08:55:42.929774+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:55:42.929774+0000","last_undegraded":"2024-09-21T08:55:42.929774+0000","last_fullsized":"2024-09-21T08:55:42.929774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.929679+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:26.608525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.780445+0000","last_change":"2024-09-21T08:55:44.780472+0000","last_active":"2024-09-21T08:55:44.780445+0000","last_peered":"2024-09-21T08:55:44.780445+0000","last_clean":"2024-09-21T08:55:44.780445+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:55:44.780445+0000","last_undegraded":"2024-09-21T08:55:44.780445+0000","last_fullsized":"2024-09-21T08:55:44.780445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.780350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:23.748592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.263419+0000","last_change":"2024-09-21T08:55:09.263468+0000","last_active":"2024-09-21T08:55:09.263419+0000","last_peered":"2024-09-21T08:55:09.263419+0000","last_clean":"2024-09-21T08:55:09.263419+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:55:09.263419+0000","last_undegraded":"2024-09-21T08:55:09.263419+0000","last_fullsized":"2024-09-21T08:55:09.263419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.263316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:55.833766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'31","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.779617+0000","last_change":"2024-09-21T08:55:10.779651+0000","last_active":"2024-09-21T08:55:10.779617+0000","last_peered":"2024-09-21T08:55:10.779617+0000","last_clean":"2024-09-21T08:55:10.779617+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:55:10.779617+0000","last_undegraded":"2024-09-21T08:55:10.779617+0000","last_fullsized":"2024-09-21T08:55:10.779617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'31","last_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_deep_scrub":"36'31","last_deep_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.779521+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:53.739000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.738161+0000","last_change":"2024-09-21T08:55:20.738188+0000","last_active":"2024-09-21T08:55:20.738161+0000","last_peered":"2024-09-21T08:55:20.738161+0000","last_clean":"2024-09-21T08:55:20.738161+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:55:20.738161+0000","last_undegraded":"2024-09-21T08:55:20.738161+0000","last_fullsized":"2024-09-21T08:55:20.738161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.738067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:07.544426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184813+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:54:15.184813+0000","last_peered":"2024-09-21T08:54:15.184813+0000","last_clean":"2024-09-21T08:54:15.184813+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:54:15.184813+0000","last_undegraded":"2024-09-21T08:54:15.184813+0000","last_fullsized":"2024-09-21T08:54:15.184813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.896750+0000","last_change":"2024-09-21T08:55:19.896791+0000","last_active":"2024-09-21T08:55:19.896750+0000","last_peered":"2024-09-21T08:55:19.896750+0000","last_clean":"2024-09-21T08:55:19.896750+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:55:19.896750+0000","last_undegraded":"2024-09-21T08:55:19.896750+0000","last_fullsized":"2024-09-21T08:55:19.896750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.896662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.710664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.396059+0000","last_change":"2024-09-21T08:55:39.396059+0000","last_active":"2024-09-21T08:55:39.396059+0000","last_peered":"2024-09-21T08:55:39.396059+0000","last_clean":"2024-09-21T08:55:39.396059+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:55:39.396059+0000","last_undegraded":"2024-09-21T08:55:39.396059+0000","last_fullsized":"2024-09-21T08:55:39.396059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.395946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:18.811856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.318908+0000","last_change":"2024-09-21T08:55:06.318938+0000","last_active":"2024-09-21T08:55:06.318908+0000","last_peered":"2024-09-21T08:55:06.318908+0000","last_clean":"2024-09-21T08:55:06.318908+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:55:06.318908+0000","last_undegraded":"2024-09-21T08:55:06.318908+0000","last_fullsized":"2024-09-21T08:55:06.318908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.318814+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:39.323163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.769310+0000","last_change":"2024-09-21T08:55:27.769355+0000","last_active":"2024-09-21T08:55:27.769310+0000","last_peered":"2024-09-21T08:55:27.769310+0000","last_clean":"2024-09-21T08:55:27.769310+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:55:27.769310+0000","last_undegraded":"2024-09-21T08:55:27.769310+0000","last_fullsized":"2024-09-21T08:55:27.769310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.769209+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.299421+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.839335+0000","last_change":"2024-09-21T08:55:07.839358+0000","last_active":"2024-09-21T08:55:07.839335+0000","last_peered":"2024-09-21T08:55:07.839335+0000","last_clean":"2024-09-21T08:55:07.839335+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:55:07.839335+0000","last_undegraded":"2024-09-21T08:55:07.839335+0000","last_fullsized":"2024-09-21T08:55:07.839335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.839244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:46.238290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183990+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:54:10.183990+0000","last_peered":"2024-09-21T08:54:10.183990+0000","last_clean":"2024-09-21T08:54:10.183990+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:54:10.183990+0000","last_undegraded":"2024-09-21T08:54:10.183990+0000","last_fullsized":"2024-09-21T08:54:10.183990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.280328+0000","last_change":"2024-09-21T08:55:19.280368+0000","last_active":"2024-09-21T08:55:19.280328+0000","last_peered":"2024-09-21T08:55:19.280328+0000","last_clean":"2024-09-21T08:55:19.280328+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:55:19.280328+0000","last_undegraded":"2024-09-21T08:55:19.280328+0000","last_fullsized":"2024-09-21T08:55:19.280328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.280205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:48.230211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.707889+0000","last_change":"2024-09-21T08:55:37.707889+0000","last_active":"2024-09-21T08:55:37.707889+0000","last_peered":"2024-09-21T08:55:37.707889+0000","last_clean":"2024-09-21T08:55:37.707889+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:55:37.707889+0000","last_undegraded":"2024-09-21T08:55:37.707889+0000","last_fullsized":"2024-09-21T08:55:37.707889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.707706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:28.506620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.745663+0000","last_change":"2024-09-21T08:55:37.745709+0000","last_active":"2024-09-21T08:55:37.745663+0000","last_peered":"2024-09-21T08:55:37.745663+0000","last_clean":"2024-09-21T08:55:37.745663+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:55:37.745663+0000","last_undegraded":"2024-09-21T08:55:37.745663+0000","last_fullsized":"2024-09-21T08:55:37.745663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.745516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:33.659012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.871380+0000","last_change":"2024-09-21T08:55:48.871380+0000","last_active":"2024-09-21T08:55:48.871380+0000","last_peered":"2024-09-21T08:55:48.871380+0000","last_clean":"2024-09-21T08:55:48.871380+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:55:48.871380+0000","last_undegraded":"2024-09-21T08:55:48.871380+0000","last_fullsized":"2024-09-21T08:55:48.871380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.871258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:46.404775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.911523+0000","last_change":"2024-09-21T08:55:43.911547+0000","last_active":"2024-09-21T08:55:43.911523+0000","last_peered":"2024-09-21T08:55:43.911523+0000","last_clean":"2024-09-21T08:55:43.911523+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:55:43.911523+0000","last_undegraded":"2024-09-21T08:55:43.911523+0000","last_fullsized":"2024-09-21T08:55:43.911523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.911438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.834517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.447100+0000","last_change":"2024-09-21T08:51:38.137359+0000","last_active":"2024-09-21T08:54:57.447100+0000","last_peered":"2024-09-21T08:54:57.447100+0000","last_clean":"2024-09-21T08:54:57.447100+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:54:57.447100+0000","last_undegraded":"2024-09-21T08:54:57.447100+0000","last_fullsized":"2024-09-21T08:54:57.447100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.729640+0000","last_change":"2024-09-21T08:55:26.729668+0000","last_active":"2024-09-21T08:55:26.729640+0000","last_peered":"2024-09-21T08:55:26.729640+0000","last_clean":"2024-09-21T08:55:26.729640+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:55:26.729640+0000","last_undegraded":"2024-09-21T08:55:26.729640+0000","last_fullsized":"2024-09-21T08:55:26.729640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.729534+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:03.131761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.759949+0000","last_change":"2024-09-21T08:55:38.759949+0000","last_active":"2024-09-21T08:55:38.759949+0000","last_peered":"2024-09-21T08:55:38.759949+0000","last_clean":"2024-09-21T08:55:38.759949+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:55:38.759949+0000","last_undegraded":"2024-09-21T08:55:38.759949+0000","last_fullsized":"2024-09-21T08:55:38.759949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.759839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:25.566198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.701599+0000","last_change":"2024-09-21T08:55:33.701599+0000","last_active":"2024-09-21T08:55:33.701599+0000","last_peered":"2024-09-21T08:55:33.701599+0000","last_clean":"2024-09-21T08:55:33.701599+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:55:33.701599+0000","last_undegraded":"2024-09-21T08:55:33.701599+0000","last_fullsized":"2024-09-21T08:55:33.701599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.701471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:14.564757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.888648+0000","last_change":"2024-09-21T08:55:52.888675+0000","last_active":"2024-09-21T08:55:52.888648+0000","last_peered":"2024-09-21T08:55:52.888648+0000","last_clean":"2024-09-21T08:55:52.888648+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:55:52.888648+0000","last_undegraded":"2024-09-21T08:55:52.888648+0000","last_fullsized":"2024-09-21T08:55:52.888648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.888547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:38.715655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.649567+0000","last_change":"2024-09-21T08:55:47.649595+0000","last_active":"2024-09-21T08:55:47.649567+0000","last_peered":"2024-09-21T08:55:47.649567+0000","last_clean":"2024-09-21T08:55:47.649567+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:55:47.649567+0000","last_undegraded":"2024-09-21T08:55:47.649567+0000","last_fullsized":"2024-09-21T08:55:47.649567+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.649463+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:43.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.366046+0000","last_change":"2024-09-21T08:55:31.366070+0000","last_active":"2024-09-21T08:55:31.366046+0000","last_peered":"2024-09-21T08:55:31.366046+0000","last_clean":"2024-09-21T08:55:31.366046+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:55:31.366046+0000","last_undegraded":"2024-09-21T08:55:31.366046+0000","last_fullsized":"2024-09-21T08:55:31.366046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.365957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:46.435495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.794295+0000","last_change":"2024-09-21T08:55:39.794295+0000","last_active":"2024-09-21T08:55:39.794295+0000","last_peered":"2024-09-21T08:55:39.794295+0000","last_clean":"2024-09-21T08:55:39.794295+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:55:39.794295+0000","last_undegraded":"2024-09-21T08:55:39.794295+0000","last_fullsized":"2024-09-21T08:55:39.794295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.794176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:07.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.745341+0000","last_change":"2024-09-21T08:55:33.745413+0000","last_active":"2024-09-21T08:55:33.745341+0000","last_peered":"2024-09-21T08:55:33.745341+0000","last_clean":"2024-09-21T08:55:33.745341+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:55:33.745341+0000","last_undegraded":"2024-09-21T08:55:33.745341+0000","last_fullsized":"2024-09-21T08:55:33.745341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.745214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:50.076591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.529069+0000","last_change":"2024-09-21T08:55:50.529097+0000","last_active":"2024-09-21T08:55:50.529069+0000","last_peered":"2024-09-21T08:55:50.529069+0000","last_clean":"2024-09-21T08:55:50.529069+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:55:50.529069+0000","last_undegraded":"2024-09-21T08:55:50.529069+0000","last_fullsized":"2024-09-21T08:55:50.529069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.528965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:00.243688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.875314+0000","last_change":"2024-09-21T08:55:49.875340+0000","last_active":"2024-09-21T08:55:49.875314+0000","last_peered":"2024-09-21T08:55:49.875314+0000","last_clean":"2024-09-21T08:55:49.875314+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:55:49.875314+0000","last_undegraded":"2024-09-21T08:55:49.875314+0000","last_fullsized":"2024-09-21T08:55:49.875314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.875213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:48.388208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.381065+0000","last_change":"2024-09-21T08:55:28.381089+0000","last_active":"2024-09-21T08:55:28.381065+0000","last_peered":"2024-09-21T08:55:28.381065+0000","last_clean":"2024-09-21T08:55:28.381065+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:55:28.381065+0000","last_undegraded":"2024-09-21T08:55:28.381065+0000","last_fullsized":"2024-09-21T08:55:28.381065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.380951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.017937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.865714+0000","last_change":"2024-09-21T08:55:50.865741+0000","last_active":"2024-09-21T08:55:50.865714+0000","last_peered":"2024-09-21T08:55:50.865714+0000","last_clean":"2024-09-21T08:55:50.865714+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:55:50.865714+0000","last_undegraded":"2024-09-21T08:55:50.865714+0000","last_fullsized":"2024-09-21T08:55:50.865714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.865620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:02.835614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.895356+0000","last_change":"2024-09-21T08:55:30.895412+0000","last_active":"2024-09-21T08:55:30.895356+0000","last_peered":"2024-09-21T08:55:30.895356+0000","last_clean":"2024-09-21T08:55:30.895356+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:55:30.895356+0000","last_undegraded":"2024-09-21T08:55:30.895356+0000","last_fullsized":"2024-09-21T08:55:30.895356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.895250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:29.408246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.721624+0000","last_change":"2024-09-21T08:55:36.721660+0000","last_active":"2024-09-21T08:55:36.721624+0000","last_peered":"2024-09-21T08:55:36.721624+0000","last_clean":"2024-09-21T08:55:36.721624+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:55:36.721624+0000","last_undegraded":"2024-09-21T08:55:36.721624+0000","last_fullsized":"2024-09-21T08:55:36.721624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.721506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:00.740861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.664541+0000","last_change":"2024-09-21T08:55:31.664590+0000","last_active":"2024-09-21T08:55:31.664541+0000","last_peered":"2024-09-21T08:55:31.664541+0000","last_clean":"2024-09-21T08:55:31.664541+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:55:31.664541+0000","last_undegraded":"2024-09-21T08:55:31.664541+0000","last_fullsized":"2024-09-21T08:55:31.664541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.664444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:52.492905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.498279+0000","last_change":"2024-09-21T08:55:45.498308+0000","last_active":"2024-09-21T08:55:45.498279+0000","last_peered":"2024-09-21T08:55:45.498279+0000","last_clean":"2024-09-21T08:55:45.498279+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:55:45.498279+0000","last_undegraded":"2024-09-21T08:55:45.498279+0000","last_fullsized":"2024-09-21T08:55:45.498279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.498182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:32.304541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.353811+0000","last_change":"2024-09-21T08:55:38.353841+0000","last_active":"2024-09-21T08:55:38.353811+0000","last_peered":"2024-09-21T08:55:38.353811+0000","last_clean":"2024-09-21T08:55:38.353811+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:55:38.353811+0000","last_undegraded":"2024-09-21T08:55:38.353811+0000","last_fullsized":"2024-09-21T08:55:38.353811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.353694+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:37.227506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.479934+0000","last_change":"2024-09-21T08:55:47.479963+0000","last_active":"2024-09-21T08:55:47.479934+0000","last_peered":"2024-09-21T08:55:47.479934+0000","last_clean":"2024-09-21T08:55:47.479934+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:55:47.479934+0000","last_undegraded":"2024-09-21T08:55:47.479934+0000","last_fullsized":"2024-09-21T08:55:47.479934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.479837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:40.962501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.415358+0000","last_change":"2024-09-21T08:55:23.415391+0000","last_active":"2024-09-21T08:55:23.415358+0000","last_peered":"2024-09-21T08:55:23.415358+0000","last_clean":"2024-09-21T08:55:23.415358+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:55:23.415358+0000","last_undegraded":"2024-09-21T08:55:23.415358+0000","last_fullsized":"2024-09-21T08:55:23.415358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.415266+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:24.858792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:53:55.181475+0000","last_change":"2024-09-21T08:51:38.130730+0000","last_active":"2024-09-21T08:53:55.181475+0000","last_peered":"2024-09-21T08:53:55.181475+0000","last_clean":"2024-09-21T08:53:55.181475+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:53:55.181475+0000","last_undegraded":"2024-09-21T08:53:55.181475+0000","last_fullsized":"2024-09-21T08:53:55.181475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.320467+0000","last_change":"2024-09-21T08:55:32.320495+0000","last_active":"2024-09-21T08:55:32.320467+0000","last_peered":"2024-09-21T08:55:32.320467+0000","last_clean":"2024-09-21T08:55:32.320467+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:55:32.320467+0000","last_undegraded":"2024-09-21T08:55:32.320467+0000","last_fullsized":"2024-09-21T08:55:32.320467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.320370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:31.140044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.528401+0000","last_change":"2024-09-21T08:51:38.139422+0000","last_active":"2024-09-21T08:54:46.528401+0000","last_peered":"2024-09-21T08:54:46.528401+0000","last_clean":"2024-09-21T08:54:46.528401+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:54:46.528401+0000","last_undegraded":"2024-09-21T08:54:46.528401+0000","last_fullsized":"2024-09-21T08:54:46.528401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.853353+0000","last_change":"2024-09-21T08:55:31.853399+0000","last_active":"2024-09-21T08:55:31.853353+0000","last_peered":"2024-09-21T08:55:31.853353+0000","last_clean":"2024-09-21T08:55:31.853353+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:55:31.853353+0000","last_undegraded":"2024-09-21T08:55:31.853353+0000","last_fullsized":"2024-09-21T08:55:31.853353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.853253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.874388+0000","last_change":"2024-09-21T08:55:23.874414+0000","last_active":"2024-09-21T08:55:23.874388+0000","last_peered":"2024-09-21T08:55:23.874388+0000","last_clean":"2024-09-21T08:55:23.874388+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:55:23.874388+0000","last_undegraded":"2024-09-21T08:55:23.874388+0000","last_fullsized":"2024-09-21T08:55:23.874388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.874282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:43.324372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.375679+0000","last_change":"2024-09-21T08:55:25.375781+0000","last_active":"2024-09-21T08:55:25.375679+0000","last_peered":"2024-09-21T08:55:25.375679+0000","last_clean":"2024-09-21T08:55:25.375679+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:55:25.375679+0000","last_undegraded":"2024-09-21T08:55:25.375679+0000","last_fullsized":"2024-09-21T08:55:25.375679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.375567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:46.793767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:00.182422+0000","last_change":"2024-09-21T08:51:38.138621+0000","last_active":"2024-09-21T08:54:00.182422+0000","last_peered":"2024-09-21T08:54:00.182422+0000","last_clean":"2024-09-21T08:54:00.182422+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:54:00.182422+0000","last_undegraded":"2024-09-21T08:54:00.182422+0000","last_fullsized":"2024-09-21T08:54:00.182422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:37.100756+0000","last_clean_scrub_stamp":"2024-09-21T08:51:37.100756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.826822+0000","last_change":"2024-09-21T08:55:51.826847+0000","last_active":"2024-09-21T08:55:51.826822+0000","last_peered":"2024-09-21T08:55:51.826822+0000","last_clean":"2024-09-21T08:55:51.826822+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:55:51.826822+0000","last_undegraded":"2024-09-21T08:55:51.826822+0000","last_fullsized":"2024-09-21T08:55:51.826822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.826720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:57.054148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.688523+0000","last_change":"2024-09-21T08:55:28.688551+0000","last_active":"2024-09-21T08:55:28.688523+0000","last_peered":"2024-09-21T08:55:28.688523+0000","last_clean":"2024-09-21T08:55:28.688523+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:55:28.688523+0000","last_undegraded":"2024-09-21T08:55:28.688523+0000","last_fullsized":"2024-09-21T08:55:28.688523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.688436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:11.647915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.696898+0000","last_change":"2024-09-21T08:55:30.696969+0000","last_active":"2024-09-21T08:55:30.696898+0000","last_peered":"2024-09-21T08:55:30.696898+0000","last_clean":"2024-09-21T08:55:30.696898+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:55:30.696898+0000","last_undegraded":"2024-09-21T08:55:30.696898+0000","last_fullsized":"2024-09-21T08:55:30.696898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.696780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:08.152392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.239875+0000","last_change":"2024-09-21T08:55:17.239922+0000","last_active":"2024-09-21T08:55:17.239875+0000","last_peered":"2024-09-21T08:55:17.239875+0000","last_clean":"2024-09-21T08:55:17.239875+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:55:17.239875+0000","last_undegraded":"2024-09-21T08:55:17.239875+0000","last_fullsized":"2024-09-21T08:55:17.239875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.239755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.929519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39992,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331848,"statfs":{"total":96636764160,"available":96595812352,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673018,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673019,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:55:58.922 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.922 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.922 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.923 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.923 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.923 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.923 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.923 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.924 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.924 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.924 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.924 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.924 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T08:51:39.108777+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.925 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.925 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.925 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.925 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.925 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T08:51:25.502114+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.926 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.927 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.927 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.927 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.927 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.928 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.928 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.928 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.928 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.928 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.929 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.929 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.929 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.929 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T08:51:37.100756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:55:58.929 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T08:56:18.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:56:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.044+0000 7f4fa181e640 1 Processor -- start 2024-09-21T08:56:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.044+0000 7f4fa181e640 1 -- start start 2024-09-21T08:56:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4fa181e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f9c12e6f0 0x7f4f9c12ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4fa181e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c06e9a0 con 0x7f4f9c12f010 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4fa181e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9c12f420 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f9affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f9c12e6f0 0x7f4f9c12ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f9a7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f9c12f010 0x7f4f9c12b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50890/0 (socket says 172.21.15.29:50890) 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f9a7fc640 1 -- 172.21.15.29:0/420407991 learned_addr learned my addr 172.21.15.29:0/420407991 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f9affd640 1 -- 172.21.15.29:0/420407991 >> v1:172.21.15.29:6789/0 conn(0x7f4f9c12f010 legacy=0x7f4f9c12b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f9affd640 1 -- 172.21.15.29:0/420407991 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c12f5a0 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.045+0000 7f4f99ffb640 1 -- 172.21.15.29:0/420407991 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549316829 0 0) 0x7f4f9c06e9a0 con 0x7f4f9c12f010 2024-09-21T08:56:19.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4f9affd640 1 --2- 172.21.15.29:0/420407991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c12ead0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009720 tx=0x7f4f8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ccd1a850815277 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:19.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4f99ffb640 1 -- 172.21.15.29:0/420407991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c037070 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4f99ffb640 1 -- 172.21.15.29:0/420407991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c02ad90 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4f99ffb640 1 -- 172.21.15.29:0/420407991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c032590 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4fa181e640 1 -- 172.21.15.29:0/420407991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 msgr2=0x7f4f9c12ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.046+0000 7f4fa181e640 1 --2- 172.21.15.29:0/420407991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c12ead0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009720 tx=0x7f4f8c02a110 comp rx=0 tx=0).stop 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 -- 172.21.15.29:0/420407991 shutdown_connections 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 --2- 172.21.15.29:0/420407991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c12ead0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 -- 172.21.15.29:0/420407991 >> 172.21.15.29:0/420407991 conn(0x7f4f9c09f020 msgr2=0x7f4f9c09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 -- 172.21.15.29:0/420407991 shutdown_connections 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 -- 172.21.15.29:0/420407991 wait complete. 2024-09-21T08:56:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.047+0000 7f4fa181e640 1 Processor -- start 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4fa181e640 1 -- start start 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4fa181e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4fa181e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c12bc10 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4f9affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4f9affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53756/0 (socket says 172.21.15.29:53756) 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4f9affd640 1 -- 172.21.15.29:0/2108208292 learned_addr learned my addr 172.21.15.29:0/2108208292 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.048+0000 7f4f9affd640 1 -- 172.21.15.29:0/2108208292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c08c920 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4f9affd640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009720 tx=0x7f4f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c037050 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c038040 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c08b4a0 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c004180 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.049+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1c3df0 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.050+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4f8c004320 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.050+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c12ead0 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.050+0000 7f4f83fff640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 0x7f4f8803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.050+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4f8c06c5c0 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.050+0000 7f4f9a7fc640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 0x7f4f8803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.051+0000 7f4f9a7fc640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 0x7f4f8803a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4f90000c00 tx=0x7f4f90007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:19.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.055+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4f8c03c610 con 0x7f4f9c12e6f0 2024-09-21T08:56:19.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.231+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f9c08cc90 con 0x7f4f880382a0 2024-09-21T08:56:19.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.248+0000 7f4f83fff640 1 -- 172.21.15.29:0/2108208292 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665913 (secure 0 0 0) 0x7f4f9c08cc90 con 0x7f4f880382a0 2024-09-21T08:56:19.256 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:56:19.265 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:56:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 msgr2=0x7f4f8803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 0x7f4f8803a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4f90000c00 tx=0x7f4f90007910 comp rx=0 tx=0).stop 2024-09-21T08:56:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 msgr2=0x7f4f9c1c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009720 tx=0x7f4f8c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 shutdown_connections 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f4f880382a0 0x7f4f8803a760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 --2- 172.21.15.29:0/2108208292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c12e6f0 0x7f4f9c1c38b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.252+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 >> 172.21.15.29:0/2108208292 conn(0x7f4f9c09f020 msgr2=0x7f4f9c098820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.253+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 shutdown_connections 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:19.253+0000 7f4fa181e640 1 -- 172.21.15.29:0/2108208292 wait complete. 2024-09-21T08:56:19.268 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-21T08:56:17.242474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4790,"ondisk_log_size":4790,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152672,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334688,"statfs":{"total":386547056640,"available":386390720512,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005018"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.758671+0000","last_change":"2024-09-21T08:55:27.758671+0000","last_active":"2024-09-21T08:55:27.758671+0000","last_peered":"2024-09-21T08:55:27.758671+0000","last_clean":"2024-09-21T08:55:27.758671+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:55:27.758671+0000","last_undegraded":"2024-09-21T08:55:27.758671+0000","last_fullsized":"2024-09-21T08:55:27.758671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.758533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:27.669521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.300692+0000","last_change":"2024-09-21T08:55:36.300724+0000","last_active":"2024-09-21T08:55:36.300692+0000","last_peered":"2024-09-21T08:55:36.300692+0000","last_clean":"2024-09-21T08:55:36.300692+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:55:36.300692+0000","last_undegraded":"2024-09-21T08:55:36.300692+0000","last_fullsized":"2024-09-21T08:55:36.300692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.300596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.904691+0000","last_change":"2024-09-21T08:55:50.904720+0000","last_active":"2024-09-21T08:55:50.904691+0000","last_peered":"2024-09-21T08:55:50.904691+0000","last_clean":"2024-09-21T08:55:50.904691+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:55:50.904691+0000","last_undegraded":"2024-09-21T08:55:50.904691+0000","last_fullsized":"2024-09-21T08:55:50.904691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.904587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:11.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.803865+0000","last_change":"2024-09-21T08:55:33.803907+0000","last_active":"2024-09-21T08:55:33.803865+0000","last_peered":"2024-09-21T08:55:33.803865+0000","last_clean":"2024-09-21T08:55:33.803865+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:55:33.803865+0000","last_undegraded":"2024-09-21T08:55:33.803865+0000","last_fullsized":"2024-09-21T08:55:33.803865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.803741+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:25.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.853610+0000","last_change":"2024-09-21T08:55:57.853636+0000","last_active":"2024-09-21T08:55:57.853610+0000","last_peered":"2024-09-21T08:55:57.853610+0000","last_clean":"2024-09-21T08:55:57.853610+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:55:57.853610+0000","last_undegraded":"2024-09-21T08:55:57.853610+0000","last_fullsized":"2024-09-21T08:55:57.853610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:57.853516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:57.853516+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.853516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:01.486023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:00.813519+0000","last_change":"2024-09-21T08:56:00.813547+0000","last_active":"2024-09-21T08:56:00.813519+0000","last_peered":"2024-09-21T08:56:00.813519+0000","last_clean":"2024-09-21T08:56:00.813519+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:56:00.813519+0000","last_undegraded":"2024-09-21T08:56:00.813519+0000","last_fullsized":"2024-09-21T08:56:00.813519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:56:00.813425+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:56:00.813425+0000","last_clean_scrub_stamp":"2024-09-21T08:56:00.813425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:43.904243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.752161+0000","last_change":"2024-09-21T08:55:36.752161+0000","last_active":"2024-09-21T08:55:36.752161+0000","last_peered":"2024-09-21T08:55:36.752161+0000","last_clean":"2024-09-21T08:55:36.752161+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:55:36.752161+0000","last_undegraded":"2024-09-21T08:55:36.752161+0000","last_fullsized":"2024-09-21T08:55:36.752161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.752039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:30.109665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.800094+0000","last_change":"2024-09-21T08:55:37.800125+0000","last_active":"2024-09-21T08:55:37.800094+0000","last_peered":"2024-09-21T08:55:37.800094+0000","last_clean":"2024-09-21T08:55:37.800094+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:55:37.800094+0000","last_undegraded":"2024-09-21T08:55:37.800094+0000","last_fullsized":"2024-09-21T08:55:37.800094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.799961+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:11.784216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:14.972992+0000","last_change":"2024-09-21T08:56:14.973020+0000","last_active":"2024-09-21T08:56:14.972992+0000","last_peered":"2024-09-21T08:56:14.972992+0000","last_clean":"2024-09-21T08:56:14.972992+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:56:14.972992+0000","last_undegraded":"2024-09-21T08:56:14.972992+0000","last_fullsized":"2024-09-21T08:56:14.972992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:14.972895+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:14.972895+0000","last_clean_scrub_stamp":"2024-09-21T08:56:14.972895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:04.694553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.436421+0000","last_change":"2024-09-21T08:55:40.436449+0000","last_active":"2024-09-21T08:55:40.436421+0000","last_peered":"2024-09-21T08:55:40.436421+0000","last_clean":"2024-09-21T08:55:40.436421+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:55:40.436421+0000","last_undegraded":"2024-09-21T08:55:40.436421+0000","last_fullsized":"2024-09-21T08:55:40.436421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.436329+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:51.918514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.824531+0000","last_change":"2024-09-21T08:55:25.824569+0000","last_active":"2024-09-21T08:55:25.824531+0000","last_peered":"2024-09-21T08:55:25.824531+0000","last_clean":"2024-09-21T08:55:25.824531+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:55:25.824531+0000","last_undegraded":"2024-09-21T08:55:25.824531+0000","last_fullsized":"2024-09-21T08:55:25.824531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.824445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.554324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.633950+0000","last_change":"2024-09-21T08:55:48.633982+0000","last_active":"2024-09-21T08:55:48.633950+0000","last_peered":"2024-09-21T08:55:48.633950+0000","last_clean":"2024-09-21T08:55:48.633950+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:55:48.633950+0000","last_undegraded":"2024-09-21T08:55:48.633950+0000","last_fullsized":"2024-09-21T08:55:48.633950+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.633864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:18.768417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:12.048336+0000","last_change":"2024-09-21T08:56:12.048364+0000","last_active":"2024-09-21T08:56:12.048336+0000","last_peered":"2024-09-21T08:56:12.048336+0000","last_clean":"2024-09-21T08:56:12.048336+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:56:12.048336+0000","last_undegraded":"2024-09-21T08:56:12.048336+0000","last_fullsized":"2024-09-21T08:56:12.048336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:56:12.048240+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:56:12.048240+0000","last_clean_scrub_stamp":"2024-09-21T08:56:12.048240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:29.940468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.870515+0000","last_change":"2024-09-21T08:55:24.870515+0000","last_active":"2024-09-21T08:55:24.870515+0000","last_peered":"2024-09-21T08:55:24.870515+0000","last_clean":"2024-09-21T08:55:24.870515+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:55:24.870515+0000","last_undegraded":"2024-09-21T08:55:24.870515+0000","last_fullsized":"2024-09-21T08:55:24.870515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.870353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:25.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.719282+0000","last_change":"2024-09-21T08:55:34.719335+0000","last_active":"2024-09-21T08:55:34.719282+0000","last_peered":"2024-09-21T08:55:34.719282+0000","last_clean":"2024-09-21T08:55:34.719282+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:55:34.719282+0000","last_undegraded":"2024-09-21T08:55:34.719282+0000","last_fullsized":"2024-09-21T08:55:34.719282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.719148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:22.580263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.709517+0000","last_change":"2024-09-21T08:55:28.709517+0000","last_active":"2024-09-21T08:55:28.709517+0000","last_peered":"2024-09-21T08:55:28.709517+0000","last_clean":"2024-09-21T08:55:28.709517+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:55:28.709517+0000","last_undegraded":"2024-09-21T08:55:28.709517+0000","last_fullsized":"2024-09-21T08:55:28.709517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.709347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:36.913750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.776513+0000","last_change":"2024-09-21T08:55:34.776552+0000","last_active":"2024-09-21T08:55:34.776513+0000","last_peered":"2024-09-21T08:55:34.776513+0000","last_clean":"2024-09-21T08:55:34.776513+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:55:34.776513+0000","last_undegraded":"2024-09-21T08:55:34.776513+0000","last_fullsized":"2024-09-21T08:55:34.776513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.776428+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:14.086199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.302630+0000","last_change":"2024-09-21T08:55:33.302654+0000","last_active":"2024-09-21T08:55:33.302630+0000","last_peered":"2024-09-21T08:55:33.302630+0000","last_clean":"2024-09-21T08:55:33.302630+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:55:33.302630+0000","last_undegraded":"2024-09-21T08:55:33.302630+0000","last_fullsized":"2024-09-21T08:55:33.302630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.302523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:33.718305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.388837+0000","last_change":"2024-09-21T08:55:30.388861+0000","last_active":"2024-09-21T08:55:30.388837+0000","last_peered":"2024-09-21T08:55:30.388837+0000","last_clean":"2024-09-21T08:55:30.388837+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:55:30.388837+0000","last_undegraded":"2024-09-21T08:55:30.388837+0000","last_fullsized":"2024-09-21T08:55:30.388837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.388729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:08.353968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.912250+0000","last_change":"2024-09-21T08:55:21.912281+0000","last_active":"2024-09-21T08:55:21.912250+0000","last_peered":"2024-09-21T08:55:21.912250+0000","last_clean":"2024-09-21T08:55:21.912250+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:55:21.912250+0000","last_undegraded":"2024-09-21T08:55:21.912250+0000","last_fullsized":"2024-09-21T08:55:21.912250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.912160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:04.573712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.328948+0000","last_change":"2024-09-21T08:55:26.328976+0000","last_active":"2024-09-21T08:55:26.328948+0000","last_peered":"2024-09-21T08:55:26.328948+0000","last_clean":"2024-09-21T08:55:26.328948+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:55:26.328948+0000","last_undegraded":"2024-09-21T08:55:26.328948+0000","last_fullsized":"2024-09-21T08:55:26.328948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.328860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.318333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.330341+0000","last_change":"2024-09-21T08:55:35.330395+0000","last_active":"2024-09-21T08:55:35.330341+0000","last_peered":"2024-09-21T08:55:35.330341+0000","last_clean":"2024-09-21T08:55:35.330341+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:55:35.330341+0000","last_undegraded":"2024-09-21T08:55:35.330341+0000","last_fullsized":"2024-09-21T08:55:35.330341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.330235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.621412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.676895+0000","last_change":"2024-09-21T08:55:35.676928+0000","last_active":"2024-09-21T08:55:35.676895+0000","last_peered":"2024-09-21T08:55:35.676895+0000","last_clean":"2024-09-21T08:55:35.676895+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:55:35.676895+0000","last_undegraded":"2024-09-21T08:55:35.676895+0000","last_fullsized":"2024-09-21T08:55:35.676895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.676798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:17.765037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.440867+0000","last_change":"2024-09-21T08:55:48.440895+0000","last_active":"2024-09-21T08:55:48.440867+0000","last_peered":"2024-09-21T08:55:48.440867+0000","last_clean":"2024-09-21T08:55:48.440867+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:55:48.440867+0000","last_undegraded":"2024-09-21T08:55:48.440867+0000","last_fullsized":"2024-09-21T08:55:48.440867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.440751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:09.215187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.724429+0000","last_change":"2024-09-21T08:55:32.724453+0000","last_active":"2024-09-21T08:55:32.724429+0000","last_peered":"2024-09-21T08:55:32.724429+0000","last_clean":"2024-09-21T08:55:32.724429+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:55:32.724429+0000","last_undegraded":"2024-09-21T08:55:32.724429+0000","last_fullsized":"2024-09-21T08:55:32.724429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.724341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:18.603732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.835379+0000","last_change":"2024-09-21T08:55:40.835407+0000","last_active":"2024-09-21T08:55:40.835379+0000","last_peered":"2024-09-21T08:55:40.835379+0000","last_clean":"2024-09-21T08:55:40.835379+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:55:40.835379+0000","last_undegraded":"2024-09-21T08:55:40.835379+0000","last_fullsized":"2024-09-21T08:55:40.835379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.835288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:34.317951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.328611+0000","last_change":"2024-09-21T08:55:34.328639+0000","last_active":"2024-09-21T08:55:34.328611+0000","last_peered":"2024-09-21T08:55:34.328611+0000","last_clean":"2024-09-21T08:55:34.328611+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:55:34.328611+0000","last_undegraded":"2024-09-21T08:55:34.328611+0000","last_fullsized":"2024-09-21T08:55:34.328611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.328524+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:28.403133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:13.001322+0000","last_change":"2024-09-21T08:56:13.001346+0000","last_active":"2024-09-21T08:56:13.001322+0000","last_peered":"2024-09-21T08:56:13.001322+0000","last_clean":"2024-09-21T08:56:13.001322+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:56:13.001322+0000","last_undegraded":"2024-09-21T08:56:13.001322+0000","last_fullsized":"2024-09-21T08:56:13.001322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:13.001225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:13.001225+0000","last_clean_scrub_stamp":"2024-09-21T08:56:13.001225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:39.003910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.615162+0000","last_change":"2024-09-21T08:55:53.615189+0000","last_active":"2024-09-21T08:55:53.615162+0000","last_peered":"2024-09-21T08:55:53.615162+0000","last_clean":"2024-09-21T08:55:53.615162+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:55:53.615162+0000","last_undegraded":"2024-09-21T08:55:53.615162+0000","last_fullsized":"2024-09-21T08:55:53.615162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.615080+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:40.609106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.875580+0000","last_change":"2024-09-21T08:55:39.875606+0000","last_active":"2024-09-21T08:55:39.875580+0000","last_peered":"2024-09-21T08:55:39.875580+0000","last_clean":"2024-09-21T08:55:39.875580+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:55:39.875580+0000","last_undegraded":"2024-09-21T08:55:39.875580+0000","last_fullsized":"2024-09-21T08:55:39.875580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.875491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:41.825808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:04.980823+0000","last_change":"2024-09-21T08:56:04.980851+0000","last_active":"2024-09-21T08:56:04.980823+0000","last_peered":"2024-09-21T08:56:04.980823+0000","last_clean":"2024-09-21T08:56:04.980823+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:56:04.980823+0000","last_undegraded":"2024-09-21T08:56:04.980823+0000","last_fullsized":"2024-09-21T08:56:04.980823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:04.980684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:04.980684+0000","last_clean_scrub_stamp":"2024-09-21T08:56:04.980684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:25.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.798158+0000","last_change":"2024-09-21T08:54:59.798211+0000","last_active":"2024-09-21T08:54:59.798158+0000","last_peered":"2024-09-21T08:54:59.798158+0000","last_clean":"2024-09-21T08:54:59.798158+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:54:59.798158+0000","last_undegraded":"2024-09-21T08:54:59.798158+0000","last_fullsized":"2024-09-21T08:54:59.798158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.798019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:26.891797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'42","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.790948+0000","last_change":"2024-09-21T08:55:25.791003+0000","last_active":"2024-09-21T08:55:25.790948+0000","last_peered":"2024-09-21T08:55:25.790948+0000","last_clean":"2024-09-21T08:55:25.790948+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:55:25.790948+0000","last_undegraded":"2024-09-21T08:55:25.790948+0000","last_fullsized":"2024-09-21T08:55:25.790948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'42","last_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_deep_scrub":"36'42","last_deep_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.790847+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:12.540524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.311370+0000","last_change":"2024-09-21T08:55:08.311412+0000","last_active":"2024-09-21T08:55:08.311370+0000","last_peered":"2024-09-21T08:55:08.311370+0000","last_clean":"2024-09-21T08:55:08.311370+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:55:08.311370+0000","last_undegraded":"2024-09-21T08:55:08.311370+0000","last_fullsized":"2024-09-21T08:55:08.311370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.311270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:32.145710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.670652+0000","last_change":"2024-09-21T08:55:56.670703+0000","last_active":"2024-09-21T08:55:56.670652+0000","last_peered":"2024-09-21T08:55:56.670652+0000","last_clean":"2024-09-21T08:55:56.670652+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:55:56.670652+0000","last_undegraded":"2024-09-21T08:55:56.670652+0000","last_fullsized":"2024-09-21T08:55:56.670652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:56.670547+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:56.670547+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.670547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:55.183543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.846905+0000","last_change":"2024-09-21T08:55:38.846931+0000","last_active":"2024-09-21T08:55:38.846905+0000","last_peered":"2024-09-21T08:55:38.846905+0000","last_clean":"2024-09-21T08:55:38.846905+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:55:38.846905+0000","last_undegraded":"2024-09-21T08:55:38.846905+0000","last_fullsized":"2024-09-21T08:55:38.846905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.846819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:19.411878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.717883+0000","last_change":"2024-09-21T08:55:35.717928+0000","last_active":"2024-09-21T08:55:35.717883+0000","last_peered":"2024-09-21T08:55:35.717883+0000","last_clean":"2024-09-21T08:55:35.717883+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:55:35.717883+0000","last_undegraded":"2024-09-21T08:55:35.717883+0000","last_fullsized":"2024-09-21T08:55:35.717883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.717771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.729351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.788065+0000","last_change":"2024-09-21T08:55:13.788099+0000","last_active":"2024-09-21T08:55:13.788065+0000","last_peered":"2024-09-21T08:55:13.788065+0000","last_clean":"2024-09-21T08:55:13.788065+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:55:13.788065+0000","last_undegraded":"2024-09-21T08:55:13.788065+0000","last_fullsized":"2024-09-21T08:55:13.788065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.787969+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:42.737974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.271126+0000","last_change":"2024-09-21T08:55:03.271154+0000","last_active":"2024-09-21T08:55:03.271126+0000","last_peered":"2024-09-21T08:55:03.271126+0000","last_clean":"2024-09-21T08:55:03.271126+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:55:03.271126+0000","last_undegraded":"2024-09-21T08:55:03.271126+0000","last_fullsized":"2024-09-21T08:55:03.271126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.271042+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:48.059788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.283436+0000","last_change":"2024-09-21T08:55:16.283461+0000","last_active":"2024-09-21T08:55:16.283436+0000","last_peered":"2024-09-21T08:55:16.283436+0000","last_clean":"2024-09-21T08:55:16.283436+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:55:16.283436+0000","last_undegraded":"2024-09-21T08:55:16.283436+0000","last_fullsized":"2024-09-21T08:55:16.283436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:56.311040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.803836+0000","last_change":"2024-09-21T08:55:23.803862+0000","last_active":"2024-09-21T08:55:23.803836+0000","last_peered":"2024-09-21T08:55:23.803836+0000","last_clean":"2024-09-21T08:55:23.803836+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:55:23.803836+0000","last_undegraded":"2024-09-21T08:55:23.803836+0000","last_fullsized":"2024-09-21T08:55:23.803836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.803738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:17.468439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.729621+0000","last_change":"2024-09-21T08:55:35.729650+0000","last_active":"2024-09-21T08:55:35.729621+0000","last_peered":"2024-09-21T08:55:35.729621+0000","last_clean":"2024-09-21T08:55:35.729621+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:55:35.729621+0000","last_undegraded":"2024-09-21T08:55:35.729621+0000","last_fullsized":"2024-09-21T08:55:35.729621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.729524+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:50.337054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:03.988250+0000","last_change":"2024-09-21T08:56:03.988279+0000","last_active":"2024-09-21T08:56:03.988250+0000","last_peered":"2024-09-21T08:56:03.988250+0000","last_clean":"2024-09-21T08:56:03.988250+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:56:03.988250+0000","last_undegraded":"2024-09-21T08:56:03.988250+0000","last_fullsized":"2024-09-21T08:56:03.988250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:03.988135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:03.988135+0000","last_clean_scrub_stamp":"2024-09-21T08:56:03.988135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:18.156018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.766522+0000","last_change":"2024-09-21T08:55:16.766565+0000","last_active":"2024-09-21T08:55:16.766522+0000","last_peered":"2024-09-21T08:55:16.766522+0000","last_clean":"2024-09-21T08:55:16.766522+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:55:16.766522+0000","last_undegraded":"2024-09-21T08:55:16.766522+0000","last_fullsized":"2024-09-21T08:55:16.766522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.766426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.846397+0000","last_change":"2024-09-21T08:55:03.846476+0000","last_active":"2024-09-21T08:55:03.846397+0000","last_peered":"2024-09-21T08:55:03.846397+0000","last_clean":"2024-09-21T08:55:03.846397+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:55:03.846397+0000","last_undegraded":"2024-09-21T08:55:03.846397+0000","last_fullsized":"2024-09-21T08:55:03.846397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.846298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.204915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":397,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.800259+0000","last_change":"2024-09-21T08:55:24.800324+0000","last_active":"2024-09-21T08:55:24.800259+0000","last_peered":"2024-09-21T08:55:24.800259+0000","last_clean":"2024-09-21T08:55:24.800259+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:55:24.800259+0000","last_undegraded":"2024-09-21T08:55:24.800259+0000","last_fullsized":"2024-09-21T08:55:24.800259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.800122+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:26.312772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.730235+0000","last_change":"2024-09-21T08:55:44.730260+0000","last_active":"2024-09-21T08:55:44.730235+0000","last_peered":"2024-09-21T08:55:44.730235+0000","last_clean":"2024-09-21T08:55:44.730235+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:55:44.730235+0000","last_undegraded":"2024-09-21T08:55:44.730235+0000","last_fullsized":"2024-09-21T08:55:44.730235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.730154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:15.236835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.784611+0000","last_change":"2024-09-21T08:55:43.784636+0000","last_active":"2024-09-21T08:55:43.784611+0000","last_peered":"2024-09-21T08:55:43.784611+0000","last_clean":"2024-09-21T08:55:43.784611+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:55:43.784611+0000","last_undegraded":"2024-09-21T08:55:43.784611+0000","last_fullsized":"2024-09-21T08:55:43.784611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.784505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:53.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.512513+0000","last_change":"2024-09-21T08:55:46.512542+0000","last_active":"2024-09-21T08:55:46.512513+0000","last_peered":"2024-09-21T08:55:46.512513+0000","last_clean":"2024-09-21T08:55:46.512513+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:55:46.512513+0000","last_undegraded":"2024-09-21T08:55:46.512513+0000","last_fullsized":"2024-09-21T08:55:46.512513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.512417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:13.737081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.844294+0000","last_change":"2024-09-21T08:55:06.844317+0000","last_active":"2024-09-21T08:55:06.844294+0000","last_peered":"2024-09-21T08:55:06.844294+0000","last_clean":"2024-09-21T08:55:06.844294+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:55:06.844294+0000","last_undegraded":"2024-09-21T08:55:06.844294+0000","last_fullsized":"2024-09-21T08:55:06.844294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.844209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:21.913747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.875043+0000","last_change":"2024-09-21T08:55:01.875112+0000","last_active":"2024-09-21T08:55:01.875043+0000","last_peered":"2024-09-21T08:55:01.875043+0000","last_clean":"2024-09-21T08:55:01.875043+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:55:01.875043+0000","last_undegraded":"2024-09-21T08:55:01.875043+0000","last_fullsized":"2024-09-21T08:55:01.875043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.874944+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:51.653141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":412,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.728803+0000","last_change":"2024-09-21T08:54:59.728835+0000","last_active":"2024-09-21T08:54:59.728803+0000","last_peered":"2024-09-21T08:54:59.728803+0000","last_clean":"2024-09-21T08:54:59.728803+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:59.728803+0000","last_undegraded":"2024-09-21T08:54:59.728803+0000","last_fullsized":"2024-09-21T08:54:59.728803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.728698+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:59.656529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.761716+0000","last_change":"2024-09-21T08:55:17.761716+0000","last_active":"2024-09-21T08:55:17.761716+0000","last_peered":"2024-09-21T08:55:17.761716+0000","last_clean":"2024-09-21T08:55:17.761716+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:55:17.761716+0000","last_undegraded":"2024-09-21T08:55:17.761716+0000","last_fullsized":"2024-09-21T08:55:17.761716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.761576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:31.242840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.695994+0000","last_change":"2024-09-21T08:55:39.695994+0000","last_active":"2024-09-21T08:55:39.695994+0000","last_peered":"2024-09-21T08:55:39.695994+0000","last_clean":"2024-09-21T08:55:39.695994+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:55:39.695994+0000","last_undegraded":"2024-09-21T08:55:39.695994+0000","last_fullsized":"2024-09-21T08:55:39.695994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.695871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:43.205570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.335805+0000","last_change":"2024-09-21T08:55:07.335805+0000","last_active":"2024-09-21T08:55:07.335805+0000","last_peered":"2024-09-21T08:55:07.335805+0000","last_clean":"2024-09-21T08:55:07.335805+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:55:07.335805+0000","last_undegraded":"2024-09-21T08:55:07.335805+0000","last_fullsized":"2024-09-21T08:55:07.335805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.335664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:12.617439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.848218+0000","last_change":"2024-09-21T08:55:05.848218+0000","last_active":"2024-09-21T08:55:05.848218+0000","last_peered":"2024-09-21T08:55:05.848218+0000","last_clean":"2024-09-21T08:55:05.848218+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:55:05.848218+0000","last_undegraded":"2024-09-21T08:55:05.848218+0000","last_fullsized":"2024-09-21T08:55:05.848218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.848037+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:50.214913+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.716703+0000","last_change":"2024-09-21T08:55:15.716764+0000","last_active":"2024-09-21T08:55:15.716703+0000","last_peered":"2024-09-21T08:55:15.716703+0000","last_clean":"2024-09-21T08:55:15.716703+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:55:15.716703+0000","last_undegraded":"2024-09-21T08:55:15.716703+0000","last_fullsized":"2024-09-21T08:55:15.716703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.716602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:42.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.718870+0000","last_change":"2024-09-21T08:55:45.718870+0000","last_active":"2024-09-21T08:55:45.718870+0000","last_peered":"2024-09-21T08:55:45.718870+0000","last_clean":"2024-09-21T08:55:45.718870+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:55:45.718870+0000","last_undegraded":"2024-09-21T08:55:45.718870+0000","last_fullsized":"2024-09-21T08:55:45.718870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.718731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:25.241247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.368278+0000","last_change":"2024-09-21T08:55:29.368278+0000","last_active":"2024-09-21T08:55:29.368278+0000","last_peered":"2024-09-21T08:55:29.368278+0000","last_clean":"2024-09-21T08:55:29.368278+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:55:29.368278+0000","last_undegraded":"2024-09-21T08:55:29.368278+0000","last_fullsized":"2024-09-21T08:55:29.368278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.368154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:39.906265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.732793+0000","last_change":"2024-09-21T08:55:29.732793+0000","last_active":"2024-09-21T08:55:29.732793+0000","last_peered":"2024-09-21T08:55:29.732793+0000","last_clean":"2024-09-21T08:55:29.732793+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:55:29.732793+0000","last_undegraded":"2024-09-21T08:55:29.732793+0000","last_fullsized":"2024-09-21T08:55:29.732793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:16.861355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.780422+0000","last_change":"2024-09-21T08:55:22.780422+0000","last_active":"2024-09-21T08:55:22.780422+0000","last_peered":"2024-09-21T08:55:22.780422+0000","last_clean":"2024-09-21T08:55:22.780422+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:55:22.780422+0000","last_undegraded":"2024-09-21T08:55:22.780422+0000","last_fullsized":"2024-09-21T08:55:22.780422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.780305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:24.779384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.783357+0000","last_change":"2024-09-21T08:55:02.783357+0000","last_active":"2024-09-21T08:55:02.783357+0000","last_peered":"2024-09-21T08:55:02.783357+0000","last_clean":"2024-09-21T08:55:02.783357+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:55:02.783357+0000","last_undegraded":"2024-09-21T08:55:02.783357+0000","last_fullsized":"2024-09-21T08:55:02.783357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.783222+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:51.818565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.753424+0000","last_change":"2024-09-21T08:54:58.753424+0000","last_active":"2024-09-21T08:54:58.753424+0000","last_peered":"2024-09-21T08:54:58.753424+0000","last_clean":"2024-09-21T08:54:58.753424+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:54:58.753424+0000","last_undegraded":"2024-09-21T08:54:58.753424+0000","last_fullsized":"2024-09-21T08:54:58.753424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.753265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:03.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.585257+0000","last_change":"2024-09-21T08:55:52.585257+0000","last_active":"2024-09-21T08:55:52.585257+0000","last_peered":"2024-09-21T08:55:52.585257+0000","last_clean":"2024-09-21T08:55:52.585257+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:55:52.585257+0000","last_undegraded":"2024-09-21T08:55:52.585257+0000","last_fullsized":"2024-09-21T08:55:52.585257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.585105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:30.427159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.748713+0000","last_change":"2024-09-21T08:55:42.748713+0000","last_active":"2024-09-21T08:55:42.748713+0000","last_peered":"2024-09-21T08:55:42.748713+0000","last_clean":"2024-09-21T08:55:42.748713+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:55:42.748713+0000","last_undegraded":"2024-09-21T08:55:42.748713+0000","last_fullsized":"2024-09-21T08:55:42.748713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.748598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.005211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.857615+0000","last_change":"2024-09-21T08:55:56.857615+0000","last_active":"2024-09-21T08:55:56.857615+0000","last_peered":"2024-09-21T08:55:56.857615+0000","last_clean":"2024-09-21T08:55:56.857615+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:55:56.857615+0000","last_undegraded":"2024-09-21T08:55:56.857615+0000","last_fullsized":"2024-09-21T08:55:56.857615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:56.857500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:56.857500+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.857500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:37.386837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.760365+0000","last_change":"2024-09-21T08:55:14.760365+0000","last_active":"2024-09-21T08:55:14.760365+0000","last_peered":"2024-09-21T08:55:14.760365+0000","last_clean":"2024-09-21T08:55:14.760365+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:55:14.760365+0000","last_undegraded":"2024-09-21T08:55:14.760365+0000","last_fullsized":"2024-09-21T08:55:14.760365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:36.121650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.804457+0000","last_change":"2024-09-21T08:55:08.804457+0000","last_active":"2024-09-21T08:55:08.804457+0000","last_peered":"2024-09-21T08:55:08.804457+0000","last_clean":"2024-09-21T08:55:08.804457+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:55:08.804457+0000","last_undegraded":"2024-09-21T08:55:08.804457+0000","last_fullsized":"2024-09-21T08:55:08.804457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.804253+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:28.647102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.784970+0000","last_change":"2024-09-21T08:54:57.784970+0000","last_active":"2024-09-21T08:54:57.784970+0000","last_peered":"2024-09-21T08:54:57.784970+0000","last_clean":"2024-09-21T08:54:57.784970+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:57.784970+0000","last_undegraded":"2024-09-21T08:54:57.784970+0000","last_fullsized":"2024-09-21T08:54:57.784970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.784865+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:42.573611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.765800+0000","last_change":"2024-09-21T08:55:57.765800+0000","last_active":"2024-09-21T08:55:57.765800+0000","last_peered":"2024-09-21T08:55:57.765800+0000","last_clean":"2024-09-21T08:55:57.765800+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:55:57.765800+0000","last_undegraded":"2024-09-21T08:55:57.765800+0000","last_fullsized":"2024-09-21T08:55:57.765800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:57.765674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:57.765674+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.765674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:38.330732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.924903+0000","last_change":"2024-09-21T08:55:20.924903+0000","last_active":"2024-09-21T08:55:20.924903+0000","last_peered":"2024-09-21T08:55:20.924903+0000","last_clean":"2024-09-21T08:55:20.924903+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:55:20.924903+0000","last_undegraded":"2024-09-21T08:55:20.924903+0000","last_fullsized":"2024-09-21T08:55:20.924903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.924750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:02.221123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:02.946792+0000","last_change":"2024-09-21T08:56:02.946792+0000","last_active":"2024-09-21T08:56:02.946792+0000","last_peered":"2024-09-21T08:56:02.946792+0000","last_clean":"2024-09-21T08:56:02.946792+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:56:02.946792+0000","last_undegraded":"2024-09-21T08:56:02.946792+0000","last_fullsized":"2024-09-21T08:56:02.946792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:02.946654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:02.946654+0000","last_clean_scrub_stamp":"2024-09-21T08:56:02.946654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:05.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.782208+0000","last_change":"2024-09-21T08:55:20.782208+0000","last_active":"2024-09-21T08:55:20.782208+0000","last_peered":"2024-09-21T08:55:20.782208+0000","last_clean":"2024-09-21T08:55:20.782208+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:55:20.782208+0000","last_undegraded":"2024-09-21T08:55:20.782208+0000","last_fullsized":"2024-09-21T08:55:20.782208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.782093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:39.369522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.756347+0000","last_change":"2024-09-21T08:55:16.756347+0000","last_active":"2024-09-21T08:55:16.756347+0000","last_peered":"2024-09-21T08:55:16.756347+0000","last_clean":"2024-09-21T08:55:16.756347+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:55:16.756347+0000","last_undegraded":"2024-09-21T08:55:16.756347+0000","last_fullsized":"2024-09-21T08:55:16.756347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.756216+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:45.207448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.769638+0000","last_change":"2024-09-21T08:55:03.769638+0000","last_active":"2024-09-21T08:55:03.769638+0000","last_peered":"2024-09-21T08:55:03.769638+0000","last_clean":"2024-09-21T08:55:03.769638+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:55:03.769638+0000","last_undegraded":"2024-09-21T08:55:03.769638+0000","last_fullsized":"2024-09-21T08:55:03.769638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:37.381181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:59.797377+0000","last_change":"2024-09-21T08:55:59.797377+0000","last_active":"2024-09-21T08:55:59.797377+0000","last_peered":"2024-09-21T08:55:59.797377+0000","last_clean":"2024-09-21T08:55:59.797377+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:55:59.797377+0000","last_undegraded":"2024-09-21T08:55:59.797377+0000","last_fullsized":"2024-09-21T08:55:59.797377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:55:59.797237+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:55:59.797237+0000","last_clean_scrub_stamp":"2024-09-21T08:55:59.797237+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.875659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.672364+0000","last_change":"2024-09-21T08:55:57.672364+0000","last_active":"2024-09-21T08:55:57.672364+0000","last_peered":"2024-09-21T08:55:57.672364+0000","last_clean":"2024-09-21T08:55:57.672364+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:55:57.672364+0000","last_undegraded":"2024-09-21T08:55:57.672364+0000","last_fullsized":"2024-09-21T08:55:57.672364+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:57.672248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:57.672248+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.672248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:50.432472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.850043+0000","last_change":"2024-09-21T08:55:47.850043+0000","last_active":"2024-09-21T08:55:47.850043+0000","last_peered":"2024-09-21T08:55:47.850043+0000","last_clean":"2024-09-21T08:55:47.850043+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:55:47.850043+0000","last_undegraded":"2024-09-21T08:55:47.850043+0000","last_fullsized":"2024-09-21T08:55:47.850043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.849880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:03.295159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.770379+0000","last_change":"2024-09-21T08:55:10.770379+0000","last_active":"2024-09-21T08:55:10.770379+0000","last_peered":"2024-09-21T08:55:10.770379+0000","last_clean":"2024-09-21T08:55:10.770379+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:55:10.770379+0000","last_undegraded":"2024-09-21T08:55:10.770379+0000","last_fullsized":"2024-09-21T08:55:10.770379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.770161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:07.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.337560+0000","last_change":"2024-09-21T08:55:05.337560+0000","last_active":"2024-09-21T08:55:05.337560+0000","last_peered":"2024-09-21T08:55:05.337560+0000","last_clean":"2024-09-21T08:55:05.337560+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:55:05.337560+0000","last_undegraded":"2024-09-21T08:55:05.337560+0000","last_fullsized":"2024-09-21T08:55:05.337560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.337433+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:14.239468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.774171+0000","last_change":"2024-09-21T08:55:21.774171+0000","last_active":"2024-09-21T08:55:21.774171+0000","last_peered":"2024-09-21T08:55:21.774171+0000","last_clean":"2024-09-21T08:55:21.774171+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:55:21.774171+0000","last_undegraded":"2024-09-21T08:55:21.774171+0000","last_fullsized":"2024-09-21T08:55:21.774171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.774029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:30:48.998694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.819828+0000","last_change":"2024-09-21T08:55:32.819828+0000","last_active":"2024-09-21T08:55:32.819828+0000","last_peered":"2024-09-21T08:55:32.819828+0000","last_clean":"2024-09-21T08:55:32.819828+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:55:32.819828+0000","last_undegraded":"2024-09-21T08:55:32.819828+0000","last_fullsized":"2024-09-21T08:55:32.819828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.819677+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:40.054203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.765733+0000","last_change":"2024-09-21T08:55:14.765733+0000","last_active":"2024-09-21T08:55:14.765733+0000","last_peered":"2024-09-21T08:55:14.765733+0000","last_clean":"2024-09-21T08:55:14.765733+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:55:14.765733+0000","last_undegraded":"2024-09-21T08:55:14.765733+0000","last_fullsized":"2024-09-21T08:55:14.765733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.765635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:45.731851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:58.870739+0000","last_change":"2024-09-21T08:55:58.870739+0000","last_active":"2024-09-21T08:55:58.870739+0000","last_peered":"2024-09-21T08:55:58.870739+0000","last_clean":"2024-09-21T08:55:58.870739+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:55:58.870739+0000","last_undegraded":"2024-09-21T08:55:58.870739+0000","last_fullsized":"2024-09-21T08:55:58.870739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:58.870562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:58.870562+0000","last_clean_scrub_stamp":"2024-09-21T08:55:58.870562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:37.629492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.811916+0000","last_change":"2024-09-21T08:55:18.811916+0000","last_active":"2024-09-21T08:55:18.811916+0000","last_peered":"2024-09-21T08:55:18.811916+0000","last_clean":"2024-09-21T08:55:18.811916+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:55:18.811916+0000","last_undegraded":"2024-09-21T08:55:18.811916+0000","last_fullsized":"2024-09-21T08:55:18.811916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.811773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:45.894080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.869844+0000","last_change":"2024-09-21T08:55:06.869844+0000","last_active":"2024-09-21T08:55:06.869844+0000","last_peered":"2024-09-21T08:55:06.869844+0000","last_clean":"2024-09-21T08:55:06.869844+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:55:06.869844+0000","last_undegraded":"2024-09-21T08:55:06.869844+0000","last_fullsized":"2024-09-21T08:55:06.869844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.869692+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:33.235003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.047051+0000","last_change":"2024-09-21T08:54:57.047051+0000","last_active":"2024-09-21T08:54:57.047051+0000","last_peered":"2024-09-21T08:54:57.047051+0000","last_clean":"2024-09-21T08:54:57.047051+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:57.047051+0000","last_undegraded":"2024-09-21T08:54:57.047051+0000","last_fullsized":"2024-09-21T08:54:57.047051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.046922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:17.104050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.833856+0000","last_change":"2024-09-21T08:55:55.833856+0000","last_active":"2024-09-21T08:55:55.833856+0000","last_peered":"2024-09-21T08:55:55.833856+0000","last_clean":"2024-09-21T08:55:55.833856+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:55:55.833856+0000","last_undegraded":"2024-09-21T08:55:55.833856+0000","last_fullsized":"2024-09-21T08:55:55.833856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-21T08:55:55.833680+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-21T08:55:55.833680+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.833680+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:03.456183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.795434+0000","last_change":"2024-09-21T08:55:26.795434+0000","last_active":"2024-09-21T08:55:26.795434+0000","last_peered":"2024-09-21T08:55:26.795434+0000","last_clean":"2024-09-21T08:55:26.795434+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:55:26.795434+0000","last_undegraded":"2024-09-21T08:55:26.795434+0000","last_fullsized":"2024-09-21T08:55:26.795434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.795295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:53.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.898149+0000","last_change":"2024-09-21T08:55:47.898149+0000","last_active":"2024-09-21T08:55:47.898149+0000","last_peered":"2024-09-21T08:55:47.898149+0000","last_clean":"2024-09-21T08:55:47.898149+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:55:47.898149+0000","last_undegraded":"2024-09-21T08:55:47.898149+0000","last_fullsized":"2024-09-21T08:55:47.898149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.897995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:38.549881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":621,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.275924+0000","last_change":"2024-09-21T08:55:13.275924+0000","last_active":"2024-09-21T08:55:13.275924+0000","last_peered":"2024-09-21T08:55:13.275924+0000","last_clean":"2024-09-21T08:55:13.275924+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:55:13.275924+0000","last_undegraded":"2024-09-21T08:55:13.275924+0000","last_fullsized":"2024-09-21T08:55:13.275924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.275785+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.674831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.785316+0000","last_change":"2024-09-21T08:55:00.785316+0000","last_active":"2024-09-21T08:55:00.785316+0000","last_peered":"2024-09-21T08:55:00.785316+0000","last_clean":"2024-09-21T08:55:00.785316+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:55:00.785316+0000","last_undegraded":"2024-09-21T08:55:00.785316+0000","last_fullsized":"2024-09-21T08:55:00.785316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.785184+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:02.902127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.291227+0000","last_change":"2024-09-21T08:54:57.291227+0000","last_active":"2024-09-21T08:54:57.291227+0000","last_peered":"2024-09-21T08:54:57.291227+0000","last_clean":"2024-09-21T08:54:57.291227+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:57.291227+0000","last_undegraded":"2024-09-21T08:54:57.291227+0000","last_fullsized":"2024-09-21T08:54:57.291227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.291058+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:31.954176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.713606+0000","last_change":"2024-09-21T08:55:43.713606+0000","last_active":"2024-09-21T08:55:43.713606+0000","last_peered":"2024-09-21T08:55:43.713606+0000","last_clean":"2024-09-21T08:55:43.713606+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:55:43.713606+0000","last_undegraded":"2024-09-21T08:55:43.713606+0000","last_fullsized":"2024-09-21T08:55:43.713606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.713484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:38.539015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.248434+0000","last_change":"2024-09-21T08:55:18.248434+0000","last_active":"2024-09-21T08:55:18.248434+0000","last_peered":"2024-09-21T08:55:18.248434+0000","last_clean":"2024-09-21T08:55:18.248434+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:55:18.248434+0000","last_undegraded":"2024-09-21T08:55:18.248434+0000","last_fullsized":"2024-09-21T08:55:18.248434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.248234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.175858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.821675+0000","last_change":"2024-09-21T08:55:54.821675+0000","last_active":"2024-09-21T08:55:54.821675+0000","last_peered":"2024-09-21T08:55:54.821675+0000","last_clean":"2024-09-21T08:55:54.821675+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:55:54.821675+0000","last_undegraded":"2024-09-21T08:55:54.821675+0000","last_fullsized":"2024-09-21T08:55:54.821675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.821560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.789049+0000","last_change":"2024-09-21T08:54:58.789049+0000","last_active":"2024-09-21T08:54:58.789049+0000","last_peered":"2024-09-21T08:54:58.789049+0000","last_clean":"2024-09-21T08:54:58.789049+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:54:58.789049+0000","last_undegraded":"2024-09-21T08:54:58.789049+0000","last_fullsized":"2024-09-21T08:54:58.789049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.788878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:55.506296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.233457+0000","last_change":"2024-09-21T08:55:02.233457+0000","last_active":"2024-09-21T08:55:02.233457+0000","last_peered":"2024-09-21T08:55:02.233457+0000","last_clean":"2024-09-21T08:55:02.233457+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:55:02.233457+0000","last_undegraded":"2024-09-21T08:55:02.233457+0000","last_fullsized":"2024-09-21T08:55:02.233457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.233330+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:49.289271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.914269+0000","last_change":"2024-09-21T08:55:00.914269+0000","last_active":"2024-09-21T08:55:00.914269+0000","last_peered":"2024-09-21T08:55:00.914269+0000","last_clean":"2024-09-21T08:55:00.914269+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:55:00.914269+0000","last_undegraded":"2024-09-21T08:55:00.914269+0000","last_fullsized":"2024-09-21T08:55:00.914269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.914158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:41.840956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.415222+0000","last_change":"2024-09-21T08:55:24.415222+0000","last_active":"2024-09-21T08:55:24.415222+0000","last_peered":"2024-09-21T08:55:24.415222+0000","last_clean":"2024-09-21T08:55:24.415222+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:55:24.415222+0000","last_undegraded":"2024-09-21T08:55:24.415222+0000","last_fullsized":"2024-09-21T08:55:24.415222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.415062+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.497368+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.745614+0000","last_change":"2024-09-21T08:55:15.745614+0000","last_active":"2024-09-21T08:55:15.745614+0000","last_peered":"2024-09-21T08:55:15.745614+0000","last_clean":"2024-09-21T08:55:15.745614+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:55:15.745614+0000","last_undegraded":"2024-09-21T08:55:15.745614+0000","last_fullsized":"2024-09-21T08:55:15.745614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.745464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:56.608749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.487186+0000","last_change":"2024-09-21T08:55:42.487237+0000","last_active":"2024-09-21T08:55:42.487186+0000","last_peered":"2024-09-21T08:55:42.487186+0000","last_clean":"2024-09-21T08:55:42.487186+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:55:42.487186+0000","last_undegraded":"2024-09-21T08:55:42.487186+0000","last_fullsized":"2024-09-21T08:55:42.487186+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.487068+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:00.435324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:10.043950+0000","last_change":"2024-09-21T08:56:10.044009+0000","last_active":"2024-09-21T08:56:10.043950+0000","last_peered":"2024-09-21T08:56:10.043950+0000","last_clean":"2024-09-21T08:56:10.043950+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:56:10.043950+0000","last_undegraded":"2024-09-21T08:56:10.043950+0000","last_fullsized":"2024-09-21T08:56:10.043950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:10.043854+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:10.043854+0000","last_clean_scrub_stamp":"2024-09-21T08:56:10.043854+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:41.258883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.827630+0000","last_change":"2024-09-21T08:55:49.827630+0000","last_active":"2024-09-21T08:55:49.827630+0000","last_peered":"2024-09-21T08:55:49.827630+0000","last_clean":"2024-09-21T08:55:49.827630+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:55:49.827630+0000","last_undegraded":"2024-09-21T08:55:49.827630+0000","last_fullsized":"2024-09-21T08:55:49.827630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.827461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:54.174951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.277221+0000","last_change":"2024-09-21T08:55:14.277221+0000","last_active":"2024-09-21T08:55:14.277221+0000","last_peered":"2024-09-21T08:55:14.277221+0000","last_clean":"2024-09-21T08:55:14.277221+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:55:14.277221+0000","last_undegraded":"2024-09-21T08:55:14.277221+0000","last_fullsized":"2024-09-21T08:55:14.277221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.277103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:39.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'92","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.791546+0000","last_change":"2024-09-21T08:55:26.791546+0000","last_active":"2024-09-21T08:55:26.791546+0000","last_peered":"2024-09-21T08:55:26.791546+0000","last_clean":"2024-09-21T08:55:26.791546+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:55:26.791546+0000","last_undegraded":"2024-09-21T08:55:26.791546+0000","last_fullsized":"2024-09-21T08:55:26.791546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.791383+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:05.355379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.765010+0000","last_change":"2024-09-21T08:55:02.765010+0000","last_active":"2024-09-21T08:55:02.765010+0000","last_peered":"2024-09-21T08:55:02.765010+0000","last_clean":"2024-09-21T08:55:02.765010+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:55:02.765010+0000","last_undegraded":"2024-09-21T08:55:02.765010+0000","last_fullsized":"2024-09-21T08:55:02.765010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.764887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:26.749713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.857880+0000","last_change":"2024-09-21T08:55:16.857880+0000","last_active":"2024-09-21T08:55:16.857880+0000","last_peered":"2024-09-21T08:55:16.857880+0000","last_clean":"2024-09-21T08:55:16.857880+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:55:16.857880+0000","last_undegraded":"2024-09-21T08:55:16.857880+0000","last_fullsized":"2024-09-21T08:55:16.857880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.857712+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:32.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.907754+0000","last_change":"2024-09-21T08:55:41.907754+0000","last_active":"2024-09-21T08:55:41.907754+0000","last_peered":"2024-09-21T08:55:41.907754+0000","last_clean":"2024-09-21T08:55:41.907754+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:55:41.907754+0000","last_undegraded":"2024-09-21T08:55:41.907754+0000","last_fullsized":"2024-09-21T08:55:41.907754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.907611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.998429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:09.014725+0000","last_change":"2024-09-21T08:56:09.014750+0000","last_active":"2024-09-21T08:56:09.014725+0000","last_peered":"2024-09-21T08:56:09.014725+0000","last_clean":"2024-09-21T08:56:09.014725+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:56:09.014725+0000","last_undegraded":"2024-09-21T08:56:09.014725+0000","last_fullsized":"2024-09-21T08:56:09.014725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:09.014633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:09.014633+0000","last_clean_scrub_stamp":"2024-09-21T08:56:09.014633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:36.680208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.817388+0000","last_change":"2024-09-21T08:55:42.817388+0000","last_active":"2024-09-21T08:55:42.817388+0000","last_peered":"2024-09-21T08:55:42.817388+0000","last_clean":"2024-09-21T08:55:42.817388+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:55:42.817388+0000","last_undegraded":"2024-09-21T08:55:42.817388+0000","last_fullsized":"2024-09-21T08:55:42.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.817206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:50.764942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.447634+0000","last_change":"2024-09-21T08:52:14.236069+0000","last_active":"2024-09-21T08:54:57.447634+0000","last_peered":"2024-09-21T08:54:57.447634+0000","last_clean":"2024-09-21T08:54:57.447634+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:54:57.447634+0000","last_undegraded":"2024-09-21T08:54:57.447634+0000","last_fullsized":"2024-09-21T08:54:57.447634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.257947+0000","last_change":"2024-09-21T08:54:59.257947+0000","last_active":"2024-09-21T08:54:59.257947+0000","last_peered":"2024-09-21T08:54:59.257947+0000","last_clean":"2024-09-21T08:54:59.257947+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:59.257947+0000","last_undegraded":"2024-09-21T08:54:59.257947+0000","last_fullsized":"2024-09-21T08:54:59.257947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.257796+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:55.128267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.776067+0000","last_change":"2024-09-21T08:55:19.776067+0000","last_active":"2024-09-21T08:55:19.776067+0000","last_peered":"2024-09-21T08:55:19.776067+0000","last_clean":"2024-09-21T08:55:19.776067+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:55:19.776067+0000","last_undegraded":"2024-09-21T08:55:19.776067+0000","last_fullsized":"2024-09-21T08:55:19.776067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.775947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:14.023176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.562701+0000","last_change":"2024-09-21T08:55:51.562701+0000","last_active":"2024-09-21T08:55:51.562701+0000","last_peered":"2024-09-21T08:55:51.562701+0000","last_clean":"2024-09-21T08:55:51.562701+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:55:51.562701+0000","last_undegraded":"2024-09-21T08:55:51.562701+0000","last_fullsized":"2024-09-21T08:55:51.562701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.562587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:30.126583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.862467+0000","last_change":"2024-09-21T08:55:53.862467+0000","last_active":"2024-09-21T08:55:53.862467+0000","last_peered":"2024-09-21T08:55:53.862467+0000","last_clean":"2024-09-21T08:55:53.862467+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:55:53.862467+0000","last_undegraded":"2024-09-21T08:55:53.862467+0000","last_fullsized":"2024-09-21T08:55:53.862467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.862350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:33.172121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.753073+0000","last_change":"2024-09-21T08:55:34.753073+0000","last_active":"2024-09-21T08:55:34.753073+0000","last_peered":"2024-09-21T08:55:34.753073+0000","last_clean":"2024-09-21T08:55:34.753073+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:55:34.753073+0000","last_undegraded":"2024-09-21T08:55:34.753073+0000","last_fullsized":"2024-09-21T08:55:34.753073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.752903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.670098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.714370+0000","last_change":"2024-09-21T08:55:32.714370+0000","last_active":"2024-09-21T08:55:32.714370+0000","last_peered":"2024-09-21T08:55:32.714370+0000","last_clean":"2024-09-21T08:55:32.714370+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:55:32.714370+0000","last_undegraded":"2024-09-21T08:55:32.714370+0000","last_fullsized":"2024-09-21T08:55:32.714370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.714206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.680422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.647486+0000","last_change":"2024-09-21T08:55:49.647486+0000","last_active":"2024-09-21T08:55:49.647486+0000","last_peered":"2024-09-21T08:55:49.647486+0000","last_clean":"2024-09-21T08:55:49.647486+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:55:49.647486+0000","last_undegraded":"2024-09-21T08:55:49.647486+0000","last_fullsized":"2024-09-21T08:55:49.647486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.647372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:21.810649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.818896+0000","last_change":"2024-09-21T08:55:09.818896+0000","last_active":"2024-09-21T08:55:09.818896+0000","last_peered":"2024-09-21T08:55:09.818896+0000","last_clean":"2024-09-21T08:55:09.818896+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:55:09.818896+0000","last_undegraded":"2024-09-21T08:55:09.818896+0000","last_fullsized":"2024-09-21T08:55:09.818896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.818766+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:10.946408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.758991+0000","last_change":"2024-09-21T08:55:01.758991+0000","last_active":"2024-09-21T08:55:01.758991+0000","last_peered":"2024-09-21T08:55:01.758991+0000","last_clean":"2024-09-21T08:55:01.758991+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:55:01.758991+0000","last_undegraded":"2024-09-21T08:55:01.758991+0000","last_fullsized":"2024-09-21T08:55:01.758991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.758844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:27.038728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.770163+0000","last_change":"2024-09-21T08:55:36.770188+0000","last_active":"2024-09-21T08:55:36.770163+0000","last_peered":"2024-09-21T08:55:36.770163+0000","last_clean":"2024-09-21T08:55:36.770163+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:55:36.770163+0000","last_undegraded":"2024-09-21T08:55:36.770163+0000","last_fullsized":"2024-09-21T08:55:36.770163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.770077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:44.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.735665+0000","last_change":"2024-09-21T08:55:25.735665+0000","last_active":"2024-09-21T08:55:25.735665+0000","last_peered":"2024-09-21T08:55:25.735665+0000","last_clean":"2024-09-21T08:55:25.735665+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:55:25.735665+0000","last_undegraded":"2024-09-21T08:55:25.735665+0000","last_fullsized":"2024-09-21T08:55:25.735665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.735532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:16.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:08.023862+0000","last_change":"2024-09-21T08:56:08.023918+0000","last_active":"2024-09-21T08:56:08.023862+0000","last_peered":"2024-09-21T08:56:08.023862+0000","last_clean":"2024-09-21T08:56:08.023862+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:56:08.023862+0000","last_undegraded":"2024-09-21T08:56:08.023862+0000","last_fullsized":"2024-09-21T08:56:08.023862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:56:08.023744+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:56:08.023744+0000","last_clean_scrub_stamp":"2024-09-21T08:56:08.023744+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:54.590266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.740384+0000","last_change":"2024-09-21T08:55:40.740384+0000","last_active":"2024-09-21T08:55:40.740384+0000","last_peered":"2024-09-21T08:55:40.740384+0000","last_clean":"2024-09-21T08:55:40.740384+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:55:40.740384+0000","last_undegraded":"2024-09-21T08:55:40.740384+0000","last_fullsized":"2024-09-21T08:55:40.740384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.740241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:23.556756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.772851+0000","last_change":"2024-09-21T08:55:12.772851+0000","last_active":"2024-09-21T08:55:12.772851+0000","last_peered":"2024-09-21T08:55:12.772851+0000","last_clean":"2024-09-21T08:55:12.772851+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:55:12.772851+0000","last_undegraded":"2024-09-21T08:55:12.772851+0000","last_fullsized":"2024-09-21T08:55:12.772851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.772717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:25.700341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.753327+0000","last_change":"2024-09-21T08:54:57.753327+0000","last_active":"2024-09-21T08:54:57.753327+0000","last_peered":"2024-09-21T08:54:57.753327+0000","last_clean":"2024-09-21T08:54:57.753327+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:57.753327+0000","last_undegraded":"2024-09-21T08:54:57.753327+0000","last_fullsized":"2024-09-21T08:54:57.753327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.753140+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:11.199581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.789686+0000","last_change":"2024-09-21T08:55:22.789686+0000","last_active":"2024-09-21T08:55:22.789686+0000","last_peered":"2024-09-21T08:55:22.789686+0000","last_clean":"2024-09-21T08:55:22.789686+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:55:22.789686+0000","last_undegraded":"2024-09-21T08:55:22.789686+0000","last_fullsized":"2024-09-21T08:55:22.789686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.789579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:47.777856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.650198+0000","last_change":"2024-09-21T08:55:54.650198+0000","last_active":"2024-09-21T08:55:54.650198+0000","last_peered":"2024-09-21T08:55:54.650198+0000","last_clean":"2024-09-21T08:55:54.650198+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:55:54.650198+0000","last_undegraded":"2024-09-21T08:55:54.650198+0000","last_fullsized":"2024-09-21T08:55:54.650198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.650076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:10.095355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.328523+0000","last_change":"2024-09-21T08:55:21.328523+0000","last_active":"2024-09-21T08:55:21.328523+0000","last_peered":"2024-09-21T08:55:21.328523+0000","last_clean":"2024-09-21T08:55:21.328523+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:55:21.328523+0000","last_undegraded":"2024-09-21T08:55:21.328523+0000","last_fullsized":"2024-09-21T08:55:21.328523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.328401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:48.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.738169+0000","last_change":"2024-09-21T08:55:31.738169+0000","last_active":"2024-09-21T08:55:31.738169+0000","last_peered":"2024-09-21T08:55:31.738169+0000","last_clean":"2024-09-21T08:55:31.738169+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:55:31.738169+0000","last_undegraded":"2024-09-21T08:55:31.738169+0000","last_fullsized":"2024-09-21T08:55:31.738169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.738045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:13.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.819976+0000","last_change":"2024-09-21T08:55:46.820002+0000","last_active":"2024-09-21T08:55:46.819976+0000","last_peered":"2024-09-21T08:55:46.819976+0000","last_clean":"2024-09-21T08:55:46.819976+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:55:46.819976+0000","last_undegraded":"2024-09-21T08:55:46.819976+0000","last_fullsized":"2024-09-21T08:55:46.819976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.819884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:05.525223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.769332+0000","last_change":"2024-09-21T08:55:17.769332+0000","last_active":"2024-09-21T08:55:17.769332+0000","last_peered":"2024-09-21T08:55:17.769332+0000","last_clean":"2024-09-21T08:55:17.769332+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:55:17.769332+0000","last_undegraded":"2024-09-21T08:55:17.769332+0000","last_fullsized":"2024-09-21T08:55:17.769332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.769154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:19.212681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.852373+0000","last_change":"2024-09-21T08:55:05.852373+0000","last_active":"2024-09-21T08:55:05.852373+0000","last_peered":"2024-09-21T08:55:05.852373+0000","last_clean":"2024-09-21T08:55:05.852373+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:55:05.852373+0000","last_undegraded":"2024-09-21T08:55:05.852373+0000","last_fullsized":"2024-09-21T08:55:05.852373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.852239+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.553041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.982940+0000","last_change":"2024-09-21T08:54:58.982940+0000","last_active":"2024-09-21T08:54:58.982940+0000","last_peered":"2024-09-21T08:54:58.982940+0000","last_clean":"2024-09-21T08:54:58.982940+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:54:58.982940+0000","last_undegraded":"2024-09-21T08:54:58.982940+0000","last_fullsized":"2024-09-21T08:54:58.982940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.982822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:26.322430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.817353+0000","last_change":"2024-09-21T08:55:54.817382+0000","last_active":"2024-09-21T08:55:54.817353+0000","last_peered":"2024-09-21T08:55:54.817353+0000","last_clean":"2024-09-21T08:55:54.817353+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:55:54.817353+0000","last_undegraded":"2024-09-21T08:55:54.817353+0000","last_fullsized":"2024-09-21T08:55:54.817353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:54.817258+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:54.817258+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.817258+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.353664+0000","last_change":"2024-09-21T08:55:27.353664+0000","last_active":"2024-09-21T08:55:27.353664+0000","last_peered":"2024-09-21T08:55:27.353664+0000","last_clean":"2024-09-21T08:55:27.353664+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:55:27.353664+0000","last_undegraded":"2024-09-21T08:55:27.353664+0000","last_fullsized":"2024-09-21T08:55:27.353664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.353550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:16.388892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.875753+0000","last_change":"2024-09-21T08:55:51.875789+0000","last_active":"2024-09-21T08:55:51.875753+0000","last_peered":"2024-09-21T08:55:51.875753+0000","last_clean":"2024-09-21T08:55:51.875753+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:55:51.875753+0000","last_undegraded":"2024-09-21T08:55:51.875753+0000","last_fullsized":"2024-09-21T08:55:51.875753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.875661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:15.984515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:07.037057+0000","last_change":"2024-09-21T08:56:07.037086+0000","last_active":"2024-09-21T08:56:07.037057+0000","last_peered":"2024-09-21T08:56:07.037057+0000","last_clean":"2024-09-21T08:56:07.037057+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:56:07.037057+0000","last_undegraded":"2024-09-21T08:56:07.037057+0000","last_fullsized":"2024-09-21T08:56:07.037057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:07.036962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:07.036962+0000","last_clean_scrub_stamp":"2024-09-21T08:56:07.036962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:41.843358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.847420+0000","last_change":"2024-09-21T08:55:05.847420+0000","last_active":"2024-09-21T08:55:05.847420+0000","last_peered":"2024-09-21T08:55:05.847420+0000","last_clean":"2024-09-21T08:55:05.847420+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:55:05.847420+0000","last_undegraded":"2024-09-21T08:55:05.847420+0000","last_fullsized":"2024-09-21T08:55:05.847420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.847290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:42:43.812529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.280639+0000","last_change":"2024-09-21T08:54:58.280639+0000","last_active":"2024-09-21T08:54:58.280639+0000","last_peered":"2024-09-21T08:54:58.280639+0000","last_clean":"2024-09-21T08:54:58.280639+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:54:58.280639+0000","last_undegraded":"2024-09-21T08:54:58.280639+0000","last_fullsized":"2024-09-21T08:54:58.280639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.280470+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:25.040327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":367,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.299155+0000","last_change":"2024-09-21T08:55:00.299155+0000","last_active":"2024-09-21T08:55:00.299155+0000","last_peered":"2024-09-21T08:55:00.299155+0000","last_clean":"2024-09-21T08:55:00.299155+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:55:00.299155+0000","last_undegraded":"2024-09-21T08:55:00.299155+0000","last_fullsized":"2024-09-21T08:55:00.299155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.299020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:39.253241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.862205+0000","last_change":"2024-09-21T08:55:48.862230+0000","last_active":"2024-09-21T08:55:48.862205+0000","last_peered":"2024-09-21T08:55:48.862205+0000","last_clean":"2024-09-21T08:55:48.862205+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:55:48.862205+0000","last_undegraded":"2024-09-21T08:55:48.862205+0000","last_fullsized":"2024-09-21T08:55:48.862205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.862116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:22.856674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.768148+0000","last_change":"2024-09-21T08:55:11.768148+0000","last_active":"2024-09-21T08:55:11.768148+0000","last_peered":"2024-09-21T08:55:11.768148+0000","last_clean":"2024-09-21T08:55:11.768148+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:55:11.768148+0000","last_undegraded":"2024-09-21T08:55:11.768148+0000","last_fullsized":"2024-09-21T08:55:11.768148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.768028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:52.506242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.810409+0000","last_change":"2024-09-21T08:55:52.810409+0000","last_active":"2024-09-21T08:55:52.810409+0000","last_peered":"2024-09-21T08:55:52.810409+0000","last_clean":"2024-09-21T08:55:52.810409+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:55:52.810409+0000","last_undegraded":"2024-09-21T08:55:52.810409+0000","last_fullsized":"2024-09-21T08:55:52.810409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.810289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.050909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.830117+0000","last_change":"2024-09-21T08:55:45.830117+0000","last_active":"2024-09-21T08:55:45.830117+0000","last_peered":"2024-09-21T08:55:45.830117+0000","last_clean":"2024-09-21T08:55:45.830117+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:55:45.830117+0000","last_undegraded":"2024-09-21T08:55:45.830117+0000","last_fullsized":"2024-09-21T08:55:45.830117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.829992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:23.672046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.822721+0000","last_change":"2024-09-21T08:55:03.822721+0000","last_active":"2024-09-21T08:55:03.822721+0000","last_peered":"2024-09-21T08:55:03.822721+0000","last_clean":"2024-09-21T08:55:03.822721+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:55:03.822721+0000","last_undegraded":"2024-09-21T08:55:03.822721+0000","last_fullsized":"2024-09-21T08:55:03.822721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:17.459600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.863917+0000","last_change":"2024-09-21T08:55:29.863917+0000","last_active":"2024-09-21T08:55:29.863917+0000","last_peered":"2024-09-21T08:55:29.863917+0000","last_clean":"2024-09-21T08:55:29.863917+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:55:29.863917+0000","last_undegraded":"2024-09-21T08:55:29.863917+0000","last_fullsized":"2024-09-21T08:55:29.863917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.863791+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:04.357452+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.791438+0000","last_change":"2024-09-21T08:55:11.791438+0000","last_active":"2024-09-21T08:55:11.791438+0000","last_peered":"2024-09-21T08:55:11.791438+0000","last_clean":"2024-09-21T08:55:11.791438+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:55:11.791438+0000","last_undegraded":"2024-09-21T08:55:11.791438+0000","last_fullsized":"2024-09-21T08:55:11.791438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.791309+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:31.481073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.637946+0000","last_change":"2024-09-21T08:55:55.637984+0000","last_active":"2024-09-21T08:55:55.637946+0000","last_peered":"2024-09-21T08:55:55.637946+0000","last_clean":"2024-09-21T08:55:55.637946+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:55:55.637946+0000","last_undegraded":"2024-09-21T08:55:55.637946+0000","last_fullsized":"2024-09-21T08:55:55.637946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-21T08:55:55.637850+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-21T08:55:55.637850+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.637850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:30.131511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.750304+0000","last_change":"2024-09-21T08:55:30.750304+0000","last_active":"2024-09-21T08:55:30.750304+0000","last_peered":"2024-09-21T08:55:30.750304+0000","last_clean":"2024-09-21T08:55:30.750304+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:55:30.750304+0000","last_undegraded":"2024-09-21T08:55:30.750304+0000","last_fullsized":"2024-09-21T08:55:30.750304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.750144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:34.425604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.343120+0000","last_change":"2024-09-21T08:55:37.343120+0000","last_active":"2024-09-21T08:55:37.343120+0000","last_peered":"2024-09-21T08:55:37.343120+0000","last_clean":"2024-09-21T08:55:37.343120+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:55:37.343120+0000","last_undegraded":"2024-09-21T08:55:37.343120+0000","last_fullsized":"2024-09-21T08:55:37.343120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.342994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:14.798606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:11.092454+0000","last_change":"2024-09-21T08:56:11.092474+0000","last_active":"2024-09-21T08:56:11.092454+0000","last_peered":"2024-09-21T08:56:11.092454+0000","last_clean":"2024-09-21T08:56:11.092454+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:56:11.092454+0000","last_undegraded":"2024-09-21T08:56:11.092454+0000","last_fullsized":"2024-09-21T08:56:11.092454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:11.092345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:11.092345+0000","last_clean_scrub_stamp":"2024-09-21T08:56:11.092345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:20.996499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.447597+0000","last_change":"2024-09-21T08:52:14.234354+0000","last_active":"2024-09-21T08:54:57.447597+0000","last_peered":"2024-09-21T08:54:57.447597+0000","last_clean":"2024-09-21T08:54:57.447597+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:54:57.447597+0000","last_undegraded":"2024-09-21T08:54:57.447597+0000","last_fullsized":"2024-09-21T08:54:57.447597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:41.116106+0000","last_clean_scrub_stamp":"2024-09-21T08:51:41.116106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.829284+0000","last_change":"2024-09-21T08:55:02.829284+0000","last_active":"2024-09-21T08:55:02.829284+0000","last_peered":"2024-09-21T08:55:02.829284+0000","last_clean":"2024-09-21T08:55:02.829284+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:55:02.829284+0000","last_undegraded":"2024-09-21T08:55:02.829284+0000","last_fullsized":"2024-09-21T08:55:02.829284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.829144+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.593879+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.820070+0000","last_change":"2024-09-21T08:55:04.820070+0000","last_active":"2024-09-21T08:55:04.820070+0000","last_peered":"2024-09-21T08:55:04.820070+0000","last_clean":"2024-09-21T08:55:04.820070+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:55:04.820070+0000","last_undegraded":"2024-09-21T08:55:04.820070+0000","last_fullsized":"2024-09-21T08:55:04.820070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.819955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:13.094734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.834090+0000","last_change":"2024-09-21T08:55:12.834113+0000","last_active":"2024-09-21T08:55:12.834090+0000","last_peered":"2024-09-21T08:55:12.834090+0000","last_clean":"2024-09-21T08:55:12.834090+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:55:12.834090+0000","last_undegraded":"2024-09-21T08:55:12.834090+0000","last_fullsized":"2024-09-21T08:55:12.834090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.833970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:00.715535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.696909+0000","last_change":"2024-09-21T08:55:46.696909+0000","last_active":"2024-09-21T08:55:46.696909+0000","last_peered":"2024-09-21T08:55:46.696909+0000","last_clean":"2024-09-21T08:55:46.696909+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:55:46.696909+0000","last_undegraded":"2024-09-21T08:55:46.696909+0000","last_fullsized":"2024-09-21T08:55:46.696909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.696741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:14.571486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.834367+0000","last_change":"2024-09-21T08:55:17.834410+0000","last_active":"2024-09-21T08:55:17.834367+0000","last_peered":"2024-09-21T08:55:17.834367+0000","last_clean":"2024-09-21T08:55:17.834367+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:55:17.834367+0000","last_undegraded":"2024-09-21T08:55:17.834367+0000","last_fullsized":"2024-09-21T08:55:17.834367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.834243+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:49.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:01.931936+0000","last_change":"2024-09-21T08:56:01.931962+0000","last_active":"2024-09-21T08:56:01.931936+0000","last_peered":"2024-09-21T08:56:01.931936+0000","last_clean":"2024-09-21T08:56:01.931936+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:56:01.931936+0000","last_undegraded":"2024-09-21T08:56:01.931936+0000","last_fullsized":"2024-09-21T08:56:01.931936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:01.931841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:01.931841+0000","last_clean_scrub_stamp":"2024-09-21T08:56:01.931841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:36.095636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.275010+0000","last_change":"2024-09-21T08:55:15.275037+0000","last_active":"2024-09-21T08:55:15.275010+0000","last_peered":"2024-09-21T08:55:15.275010+0000","last_clean":"2024-09-21T08:55:15.275010+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:55:15.275010+0000","last_undegraded":"2024-09-21T08:55:15.275010+0000","last_fullsized":"2024-09-21T08:55:15.275010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.274919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:38.364271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.810730+0000","last_change":"2024-09-21T08:55:04.810792+0000","last_active":"2024-09-21T08:55:04.810730+0000","last_peered":"2024-09-21T08:55:04.810730+0000","last_clean":"2024-09-21T08:55:04.810730+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:55:04.810730+0000","last_undegraded":"2024-09-21T08:55:04.810730+0000","last_fullsized":"2024-09-21T08:55:04.810730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.810614+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:15.348725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.814729+0000","last_change":"2024-09-21T08:55:28.814755+0000","last_active":"2024-09-21T08:55:28.814729+0000","last_peered":"2024-09-21T08:55:28.814729+0000","last_clean":"2024-09-21T08:55:28.814729+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:55:28.814729+0000","last_undegraded":"2024-09-21T08:55:28.814729+0000","last_fullsized":"2024-09-21T08:55:28.814729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.814626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:58.769235+0000","last_change":"2024-09-21T08:55:58.769259+0000","last_active":"2024-09-21T08:55:58.769235+0000","last_peered":"2024-09-21T08:55:58.769235+0000","last_clean":"2024-09-21T08:55:58.769235+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:55:58.769235+0000","last_undegraded":"2024-09-21T08:55:58.769235+0000","last_fullsized":"2024-09-21T08:55:58.769235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:58.769150+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:58.769150+0000","last_clean_scrub_stamp":"2024-09-21T08:55:58.769150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:00.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.379173+0000","last_change":"2024-09-21T08:55:22.379222+0000","last_active":"2024-09-21T08:55:22.379173+0000","last_peered":"2024-09-21T08:55:22.379173+0000","last_clean":"2024-09-21T08:55:22.379173+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:55:22.379173+0000","last_undegraded":"2024-09-21T08:55:22.379173+0000","last_fullsized":"2024-09-21T08:55:22.379173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.379069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:35.825511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.686421+0000","last_change":"2024-09-21T08:55:38.686447+0000","last_active":"2024-09-21T08:55:38.686421+0000","last_peered":"2024-09-21T08:55:38.686421+0000","last_clean":"2024-09-21T08:55:38.686421+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:55:38.686421+0000","last_undegraded":"2024-09-21T08:55:38.686421+0000","last_fullsized":"2024-09-21T08:55:38.686421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.686327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:51.215101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.817707+0000","last_change":"2024-09-21T08:55:07.817734+0000","last_active":"2024-09-21T08:55:07.817707+0000","last_peered":"2024-09-21T08:55:07.817707+0000","last_clean":"2024-09-21T08:55:07.817707+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:55:07.817707+0000","last_undegraded":"2024-09-21T08:55:07.817707+0000","last_fullsized":"2024-09-21T08:55:07.817707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.817604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:06.637277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.835986+0000","last_change":"2024-09-21T08:54:56.836033+0000","last_active":"2024-09-21T08:54:56.835986+0000","last_peered":"2024-09-21T08:54:56.835986+0000","last_clean":"2024-09-21T08:54:56.835986+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:56.835986+0000","last_undegraded":"2024-09-21T08:54:56.835986+0000","last_fullsized":"2024-09-21T08:54:56.835986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_clean_scrub_stamp":"2024-09-21T08:54:56.835862+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.916858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.824181+0000","last_change":"2024-09-21T08:55:04.824228+0000","last_active":"2024-09-21T08:55:04.824181+0000","last_peered":"2024-09-21T08:55:04.824181+0000","last_clean":"2024-09-21T08:55:04.824181+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:55:04.824181+0000","last_undegraded":"2024-09-21T08:55:04.824181+0000","last_fullsized":"2024-09-21T08:55:04.824181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.824082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:20.883736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.734522+0000","last_change":"2024-09-21T08:55:27.734551+0000","last_active":"2024-09-21T08:55:27.734522+0000","last_peered":"2024-09-21T08:55:27.734522+0000","last_clean":"2024-09-21T08:55:27.734522+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:55:27.734522+0000","last_undegraded":"2024-09-21T08:55:27.734522+0000","last_fullsized":"2024-09-21T08:55:27.734522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.734430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:25.498043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.674293+0000","last_change":"2024-09-21T08:55:29.674323+0000","last_active":"2024-09-21T08:55:29.674293+0000","last_peered":"2024-09-21T08:55:29.674293+0000","last_clean":"2024-09-21T08:55:29.674293+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:55:29.674293+0000","last_undegraded":"2024-09-21T08:55:29.674293+0000","last_fullsized":"2024-09-21T08:55:29.674293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.674182+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:31.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.786099+0000","last_change":"2024-09-21T08:55:41.786127+0000","last_active":"2024-09-21T08:55:41.786099+0000","last_peered":"2024-09-21T08:55:41.786099+0000","last_clean":"2024-09-21T08:55:41.786099+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:55:41.786099+0000","last_undegraded":"2024-09-21T08:55:41.786099+0000","last_fullsized":"2024-09-21T08:55:41.786099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.786001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:58.913913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.849013+0000","last_change":"2024-09-21T08:55:13.849035+0000","last_active":"2024-09-21T08:55:13.849013+0000","last_peered":"2024-09-21T08:55:13.849013+0000","last_clean":"2024-09-21T08:55:13.849013+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:55:13.849013+0000","last_undegraded":"2024-09-21T08:55:13.849013+0000","last_fullsized":"2024-09-21T08:55:13.849013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.848927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.202435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'47","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.833227+0000","last_change":"2024-09-21T08:55:09.833272+0000","last_active":"2024-09-21T08:55:09.833227+0000","last_peered":"2024-09-21T08:55:09.833227+0000","last_clean":"2024-09-21T08:55:09.833227+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:55:09.833227+0000","last_undegraded":"2024-09-21T08:55:09.833227+0000","last_fullsized":"2024-09-21T08:55:09.833227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.833131+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:32.922483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.298583+0000","last_change":"2024-09-21T08:55:04.298628+0000","last_active":"2024-09-21T08:55:04.298583+0000","last_peered":"2024-09-21T08:55:04.298583+0000","last_clean":"2024-09-21T08:55:04.298583+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:55:04.298583+0000","last_undegraded":"2024-09-21T08:55:04.298583+0000","last_fullsized":"2024-09-21T08:55:04.298583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.298475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.675637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:20.185462+0000","last_change":"2024-09-21T08:51:48.168708+0000","last_active":"2024-09-21T08:54:20.185462+0000","last_peered":"2024-09-21T08:54:20.185462+0000","last_clean":"2024-09-21T08:54:20.185462+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:54:20.185462+0000","last_undegraded":"2024-09-21T08:54:20.185462+0000","last_fullsized":"2024-09-21T08:54:20.185462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.759091+0000","last_change":"2024-09-21T08:55:09.759114+0000","last_active":"2024-09-21T08:55:09.759091+0000","last_peered":"2024-09-21T08:55:09.759091+0000","last_clean":"2024-09-21T08:55:09.759091+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:55:09.759091+0000","last_undegraded":"2024-09-21T08:55:09.759091+0000","last_fullsized":"2024-09-21T08:55:09.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.759005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:03.833615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.445455+0000","last_change":"2024-09-21T08:55:41.445493+0000","last_active":"2024-09-21T08:55:41.445455+0000","last_peered":"2024-09-21T08:55:41.445455+0000","last_clean":"2024-09-21T08:55:41.445455+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:55:41.445455+0000","last_undegraded":"2024-09-21T08:55:41.445455+0000","last_fullsized":"2024-09-21T08:55:41.445455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.445334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:29.306449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.791688+0000","last_change":"2024-09-21T08:55:01.791713+0000","last_active":"2024-09-21T08:55:01.791688+0000","last_peered":"2024-09-21T08:55:01.791688+0000","last_clean":"2024-09-21T08:55:01.791688+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:55:01.791688+0000","last_undegraded":"2024-09-21T08:55:01.791688+0000","last_fullsized":"2024-09-21T08:55:01.791688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.791549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.781022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.862851+0000","last_change":"2024-09-21T08:55:07.862890+0000","last_active":"2024-09-21T08:55:07.862851+0000","last_peered":"2024-09-21T08:55:07.862851+0000","last_clean":"2024-09-21T08:55:07.862851+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:55:07.862851+0000","last_undegraded":"2024-09-21T08:55:07.862851+0000","last_fullsized":"2024-09-21T08:55:07.862851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.862752+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:51.564071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.950779+0000","last_change":"2024-09-21T08:54:59.950823+0000","last_active":"2024-09-21T08:54:59.950779+0000","last_peered":"2024-09-21T08:54:59.950779+0000","last_clean":"2024-09-21T08:54:59.950779+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:54:59.950779+0000","last_undegraded":"2024-09-21T08:54:59.950779+0000","last_fullsized":"2024-09-21T08:54:59.950779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.950635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:23.543628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.930606+0000","last_change":"2024-09-21T08:55:45.930606+0000","last_active":"2024-09-21T08:55:45.930606+0000","last_peered":"2024-09-21T08:55:45.930606+0000","last_clean":"2024-09-21T08:55:45.930606+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:55:45.930606+0000","last_undegraded":"2024-09-21T08:55:45.930606+0000","last_fullsized":"2024-09-21T08:55:45.930606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.930470+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.552172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.771531+0000","last_change":"2024-09-21T08:55:53.771575+0000","last_active":"2024-09-21T08:55:53.771531+0000","last_peered":"2024-09-21T08:55:53.771531+0000","last_clean":"2024-09-21T08:55:53.771531+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:55:53.771531+0000","last_undegraded":"2024-09-21T08:55:53.771531+0000","last_fullsized":"2024-09-21T08:55:53.771531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.771415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.063865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.788002+0000","last_change":"2024-09-21T08:55:21.788002+0000","last_active":"2024-09-21T08:55:21.788002+0000","last_peered":"2024-09-21T08:55:21.788002+0000","last_clean":"2024-09-21T08:55:21.788002+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:55:21.788002+0000","last_undegraded":"2024-09-21T08:55:21.788002+0000","last_fullsized":"2024-09-21T08:55:21.788002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.787814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:10.823157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'65","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.807924+0000","last_change":"2024-09-21T08:55:08.807971+0000","last_active":"2024-09-21T08:55:08.807924+0000","last_peered":"2024-09-21T08:55:08.807924+0000","last_clean":"2024-09-21T08:55:08.807924+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:55:08.807924+0000","last_undegraded":"2024-09-21T08:55:08.807924+0000","last_fullsized":"2024-09-21T08:55:08.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'65","last_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_deep_scrub":"36'65","last_deep_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.807820+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:33.816177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.013839+0000","last_change":"2024-09-21T08:54:58.013862+0000","last_active":"2024-09-21T08:54:58.013839+0000","last_peered":"2024-09-21T08:54:58.013839+0000","last_clean":"2024-09-21T08:54:58.013839+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:54:58.013839+0000","last_undegraded":"2024-09-21T08:54:58.013839+0000","last_fullsized":"2024-09-21T08:54:58.013839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.013702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:15.698435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.814931+0000","last_change":"2024-09-21T08:55:56.814958+0000","last_active":"2024-09-21T08:55:56.814931+0000","last_peered":"2024-09-21T08:55:56.814931+0000","last_clean":"2024-09-21T08:55:56.814931+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:55:56.814931+0000","last_undegraded":"2024-09-21T08:55:56.814931+0000","last_fullsized":"2024-09-21T08:55:56.814931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-21T08:55:56.814833+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-21T08:55:56.814833+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.814833+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:30.799088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.822947+0000","last_change":"2024-09-21T08:55:41.822974+0000","last_active":"2024-09-21T08:55:41.822947+0000","last_peered":"2024-09-21T08:55:41.822947+0000","last_clean":"2024-09-21T08:55:41.822947+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:55:41.822947+0000","last_undegraded":"2024-09-21T08:55:41.822947+0000","last_fullsized":"2024-09-21T08:55:41.822947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.822847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:42.546644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.488369+0000","last_change":"2024-09-21T08:55:49.488396+0000","last_active":"2024-09-21T08:55:49.488369+0000","last_peered":"2024-09-21T08:55:49.488369+0000","last_clean":"2024-09-21T08:55:49.488369+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:55:49.488369+0000","last_undegraded":"2024-09-21T08:55:49.488369+0000","last_fullsized":"2024-09-21T08:55:49.488369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.488278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:42.503251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.841357+0000","last_change":"2024-09-21T08:55:15.841357+0000","last_active":"2024-09-21T08:55:15.841357+0000","last_peered":"2024-09-21T08:55:15.841357+0000","last_clean":"2024-09-21T08:55:15.841357+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:55:15.841357+0000","last_undegraded":"2024-09-21T08:55:15.841357+0000","last_fullsized":"2024-09-21T08:55:15.841357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.841239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:07.982245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.796107+0000","last_change":"2024-09-21T08:55:12.796146+0000","last_active":"2024-09-21T08:55:12.796107+0000","last_peered":"2024-09-21T08:55:12.796107+0000","last_clean":"2024-09-21T08:55:12.796107+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:55:12.796107+0000","last_undegraded":"2024-09-21T08:55:12.796107+0000","last_fullsized":"2024-09-21T08:55:12.796107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.796020+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:06.530723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.286766+0000","last_change":"2024-09-21T08:55:12.286792+0000","last_active":"2024-09-21T08:55:12.286766+0000","last_peered":"2024-09-21T08:55:12.286766+0000","last_clean":"2024-09-21T08:55:12.286766+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:55:12.286766+0000","last_undegraded":"2024-09-21T08:55:12.286766+0000","last_fullsized":"2024-09-21T08:55:12.286766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.286668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:03.780340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.858572+0000","last_change":"2024-09-21T08:55:40.858621+0000","last_active":"2024-09-21T08:55:40.858572+0000","last_peered":"2024-09-21T08:55:40.858572+0000","last_clean":"2024-09-21T08:55:40.858572+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:55:40.858572+0000","last_undegraded":"2024-09-21T08:55:40.858572+0000","last_fullsized":"2024-09-21T08:55:40.858572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.858468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.799865+0000","last_change":"2024-09-21T08:55:13.799916+0000","last_active":"2024-09-21T08:55:13.799865+0000","last_peered":"2024-09-21T08:55:13.799865+0000","last_clean":"2024-09-21T08:55:13.799865+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:55:13.799865+0000","last_undegraded":"2024-09-21T08:55:13.799865+0000","last_fullsized":"2024-09-21T08:55:13.799865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.799748+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.649021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.495607+0000","last_change":"2024-09-21T08:55:44.495655+0000","last_active":"2024-09-21T08:55:44.495607+0000","last_peered":"2024-09-21T08:55:44.495607+0000","last_clean":"2024-09-21T08:55:44.495607+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:55:44.495607+0000","last_undegraded":"2024-09-21T08:55:44.495607+0000","last_fullsized":"2024-09-21T08:55:44.495607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.495495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:38.742724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.846050+0000","last_change":"2024-09-21T08:55:14.846074+0000","last_active":"2024-09-21T08:55:14.846050+0000","last_peered":"2024-09-21T08:55:14.846050+0000","last_clean":"2024-09-21T08:55:14.846050+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:55:14.846050+0000","last_undegraded":"2024-09-21T08:55:14.846050+0000","last_fullsized":"2024-09-21T08:55:14.846050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.845959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:24.445746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.829399+0000","last_change":"2024-09-21T08:55:10.829399+0000","last_active":"2024-09-21T08:55:10.829399+0000","last_peered":"2024-09-21T08:55:10.829399+0000","last_clean":"2024-09-21T08:55:10.829399+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:55:10.829399+0000","last_undegraded":"2024-09-21T08:55:10.829399+0000","last_fullsized":"2024-09-21T08:55:10.829399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.829198+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:50.856893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.802367+0000","last_change":"2024-09-21T08:55:19.802367+0000","last_active":"2024-09-21T08:55:19.802367+0000","last_peered":"2024-09-21T08:55:19.802367+0000","last_clean":"2024-09-21T08:55:19.802367+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:55:19.802367+0000","last_undegraded":"2024-09-21T08:55:19.802367+0000","last_fullsized":"2024-09-21T08:55:19.802367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.802246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:41.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:46.708384+0000","last_change":"2024-09-21T08:51:48.167422+0000","last_active":"2024-09-21T08:54:46.708384+0000","last_peered":"2024-09-21T08:54:46.708384+0000","last_clean":"2024-09-21T08:54:46.708384+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:54:46.708384+0000","last_undegraded":"2024-09-21T08:54:46.708384+0000","last_fullsized":"2024-09-21T08:54:46.708384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.775852+0000","last_change":"2024-09-21T08:55:24.775881+0000","last_active":"2024-09-21T08:55:24.775852+0000","last_peered":"2024-09-21T08:55:24.775852+0000","last_clean":"2024-09-21T08:55:24.775852+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:55:24.775852+0000","last_undegraded":"2024-09-21T08:55:24.775852+0000","last_fullsized":"2024-09-21T08:55:24.775852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.775748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:55.003623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:00.941023+0000","last_change":"2024-09-21T08:56:00.941068+0000","last_active":"2024-09-21T08:56:00.941023+0000","last_peered":"2024-09-21T08:56:00.941023+0000","last_clean":"2024-09-21T08:56:00.941023+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:56:00.941023+0000","last_undegraded":"2024-09-21T08:56:00.941023+0000","last_fullsized":"2024-09-21T08:56:00.941023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:00.940920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:00.940920+0000","last_clean_scrub_stamp":"2024-09-21T08:56:00.940920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:29.670084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.214468+0000","last_change":"2024-09-21T08:55:10.214510+0000","last_active":"2024-09-21T08:55:10.214468+0000","last_peered":"2024-09-21T08:55:10.214468+0000","last_clean":"2024-09-21T08:55:10.214468+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:55:10.214468+0000","last_undegraded":"2024-09-21T08:55:10.214468+0000","last_fullsized":"2024-09-21T08:55:10.214468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.214364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:53.485342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.804730+0000","last_change":"2024-09-21T08:55:23.804730+0000","last_active":"2024-09-21T08:55:23.804730+0000","last_peered":"2024-09-21T08:55:23.804730+0000","last_clean":"2024-09-21T08:55:23.804730+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:55:23.804730+0000","last_undegraded":"2024-09-21T08:55:23.804730+0000","last_fullsized":"2024-09-21T08:55:23.804730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.804588+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.579024+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.852971+0000","last_change":"2024-09-21T08:55:08.852971+0000","last_active":"2024-09-21T08:55:08.852971+0000","last_peered":"2024-09-21T08:55:08.852971+0000","last_clean":"2024-09-21T08:55:08.852971+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:55:08.852971+0000","last_undegraded":"2024-09-21T08:55:08.852971+0000","last_fullsized":"2024-09-21T08:55:08.852971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.852812+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:10.217991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.883609+0000","last_change":"2024-09-21T08:55:44.883638+0000","last_active":"2024-09-21T08:55:44.883609+0000","last_peered":"2024-09-21T08:55:44.883609+0000","last_clean":"2024-09-21T08:55:44.883609+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:55:44.883609+0000","last_undegraded":"2024-09-21T08:55:44.883609+0000","last_fullsized":"2024-09-21T08:55:44.883609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.883511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:00.980965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'20","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.912827+0000","last_change":"2024-09-21T08:55:22.912859+0000","last_active":"2024-09-21T08:55:22.912827+0000","last_peered":"2024-09-21T08:55:22.912827+0000","last_clean":"2024-09-21T08:55:22.912827+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:55:22.912827+0000","last_undegraded":"2024-09-21T08:55:22.912827+0000","last_fullsized":"2024-09-21T08:55:22.912827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.912725+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:41.989671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.507430+0000","last_change":"2024-09-21T08:55:43.507456+0000","last_active":"2024-09-21T08:55:43.507430+0000","last_peered":"2024-09-21T08:55:43.507430+0000","last_clean":"2024-09-21T08:55:43.507430+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:55:43.507430+0000","last_undegraded":"2024-09-21T08:55:43.507430+0000","last_fullsized":"2024-09-21T08:55:43.507430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.507314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:19.260233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.250725+0000","last_change":"2024-09-21T08:55:11.250750+0000","last_active":"2024-09-21T08:55:11.250725+0000","last_peered":"2024-09-21T08:55:11.250725+0000","last_clean":"2024-09-21T08:55:11.250725+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:55:11.250725+0000","last_undegraded":"2024-09-21T08:55:11.250725+0000","last_fullsized":"2024-09-21T08:55:11.250725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:35.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.282349+0000","last_change":"2024-09-21T08:55:01.282405+0000","last_active":"2024-09-21T08:55:01.282349+0000","last_peered":"2024-09-21T08:55:01.282349+0000","last_clean":"2024-09-21T08:55:01.282349+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:55:01.282349+0000","last_undegraded":"2024-09-21T08:55:01.282349+0000","last_fullsized":"2024-09-21T08:55:01.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.282245+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:55.435995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.731794+0000","last_change":"2024-09-21T08:55:00.731817+0000","last_active":"2024-09-21T08:55:00.731794+0000","last_peered":"2024-09-21T08:55:00.731794+0000","last_clean":"2024-09-21T08:55:00.731794+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:55:00.731794+0000","last_undegraded":"2024-09-21T08:55:00.731794+0000","last_fullsized":"2024-09-21T08:55:00.731794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.731703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:33.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.329562+0000","last_change":"2024-09-21T08:55:20.329590+0000","last_active":"2024-09-21T08:55:20.329562+0000","last_peered":"2024-09-21T08:55:20.329562+0000","last_clean":"2024-09-21T08:55:20.329562+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:55:20.329562+0000","last_undegraded":"2024-09-21T08:55:20.329562+0000","last_fullsized":"2024-09-21T08:55:20.329562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.329430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:41.690836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.870236+0000","last_change":"2024-09-21T08:55:18.870267+0000","last_active":"2024-09-21T08:55:18.870236+0000","last_peered":"2024-09-21T08:55:18.870236+0000","last_clean":"2024-09-21T08:55:18.870236+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:55:18.870236+0000","last_undegraded":"2024-09-21T08:55:18.870236+0000","last_fullsized":"2024-09-21T08:55:18.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.870118+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:22.956813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.924625+0000","last_change":"2024-09-21T08:55:46.924649+0000","last_active":"2024-09-21T08:55:46.924625+0000","last_peered":"2024-09-21T08:55:46.924625+0000","last_clean":"2024-09-21T08:55:46.924625+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:55:46.924625+0000","last_undegraded":"2024-09-21T08:55:46.924625+0000","last_fullsized":"2024-09-21T08:55:46.924625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.924493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:22.780740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.806832+0000","last_change":"2024-09-21T08:55:11.806872+0000","last_active":"2024-09-21T08:55:11.806832+0000","last_peered":"2024-09-21T08:55:11.806832+0000","last_clean":"2024-09-21T08:55:11.806832+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:55:11.806832+0000","last_undegraded":"2024-09-21T08:55:11.806832+0000","last_fullsized":"2024-09-21T08:55:11.806832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.806716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:26.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.872312+0000","last_change":"2024-09-21T08:55:06.872367+0000","last_active":"2024-09-21T08:55:06.872312+0000","last_peered":"2024-09-21T08:55:06.872312+0000","last_clean":"2024-09-21T08:55:06.872312+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:55:06.872312+0000","last_undegraded":"2024-09-21T08:55:06.872312+0000","last_fullsized":"2024-09-21T08:55:06.872312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.872210+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:58.365881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.754358+0000","last_change":"2024-09-21T08:55:18.754399+0000","last_active":"2024-09-21T08:55:18.754358+0000","last_peered":"2024-09-21T08:55:18.754358+0000","last_clean":"2024-09-21T08:55:18.754358+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:55:18.754358+0000","last_undegraded":"2024-09-21T08:55:18.754358+0000","last_fullsized":"2024-09-21T08:55:18.754358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.754246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:42.773601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184844+0000","last_change":"2024-09-21T08:51:48.168970+0000","last_active":"2024-09-21T08:54:15.184844+0000","last_peered":"2024-09-21T08:54:15.184844+0000","last_clean":"2024-09-21T08:54:15.184844+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:54:15.184844+0000","last_undegraded":"2024-09-21T08:54:15.184844+0000","last_fullsized":"2024-09-21T08:54:15.184844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.929774+0000","last_change":"2024-09-21T08:55:42.929800+0000","last_active":"2024-09-21T08:55:42.929774+0000","last_peered":"2024-09-21T08:55:42.929774+0000","last_clean":"2024-09-21T08:55:42.929774+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:55:42.929774+0000","last_undegraded":"2024-09-21T08:55:42.929774+0000","last_fullsized":"2024-09-21T08:55:42.929774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.929679+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:26.608525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.780445+0000","last_change":"2024-09-21T08:55:44.780472+0000","last_active":"2024-09-21T08:55:44.780445+0000","last_peered":"2024-09-21T08:55:44.780445+0000","last_clean":"2024-09-21T08:55:44.780445+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:55:44.780445+0000","last_undegraded":"2024-09-21T08:55:44.780445+0000","last_fullsized":"2024-09-21T08:55:44.780445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.780350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:23.748592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.263419+0000","last_change":"2024-09-21T08:55:09.263468+0000","last_active":"2024-09-21T08:55:09.263419+0000","last_peered":"2024-09-21T08:55:09.263419+0000","last_clean":"2024-09-21T08:55:09.263419+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:55:09.263419+0000","last_undegraded":"2024-09-21T08:55:09.263419+0000","last_fullsized":"2024-09-21T08:55:09.263419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.263316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:55.833766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'31","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.779617+0000","last_change":"2024-09-21T08:55:10.779651+0000","last_active":"2024-09-21T08:55:10.779617+0000","last_peered":"2024-09-21T08:55:10.779617+0000","last_clean":"2024-09-21T08:55:10.779617+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:55:10.779617+0000","last_undegraded":"2024-09-21T08:55:10.779617+0000","last_fullsized":"2024-09-21T08:55:10.779617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'31","last_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_deep_scrub":"36'31","last_deep_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.779521+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:53.739000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.738161+0000","last_change":"2024-09-21T08:55:20.738188+0000","last_active":"2024-09-21T08:55:20.738161+0000","last_peered":"2024-09-21T08:55:20.738161+0000","last_clean":"2024-09-21T08:55:20.738161+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:55:20.738161+0000","last_undegraded":"2024-09-21T08:55:20.738161+0000","last_fullsized":"2024-09-21T08:55:20.738161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.738067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:07.544426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:15.184813+0000","last_change":"2024-09-21T08:51:48.168870+0000","last_active":"2024-09-21T08:54:15.184813+0000","last_peered":"2024-09-21T08:54:15.184813+0000","last_clean":"2024-09-21T08:54:15.184813+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:54:15.184813+0000","last_undegraded":"2024-09-21T08:54:15.184813+0000","last_fullsized":"2024-09-21T08:54:15.184813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.896750+0000","last_change":"2024-09-21T08:55:19.896791+0000","last_active":"2024-09-21T08:55:19.896750+0000","last_peered":"2024-09-21T08:55:19.896750+0000","last_clean":"2024-09-21T08:55:19.896750+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:55:19.896750+0000","last_undegraded":"2024-09-21T08:55:19.896750+0000","last_fullsized":"2024-09-21T08:55:19.896750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.896662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.710664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.396059+0000","last_change":"2024-09-21T08:55:39.396059+0000","last_active":"2024-09-21T08:55:39.396059+0000","last_peered":"2024-09-21T08:55:39.396059+0000","last_clean":"2024-09-21T08:55:39.396059+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:55:39.396059+0000","last_undegraded":"2024-09-21T08:55:39.396059+0000","last_fullsized":"2024-09-21T08:55:39.396059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.395946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:18.811856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.318908+0000","last_change":"2024-09-21T08:55:06.318938+0000","last_active":"2024-09-21T08:55:06.318908+0000","last_peered":"2024-09-21T08:55:06.318908+0000","last_clean":"2024-09-21T08:55:06.318908+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:55:06.318908+0000","last_undegraded":"2024-09-21T08:55:06.318908+0000","last_fullsized":"2024-09-21T08:55:06.318908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.318814+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:39.323163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.769310+0000","last_change":"2024-09-21T08:55:27.769355+0000","last_active":"2024-09-21T08:55:27.769310+0000","last_peered":"2024-09-21T08:55:27.769310+0000","last_clean":"2024-09-21T08:55:27.769310+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:55:27.769310+0000","last_undegraded":"2024-09-21T08:55:27.769310+0000","last_fullsized":"2024-09-21T08:55:27.769310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.769209+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.299421+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.839335+0000","last_change":"2024-09-21T08:55:07.839358+0000","last_active":"2024-09-21T08:55:07.839335+0000","last_peered":"2024-09-21T08:55:07.839335+0000","last_clean":"2024-09-21T08:55:07.839335+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:55:07.839335+0000","last_undegraded":"2024-09-21T08:55:07.839335+0000","last_fullsized":"2024-09-21T08:55:07.839335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.839244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:46.238290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:10.183990+0000","last_change":"2024-09-21T08:51:48.167652+0000","last_active":"2024-09-21T08:54:10.183990+0000","last_peered":"2024-09-21T08:54:10.183990+0000","last_clean":"2024-09-21T08:54:10.183990+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:54:10.183990+0000","last_undegraded":"2024-09-21T08:54:10.183990+0000","last_fullsized":"2024-09-21T08:54:10.183990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:51:47.136673+0000","last_clean_scrub_stamp":"2024-09-21T08:51:47.136673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.280368+0000","last_change":"2024-09-21T08:55:19.280368+0000","last_active":"2024-09-21T08:55:19.280368+0000","last_peered":"2024-09-21T08:55:19.280368+0000","last_clean":"2024-09-21T08:55:19.280368+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:55:19.280368+0000","last_undegraded":"2024-09-21T08:55:19.280368+0000","last_fullsized":"2024-09-21T08:55:19.280368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.280205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:48.230211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.707889+0000","last_change":"2024-09-21T08:55:37.707889+0000","last_active":"2024-09-21T08:55:37.707889+0000","last_peered":"2024-09-21T08:55:37.707889+0000","last_clean":"2024-09-21T08:55:37.707889+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:55:37.707889+0000","last_undegraded":"2024-09-21T08:55:37.707889+0000","last_fullsized":"2024-09-21T08:55:37.707889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.707706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:28.506620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.745709+0000","last_change":"2024-09-21T08:55:37.745709+0000","last_active":"2024-09-21T08:55:37.745709+0000","last_peered":"2024-09-21T08:55:37.745709+0000","last_clean":"2024-09-21T08:55:37.745709+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:55:37.745709+0000","last_undegraded":"2024-09-21T08:55:37.745709+0000","last_fullsized":"2024-09-21T08:55:37.745709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.745516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:33.659012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.871380+0000","last_change":"2024-09-21T08:55:48.871380+0000","last_active":"2024-09-21T08:55:48.871380+0000","last_peered":"2024-09-21T08:55:48.871380+0000","last_clean":"2024-09-21T08:55:48.871380+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:55:48.871380+0000","last_undegraded":"2024-09-21T08:55:48.871380+0000","last_fullsized":"2024-09-21T08:55:48.871380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.871258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:46.404775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.911547+0000","last_change":"2024-09-21T08:55:43.911547+0000","last_active":"2024-09-21T08:55:43.911547+0000","last_peered":"2024-09-21T08:55:43.911547+0000","last_clean":"2024-09-21T08:55:43.911547+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:55:43.911547+0000","last_undegraded":"2024-09-21T08:55:43.911547+0000","last_fullsized":"2024-09-21T08:55:43.911547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.911438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.834517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:05.992686+0000","last_change":"2024-09-21T08:56:05.992716+0000","last_active":"2024-09-21T08:56:05.992686+0000","last_peered":"2024-09-21T08:56:05.992686+0000","last_clean":"2024-09-21T08:56:05.992686+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:56:05.992686+0000","last_undegraded":"2024-09-21T08:56:05.992686+0000","last_fullsized":"2024-09-21T08:56:05.992686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:05.992593+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:05.992593+0000","last_clean_scrub_stamp":"2024-09-21T08:56:05.992593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:35.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.729668+0000","last_change":"2024-09-21T08:55:26.729668+0000","last_active":"2024-09-21T08:55:26.729668+0000","last_peered":"2024-09-21T08:55:26.729668+0000","last_clean":"2024-09-21T08:55:26.729668+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:55:26.729668+0000","last_undegraded":"2024-09-21T08:55:26.729668+0000","last_fullsized":"2024-09-21T08:55:26.729668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.729534+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:03.131761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.759949+0000","last_change":"2024-09-21T08:55:38.759949+0000","last_active":"2024-09-21T08:55:38.759949+0000","last_peered":"2024-09-21T08:55:38.759949+0000","last_clean":"2024-09-21T08:55:38.759949+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:55:38.759949+0000","last_undegraded":"2024-09-21T08:55:38.759949+0000","last_fullsized":"2024-09-21T08:55:38.759949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.759839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:25.566198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.701599+0000","last_change":"2024-09-21T08:55:33.701599+0000","last_active":"2024-09-21T08:55:33.701599+0000","last_peered":"2024-09-21T08:55:33.701599+0000","last_clean":"2024-09-21T08:55:33.701599+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:55:33.701599+0000","last_undegraded":"2024-09-21T08:55:33.701599+0000","last_fullsized":"2024-09-21T08:55:33.701599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.701471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:14.564757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.888675+0000","last_change":"2024-09-21T08:55:52.888675+0000","last_active":"2024-09-21T08:55:52.888675+0000","last_peered":"2024-09-21T08:55:52.888675+0000","last_clean":"2024-09-21T08:55:52.888675+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:55:52.888675+0000","last_undegraded":"2024-09-21T08:55:52.888675+0000","last_fullsized":"2024-09-21T08:55:52.888675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.888547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:38.715655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.649567+0000","last_change":"2024-09-21T08:55:47.649595+0000","last_active":"2024-09-21T08:55:47.649567+0000","last_peered":"2024-09-21T08:55:47.649567+0000","last_clean":"2024-09-21T08:55:47.649567+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:55:47.649567+0000","last_undegraded":"2024-09-21T08:55:47.649567+0000","last_fullsized":"2024-09-21T08:55:47.649567+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.649463+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:43.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.366070+0000","last_change":"2024-09-21T08:55:31.366070+0000","last_active":"2024-09-21T08:55:31.366070+0000","last_peered":"2024-09-21T08:55:31.366070+0000","last_clean":"2024-09-21T08:55:31.366070+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:55:31.366070+0000","last_undegraded":"2024-09-21T08:55:31.366070+0000","last_fullsized":"2024-09-21T08:55:31.366070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.365957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:46.435495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.794295+0000","last_change":"2024-09-21T08:55:39.794295+0000","last_active":"2024-09-21T08:55:39.794295+0000","last_peered":"2024-09-21T08:55:39.794295+0000","last_clean":"2024-09-21T08:55:39.794295+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:55:39.794295+0000","last_undegraded":"2024-09-21T08:55:39.794295+0000","last_fullsized":"2024-09-21T08:55:39.794295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.794176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:07.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.745413+0000","last_change":"2024-09-21T08:55:33.745413+0000","last_active":"2024-09-21T08:55:33.745413+0000","last_peered":"2024-09-21T08:55:33.745413+0000","last_clean":"2024-09-21T08:55:33.745413+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:55:33.745413+0000","last_undegraded":"2024-09-21T08:55:33.745413+0000","last_fullsized":"2024-09-21T08:55:33.745413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.745214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:50.076591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.529069+0000","last_change":"2024-09-21T08:55:50.529097+0000","last_active":"2024-09-21T08:55:50.529069+0000","last_peered":"2024-09-21T08:55:50.529069+0000","last_clean":"2024-09-21T08:55:50.529069+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:55:50.529069+0000","last_undegraded":"2024-09-21T08:55:50.529069+0000","last_fullsized":"2024-09-21T08:55:50.529069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.528965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:00.243688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.875340+0000","last_change":"2024-09-21T08:55:49.875340+0000","last_active":"2024-09-21T08:55:49.875340+0000","last_peered":"2024-09-21T08:55:49.875340+0000","last_clean":"2024-09-21T08:55:49.875340+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:55:49.875340+0000","last_undegraded":"2024-09-21T08:55:49.875340+0000","last_fullsized":"2024-09-21T08:55:49.875340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.875213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:48.388208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.381065+0000","last_change":"2024-09-21T08:55:28.381089+0000","last_active":"2024-09-21T08:55:28.381065+0000","last_peered":"2024-09-21T08:55:28.381065+0000","last_clean":"2024-09-21T08:55:28.381065+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:55:28.381065+0000","last_undegraded":"2024-09-21T08:55:28.381065+0000","last_fullsized":"2024-09-21T08:55:28.381065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.380951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.017937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.865741+0000","last_change":"2024-09-21T08:55:50.865741+0000","last_active":"2024-09-21T08:55:50.865741+0000","last_peered":"2024-09-21T08:55:50.865741+0000","last_clean":"2024-09-21T08:55:50.865741+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:55:50.865741+0000","last_undegraded":"2024-09-21T08:55:50.865741+0000","last_fullsized":"2024-09-21T08:55:50.865741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.865620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:02.835614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.895356+0000","last_change":"2024-09-21T08:55:30.895412+0000","last_active":"2024-09-21T08:55:30.895356+0000","last_peered":"2024-09-21T08:55:30.895356+0000","last_clean":"2024-09-21T08:55:30.895356+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:55:30.895356+0000","last_undegraded":"2024-09-21T08:55:30.895356+0000","last_fullsized":"2024-09-21T08:55:30.895356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.895250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:29.408246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.721660+0000","last_change":"2024-09-21T08:55:36.721660+0000","last_active":"2024-09-21T08:55:36.721660+0000","last_peered":"2024-09-21T08:55:36.721660+0000","last_clean":"2024-09-21T08:55:36.721660+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:55:36.721660+0000","last_undegraded":"2024-09-21T08:55:36.721660+0000","last_fullsized":"2024-09-21T08:55:36.721660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.721506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:00.740861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.664590+0000","last_change":"2024-09-21T08:55:31.664590+0000","last_active":"2024-09-21T08:55:31.664590+0000","last_peered":"2024-09-21T08:55:31.664590+0000","last_clean":"2024-09-21T08:55:31.664590+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:55:31.664590+0000","last_undegraded":"2024-09-21T08:55:31.664590+0000","last_fullsized":"2024-09-21T08:55:31.664590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.664444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:52.492905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.498308+0000","last_change":"2024-09-21T08:55:45.498308+0000","last_active":"2024-09-21T08:55:45.498308+0000","last_peered":"2024-09-21T08:55:45.498308+0000","last_clean":"2024-09-21T08:55:45.498308+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:55:45.498308+0000","last_undegraded":"2024-09-21T08:55:45.498308+0000","last_fullsized":"2024-09-21T08:55:45.498308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.498182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:32.304541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.353841+0000","last_change":"2024-09-21T08:55:38.353841+0000","last_active":"2024-09-21T08:55:38.353841+0000","last_peered":"2024-09-21T08:55:38.353841+0000","last_clean":"2024-09-21T08:55:38.353841+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:55:38.353841+0000","last_undegraded":"2024-09-21T08:55:38.353841+0000","last_fullsized":"2024-09-21T08:55:38.353841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.353694+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:37.227506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.479963+0000","last_change":"2024-09-21T08:55:47.479963+0000","last_active":"2024-09-21T08:55:47.479963+0000","last_peered":"2024-09-21T08:55:47.479963+0000","last_clean":"2024-09-21T08:55:47.479963+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:55:47.479963+0000","last_undegraded":"2024-09-21T08:55:47.479963+0000","last_fullsized":"2024-09-21T08:55:47.479963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.479837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:40.962501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.415391+0000","last_change":"2024-09-21T08:55:23.415391+0000","last_active":"2024-09-21T08:55:23.415391+0000","last_peered":"2024-09-21T08:55:23.415391+0000","last_clean":"2024-09-21T08:55:23.415391+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:55:23.415391+0000","last_undegraded":"2024-09-21T08:55:23.415391+0000","last_fullsized":"2024-09-21T08:55:23.415391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.415266+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:24.858792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:14.001468+0000","last_change":"2024-09-21T08:56:14.001513+0000","last_active":"2024-09-21T08:56:14.001468+0000","last_peered":"2024-09-21T08:56:14.001468+0000","last_clean":"2024-09-21T08:56:14.001468+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:56:14.001468+0000","last_undegraded":"2024-09-21T08:56:14.001468+0000","last_fullsized":"2024-09-21T08:56:14.001468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:14.001315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:14.001315+0000","last_clean_scrub_stamp":"2024-09-21T08:56:14.001315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:30.781736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.320495+0000","last_change":"2024-09-21T08:55:32.320495+0000","last_active":"2024-09-21T08:55:32.320495+0000","last_peered":"2024-09-21T08:55:32.320495+0000","last_clean":"2024-09-21T08:55:32.320495+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:55:32.320495+0000","last_undegraded":"2024-09-21T08:55:32.320495+0000","last_fullsized":"2024-09-21T08:55:32.320495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.320370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:31.140044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.829772+0000","last_change":"2024-09-21T08:55:55.829772+0000","last_active":"2024-09-21T08:55:55.829772+0000","last_peered":"2024-09-21T08:55:55.829772+0000","last_clean":"2024-09-21T08:55:55.829772+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:55:55.829772+0000","last_undegraded":"2024-09-21T08:55:55.829772+0000","last_fullsized":"2024-09-21T08:55:55.829772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:55.829606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:55.829606+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.829606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:18.774505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.853399+0000","last_change":"2024-09-21T08:55:31.853399+0000","last_active":"2024-09-21T08:55:31.853399+0000","last_peered":"2024-09-21T08:55:31.853399+0000","last_clean":"2024-09-21T08:55:31.853399+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:55:31.853399+0000","last_undegraded":"2024-09-21T08:55:31.853399+0000","last_fullsized":"2024-09-21T08:55:31.853399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.853253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.874388+0000","last_change":"2024-09-21T08:55:23.874414+0000","last_active":"2024-09-21T08:55:23.874388+0000","last_peered":"2024-09-21T08:55:23.874388+0000","last_clean":"2024-09-21T08:55:23.874388+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:55:23.874388+0000","last_undegraded":"2024-09-21T08:55:23.874388+0000","last_fullsized":"2024-09-21T08:55:23.874388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.874282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:43.324372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.375781+0000","last_change":"2024-09-21T08:55:25.375781+0000","last_active":"2024-09-21T08:55:25.375781+0000","last_peered":"2024-09-21T08:55:25.375781+0000","last_clean":"2024-09-21T08:55:25.375781+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:55:25.375781+0000","last_undegraded":"2024-09-21T08:55:25.375781+0000","last_fullsized":"2024-09-21T08:55:25.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.375567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:46.793767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:59.913068+0000","last_change":"2024-09-21T08:55:59.913094+0000","last_active":"2024-09-21T08:55:59.913068+0000","last_peered":"2024-09-21T08:55:59.913068+0000","last_clean":"2024-09-21T08:55:59.913068+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:55:59.913068+0000","last_undegraded":"2024-09-21T08:55:59.913068+0000","last_fullsized":"2024-09-21T08:55:59.913068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:59.912999+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:59.912999+0000","last_clean_scrub_stamp":"2024-09-21T08:55:59.912999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:37.990297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.826822+0000","last_change":"2024-09-21T08:55:51.826847+0000","last_active":"2024-09-21T08:55:51.826822+0000","last_peered":"2024-09-21T08:55:51.826822+0000","last_clean":"2024-09-21T08:55:51.826822+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:55:51.826822+0000","last_undegraded":"2024-09-21T08:55:51.826822+0000","last_fullsized":"2024-09-21T08:55:51.826822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.826720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:57.054148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.688523+0000","last_change":"2024-09-21T08:55:28.688551+0000","last_active":"2024-09-21T08:55:28.688523+0000","last_peered":"2024-09-21T08:55:28.688523+0000","last_clean":"2024-09-21T08:55:28.688523+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:55:28.688523+0000","last_undegraded":"2024-09-21T08:55:28.688523+0000","last_fullsized":"2024-09-21T08:55:28.688523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.688436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:11.647915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.696898+0000","last_change":"2024-09-21T08:55:30.696969+0000","last_active":"2024-09-21T08:55:30.696898+0000","last_peered":"2024-09-21T08:55:30.696898+0000","last_clean":"2024-09-21T08:55:30.696898+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:55:30.696898+0000","last_undegraded":"2024-09-21T08:55:30.696898+0000","last_fullsized":"2024-09-21T08:55:30.696898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.696780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:08.152392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.239875+0000","last_change":"2024-09-21T08:55:17.239922+0000","last_active":"2024-09-21T08:55:17.239875+0000","last_peered":"2024-09-21T08:55:17.239875+0000","last_clean":"2024-09-21T08:55:17.239875+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:55:17.239875+0000","last_undegraded":"2024-09-21T08:55:17.239875+0000","last_fullsized":"2024-09-21T08:55:17.239875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.239755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.929519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39992,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331848,"statfs":{"total":96636764160,"available":96595812352,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673022,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673023,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:56:19.283 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.283 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T08:51:41.116106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.284 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.284 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.285 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.285 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.285 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T08:51:47.136673+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=51, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=8, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T08:56:19.286 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T08:56:39.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8072fc4640 1 Processor -- start 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8072fc4640 1 -- start start 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8072fc4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f806c09bd50 0x7f806c09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8072fc4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806c09d3b0 con 0x7f806c09c670 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8072fc4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f806c098230 con 0x7f806c09bd50 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8070d60640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f806c09bd50 0x7f806c09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f806bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f806c09c670 0x7f806c0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52298/0 (socket says 172.21.15.29:52298) 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f806bfff640 1 -- 172.21.15.29:0/1510388809 learned_addr learned my addr 172.21.15.29:0/1510388809 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8070d60640 1 -- 172.21.15.29:0/1510388809 >> v1:172.21.15.29:6789/0 conn(0x7f806c09c670 legacy=0x7f806c0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f8070d60640 1 -- 172.21.15.29:0/1510388809 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c0983e0 con 0x7f806c09bd50 2024-09-21T08:56:39.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.399+0000 7f806b7fe640 1 -- 172.21.15.29:0/1510388809 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525690290 0 0) 0x7f8054001110 con 0x7f806c09c670 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.400+0000 7f8070d60640 1 --2- 172.21.15.29:0/1510388809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c09c130 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f805c009720 tx=0x7f805c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e89c81db5742f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.400+0000 7f806b7fe640 1 -- 172.21.15.29:0/1510388809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c037070 con 0x7f806c09bd50 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.400+0000 7f806b7fe640 1 -- 172.21.15.29:0/1510388809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c02ad90 con 0x7f806c09bd50 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.400+0000 7f806b7fe640 1 -- 172.21.15.29:0/1510388809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c032590 con 0x7f806c09bd50 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 -- 172.21.15.29:0/1510388809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 msgr2=0x7f806c09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1510388809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c09c130 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f805c009720 tx=0x7f805c02a110 comp rx=0 tx=0).stop 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 -- 172.21.15.29:0/1510388809 shutdown_connections 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1510388809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c09c130 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 -- 172.21.15.29:0/1510388809 >> 172.21.15.29:0/1510388809 conn(0x7f806c06d4a0 msgr2=0x7f806c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 -- 172.21.15.29:0/1510388809 shutdown_connections 2024-09-21T08:56:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.401+0000 7f8072fc4640 1 -- 172.21.15.29:0/1510388809 wait complete. 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.402+0000 7f8072fc4640 1 Processor -- start 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.402+0000 7f8072fc4640 1 -- start start 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8072fc4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8072fc4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f806c099b90 con 0x7f806c09bd50 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8070d60640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8070d60640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44620/0 (socket says 172.21.15.29:44620) 2024-09-21T08:56:39.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8070d60640 1 -- 172.21.15.29:0/1854931101 learned_addr learned my addr 172.21.15.29:0/1854931101 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8070d60640 1 -- 172.21.15.29:0/1854931101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c1b3020 con 0x7f806c09bd50 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8070d60640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f805c009720 tx=0x7f805c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c041070 con 0x7f806c09bd50 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c03c460 con 0x7f806c09bd50 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c037040 con 0x7f806c09bd50 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c09a760 con 0x7f806c09bd50 2024-09-21T08:56:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.403+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1b28f0 con 0x7f806c09bd50 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.404+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f805c044070 con 0x7f806c09bd50 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.404+0000 7f80697fa640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 0x7f804c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.404+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c1b2670 con 0x7f806c09bd50 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.405+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f805c06c7e0 con 0x7f806c09bd50 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.405+0000 7f806bfff640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 0x7f804c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.405+0000 7f806bfff640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 0x7f804c03a790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8054000c00 tx=0x7f8054001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.410+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f806c1b3020 con 0x7f806c09bd50 2024-09-21T08:56:39.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.585+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 --> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f806c09a130 con 0x7f804c0382d0 2024-09-21T08:56:39.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.600+0000 7f80697fa640 1 -- 172.21.15.29:0/1854931101 <== mgr.4098 v2:172.21.15.196:6824/482734080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666178 (secure 0 0 0) 0x7f806c09a130 con 0x7f804c0382d0 2024-09-21T08:56:39.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T08:56:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T08:56:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.604+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 msgr2=0x7f804c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.604+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 0x7f804c03a790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8054000c00 tx=0x7f8054001250 comp rx=0 tx=0).stop 2024-09-21T08:56:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 msgr2=0x7f806c1b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f805c009720 tx=0x7f805c0046c0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 shutdown_connections 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f804c0382d0 0x7f804c03a790 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 --2- 172.21.15.29:0/1854931101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f806c09bd50 0x7f806c1b38b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 >> 172.21.15.29:0/1854931101 conn(0x7f806c06d4a0 msgr2=0x7f806c09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 shutdown_connections 2024-09-21T08:56:39.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.605+0000 7f8072fc4640 1 -- 172.21.15.29:0/1854931101 wait complete. 2024-09-21T08:56:39.618 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-21T08:56:39.253633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5098,"num_read_kb":4679,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4791,"ondisk_log_size":4791,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152672,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334688,"statfs":{"total":386547056640,"available":386390720512,"internally_reserved":0,"allocated":3047424,"data_stored":1812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003802"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.758671+0000","last_change":"2024-09-21T08:55:27.758671+0000","last_active":"2024-09-21T08:55:27.758671+0000","last_peered":"2024-09-21T08:55:27.758671+0000","last_clean":"2024-09-21T08:55:27.758671+0000","last_became_active":"2024-09-21T08:51:38.148771+0000","last_became_peered":"2024-09-21T08:51:38.148771+0000","last_unstale":"2024-09-21T08:55:27.758671+0000","last_undegraded":"2024-09-21T08:55:27.758671+0000","last_fullsized":"2024-09-21T08:55:27.758671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:27.758533+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.758533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:27.669521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.300692+0000","last_change":"2024-09-21T08:55:36.300724+0000","last_active":"2024-09-21T08:55:36.300692+0000","last_peered":"2024-09-21T08:55:36.300692+0000","last_clean":"2024-09-21T08:55:36.300692+0000","last_became_active":"2024-09-21T08:51:40.134256+0000","last_became_peered":"2024-09-21T08:51:40.134256+0000","last_unstale":"2024-09-21T08:55:36.300692+0000","last_undegraded":"2024-09-21T08:55:36.300692+0000","last_fullsized":"2024-09-21T08:55:36.300692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.300596+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.300596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.904691+0000","last_change":"2024-09-21T08:55:50.904720+0000","last_active":"2024-09-21T08:55:50.904691+0000","last_peered":"2024-09-21T08:55:50.904691+0000","last_clean":"2024-09-21T08:55:50.904691+0000","last_became_active":"2024-09-21T08:51:38.131389+0000","last_became_peered":"2024-09-21T08:51:38.131389+0000","last_unstale":"2024-09-21T08:55:50.904691+0000","last_undegraded":"2024-09-21T08:55:50.904691+0000","last_fullsized":"2024-09-21T08:55:50.904691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.904587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.904587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:11.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'20","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.803865+0000","last_change":"2024-09-21T08:55:33.803907+0000","last_active":"2024-09-21T08:55:33.803865+0000","last_peered":"2024-09-21T08:55:33.803865+0000","last_clean":"2024-09-21T08:55:33.803865+0000","last_became_active":"2024-09-21T08:51:40.135811+0000","last_became_peered":"2024-09-21T08:51:40.135811+0000","last_unstale":"2024-09-21T08:55:33.803865+0000","last_undegraded":"2024-09-21T08:55:33.803865+0000","last_fullsized":"2024-09-21T08:55:33.803865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:33.803741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.803741+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:25.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.853610+0000","last_change":"2024-09-21T08:55:57.853636+0000","last_active":"2024-09-21T08:55:57.853610+0000","last_peered":"2024-09-21T08:55:57.853610+0000","last_clean":"2024-09-21T08:55:57.853610+0000","last_became_active":"2024-09-21T08:51:38.138039+0000","last_became_peered":"2024-09-21T08:51:38.138039+0000","last_unstale":"2024-09-21T08:55:57.853610+0000","last_undegraded":"2024-09-21T08:55:57.853610+0000","last_fullsized":"2024-09-21T08:55:57.853610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:57.853516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:57.853516+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.853516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:01.486023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:00.813519+0000","last_change":"2024-09-21T08:56:00.813547+0000","last_active":"2024-09-21T08:56:00.813519+0000","last_peered":"2024-09-21T08:56:00.813519+0000","last_clean":"2024-09-21T08:56:00.813519+0000","last_became_active":"2024-09-21T08:52:14.235719+0000","last_became_peered":"2024-09-21T08:52:14.235719+0000","last_unstale":"2024-09-21T08:56:00.813519+0000","last_undegraded":"2024-09-21T08:56:00.813519+0000","last_fullsized":"2024-09-21T08:56:00.813519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:56:00.813425+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:56:00.813425+0000","last_clean_scrub_stamp":"2024-09-21T08:56:00.813425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:43.904243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.752161+0000","last_change":"2024-09-21T08:55:36.752161+0000","last_active":"2024-09-21T08:55:36.752161+0000","last_peered":"2024-09-21T08:55:36.752161+0000","last_clean":"2024-09-21T08:55:36.752161+0000","last_became_active":"2024-09-21T08:51:38.140308+0000","last_became_peered":"2024-09-21T08:51:38.140308+0000","last_unstale":"2024-09-21T08:55:36.752161+0000","last_undegraded":"2024-09-21T08:55:36.752161+0000","last_fullsized":"2024-09-21T08:55:36.752161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.752039+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.752039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:30.109665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.800094+0000","last_change":"2024-09-21T08:55:37.800125+0000","last_active":"2024-09-21T08:55:37.800094+0000","last_peered":"2024-09-21T08:55:37.800094+0000","last_clean":"2024-09-21T08:55:37.800094+0000","last_became_active":"2024-09-21T08:51:40.133063+0000","last_became_peered":"2024-09-21T08:51:40.133063+0000","last_unstale":"2024-09-21T08:55:37.800094+0000","last_undegraded":"2024-09-21T08:55:37.800094+0000","last_fullsized":"2024-09-21T08:55:37.800094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:37.799961+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.799961+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:11.784216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:14.972992+0000","last_change":"2024-09-21T08:56:14.973020+0000","last_active":"2024-09-21T08:56:14.972992+0000","last_peered":"2024-09-21T08:56:14.972992+0000","last_clean":"2024-09-21T08:56:14.972992+0000","last_became_active":"2024-09-21T08:51:38.149926+0000","last_became_peered":"2024-09-21T08:51:38.149926+0000","last_unstale":"2024-09-21T08:56:14.972992+0000","last_undegraded":"2024-09-21T08:56:14.972992+0000","last_fullsized":"2024-09-21T08:56:14.972992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:14.972895+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:14.972895+0000","last_clean_scrub_stamp":"2024-09-21T08:56:14.972895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:04.694553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'22","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.436421+0000","last_change":"2024-09-21T08:55:40.436449+0000","last_active":"2024-09-21T08:55:40.436421+0000","last_peered":"2024-09-21T08:55:40.436421+0000","last_clean":"2024-09-21T08:55:40.436421+0000","last_became_active":"2024-09-21T08:51:40.139035+0000","last_became_peered":"2024-09-21T08:51:40.139035+0000","last_unstale":"2024-09-21T08:55:40.436421+0000","last_undegraded":"2024-09-21T08:55:40.436421+0000","last_fullsized":"2024-09-21T08:55:40.436421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:40.436329+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.436329+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:51.918514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":75,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.824531+0000","last_change":"2024-09-21T08:55:25.824569+0000","last_active":"2024-09-21T08:55:25.824531+0000","last_peered":"2024-09-21T08:55:25.824531+0000","last_clean":"2024-09-21T08:55:25.824531+0000","last_became_active":"2024-09-21T08:51:38.149147+0000","last_became_peered":"2024-09-21T08:51:38.149147+0000","last_unstale":"2024-09-21T08:55:25.824531+0000","last_undegraded":"2024-09-21T08:55:25.824531+0000","last_fullsized":"2024-09-21T08:55:25.824531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:25.824445+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.824445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:47.554324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'10","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.633982+0000","last_change":"2024-09-21T08:55:48.633982+0000","last_active":"2024-09-21T08:55:48.633982+0000","last_peered":"2024-09-21T08:55:48.633982+0000","last_clean":"2024-09-21T08:55:48.633982+0000","last_became_active":"2024-09-21T08:52:14.235388+0000","last_became_peered":"2024-09-21T08:52:14.235388+0000","last_unstale":"2024-09-21T08:55:48.633982+0000","last_undegraded":"2024-09-21T08:55:48.633982+0000","last_fullsized":"2024-09-21T08:55:48.633982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:48.633864+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.633864+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:18.768417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:12.048336+0000","last_change":"2024-09-21T08:56:12.048364+0000","last_active":"2024-09-21T08:56:12.048336+0000","last_peered":"2024-09-21T08:56:12.048336+0000","last_clean":"2024-09-21T08:56:12.048336+0000","last_became_active":"2024-09-21T08:51:38.125280+0000","last_became_peered":"2024-09-21T08:51:38.125280+0000","last_unstale":"2024-09-21T08:56:12.048336+0000","last_undegraded":"2024-09-21T08:56:12.048336+0000","last_fullsized":"2024-09-21T08:56:12.048336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:56:12.048240+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:56:12.048240+0000","last_clean_scrub_stamp":"2024-09-21T08:56:12.048240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:29.940468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.870515+0000","last_change":"2024-09-21T08:55:24.870515+0000","last_active":"2024-09-21T08:55:24.870515+0000","last_peered":"2024-09-21T08:55:24.870515+0000","last_clean":"2024-09-21T08:55:24.870515+0000","last_became_active":"2024-09-21T08:51:40.136344+0000","last_became_peered":"2024-09-21T08:51:40.136344+0000","last_unstale":"2024-09-21T08:55:24.870515+0000","last_undegraded":"2024-09-21T08:55:24.870515+0000","last_fullsized":"2024-09-21T08:55:24.870515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:24.870353+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.870353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:25.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.719335+0000","last_change":"2024-09-21T08:55:34.719335+0000","last_active":"2024-09-21T08:55:34.719335+0000","last_peered":"2024-09-21T08:55:34.719335+0000","last_clean":"2024-09-21T08:55:34.719335+0000","last_became_active":"2024-09-21T08:51:38.136925+0000","last_became_peered":"2024-09-21T08:51:38.136925+0000","last_unstale":"2024-09-21T08:55:34.719335+0000","last_undegraded":"2024-09-21T08:55:34.719335+0000","last_fullsized":"2024-09-21T08:55:34.719335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.719148+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.719148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:22.580263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.709517+0000","last_change":"2024-09-21T08:55:28.709517+0000","last_active":"2024-09-21T08:55:28.709517+0000","last_peered":"2024-09-21T08:55:28.709517+0000","last_clean":"2024-09-21T08:55:28.709517+0000","last_became_active":"2024-09-21T08:51:40.139688+0000","last_became_peered":"2024-09-21T08:51:40.139688+0000","last_unstale":"2024-09-21T08:55:28.709517+0000","last_undegraded":"2024-09-21T08:55:28.709517+0000","last_fullsized":"2024-09-21T08:55:28.709517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:28.709347+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.709347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:36.913750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.776552+0000","last_change":"2024-09-21T08:55:34.776552+0000","last_active":"2024-09-21T08:55:34.776552+0000","last_peered":"2024-09-21T08:55:34.776552+0000","last_clean":"2024-09-21T08:55:34.776552+0000","last_became_active":"2024-09-21T08:51:40.135264+0000","last_became_peered":"2024-09-21T08:51:40.135264+0000","last_unstale":"2024-09-21T08:55:34.776552+0000","last_undegraded":"2024-09-21T08:55:34.776552+0000","last_fullsized":"2024-09-21T08:55:34.776552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:34.776428+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.776428+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:14.086199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.302654+0000","last_change":"2024-09-21T08:55:33.302654+0000","last_active":"2024-09-21T08:55:33.302654+0000","last_peered":"2024-09-21T08:55:33.302654+0000","last_clean":"2024-09-21T08:55:33.302654+0000","last_became_active":"2024-09-21T08:51:38.137793+0000","last_became_peered":"2024-09-21T08:51:38.137793+0000","last_unstale":"2024-09-21T08:55:33.302654+0000","last_undegraded":"2024-09-21T08:55:33.302654+0000","last_fullsized":"2024-09-21T08:55:33.302654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:33.302523+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.302523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:33.718305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.388861+0000","last_change":"2024-09-21T08:55:30.388861+0000","last_active":"2024-09-21T08:55:30.388861+0000","last_peered":"2024-09-21T08:55:30.388861+0000","last_clean":"2024-09-21T08:55:30.388861+0000","last_became_active":"2024-09-21T08:51:40.134723+0000","last_became_peered":"2024-09-21T08:51:40.134723+0000","last_unstale":"2024-09-21T08:55:30.388861+0000","last_undegraded":"2024-09-21T08:55:30.388861+0000","last_fullsized":"2024-09-21T08:55:30.388861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:30.388729+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.388729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:43:08.353968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.912281+0000","last_change":"2024-09-21T08:55:21.912281+0000","last_active":"2024-09-21T08:55:21.912281+0000","last_peered":"2024-09-21T08:55:21.912281+0000","last_clean":"2024-09-21T08:55:21.912281+0000","last_became_active":"2024-09-21T08:51:38.149932+0000","last_became_peered":"2024-09-21T08:51:38.149932+0000","last_unstale":"2024-09-21T08:55:21.912281+0000","last_undegraded":"2024-09-21T08:55:21.912281+0000","last_fullsized":"2024-09-21T08:55:21.912281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:21.912160+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.912160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:04.573712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.328976+0000","last_change":"2024-09-21T08:55:26.328976+0000","last_active":"2024-09-21T08:55:26.328976+0000","last_peered":"2024-09-21T08:55:26.328976+0000","last_clean":"2024-09-21T08:55:26.328976+0000","last_became_active":"2024-09-21T08:51:40.134695+0000","last_became_peered":"2024-09-21T08:51:40.134695+0000","last_unstale":"2024-09-21T08:55:26.328976+0000","last_undegraded":"2024-09-21T08:55:26.328976+0000","last_fullsized":"2024-09-21T08:55:26.328976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:26.328860+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.328860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:08.318333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.330395+0000","last_change":"2024-09-21T08:55:35.330395+0000","last_active":"2024-09-21T08:55:35.330395+0000","last_peered":"2024-09-21T08:55:35.330395+0000","last_clean":"2024-09-21T08:55:35.330395+0000","last_became_active":"2024-09-21T08:51:38.137962+0000","last_became_peered":"2024-09-21T08:51:38.137962+0000","last_unstale":"2024-09-21T08:55:35.330395+0000","last_undegraded":"2024-09-21T08:55:35.330395+0000","last_fullsized":"2024-09-21T08:55:35.330395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.330235+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.330235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:27.621412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.676928+0000","last_change":"2024-09-21T08:55:35.676928+0000","last_active":"2024-09-21T08:55:35.676928+0000","last_peered":"2024-09-21T08:55:35.676928+0000","last_clean":"2024-09-21T08:55:35.676928+0000","last_became_active":"2024-09-21T08:51:40.130194+0000","last_became_peered":"2024-09-21T08:51:40.130194+0000","last_unstale":"2024-09-21T08:55:35.676928+0000","last_undegraded":"2024-09-21T08:55:35.676928+0000","last_fullsized":"2024-09-21T08:55:35.676928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:35.676798+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.676798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:17.765037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.440895+0000","last_change":"2024-09-21T08:55:48.440895+0000","last_active":"2024-09-21T08:55:48.440895+0000","last_peered":"2024-09-21T08:55:48.440895+0000","last_clean":"2024-09-21T08:55:48.440895+0000","last_became_active":"2024-09-21T08:51:38.133402+0000","last_became_peered":"2024-09-21T08:51:38.133402+0000","last_unstale":"2024-09-21T08:55:48.440895+0000","last_undegraded":"2024-09-21T08:55:48.440895+0000","last_fullsized":"2024-09-21T08:55:48.440895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.440751+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.440751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:09.215187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.724453+0000","last_change":"2024-09-21T08:55:32.724453+0000","last_active":"2024-09-21T08:55:32.724453+0000","last_peered":"2024-09-21T08:55:32.724453+0000","last_clean":"2024-09-21T08:55:32.724453+0000","last_became_active":"2024-09-21T08:51:40.143429+0000","last_became_peered":"2024-09-21T08:51:40.143429+0000","last_unstale":"2024-09-21T08:55:32.724453+0000","last_undegraded":"2024-09-21T08:55:32.724453+0000","last_fullsized":"2024-09-21T08:55:32.724453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.724341+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.724341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:18.603732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.835407+0000","last_change":"2024-09-21T08:55:40.835407+0000","last_active":"2024-09-21T08:55:40.835407+0000","last_peered":"2024-09-21T08:55:40.835407+0000","last_clean":"2024-09-21T08:55:40.835407+0000","last_became_active":"2024-09-21T08:51:38.137012+0000","last_became_peered":"2024-09-21T08:51:38.137012+0000","last_unstale":"2024-09-21T08:55:40.835407+0000","last_undegraded":"2024-09-21T08:55:40.835407+0000","last_fullsized":"2024-09-21T08:55:40.835407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.835288+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.835288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:34.317951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.328639+0000","last_change":"2024-09-21T08:55:34.328639+0000","last_active":"2024-09-21T08:55:34.328639+0000","last_peered":"2024-09-21T08:55:34.328639+0000","last_clean":"2024-09-21T08:55:34.328639+0000","last_became_active":"2024-09-21T08:51:40.138349+0000","last_became_peered":"2024-09-21T08:51:40.138349+0000","last_unstale":"2024-09-21T08:55:34.328639+0000","last_undegraded":"2024-09-21T08:55:34.328639+0000","last_fullsized":"2024-09-21T08:55:34.328639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:34.328524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.328524+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:28.403133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:13.001346+0000","last_change":"2024-09-21T08:56:13.001346+0000","last_active":"2024-09-21T08:56:13.001346+0000","last_peered":"2024-09-21T08:56:13.001346+0000","last_clean":"2024-09-21T08:56:13.001346+0000","last_became_active":"2024-09-21T08:51:38.126381+0000","last_became_peered":"2024-09-21T08:51:38.126381+0000","last_unstale":"2024-09-21T08:56:13.001346+0000","last_undegraded":"2024-09-21T08:56:13.001346+0000","last_fullsized":"2024-09-21T08:56:13.001346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:13.001225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:13.001225+0000","last_clean_scrub_stamp":"2024-09-21T08:56:13.001225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:39.003910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.615162+0000","last_change":"2024-09-21T08:55:53.615189+0000","last_active":"2024-09-21T08:55:53.615162+0000","last_peered":"2024-09-21T08:55:53.615162+0000","last_clean":"2024-09-21T08:55:53.615162+0000","last_became_active":"2024-09-21T08:51:48.160539+0000","last_became_peered":"2024-09-21T08:51:48.160539+0000","last_unstale":"2024-09-21T08:55:53.615162+0000","last_undegraded":"2024-09-21T08:55:53.615162+0000","last_fullsized":"2024-09-21T08:55:53.615162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-21T08:55:53.615080+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.615080+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:40.609106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.875606+0000","last_change":"2024-09-21T08:55:39.875606+0000","last_active":"2024-09-21T08:55:39.875606+0000","last_peered":"2024-09-21T08:55:39.875606+0000","last_clean":"2024-09-21T08:55:39.875606+0000","last_became_active":"2024-09-21T08:51:40.132212+0000","last_became_peered":"2024-09-21T08:51:40.132212+0000","last_unstale":"2024-09-21T08:55:39.875606+0000","last_undegraded":"2024-09-21T08:55:39.875606+0000","last_fullsized":"2024-09-21T08:55:39.875606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.875491+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.875491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:41.825808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:04.980851+0000","last_change":"2024-09-21T08:56:04.980851+0000","last_active":"2024-09-21T08:56:04.980851+0000","last_peered":"2024-09-21T08:56:04.980851+0000","last_clean":"2024-09-21T08:56:04.980851+0000","last_became_active":"2024-09-21T08:51:38.150468+0000","last_became_peered":"2024-09-21T08:51:38.150468+0000","last_unstale":"2024-09-21T08:56:04.980851+0000","last_undegraded":"2024-09-21T08:56:04.980851+0000","last_fullsized":"2024-09-21T08:56:04.980851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:04.980684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:04.980684+0000","last_clean_scrub_stamp":"2024-09-21T08:56:04.980684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:25.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.798211+0000","last_change":"2024-09-21T08:54:59.798211+0000","last_active":"2024-09-21T08:54:59.798211+0000","last_peered":"2024-09-21T08:54:59.798211+0000","last_clean":"2024-09-21T08:54:59.798211+0000","last_became_active":"2024-09-21T08:51:42.138319+0000","last_became_peered":"2024-09-21T08:51:42.138319+0000","last_unstale":"2024-09-21T08:54:59.798211+0000","last_undegraded":"2024-09-21T08:54:59.798211+0000","last_fullsized":"2024-09-21T08:54:59.798211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.798019+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.798019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:26.891797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'42","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.791003+0000","last_change":"2024-09-21T08:55:25.791003+0000","last_active":"2024-09-21T08:55:25.791003+0000","last_peered":"2024-09-21T08:55:25.791003+0000","last_clean":"2024-09-21T08:55:25.791003+0000","last_became_active":"2024-09-21T08:51:44.148388+0000","last_became_peered":"2024-09-21T08:51:44.148388+0000","last_unstale":"2024-09-21T08:55:25.791003+0000","last_undegraded":"2024-09-21T08:55:25.791003+0000","last_fullsized":"2024-09-21T08:55:25.791003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'42","last_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_deep_scrub":"36'42","last_deep_scrub_stamp":"2024-09-21T08:55:25.790847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.790847+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:12.540524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.311412+0000","last_change":"2024-09-21T08:55:08.311412+0000","last_active":"2024-09-21T08:55:08.311412+0000","last_peered":"2024-09-21T08:55:08.311412+0000","last_clean":"2024-09-21T08:55:08.311412+0000","last_became_active":"2024-09-21T08:51:46.151980+0000","last_became_peered":"2024-09-21T08:51:46.151980+0000","last_unstale":"2024-09-21T08:55:08.311412+0000","last_undegraded":"2024-09-21T08:55:08.311412+0000","last_fullsized":"2024-09-21T08:55:08.311412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:08.311270+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.311270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:32.145710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.670652+0000","last_change":"2024-09-21T08:55:56.670703+0000","last_active":"2024-09-21T08:55:56.670652+0000","last_peered":"2024-09-21T08:55:56.670652+0000","last_clean":"2024-09-21T08:55:56.670652+0000","last_became_active":"2024-09-21T08:51:48.165160+0000","last_became_peered":"2024-09-21T08:51:48.165160+0000","last_unstale":"2024-09-21T08:55:56.670652+0000","last_undegraded":"2024-09-21T08:55:56.670652+0000","last_fullsized":"2024-09-21T08:55:56.670652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:56.670547+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:56.670547+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.670547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:55.183543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.846931+0000","last_change":"2024-09-21T08:55:38.846931+0000","last_active":"2024-09-21T08:55:38.846931+0000","last_peered":"2024-09-21T08:55:38.846931+0000","last_clean":"2024-09-21T08:55:38.846931+0000","last_became_active":"2024-09-21T08:51:40.132430+0000","last_became_peered":"2024-09-21T08:51:40.132430+0000","last_unstale":"2024-09-21T08:55:38.846931+0000","last_undegraded":"2024-09-21T08:55:38.846931+0000","last_fullsized":"2024-09-21T08:55:38.846931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:38.846819+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.846819+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:19.411878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.717928+0000","last_change":"2024-09-21T08:55:35.717928+0000","last_active":"2024-09-21T08:55:35.717928+0000","last_peered":"2024-09-21T08:55:35.717928+0000","last_clean":"2024-09-21T08:55:35.717928+0000","last_became_active":"2024-09-21T08:51:38.134727+0000","last_became_peered":"2024-09-21T08:51:38.134727+0000","last_unstale":"2024-09-21T08:55:35.717928+0000","last_undegraded":"2024-09-21T08:55:35.717928+0000","last_fullsized":"2024-09-21T08:55:35.717928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:35.717771+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.717771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.729351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"36'5","reported_seq":239,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.788099+0000","last_change":"2024-09-21T08:55:13.788099+0000","last_active":"2024-09-21T08:55:13.788099+0000","last_peered":"2024-09-21T08:55:13.788099+0000","last_clean":"2024-09-21T08:55:13.788099+0000","last_became_active":"2024-09-21T08:51:42.139026+0000","last_became_peered":"2024-09-21T08:51:42.139026+0000","last_unstale":"2024-09-21T08:55:13.788099+0000","last_undegraded":"2024-09-21T08:55:13.788099+0000","last_fullsized":"2024-09-21T08:55:13.788099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:13.787969+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.787969+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:42.737974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.271154+0000","last_change":"2024-09-21T08:55:03.271154+0000","last_active":"2024-09-21T08:55:03.271154+0000","last_peered":"2024-09-21T08:55:03.271154+0000","last_clean":"2024-09-21T08:55:03.271154+0000","last_became_active":"2024-09-21T08:51:44.146260+0000","last_became_peered":"2024-09-21T08:51:44.146260+0000","last_unstale":"2024-09-21T08:55:03.271154+0000","last_undegraded":"2024-09-21T08:55:03.271154+0000","last_fullsized":"2024-09-21T08:55:03.271154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:03.271042+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.271042+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:48.059788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.283461+0000","last_change":"2024-09-21T08:55:16.283461+0000","last_active":"2024-09-21T08:55:16.283461+0000","last_peered":"2024-09-21T08:55:16.283461+0000","last_clean":"2024-09-21T08:55:16.283461+0000","last_became_active":"2024-09-21T08:51:46.156802+0000","last_became_peered":"2024-09-21T08:51:46.156802+0000","last_unstale":"2024-09-21T08:55:16.283461+0000","last_undegraded":"2024-09-21T08:55:16.283461+0000","last_fullsized":"2024-09-21T08:55:16.283461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.283345+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:56.311040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.803836+0000","last_change":"2024-09-21T08:55:23.803862+0000","last_active":"2024-09-21T08:55:23.803836+0000","last_peered":"2024-09-21T08:55:23.803836+0000","last_clean":"2024-09-21T08:55:23.803836+0000","last_became_active":"2024-09-21T08:51:48.153903+0000","last_became_peered":"2024-09-21T08:51:48.153903+0000","last_unstale":"2024-09-21T08:55:23.803836+0000","last_undegraded":"2024-09-21T08:55:23.803836+0000","last_fullsized":"2024-09-21T08:55:23.803836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:23.803738+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.803738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:17.468439+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'12","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:35.729650+0000","last_change":"2024-09-21T08:55:35.729650+0000","last_active":"2024-09-21T08:55:35.729650+0000","last_peered":"2024-09-21T08:55:35.729650+0000","last_clean":"2024-09-21T08:55:35.729650+0000","last_became_active":"2024-09-21T08:51:40.133537+0000","last_became_peered":"2024-09-21T08:51:40.133537+0000","last_unstale":"2024-09-21T08:55:35.729650+0000","last_undegraded":"2024-09-21T08:55:35.729650+0000","last_fullsized":"2024-09-21T08:55:35.729650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:35.729524+0000","last_clean_scrub_stamp":"2024-09-21T08:55:35.729524+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:50.337054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:03.988279+0000","last_change":"2024-09-21T08:56:03.988279+0000","last_active":"2024-09-21T08:56:03.988279+0000","last_peered":"2024-09-21T08:56:03.988279+0000","last_clean":"2024-09-21T08:56:03.988279+0000","last_became_active":"2024-09-21T08:51:38.137414+0000","last_became_peered":"2024-09-21T08:51:38.137414+0000","last_unstale":"2024-09-21T08:56:03.988279+0000","last_undegraded":"2024-09-21T08:56:03.988279+0000","last_fullsized":"2024-09-21T08:56:03.988279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:03.988135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:03.988135+0000","last_clean_scrub_stamp":"2024-09-21T08:56:03.988135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:18.156018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.766565+0000","last_change":"2024-09-21T08:55:16.766565+0000","last_active":"2024-09-21T08:55:16.766565+0000","last_peered":"2024-09-21T08:55:16.766565+0000","last_clean":"2024-09-21T08:55:16.766565+0000","last_became_active":"2024-09-21T08:51:42.136670+0000","last_became_peered":"2024-09-21T08:51:42.136670+0000","last_unstale":"2024-09-21T08:55:16.766565+0000","last_undegraded":"2024-09-21T08:55:16.766565+0000","last_fullsized":"2024-09-21T08:55:16.766565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:16.766426+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.766426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:14.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.846476+0000","last_change":"2024-09-21T08:55:03.846476+0000","last_active":"2024-09-21T08:55:03.846476+0000","last_peered":"2024-09-21T08:55:03.846476+0000","last_clean":"2024-09-21T08:55:03.846476+0000","last_became_active":"2024-09-21T08:51:44.151255+0000","last_became_peered":"2024-09-21T08:51:44.151255+0000","last_unstale":"2024-09-21T08:55:03.846476+0000","last_undegraded":"2024-09-21T08:55:03.846476+0000","last_fullsized":"2024-09-21T08:55:03.846476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:03.846298+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.846298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:39.204915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.800324+0000","last_change":"2024-09-21T08:55:24.800324+0000","last_active":"2024-09-21T08:55:24.800324+0000","last_peered":"2024-09-21T08:55:24.800324+0000","last_clean":"2024-09-21T08:55:24.800324+0000","last_became_active":"2024-09-21T08:51:46.157752+0000","last_became_peered":"2024-09-21T08:51:46.157752+0000","last_unstale":"2024-09-21T08:55:24.800324+0000","last_undegraded":"2024-09-21T08:55:24.800324+0000","last_fullsized":"2024-09-21T08:55:24.800324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-21T08:55:24.800122+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.800122+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:26.312772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.730235+0000","last_change":"2024-09-21T08:55:44.730260+0000","last_active":"2024-09-21T08:55:44.730235+0000","last_peered":"2024-09-21T08:55:44.730235+0000","last_clean":"2024-09-21T08:55:44.730235+0000","last_became_active":"2024-09-21T08:51:48.155448+0000","last_became_peered":"2024-09-21T08:51:48.155448+0000","last_unstale":"2024-09-21T08:55:44.730235+0000","last_undegraded":"2024-09-21T08:55:44.730235+0000","last_fullsized":"2024-09-21T08:55:44.730235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.730154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.730154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:15.236835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'8","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.784636+0000","last_change":"2024-09-21T08:55:43.784636+0000","last_active":"2024-09-21T08:55:43.784636+0000","last_peered":"2024-09-21T08:55:43.784636+0000","last_clean":"2024-09-21T08:55:43.784636+0000","last_became_active":"2024-09-21T08:51:40.135550+0000","last_became_peered":"2024-09-21T08:51:40.135550+0000","last_unstale":"2024-09-21T08:55:43.784636+0000","last_undegraded":"2024-09-21T08:55:43.784636+0000","last_fullsized":"2024-09-21T08:55:43.784636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:43.784505+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.784505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:53.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.512542+0000","last_change":"2024-09-21T08:55:46.512542+0000","last_active":"2024-09-21T08:55:46.512542+0000","last_peered":"2024-09-21T08:55:46.512542+0000","last_clean":"2024-09-21T08:55:46.512542+0000","last_became_active":"2024-09-21T08:51:38.130066+0000","last_became_peered":"2024-09-21T08:51:38.130066+0000","last_unstale":"2024-09-21T08:55:46.512542+0000","last_undegraded":"2024-09-21T08:55:46.512542+0000","last_fullsized":"2024-09-21T08:55:46.512542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:46.512417+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.512417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:13.737081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.844317+0000","last_change":"2024-09-21T08:55:06.844317+0000","last_active":"2024-09-21T08:55:06.844317+0000","last_peered":"2024-09-21T08:55:06.844317+0000","last_clean":"2024-09-21T08:55:06.844317+0000","last_became_active":"2024-09-21T08:51:42.135875+0000","last_became_peered":"2024-09-21T08:51:42.135875+0000","last_unstale":"2024-09-21T08:55:06.844317+0000","last_undegraded":"2024-09-21T08:55:06.844317+0000","last_fullsized":"2024-09-21T08:55:06.844317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:06.844209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.844209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:21.913747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.875112+0000","last_change":"2024-09-21T08:55:01.875112+0000","last_active":"2024-09-21T08:55:01.875112+0000","last_peered":"2024-09-21T08:55:01.875112+0000","last_clean":"2024-09-21T08:55:01.875112+0000","last_became_active":"2024-09-21T08:51:44.151372+0000","last_became_peered":"2024-09-21T08:51:44.151372+0000","last_unstale":"2024-09-21T08:55:01.875112+0000","last_undegraded":"2024-09-21T08:55:01.875112+0000","last_fullsized":"2024-09-21T08:55:01.875112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:01.874944+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.874944+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:51.653141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.728835+0000","last_change":"2024-09-21T08:54:59.728835+0000","last_active":"2024-09-21T08:54:59.728835+0000","last_peered":"2024-09-21T08:54:59.728835+0000","last_clean":"2024-09-21T08:54:59.728835+0000","last_became_active":"2024-09-21T08:51:46.153846+0000","last_became_peered":"2024-09-21T08:51:46.153846+0000","last_unstale":"2024-09-21T08:54:59.728835+0000","last_undegraded":"2024-09-21T08:54:59.728835+0000","last_fullsized":"2024-09-21T08:54:59.728835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:59.728698+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.728698+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:59.656529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.761716+0000","last_change":"2024-09-21T08:55:17.761716+0000","last_active":"2024-09-21T08:55:17.761716+0000","last_peered":"2024-09-21T08:55:17.761716+0000","last_clean":"2024-09-21T08:55:17.761716+0000","last_became_active":"2024-09-21T08:51:40.141590+0000","last_became_peered":"2024-09-21T08:51:40.141590+0000","last_unstale":"2024-09-21T08:55:17.761716+0000","last_undegraded":"2024-09-21T08:55:17.761716+0000","last_fullsized":"2024-09-21T08:55:17.761716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:17.761576+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.761576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:51:31.242840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.695994+0000","last_change":"2024-09-21T08:55:39.695994+0000","last_active":"2024-09-21T08:55:39.695994+0000","last_peered":"2024-09-21T08:55:39.695994+0000","last_clean":"2024-09-21T08:55:39.695994+0000","last_became_active":"2024-09-21T08:51:38.144484+0000","last_became_peered":"2024-09-21T08:51:38.144484+0000","last_unstale":"2024-09-21T08:55:39.695994+0000","last_undegraded":"2024-09-21T08:55:39.695994+0000","last_fullsized":"2024-09-21T08:55:39.695994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.695871+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.695871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:09:43.205570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.335805+0000","last_change":"2024-09-21T08:55:07.335805+0000","last_active":"2024-09-21T08:55:07.335805+0000","last_peered":"2024-09-21T08:55:07.335805+0000","last_clean":"2024-09-21T08:55:07.335805+0000","last_became_active":"2024-09-21T08:51:42.139533+0000","last_became_peered":"2024-09-21T08:51:42.139533+0000","last_unstale":"2024-09-21T08:55:07.335805+0000","last_undegraded":"2024-09-21T08:55:07.335805+0000","last_fullsized":"2024-09-21T08:55:07.335805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.335664+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.335664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:12.617439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.848218+0000","last_change":"2024-09-21T08:55:05.848218+0000","last_active":"2024-09-21T08:55:05.848218+0000","last_peered":"2024-09-21T08:55:05.848218+0000","last_clean":"2024-09-21T08:55:05.848218+0000","last_became_active":"2024-09-21T08:51:44.148269+0000","last_became_peered":"2024-09-21T08:51:44.148269+0000","last_unstale":"2024-09-21T08:55:05.848218+0000","last_undegraded":"2024-09-21T08:55:05.848218+0000","last_fullsized":"2024-09-21T08:55:05.848218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-21T08:55:05.848037+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.848037+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:02:50.214913+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.716764+0000","last_change":"2024-09-21T08:55:15.716764+0000","last_active":"2024-09-21T08:55:15.716764+0000","last_peered":"2024-09-21T08:55:15.716764+0000","last_clean":"2024-09-21T08:55:15.716764+0000","last_became_active":"2024-09-21T08:51:46.157577+0000","last_became_peered":"2024-09-21T08:51:46.157577+0000","last_unstale":"2024-09-21T08:55:15.716764+0000","last_undegraded":"2024-09-21T08:55:15.716764+0000","last_fullsized":"2024-09-21T08:55:15.716764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.716602+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.716602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:42.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.718870+0000","last_change":"2024-09-21T08:55:45.718870+0000","last_active":"2024-09-21T08:55:45.718870+0000","last_peered":"2024-09-21T08:55:45.718870+0000","last_clean":"2024-09-21T08:55:45.718870+0000","last_became_active":"2024-09-21T08:51:48.156743+0000","last_became_peered":"2024-09-21T08:51:48.156743+0000","last_unstale":"2024-09-21T08:55:45.718870+0000","last_undegraded":"2024-09-21T08:55:45.718870+0000","last_fullsized":"2024-09-21T08:55:45.718870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:45.718731+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.718731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:25.241247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'6","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.368278+0000","last_change":"2024-09-21T08:55:29.368278+0000","last_active":"2024-09-21T08:55:29.368278+0000","last_peered":"2024-09-21T08:55:29.368278+0000","last_clean":"2024-09-21T08:55:29.368278+0000","last_became_active":"2024-09-21T08:51:40.128198+0000","last_became_peered":"2024-09-21T08:51:40.128198+0000","last_unstale":"2024-09-21T08:55:29.368278+0000","last_undegraded":"2024-09-21T08:55:29.368278+0000","last_fullsized":"2024-09-21T08:55:29.368278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:29.368154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.368154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:39.906265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.732793+0000","last_change":"2024-09-21T08:55:29.732793+0000","last_active":"2024-09-21T08:55:29.732793+0000","last_peered":"2024-09-21T08:55:29.732793+0000","last_clean":"2024-09-21T08:55:29.732793+0000","last_became_active":"2024-09-21T08:51:38.148101+0000","last_became_peered":"2024-09-21T08:51:38.148101+0000","last_unstale":"2024-09-21T08:55:29.732793+0000","last_undegraded":"2024-09-21T08:55:29.732793+0000","last_fullsized":"2024-09-21T08:55:29.732793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:29.732654+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:16.861355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.780422+0000","last_change":"2024-09-21T08:55:22.780422+0000","last_active":"2024-09-21T08:55:22.780422+0000","last_peered":"2024-09-21T08:55:22.780422+0000","last_clean":"2024-09-21T08:55:22.780422+0000","last_became_active":"2024-09-21T08:51:42.135246+0000","last_became_peered":"2024-09-21T08:51:42.135246+0000","last_unstale":"2024-09-21T08:55:22.780422+0000","last_undegraded":"2024-09-21T08:55:22.780422+0000","last_fullsized":"2024-09-21T08:55:22.780422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.780305+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.780305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:24.779384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.783357+0000","last_change":"2024-09-21T08:55:02.783357+0000","last_active":"2024-09-21T08:55:02.783357+0000","last_peered":"2024-09-21T08:55:02.783357+0000","last_clean":"2024-09-21T08:55:02.783357+0000","last_became_active":"2024-09-21T08:51:44.144394+0000","last_became_peered":"2024-09-21T08:51:44.144394+0000","last_unstale":"2024-09-21T08:55:02.783357+0000","last_undegraded":"2024-09-21T08:55:02.783357+0000","last_fullsized":"2024-09-21T08:55:02.783357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-21T08:55:02.783222+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.783222+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:51.818565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.753424+0000","last_change":"2024-09-21T08:54:58.753424+0000","last_active":"2024-09-21T08:54:58.753424+0000","last_peered":"2024-09-21T08:54:58.753424+0000","last_clean":"2024-09-21T08:54:58.753424+0000","last_became_active":"2024-09-21T08:51:46.152411+0000","last_became_peered":"2024-09-21T08:51:46.152411+0000","last_unstale":"2024-09-21T08:54:58.753424+0000","last_undegraded":"2024-09-21T08:54:58.753424+0000","last_fullsized":"2024-09-21T08:54:58.753424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.753265+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.753265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:03.802831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.585257+0000","last_change":"2024-09-21T08:55:52.585257+0000","last_active":"2024-09-21T08:55:52.585257+0000","last_peered":"2024-09-21T08:55:52.585257+0000","last_clean":"2024-09-21T08:55:52.585257+0000","last_became_active":"2024-09-21T08:51:48.157579+0000","last_became_peered":"2024-09-21T08:51:48.157579+0000","last_unstale":"2024-09-21T08:55:52.585257+0000","last_undegraded":"2024-09-21T08:55:52.585257+0000","last_fullsized":"2024-09-21T08:55:52.585257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:52.585105+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.585105+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:30.427159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.748713+0000","last_change":"2024-09-21T08:55:42.748713+0000","last_active":"2024-09-21T08:55:42.748713+0000","last_peered":"2024-09-21T08:55:42.748713+0000","last_clean":"2024-09-21T08:55:42.748713+0000","last_became_active":"2024-09-21T08:51:40.143475+0000","last_became_peered":"2024-09-21T08:51:40.143475+0000","last_unstale":"2024-09-21T08:55:42.748713+0000","last_undegraded":"2024-09-21T08:55:42.748713+0000","last_fullsized":"2024-09-21T08:55:42.748713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:42.748598+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.748598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.005211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.857615+0000","last_change":"2024-09-21T08:55:56.857615+0000","last_active":"2024-09-21T08:55:56.857615+0000","last_peered":"2024-09-21T08:55:56.857615+0000","last_clean":"2024-09-21T08:55:56.857615+0000","last_became_active":"2024-09-21T08:51:38.145852+0000","last_became_peered":"2024-09-21T08:51:38.145852+0000","last_unstale":"2024-09-21T08:55:56.857615+0000","last_undegraded":"2024-09-21T08:55:56.857615+0000","last_fullsized":"2024-09-21T08:55:56.857615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:56.857500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:56.857500+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.857500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:37.386837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.760365+0000","last_change":"2024-09-21T08:55:14.760365+0000","last_active":"2024-09-21T08:55:14.760365+0000","last_peered":"2024-09-21T08:55:14.760365+0000","last_clean":"2024-09-21T08:55:14.760365+0000","last_became_active":"2024-09-21T08:51:42.136613+0000","last_became_peered":"2024-09-21T08:51:42.136613+0000","last_unstale":"2024-09-21T08:55:14.760365+0000","last_undegraded":"2024-09-21T08:55:14.760365+0000","last_fullsized":"2024-09-21T08:55:14.760365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.760244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:36.121650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.804457+0000","last_change":"2024-09-21T08:55:08.804457+0000","last_active":"2024-09-21T08:55:08.804457+0000","last_peered":"2024-09-21T08:55:08.804457+0000","last_clean":"2024-09-21T08:55:08.804457+0000","last_became_active":"2024-09-21T08:51:44.145127+0000","last_became_peered":"2024-09-21T08:51:44.145127+0000","last_unstale":"2024-09-21T08:55:08.804457+0000","last_undegraded":"2024-09-21T08:55:08.804457+0000","last_fullsized":"2024-09-21T08:55:08.804457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:08.804253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.804253+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:28.647102+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.784970+0000","last_change":"2024-09-21T08:54:57.784970+0000","last_active":"2024-09-21T08:54:57.784970+0000","last_peered":"2024-09-21T08:54:57.784970+0000","last_clean":"2024-09-21T08:54:57.784970+0000","last_became_active":"2024-09-21T08:51:46.152827+0000","last_became_peered":"2024-09-21T08:51:46.152827+0000","last_unstale":"2024-09-21T08:54:57.784970+0000","last_undegraded":"2024-09-21T08:54:57.784970+0000","last_fullsized":"2024-09-21T08:54:57.784970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.784865+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.784865+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:06:42.573611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.765800+0000","last_change":"2024-09-21T08:55:57.765800+0000","last_active":"2024-09-21T08:55:57.765800+0000","last_peered":"2024-09-21T08:55:57.765800+0000","last_clean":"2024-09-21T08:55:57.765800+0000","last_became_active":"2024-09-21T08:51:48.156619+0000","last_became_peered":"2024-09-21T08:51:48.156619+0000","last_unstale":"2024-09-21T08:55:57.765800+0000","last_undegraded":"2024-09-21T08:55:57.765800+0000","last_fullsized":"2024-09-21T08:55:57.765800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:57.765674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:57.765674+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.765674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:38.330732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'20","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.924903+0000","last_change":"2024-09-21T08:55:20.924903+0000","last_active":"2024-09-21T08:55:20.924903+0000","last_peered":"2024-09-21T08:55:20.924903+0000","last_clean":"2024-09-21T08:55:20.924903+0000","last_became_active":"2024-09-21T08:51:40.133243+0000","last_became_peered":"2024-09-21T08:51:40.133243+0000","last_unstale":"2024-09-21T08:55:20.924903+0000","last_undegraded":"2024-09-21T08:55:20.924903+0000","last_fullsized":"2024-09-21T08:55:20.924903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:20.924750+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.924750+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:02.221123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":73,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:02.946792+0000","last_change":"2024-09-21T08:56:02.946792+0000","last_active":"2024-09-21T08:56:02.946792+0000","last_peered":"2024-09-21T08:56:02.946792+0000","last_clean":"2024-09-21T08:56:02.946792+0000","last_became_active":"2024-09-21T08:51:38.150086+0000","last_became_peered":"2024-09-21T08:51:38.150086+0000","last_unstale":"2024-09-21T08:56:02.946792+0000","last_undegraded":"2024-09-21T08:56:02.946792+0000","last_fullsized":"2024-09-21T08:56:02.946792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:02.946654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:02.946654+0000","last_clean_scrub_stamp":"2024-09-21T08:56:02.946654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:05.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.782208+0000","last_change":"2024-09-21T08:55:20.782208+0000","last_active":"2024-09-21T08:55:20.782208+0000","last_peered":"2024-09-21T08:55:20.782208+0000","last_clean":"2024-09-21T08:55:20.782208+0000","last_became_active":"2024-09-21T08:51:42.136087+0000","last_became_peered":"2024-09-21T08:51:42.136087+0000","last_unstale":"2024-09-21T08:55:20.782208+0000","last_undegraded":"2024-09-21T08:55:20.782208+0000","last_fullsized":"2024-09-21T08:55:20.782208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.782093+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.782093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:39.369522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.756347+0000","last_change":"2024-09-21T08:55:16.756347+0000","last_active":"2024-09-21T08:55:16.756347+0000","last_peered":"2024-09-21T08:55:16.756347+0000","last_clean":"2024-09-21T08:55:16.756347+0000","last_became_active":"2024-09-21T08:51:44.146138+0000","last_became_peered":"2024-09-21T08:51:44.146138+0000","last_unstale":"2024-09-21T08:55:16.756347+0000","last_undegraded":"2024-09-21T08:55:16.756347+0000","last_fullsized":"2024-09-21T08:55:16.756347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-21T08:55:16.756216+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.756216+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:45.207448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.769638+0000","last_change":"2024-09-21T08:55:03.769638+0000","last_active":"2024-09-21T08:55:03.769638+0000","last_peered":"2024-09-21T08:55:03.769638+0000","last_clean":"2024-09-21T08:55:03.769638+0000","last_became_active":"2024-09-21T08:51:46.154090+0000","last_became_peered":"2024-09-21T08:51:46.154090+0000","last_unstale":"2024-09-21T08:55:03.769638+0000","last_undegraded":"2024-09-21T08:55:03.769638+0000","last_fullsized":"2024-09-21T08:55:03.769638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.769499+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:37.381181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:59.797377+0000","last_change":"2024-09-21T08:55:59.797377+0000","last_active":"2024-09-21T08:55:59.797377+0000","last_peered":"2024-09-21T08:55:59.797377+0000","last_clean":"2024-09-21T08:55:59.797377+0000","last_became_active":"2024-09-21T08:51:48.164541+0000","last_became_peered":"2024-09-21T08:51:48.164541+0000","last_unstale":"2024-09-21T08:55:59.797377+0000","last_undegraded":"2024-09-21T08:55:59.797377+0000","last_fullsized":"2024-09-21T08:55:59.797377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:55:59.797237+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:55:59.797237+0000","last_clean_scrub_stamp":"2024-09-21T08:55:59.797237+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.875659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:57.672364+0000","last_change":"2024-09-21T08:55:57.672364+0000","last_active":"2024-09-21T08:55:57.672364+0000","last_peered":"2024-09-21T08:55:57.672364+0000","last_clean":"2024-09-21T08:55:57.672364+0000","last_became_active":"2024-09-21T08:52:14.236210+0000","last_became_peered":"2024-09-21T08:52:14.236210+0000","last_unstale":"2024-09-21T08:55:57.672364+0000","last_undegraded":"2024-09-21T08:55:57.672364+0000","last_fullsized":"2024-09-21T08:55:57.672364+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:57.672248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:57.672248+0000","last_clean_scrub_stamp":"2024-09-21T08:55:57.672248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:50.432472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.850043+0000","last_change":"2024-09-21T08:55:47.850043+0000","last_active":"2024-09-21T08:55:47.850043+0000","last_peered":"2024-09-21T08:55:47.850043+0000","last_clean":"2024-09-21T08:55:47.850043+0000","last_became_active":"2024-09-21T08:51:38.124802+0000","last_became_peered":"2024-09-21T08:51:38.124802+0000","last_unstale":"2024-09-21T08:55:47.850043+0000","last_undegraded":"2024-09-21T08:55:47.850043+0000","last_fullsized":"2024-09-21T08:55:47.850043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.849880+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.849880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:03.295159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.770379+0000","last_change":"2024-09-21T08:55:10.770379+0000","last_active":"2024-09-21T08:55:10.770379+0000","last_peered":"2024-09-21T08:55:10.770379+0000","last_clean":"2024-09-21T08:55:10.770379+0000","last_became_active":"2024-09-21T08:51:42.141930+0000","last_became_peered":"2024-09-21T08:51:42.141930+0000","last_unstale":"2024-09-21T08:55:10.770379+0000","last_undegraded":"2024-09-21T08:55:10.770379+0000","last_fullsized":"2024-09-21T08:55:10.770379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.770161+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.770161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:07.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.337560+0000","last_change":"2024-09-21T08:55:05.337560+0000","last_active":"2024-09-21T08:55:05.337560+0000","last_peered":"2024-09-21T08:55:05.337560+0000","last_clean":"2024-09-21T08:55:05.337560+0000","last_became_active":"2024-09-21T08:51:44.145989+0000","last_became_peered":"2024-09-21T08:51:44.145989+0000","last_unstale":"2024-09-21T08:55:05.337560+0000","last_undegraded":"2024-09-21T08:55:05.337560+0000","last_fullsized":"2024-09-21T08:55:05.337560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-21T08:55:05.337433+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.337433+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:14.239468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.774171+0000","last_change":"2024-09-21T08:55:21.774171+0000","last_active":"2024-09-21T08:55:21.774171+0000","last_peered":"2024-09-21T08:55:21.774171+0000","last_clean":"2024-09-21T08:55:21.774171+0000","last_became_active":"2024-09-21T08:51:46.150608+0000","last_became_peered":"2024-09-21T08:51:46.150608+0000","last_unstale":"2024-09-21T08:55:21.774171+0000","last_undegraded":"2024-09-21T08:55:21.774171+0000","last_fullsized":"2024-09-21T08:55:21.774171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.774029+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.774029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:30:48.998694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.819828+0000","last_change":"2024-09-21T08:55:32.819828+0000","last_active":"2024-09-21T08:55:32.819828+0000","last_peered":"2024-09-21T08:55:32.819828+0000","last_clean":"2024-09-21T08:55:32.819828+0000","last_became_active":"2024-09-21T08:51:48.160073+0000","last_became_peered":"2024-09-21T08:51:48.160073+0000","last_unstale":"2024-09-21T08:55:32.819828+0000","last_undegraded":"2024-09-21T08:55:32.819828+0000","last_fullsized":"2024-09-21T08:55:32.819828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:32.819677+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.819677+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:40.054203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'10","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.765733+0000","last_change":"2024-09-21T08:55:14.765733+0000","last_active":"2024-09-21T08:55:14.765733+0000","last_peered":"2024-09-21T08:55:14.765733+0000","last_clean":"2024-09-21T08:55:14.765733+0000","last_became_active":"2024-09-21T08:51:40.141709+0000","last_became_peered":"2024-09-21T08:51:40.141709+0000","last_unstale":"2024-09-21T08:55:14.765733+0000","last_undegraded":"2024-09-21T08:55:14.765733+0000","last_fullsized":"2024-09-21T08:55:14.765733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:14.765635+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.765635+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:45.731851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:58.870739+0000","last_change":"2024-09-21T08:55:58.870739+0000","last_active":"2024-09-21T08:55:58.870739+0000","last_peered":"2024-09-21T08:55:58.870739+0000","last_clean":"2024-09-21T08:55:58.870739+0000","last_became_active":"2024-09-21T08:51:38.147125+0000","last_became_peered":"2024-09-21T08:51:38.147125+0000","last_unstale":"2024-09-21T08:55:58.870739+0000","last_undegraded":"2024-09-21T08:55:58.870739+0000","last_fullsized":"2024-09-21T08:55:58.870739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:58.870562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:58.870562+0000","last_clean_scrub_stamp":"2024-09-21T08:55:58.870562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:37.629492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.811916+0000","last_change":"2024-09-21T08:55:18.811916+0000","last_active":"2024-09-21T08:55:18.811916+0000","last_peered":"2024-09-21T08:55:18.811916+0000","last_clean":"2024-09-21T08:55:18.811916+0000","last_became_active":"2024-09-21T08:51:42.136503+0000","last_became_peered":"2024-09-21T08:51:42.136503+0000","last_unstale":"2024-09-21T08:55:18.811916+0000","last_undegraded":"2024-09-21T08:55:18.811916+0000","last_fullsized":"2024-09-21T08:55:18.811916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.811773+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.811773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:45.894080+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.869844+0000","last_change":"2024-09-21T08:55:06.869844+0000","last_active":"2024-09-21T08:55:06.869844+0000","last_peered":"2024-09-21T08:55:06.869844+0000","last_clean":"2024-09-21T08:55:06.869844+0000","last_became_active":"2024-09-21T08:51:44.145327+0000","last_became_peered":"2024-09-21T08:51:44.145327+0000","last_unstale":"2024-09-21T08:55:06.869844+0000","last_undegraded":"2024-09-21T08:55:06.869844+0000","last_fullsized":"2024-09-21T08:55:06.869844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-21T08:55:06.869692+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.869692+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:33.235003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.047051+0000","last_change":"2024-09-21T08:54:57.047051+0000","last_active":"2024-09-21T08:54:57.047051+0000","last_peered":"2024-09-21T08:54:57.047051+0000","last_clean":"2024-09-21T08:54:57.047051+0000","last_became_active":"2024-09-21T08:51:46.156072+0000","last_became_peered":"2024-09-21T08:51:46.156072+0000","last_unstale":"2024-09-21T08:54:57.047051+0000","last_undegraded":"2024-09-21T08:54:57.047051+0000","last_fullsized":"2024-09-21T08:54:57.047051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.046922+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.046922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:17.104050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.833856+0000","last_change":"2024-09-21T08:55:55.833856+0000","last_active":"2024-09-21T08:55:55.833856+0000","last_peered":"2024-09-21T08:55:55.833856+0000","last_clean":"2024-09-21T08:55:55.833856+0000","last_became_active":"2024-09-21T08:51:48.156425+0000","last_became_peered":"2024-09-21T08:51:48.156425+0000","last_unstale":"2024-09-21T08:55:55.833856+0000","last_undegraded":"2024-09-21T08:55:55.833856+0000","last_fullsized":"2024-09-21T08:55:55.833856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-21T08:55:55.833680+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-21T08:55:55.833680+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.833680+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:10:03.456183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.795434+0000","last_change":"2024-09-21T08:55:26.795434+0000","last_active":"2024-09-21T08:55:26.795434+0000","last_peered":"2024-09-21T08:55:26.795434+0000","last_clean":"2024-09-21T08:55:26.795434+0000","last_became_active":"2024-09-21T08:51:40.139072+0000","last_became_peered":"2024-09-21T08:51:40.139072+0000","last_unstale":"2024-09-21T08:55:26.795434+0000","last_undegraded":"2024-09-21T08:55:26.795434+0000","last_fullsized":"2024-09-21T08:55:26.795434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:26.795295+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.795295+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:53.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.898149+0000","last_change":"2024-09-21T08:55:47.898149+0000","last_active":"2024-09-21T08:55:47.898149+0000","last_peered":"2024-09-21T08:55:47.898149+0000","last_clean":"2024-09-21T08:55:47.898149+0000","last_became_active":"2024-09-21T08:51:38.149714+0000","last_became_peered":"2024-09-21T08:51:38.149714+0000","last_unstale":"2024-09-21T08:55:47.898149+0000","last_undegraded":"2024-09-21T08:55:47.898149+0000","last_fullsized":"2024-09-21T08:55:47.898149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.897995+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.897995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:38.549881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":621,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.275924+0000","last_change":"2024-09-21T08:55:13.275924+0000","last_active":"2024-09-21T08:55:13.275924+0000","last_peered":"2024-09-21T08:55:13.275924+0000","last_clean":"2024-09-21T08:55:13.275924+0000","last_became_active":"2024-09-21T08:51:42.134278+0000","last_became_peered":"2024-09-21T08:51:42.134278+0000","last_unstale":"2024-09-21T08:55:13.275924+0000","last_undegraded":"2024-09-21T08:55:13.275924+0000","last_fullsized":"2024-09-21T08:55:13.275924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-21T08:55:13.275785+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.275785+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.674831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.785316+0000","last_change":"2024-09-21T08:55:00.785316+0000","last_active":"2024-09-21T08:55:00.785316+0000","last_peered":"2024-09-21T08:55:00.785316+0000","last_clean":"2024-09-21T08:55:00.785316+0000","last_became_active":"2024-09-21T08:51:44.143841+0000","last_became_peered":"2024-09-21T08:51:44.143841+0000","last_unstale":"2024-09-21T08:55:00.785316+0000","last_undegraded":"2024-09-21T08:55:00.785316+0000","last_fullsized":"2024-09-21T08:55:00.785316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:00.785184+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.785184+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:02.902127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.291227+0000","last_change":"2024-09-21T08:54:57.291227+0000","last_active":"2024-09-21T08:54:57.291227+0000","last_peered":"2024-09-21T08:54:57.291227+0000","last_clean":"2024-09-21T08:54:57.291227+0000","last_became_active":"2024-09-21T08:51:46.146722+0000","last_became_peered":"2024-09-21T08:51:46.146722+0000","last_unstale":"2024-09-21T08:54:57.291227+0000","last_undegraded":"2024-09-21T08:54:57.291227+0000","last_fullsized":"2024-09-21T08:54:57.291227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:54:57.291058+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.291058+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:31.954176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.713606+0000","last_change":"2024-09-21T08:55:43.713606+0000","last_active":"2024-09-21T08:55:43.713606+0000","last_peered":"2024-09-21T08:55:43.713606+0000","last_clean":"2024-09-21T08:55:43.713606+0000","last_became_active":"2024-09-21T08:51:48.152516+0000","last_became_peered":"2024-09-21T08:51:48.152516+0000","last_unstale":"2024-09-21T08:55:43.713606+0000","last_undegraded":"2024-09-21T08:55:43.713606+0000","last_fullsized":"2024-09-21T08:55:43.713606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:43.713484+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.713484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:38.539015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'10","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.248434+0000","last_change":"2024-09-21T08:55:18.248434+0000","last_active":"2024-09-21T08:55:18.248434+0000","last_peered":"2024-09-21T08:55:18.248434+0000","last_clean":"2024-09-21T08:55:18.248434+0000","last_became_active":"2024-09-21T08:51:40.143432+0000","last_became_peered":"2024-09-21T08:51:40.143432+0000","last_unstale":"2024-09-21T08:55:18.248434+0000","last_undegraded":"2024-09-21T08:55:18.248434+0000","last_fullsized":"2024-09-21T08:55:18.248434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:18.248234+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.248234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:31.175858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.821675+0000","last_change":"2024-09-21T08:55:54.821675+0000","last_active":"2024-09-21T08:55:54.821675+0000","last_peered":"2024-09-21T08:55:54.821675+0000","last_clean":"2024-09-21T08:55:54.821675+0000","last_became_active":"2024-09-21T08:51:38.145571+0000","last_became_peered":"2024-09-21T08:51:38.145571+0000","last_unstale":"2024-09-21T08:55:54.821675+0000","last_undegraded":"2024-09-21T08:55:54.821675+0000","last_fullsized":"2024-09-21T08:55:54.821675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:54.821560+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.821560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.675640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.789049+0000","last_change":"2024-09-21T08:54:58.789049+0000","last_active":"2024-09-21T08:54:58.789049+0000","last_peered":"2024-09-21T08:54:58.789049+0000","last_clean":"2024-09-21T08:54:58.789049+0000","last_became_active":"2024-09-21T08:51:42.142518+0000","last_became_peered":"2024-09-21T08:51:42.142518+0000","last_unstale":"2024-09-21T08:54:58.789049+0000","last_undegraded":"2024-09-21T08:54:58.789049+0000","last_fullsized":"2024-09-21T08:54:58.789049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.788878+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.788878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:12:55.506296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.233457+0000","last_change":"2024-09-21T08:55:02.233457+0000","last_active":"2024-09-21T08:55:02.233457+0000","last_peered":"2024-09-21T08:55:02.233457+0000","last_clean":"2024-09-21T08:55:02.233457+0000","last_became_active":"2024-09-21T08:51:44.145737+0000","last_became_peered":"2024-09-21T08:51:44.145737+0000","last_unstale":"2024-09-21T08:55:02.233457+0000","last_undegraded":"2024-09-21T08:55:02.233457+0000","last_fullsized":"2024-09-21T08:55:02.233457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-21T08:55:02.233330+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.233330+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:49.289271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.914269+0000","last_change":"2024-09-21T08:55:00.914269+0000","last_active":"2024-09-21T08:55:00.914269+0000","last_peered":"2024-09-21T08:55:00.914269+0000","last_clean":"2024-09-21T08:55:00.914269+0000","last_became_active":"2024-09-21T08:51:46.158449+0000","last_became_peered":"2024-09-21T08:51:46.158449+0000","last_unstale":"2024-09-21T08:55:00.914269+0000","last_undegraded":"2024-09-21T08:55:00.914269+0000","last_fullsized":"2024-09-21T08:55:00.914269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.914158+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.914158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:41.840956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.415222+0000","last_change":"2024-09-21T08:55:24.415222+0000","last_active":"2024-09-21T08:55:24.415222+0000","last_peered":"2024-09-21T08:55:24.415222+0000","last_clean":"2024-09-21T08:55:24.415222+0000","last_became_active":"2024-09-21T08:51:48.154895+0000","last_became_peered":"2024-09-21T08:51:48.154895+0000","last_unstale":"2024-09-21T08:55:24.415222+0000","last_undegraded":"2024-09-21T08:55:24.415222+0000","last_fullsized":"2024-09-21T08:55:24.415222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-21T08:55:24.415062+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.415062+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.497368+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.745614+0000","last_change":"2024-09-21T08:55:15.745614+0000","last_active":"2024-09-21T08:55:15.745614+0000","last_peered":"2024-09-21T08:55:15.745614+0000","last_clean":"2024-09-21T08:55:15.745614+0000","last_became_active":"2024-09-21T08:51:40.141626+0000","last_became_peered":"2024-09-21T08:51:40.141626+0000","last_unstale":"2024-09-21T08:55:15.745614+0000","last_undegraded":"2024-09-21T08:55:15.745614+0000","last_fullsized":"2024-09-21T08:55:15.745614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:15.745464+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.745464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:56.608749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.487186+0000","last_change":"2024-09-21T08:55:42.487237+0000","last_active":"2024-09-21T08:55:42.487186+0000","last_peered":"2024-09-21T08:55:42.487186+0000","last_clean":"2024-09-21T08:55:42.487186+0000","last_became_active":"2024-09-21T08:51:23.339831+0000","last_became_peered":"2024-09-21T08:51:23.339831+0000","last_unstale":"2024-09-21T08:55:42.487186+0000","last_undegraded":"2024-09-21T08:55:42.487186+0000","last_fullsized":"2024-09-21T08:55:42.487186+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-21T08:55:42.487068+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.487068+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:00.435324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:10.043950+0000","last_change":"2024-09-21T08:56:10.044009+0000","last_active":"2024-09-21T08:56:10.043950+0000","last_peered":"2024-09-21T08:56:10.043950+0000","last_clean":"2024-09-21T08:56:10.043950+0000","last_became_active":"2024-09-21T08:51:26.512904+0000","last_became_peered":"2024-09-21T08:51:26.512904+0000","last_unstale":"2024-09-21T08:56:10.043950+0000","last_undegraded":"2024-09-21T08:56:10.043950+0000","last_fullsized":"2024-09-21T08:56:10.043950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:10.043854+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:10.043854+0000","last_clean_scrub_stamp":"2024-09-21T08:56:10.043854+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:41.258883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001245225,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.827630+0000","last_change":"2024-09-21T08:55:49.827630+0000","last_active":"2024-09-21T08:55:49.827630+0000","last_peered":"2024-09-21T08:55:49.827630+0000","last_clean":"2024-09-21T08:55:49.827630+0000","last_became_active":"2024-09-21T08:51:38.151189+0000","last_became_peered":"2024-09-21T08:51:38.151189+0000","last_unstale":"2024-09-21T08:55:49.827630+0000","last_undegraded":"2024-09-21T08:55:49.827630+0000","last_fullsized":"2024-09-21T08:55:49.827630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:49.827461+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.827461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:54.174951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.277221+0000","last_change":"2024-09-21T08:55:14.277221+0000","last_active":"2024-09-21T08:55:14.277221+0000","last_peered":"2024-09-21T08:55:14.277221+0000","last_clean":"2024-09-21T08:55:14.277221+0000","last_became_active":"2024-09-21T08:51:42.134092+0000","last_became_peered":"2024-09-21T08:51:42.134092+0000","last_unstale":"2024-09-21T08:55:14.277221+0000","last_undegraded":"2024-09-21T08:55:14.277221+0000","last_fullsized":"2024-09-21T08:55:14.277221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.277103+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.277103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:39.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'92","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.791546+0000","last_change":"2024-09-21T08:55:26.791546+0000","last_active":"2024-09-21T08:55:26.791546+0000","last_peered":"2024-09-21T08:55:26.791546+0000","last_clean":"2024-09-21T08:55:26.791546+0000","last_became_active":"2024-09-21T08:51:44.147426+0000","last_became_peered":"2024-09-21T08:51:44.147426+0000","last_unstale":"2024-09-21T08:55:26.791546+0000","last_undegraded":"2024-09-21T08:55:26.791546+0000","last_fullsized":"2024-09-21T08:55:26.791546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-09-21T08:55:26.791383+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.791383+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:05.355379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.765010+0000","last_change":"2024-09-21T08:55:02.765010+0000","last_active":"2024-09-21T08:55:02.765010+0000","last_peered":"2024-09-21T08:55:02.765010+0000","last_clean":"2024-09-21T08:55:02.765010+0000","last_became_active":"2024-09-21T08:51:46.152166+0000","last_became_peered":"2024-09-21T08:51:46.152166+0000","last_unstale":"2024-09-21T08:55:02.765010+0000","last_undegraded":"2024-09-21T08:55:02.765010+0000","last_fullsized":"2024-09-21T08:55:02.765010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:02.764887+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.764887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:26.749713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'81","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:16.857880+0000","last_change":"2024-09-21T08:55:16.857880+0000","last_active":"2024-09-21T08:55:16.857880+0000","last_peered":"2024-09-21T08:55:16.857880+0000","last_clean":"2024-09-21T08:55:16.857880+0000","last_became_active":"2024-09-21T08:51:48.153659+0000","last_became_peered":"2024-09-21T08:51:48.153659+0000","last_unstale":"2024-09-21T08:55:16.857880+0000","last_undegraded":"2024-09-21T08:55:16.857880+0000","last_fullsized":"2024-09-21T08:55:16.857880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-09-21T08:55:16.857712+0000","last_clean_scrub_stamp":"2024-09-21T08:55:16.857712+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:32.803768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.907754+0000","last_change":"2024-09-21T08:55:41.907754+0000","last_active":"2024-09-21T08:55:41.907754+0000","last_peered":"2024-09-21T08:55:41.907754+0000","last_clean":"2024-09-21T08:55:41.907754+0000","last_became_active":"2024-09-21T08:51:40.131718+0000","last_became_peered":"2024-09-21T08:51:40.131718+0000","last_unstale":"2024-09-21T08:55:41.907754+0000","last_undegraded":"2024-09-21T08:55:41.907754+0000","last_fullsized":"2024-09-21T08:55:41.907754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.907611+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.907611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:24.998429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:09.014725+0000","last_change":"2024-09-21T08:56:09.014750+0000","last_active":"2024-09-21T08:56:09.014725+0000","last_peered":"2024-09-21T08:56:09.014725+0000","last_clean":"2024-09-21T08:56:09.014725+0000","last_became_active":"2024-09-21T08:51:26.512477+0000","last_became_peered":"2024-09-21T08:51:26.512477+0000","last_unstale":"2024-09-21T08:56:09.014725+0000","last_undegraded":"2024-09-21T08:56:09.014725+0000","last_fullsized":"2024-09-21T08:56:09.014725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:09.014633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:09.014633+0000","last_clean_scrub_stamp":"2024-09-21T08:56:09.014633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:36.680208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000475,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.817388+0000","last_change":"2024-09-21T08:55:42.817388+0000","last_active":"2024-09-21T08:55:42.817388+0000","last_peered":"2024-09-21T08:55:42.817388+0000","last_clean":"2024-09-21T08:55:42.817388+0000","last_became_active":"2024-09-21T08:51:38.136591+0000","last_became_peered":"2024-09-21T08:51:38.136591+0000","last_unstale":"2024-09-21T08:55:42.817388+0000","last_undegraded":"2024-09-21T08:55:42.817388+0000","last_fullsized":"2024-09-21T08:55:42.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:42.817206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.817206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:50.764942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:21.914806+0000","last_change":"2024-09-21T08:56:21.914831+0000","last_active":"2024-09-21T08:56:21.914806+0000","last_peered":"2024-09-21T08:56:21.914806+0000","last_clean":"2024-09-21T08:56:21.914806+0000","last_became_active":"2024-09-21T08:52:14.235723+0000","last_became_peered":"2024-09-21T08:52:14.235723+0000","last_unstale":"2024-09-21T08:56:21.914806+0000","last_undegraded":"2024-09-21T08:56:21.914806+0000","last_fullsized":"2024-09-21T08:56:21.914806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:21.914702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:21.914702+0000","last_clean_scrub_stamp":"2024-09-21T08:56:21.914702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:46.017571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.257947+0000","last_change":"2024-09-21T08:54:59.257947+0000","last_active":"2024-09-21T08:54:59.257947+0000","last_peered":"2024-09-21T08:54:59.257947+0000","last_clean":"2024-09-21T08:54:59.257947+0000","last_became_active":"2024-09-21T08:51:44.151364+0000","last_became_peered":"2024-09-21T08:51:44.151364+0000","last_unstale":"2024-09-21T08:54:59.257947+0000","last_undegraded":"2024-09-21T08:54:59.257947+0000","last_fullsized":"2024-09-21T08:54:59.257947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-21T08:54:59.257796+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.257796+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:55.128267+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.776067+0000","last_change":"2024-09-21T08:55:19.776067+0000","last_active":"2024-09-21T08:55:19.776067+0000","last_peered":"2024-09-21T08:55:19.776067+0000","last_clean":"2024-09-21T08:55:19.776067+0000","last_became_active":"2024-09-21T08:51:46.150646+0000","last_became_peered":"2024-09-21T08:51:46.150646+0000","last_unstale":"2024-09-21T08:55:19.776067+0000","last_undegraded":"2024-09-21T08:55:19.776067+0000","last_fullsized":"2024-09-21T08:55:19.776067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.775947+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.775947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:14.023176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.562701+0000","last_change":"2024-09-21T08:55:51.562701+0000","last_active":"2024-09-21T08:55:51.562701+0000","last_peered":"2024-09-21T08:55:51.562701+0000","last_clean":"2024-09-21T08:55:51.562701+0000","last_became_active":"2024-09-21T08:51:48.156138+0000","last_became_peered":"2024-09-21T08:51:48.156138+0000","last_unstale":"2024-09-21T08:55:51.562701+0000","last_undegraded":"2024-09-21T08:55:51.562701+0000","last_fullsized":"2024-09-21T08:55:51.562701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:51.562587+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.562587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:30.126583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.862467+0000","last_change":"2024-09-21T08:55:53.862467+0000","last_active":"2024-09-21T08:55:53.862467+0000","last_peered":"2024-09-21T08:55:53.862467+0000","last_clean":"2024-09-21T08:55:53.862467+0000","last_became_active":"2024-09-21T08:51:40.135007+0000","last_became_peered":"2024-09-21T08:51:40.135007+0000","last_unstale":"2024-09-21T08:55:53.862467+0000","last_undegraded":"2024-09-21T08:55:53.862467+0000","last_fullsized":"2024-09-21T08:55:53.862467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:53.862350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.862350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:33.172121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:34.753073+0000","last_change":"2024-09-21T08:55:34.753073+0000","last_active":"2024-09-21T08:55:34.753073+0000","last_peered":"2024-09-21T08:55:34.753073+0000","last_clean":"2024-09-21T08:55:34.753073+0000","last_became_active":"2024-09-21T08:51:26.512035+0000","last_became_peered":"2024-09-21T08:51:26.512035+0000","last_unstale":"2024-09-21T08:55:34.753073+0000","last_undegraded":"2024-09-21T08:55:34.753073+0000","last_fullsized":"2024-09-21T08:55:34.753073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:34.752903+0000","last_clean_scrub_stamp":"2024-09-21T08:55:34.752903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.670098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039971800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.714370+0000","last_change":"2024-09-21T08:55:32.714370+0000","last_active":"2024-09-21T08:55:32.714370+0000","last_peered":"2024-09-21T08:55:32.714370+0000","last_clean":"2024-09-21T08:55:32.714370+0000","last_became_active":"2024-09-21T08:51:38.137093+0000","last_became_peered":"2024-09-21T08:51:38.137093+0000","last_unstale":"2024-09-21T08:55:32.714370+0000","last_undegraded":"2024-09-21T08:55:32.714370+0000","last_fullsized":"2024-09-21T08:55:32.714370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:32.714206+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.714206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:03.680422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.647486+0000","last_change":"2024-09-21T08:55:49.647486+0000","last_active":"2024-09-21T08:55:49.647486+0000","last_peered":"2024-09-21T08:55:49.647486+0000","last_clean":"2024-09-21T08:55:49.647486+0000","last_became_active":"2024-09-21T08:52:14.236496+0000","last_became_peered":"2024-09-21T08:52:14.236496+0000","last_unstale":"2024-09-21T08:55:49.647486+0000","last_undegraded":"2024-09-21T08:55:49.647486+0000","last_fullsized":"2024-09-21T08:55:49.647486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.647372+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.647372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:21.810649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.818896+0000","last_change":"2024-09-21T08:55:09.818896+0000","last_active":"2024-09-21T08:55:09.818896+0000","last_peered":"2024-09-21T08:55:09.818896+0000","last_clean":"2024-09-21T08:55:09.818896+0000","last_became_active":"2024-09-21T08:51:44.143417+0000","last_became_peered":"2024-09-21T08:51:44.143417+0000","last_unstale":"2024-09-21T08:55:09.818896+0000","last_undegraded":"2024-09-21T08:55:09.818896+0000","last_fullsized":"2024-09-21T08:55:09.818896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-21T08:55:09.818766+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.818766+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:10.946408+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.758991+0000","last_change":"2024-09-21T08:55:01.758991+0000","last_active":"2024-09-21T08:55:01.758991+0000","last_peered":"2024-09-21T08:55:01.758991+0000","last_clean":"2024-09-21T08:55:01.758991+0000","last_became_active":"2024-09-21T08:51:46.152187+0000","last_became_peered":"2024-09-21T08:51:46.152187+0000","last_unstale":"2024-09-21T08:55:01.758991+0000","last_undegraded":"2024-09-21T08:55:01.758991+0000","last_fullsized":"2024-09-21T08:55:01.758991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.758844+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.758844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:27.038728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.770188+0000","last_change":"2024-09-21T08:55:36.770188+0000","last_active":"2024-09-21T08:55:36.770188+0000","last_peered":"2024-09-21T08:55:36.770188+0000","last_clean":"2024-09-21T08:55:36.770188+0000","last_became_active":"2024-09-21T08:51:48.161694+0000","last_became_peered":"2024-09-21T08:51:48.161694+0000","last_unstale":"2024-09-21T08:55:36.770188+0000","last_undegraded":"2024-09-21T08:55:36.770188+0000","last_fullsized":"2024-09-21T08:55:36.770188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:36.770077+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.770077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:09:44.392580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.735665+0000","last_change":"2024-09-21T08:55:25.735665+0000","last_active":"2024-09-21T08:55:25.735665+0000","last_peered":"2024-09-21T08:55:25.735665+0000","last_clean":"2024-09-21T08:55:25.735665+0000","last_became_active":"2024-09-21T08:51:40.135491+0000","last_became_peered":"2024-09-21T08:51:40.135491+0000","last_unstale":"2024-09-21T08:55:25.735665+0000","last_undegraded":"2024-09-21T08:55:25.735665+0000","last_fullsized":"2024-09-21T08:55:25.735665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:25.735532+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.735532+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:16.628395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:08.023862+0000","last_change":"2024-09-21T08:56:08.023918+0000","last_active":"2024-09-21T08:56:08.023862+0000","last_peered":"2024-09-21T08:56:08.023862+0000","last_clean":"2024-09-21T08:56:08.023862+0000","last_became_active":"2024-09-21T08:51:26.512255+0000","last_became_peered":"2024-09-21T08:51:26.512255+0000","last_unstale":"2024-09-21T08:56:08.023862+0000","last_undegraded":"2024-09-21T08:56:08.023862+0000","last_fullsized":"2024-09-21T08:56:08.023862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:56:08.023744+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:56:08.023744+0000","last_clean_scrub_stamp":"2024-09-21T08:56:08.023744+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:54.590266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095531299999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.740384+0000","last_change":"2024-09-21T08:55:40.740384+0000","last_active":"2024-09-21T08:55:40.740384+0000","last_peered":"2024-09-21T08:55:40.740384+0000","last_clean":"2024-09-21T08:55:40.740384+0000","last_became_active":"2024-09-21T08:51:38.144517+0000","last_became_peered":"2024-09-21T08:51:38.144517+0000","last_unstale":"2024-09-21T08:55:40.740384+0000","last_undegraded":"2024-09-21T08:55:40.740384+0000","last_fullsized":"2024-09-21T08:55:40.740384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:40.740241+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.740241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:23.556756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.772851+0000","last_change":"2024-09-21T08:55:12.772851+0000","last_active":"2024-09-21T08:55:12.772851+0000","last_peered":"2024-09-21T08:55:12.772851+0000","last_clean":"2024-09-21T08:55:12.772851+0000","last_became_active":"2024-09-21T08:51:42.141075+0000","last_became_peered":"2024-09-21T08:51:42.141075+0000","last_unstale":"2024-09-21T08:55:12.772851+0000","last_undegraded":"2024-09-21T08:55:12.772851+0000","last_fullsized":"2024-09-21T08:55:12.772851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.772717+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.772717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:25.700341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:57.753327+0000","last_change":"2024-09-21T08:54:57.753327+0000","last_active":"2024-09-21T08:54:57.753327+0000","last_peered":"2024-09-21T08:54:57.753327+0000","last_clean":"2024-09-21T08:54:57.753327+0000","last_became_active":"2024-09-21T08:51:44.140262+0000","last_became_peered":"2024-09-21T08:51:44.140262+0000","last_unstale":"2024-09-21T08:54:57.753327+0000","last_undegraded":"2024-09-21T08:54:57.753327+0000","last_fullsized":"2024-09-21T08:54:57.753327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:54:57.753140+0000","last_clean_scrub_stamp":"2024-09-21T08:54:57.753140+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:11.199581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.789686+0000","last_change":"2024-09-21T08:55:22.789686+0000","last_active":"2024-09-21T08:55:22.789686+0000","last_peered":"2024-09-21T08:55:22.789686+0000","last_clean":"2024-09-21T08:55:22.789686+0000","last_became_active":"2024-09-21T08:51:46.150060+0000","last_became_peered":"2024-09-21T08:51:46.150060+0000","last_unstale":"2024-09-21T08:55:22.789686+0000","last_undegraded":"2024-09-21T08:55:22.789686+0000","last_fullsized":"2024-09-21T08:55:22.789686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:22.789579+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.789579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:47.777856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'6","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.650198+0000","last_change":"2024-09-21T08:55:54.650198+0000","last_active":"2024-09-21T08:55:54.650198+0000","last_peered":"2024-09-21T08:55:54.650198+0000","last_clean":"2024-09-21T08:55:54.650198+0000","last_became_active":"2024-09-21T08:51:48.160668+0000","last_became_peered":"2024-09-21T08:51:48.160668+0000","last_unstale":"2024-09-21T08:55:54.650198+0000","last_undegraded":"2024-09-21T08:55:54.650198+0000","last_fullsized":"2024-09-21T08:55:54.650198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:54.650076+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.650076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:10.095355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.328523+0000","last_change":"2024-09-21T08:55:21.328523+0000","last_active":"2024-09-21T08:55:21.328523+0000","last_peered":"2024-09-21T08:55:21.328523+0000","last_clean":"2024-09-21T08:55:21.328523+0000","last_became_active":"2024-09-21T08:51:40.142172+0000","last_became_peered":"2024-09-21T08:51:40.142172+0000","last_unstale":"2024-09-21T08:55:21.328523+0000","last_undegraded":"2024-09-21T08:55:21.328523+0000","last_fullsized":"2024-09-21T08:55:21.328523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:21.328401+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.328401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:48.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.738169+0000","last_change":"2024-09-21T08:55:31.738169+0000","last_active":"2024-09-21T08:55:31.738169+0000","last_peered":"2024-09-21T08:55:31.738169+0000","last_clean":"2024-09-21T08:55:31.738169+0000","last_became_active":"2024-09-21T08:51:38.146705+0000","last_became_peered":"2024-09-21T08:51:38.146705+0000","last_unstale":"2024-09-21T08:55:31.738169+0000","last_undegraded":"2024-09-21T08:55:31.738169+0000","last_fullsized":"2024-09-21T08:55:31.738169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:31.738045+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.738045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:13.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.819976+0000","last_change":"2024-09-21T08:55:46.820002+0000","last_active":"2024-09-21T08:55:46.819976+0000","last_peered":"2024-09-21T08:55:46.819976+0000","last_clean":"2024-09-21T08:55:46.819976+0000","last_became_active":"2024-09-21T08:51:26.511310+0000","last_became_peered":"2024-09-21T08:51:26.511310+0000","last_unstale":"2024-09-21T08:55:46.819976+0000","last_undegraded":"2024-09-21T08:55:46.819976+0000","last_fullsized":"2024-09-21T08:55:46.819976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.819884+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.819884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:05.525223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061919000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.769332+0000","last_change":"2024-09-21T08:55:17.769332+0000","last_active":"2024-09-21T08:55:17.769332+0000","last_peered":"2024-09-21T08:55:17.769332+0000","last_clean":"2024-09-21T08:55:17.769332+0000","last_became_active":"2024-09-21T08:51:42.136011+0000","last_became_peered":"2024-09-21T08:51:42.136011+0000","last_unstale":"2024-09-21T08:55:17.769332+0000","last_undegraded":"2024-09-21T08:55:17.769332+0000","last_fullsized":"2024-09-21T08:55:17.769332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:17.769154+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.769154+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:19.212681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.852373+0000","last_change":"2024-09-21T08:55:05.852373+0000","last_active":"2024-09-21T08:55:05.852373+0000","last_peered":"2024-09-21T08:55:05.852373+0000","last_clean":"2024-09-21T08:55:05.852373+0000","last_became_active":"2024-09-21T08:51:44.146699+0000","last_became_peered":"2024-09-21T08:51:44.146699+0000","last_unstale":"2024-09-21T08:55:05.852373+0000","last_undegraded":"2024-09-21T08:55:05.852373+0000","last_fullsized":"2024-09-21T08:55:05.852373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-21T08:55:05.852239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.852239+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:30.553041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.982940+0000","last_change":"2024-09-21T08:54:58.982940+0000","last_active":"2024-09-21T08:54:58.982940+0000","last_peered":"2024-09-21T08:54:58.982940+0000","last_clean":"2024-09-21T08:54:58.982940+0000","last_became_active":"2024-09-21T08:51:46.155222+0000","last_became_peered":"2024-09-21T08:51:46.155222+0000","last_unstale":"2024-09-21T08:54:58.982940+0000","last_undegraded":"2024-09-21T08:54:58.982940+0000","last_fullsized":"2024-09-21T08:54:58.982940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.982822+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.982822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:26.322430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:54.817382+0000","last_change":"2024-09-21T08:55:54.817382+0000","last_active":"2024-09-21T08:55:54.817382+0000","last_peered":"2024-09-21T08:55:54.817382+0000","last_clean":"2024-09-21T08:55:54.817382+0000","last_became_active":"2024-09-21T08:51:48.155378+0000","last_became_peered":"2024-09-21T08:51:48.155378+0000","last_unstale":"2024-09-21T08:55:54.817382+0000","last_undegraded":"2024-09-21T08:55:54.817382+0000","last_fullsized":"2024-09-21T08:55:54.817382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-21T08:55:54.817258+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-21T08:55:54.817258+0000","last_clean_scrub_stamp":"2024-09-21T08:55:54.817258+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.353664+0000","last_change":"2024-09-21T08:55:27.353664+0000","last_active":"2024-09-21T08:55:27.353664+0000","last_peered":"2024-09-21T08:55:27.353664+0000","last_clean":"2024-09-21T08:55:27.353664+0000","last_became_active":"2024-09-21T08:51:40.132962+0000","last_became_peered":"2024-09-21T08:51:40.132962+0000","last_unstale":"2024-09-21T08:55:27.353664+0000","last_undegraded":"2024-09-21T08:55:27.353664+0000","last_fullsized":"2024-09-21T08:55:27.353664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:27.353550+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.353550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:16.388892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.875753+0000","last_change":"2024-09-21T08:55:51.875789+0000","last_active":"2024-09-21T08:55:51.875753+0000","last_peered":"2024-09-21T08:55:51.875753+0000","last_clean":"2024-09-21T08:55:51.875753+0000","last_became_active":"2024-09-21T08:51:38.132582+0000","last_became_peered":"2024-09-21T08:51:38.132582+0000","last_unstale":"2024-09-21T08:55:51.875753+0000","last_undegraded":"2024-09-21T08:55:51.875753+0000","last_fullsized":"2024-09-21T08:55:51.875753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.875661+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.875661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:15.984515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:07.037057+0000","last_change":"2024-09-21T08:56:07.037086+0000","last_active":"2024-09-21T08:56:07.037057+0000","last_peered":"2024-09-21T08:56:07.037057+0000","last_clean":"2024-09-21T08:56:07.037057+0000","last_became_active":"2024-09-21T08:51:26.512149+0000","last_became_peered":"2024-09-21T08:51:26.512149+0000","last_unstale":"2024-09-21T08:56:07.037057+0000","last_undegraded":"2024-09-21T08:56:07.037057+0000","last_fullsized":"2024-09-21T08:56:07.037057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:07.036962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:07.036962+0000","last_clean_scrub_stamp":"2024-09-21T08:56:07.036962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:41.843358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00040918999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:05.847420+0000","last_change":"2024-09-21T08:55:05.847420+0000","last_active":"2024-09-21T08:55:05.847420+0000","last_peered":"2024-09-21T08:55:05.847420+0000","last_clean":"2024-09-21T08:55:05.847420+0000","last_became_active":"2024-09-21T08:51:42.136262+0000","last_became_peered":"2024-09-21T08:51:42.136262+0000","last_unstale":"2024-09-21T08:55:05.847420+0000","last_undegraded":"2024-09-21T08:55:05.847420+0000","last_fullsized":"2024-09-21T08:55:05.847420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:05.847290+0000","last_clean_scrub_stamp":"2024-09-21T08:55:05.847290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:42:43.812529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.280639+0000","last_change":"2024-09-21T08:54:58.280639+0000","last_active":"2024-09-21T08:54:58.280639+0000","last_peered":"2024-09-21T08:54:58.280639+0000","last_clean":"2024-09-21T08:54:58.280639+0000","last_became_active":"2024-09-21T08:51:44.152091+0000","last_became_peered":"2024-09-21T08:51:44.152091+0000","last_unstale":"2024-09-21T08:54:58.280639+0000","last_undegraded":"2024-09-21T08:54:58.280639+0000","last_fullsized":"2024-09-21T08:54:58.280639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-21T08:54:58.280470+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.280470+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:25.040327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":367,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.299155+0000","last_change":"2024-09-21T08:55:00.299155+0000","last_active":"2024-09-21T08:55:00.299155+0000","last_peered":"2024-09-21T08:55:00.299155+0000","last_clean":"2024-09-21T08:55:00.299155+0000","last_became_active":"2024-09-21T08:51:46.146821+0000","last_became_peered":"2024-09-21T08:51:46.146821+0000","last_unstale":"2024-09-21T08:55:00.299155+0000","last_undegraded":"2024-09-21T08:55:00.299155+0000","last_fullsized":"2024-09-21T08:55:00.299155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:00.299020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.299020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:39.253241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.862230+0000","last_change":"2024-09-21T08:55:48.862230+0000","last_active":"2024-09-21T08:55:48.862230+0000","last_peered":"2024-09-21T08:55:48.862230+0000","last_clean":"2024-09-21T08:55:48.862230+0000","last_became_active":"2024-09-21T08:51:48.166035+0000","last_became_peered":"2024-09-21T08:51:48.166035+0000","last_unstale":"2024-09-21T08:55:48.862230+0000","last_undegraded":"2024-09-21T08:55:48.862230+0000","last_fullsized":"2024-09-21T08:55:48.862230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:48.862116+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.862116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:22.856674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.768148+0000","last_change":"2024-09-21T08:55:11.768148+0000","last_active":"2024-09-21T08:55:11.768148+0000","last_peered":"2024-09-21T08:55:11.768148+0000","last_clean":"2024-09-21T08:55:11.768148+0000","last_became_active":"2024-09-21T08:51:40.144690+0000","last_became_peered":"2024-09-21T08:51:40.144690+0000","last_unstale":"2024-09-21T08:55:11.768148+0000","last_undegraded":"2024-09-21T08:55:11.768148+0000","last_fullsized":"2024-09-21T08:55:11.768148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:11.768028+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.768028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:52.506242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.810409+0000","last_change":"2024-09-21T08:55:52.810409+0000","last_active":"2024-09-21T08:55:52.810409+0000","last_peered":"2024-09-21T08:55:52.810409+0000","last_clean":"2024-09-21T08:55:52.810409+0000","last_became_active":"2024-09-21T08:51:38.145204+0000","last_became_peered":"2024-09-21T08:51:38.145204+0000","last_unstale":"2024-09-21T08:55:52.810409+0000","last_undegraded":"2024-09-21T08:55:52.810409+0000","last_fullsized":"2024-09-21T08:55:52.810409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:52.810289+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.810289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:25:09.050909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.830117+0000","last_change":"2024-09-21T08:55:45.830117+0000","last_active":"2024-09-21T08:55:45.830117+0000","last_peered":"2024-09-21T08:55:45.830117+0000","last_clean":"2024-09-21T08:55:45.830117+0000","last_became_active":"2024-09-21T08:51:26.511286+0000","last_became_peered":"2024-09-21T08:51:26.511286+0000","last_unstale":"2024-09-21T08:55:45.830117+0000","last_undegraded":"2024-09-21T08:55:45.830117+0000","last_fullsized":"2024-09-21T08:55:45.830117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.829992+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.829992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:35:23.672046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073279499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:03.822721+0000","last_change":"2024-09-21T08:55:03.822721+0000","last_active":"2024-09-21T08:55:03.822721+0000","last_peered":"2024-09-21T08:55:03.822721+0000","last_clean":"2024-09-21T08:55:03.822721+0000","last_became_active":"2024-09-21T08:51:42.135252+0000","last_became_peered":"2024-09-21T08:51:42.135252+0000","last_unstale":"2024-09-21T08:55:03.822721+0000","last_undegraded":"2024-09-21T08:55:03.822721+0000","last_fullsized":"2024-09-21T08:55:03.822721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:03.822614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:03.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:17.459600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.863917+0000","last_change":"2024-09-21T08:55:29.863917+0000","last_active":"2024-09-21T08:55:29.863917+0000","last_peered":"2024-09-21T08:55:29.863917+0000","last_clean":"2024-09-21T08:55:29.863917+0000","last_became_active":"2024-09-21T08:51:44.146623+0000","last_became_peered":"2024-09-21T08:51:44.146623+0000","last_unstale":"2024-09-21T08:55:29.863917+0000","last_undegraded":"2024-09-21T08:55:29.863917+0000","last_fullsized":"2024-09-21T08:55:29.863917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:29.863791+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.863791+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:04.357452+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.791438+0000","last_change":"2024-09-21T08:55:11.791438+0000","last_active":"2024-09-21T08:55:11.791438+0000","last_peered":"2024-09-21T08:55:11.791438+0000","last_clean":"2024-09-21T08:55:11.791438+0000","last_became_active":"2024-09-21T08:51:46.157510+0000","last_became_peered":"2024-09-21T08:51:46.157510+0000","last_unstale":"2024-09-21T08:55:11.791438+0000","last_undegraded":"2024-09-21T08:55:11.791438+0000","last_fullsized":"2024-09-21T08:55:11.791438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:11.791309+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.791309+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:31.481073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.637984+0000","last_change":"2024-09-21T08:55:55.637984+0000","last_active":"2024-09-21T08:55:55.637984+0000","last_peered":"2024-09-21T08:55:55.637984+0000","last_clean":"2024-09-21T08:55:55.637984+0000","last_became_active":"2024-09-21T08:51:48.162135+0000","last_became_peered":"2024-09-21T08:51:48.162135+0000","last_unstale":"2024-09-21T08:55:55.637984+0000","last_undegraded":"2024-09-21T08:55:55.637984+0000","last_fullsized":"2024-09-21T08:55:55.637984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-21T08:55:55.637850+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-21T08:55:55.637850+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.637850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:55:30.131511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.750304+0000","last_change":"2024-09-21T08:55:30.750304+0000","last_active":"2024-09-21T08:55:30.750304+0000","last_peered":"2024-09-21T08:55:30.750304+0000","last_clean":"2024-09-21T08:55:30.750304+0000","last_became_active":"2024-09-21T08:51:40.139705+0000","last_became_peered":"2024-09-21T08:51:40.139705+0000","last_unstale":"2024-09-21T08:55:30.750304+0000","last_undegraded":"2024-09-21T08:55:30.750304+0000","last_fullsized":"2024-09-21T08:55:30.750304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:30.750144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.750144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:34.425604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.343120+0000","last_change":"2024-09-21T08:55:37.343120+0000","last_active":"2024-09-21T08:55:37.343120+0000","last_peered":"2024-09-21T08:55:37.343120+0000","last_clean":"2024-09-21T08:55:37.343120+0000","last_became_active":"2024-09-21T08:51:38.137376+0000","last_became_peered":"2024-09-21T08:51:38.137376+0000","last_unstale":"2024-09-21T08:55:37.343120+0000","last_undegraded":"2024-09-21T08:55:37.343120+0000","last_fullsized":"2024-09-21T08:55:37.343120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:37.342994+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.342994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:14.798606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:11.092454+0000","last_change":"2024-09-21T08:56:11.092474+0000","last_active":"2024-09-21T08:56:11.092454+0000","last_peered":"2024-09-21T08:56:11.092454+0000","last_clean":"2024-09-21T08:56:11.092454+0000","last_became_active":"2024-09-21T08:51:26.529087+0000","last_became_peered":"2024-09-21T08:51:26.529087+0000","last_unstale":"2024-09-21T08:56:11.092454+0000","last_undegraded":"2024-09-21T08:56:11.092454+0000","last_fullsized":"2024-09-21T08:56:11.092454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:11.092345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:11.092345+0000","last_clean_scrub_stamp":"2024-09-21T08:56:11.092345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:20.996499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099706399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:20.941171+0000","last_change":"2024-09-21T08:56:20.941196+0000","last_active":"2024-09-21T08:56:20.941171+0000","last_peered":"2024-09-21T08:56:20.941171+0000","last_clean":"2024-09-21T08:56:20.941171+0000","last_became_active":"2024-09-21T08:52:14.233960+0000","last_became_peered":"2024-09-21T08:52:14.233960+0000","last_unstale":"2024-09-21T08:56:20.941171+0000","last_undegraded":"2024-09-21T08:56:20.941171+0000","last_fullsized":"2024-09-21T08:56:20.941171+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:20.941078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:20.941078+0000","last_clean_scrub_stamp":"2024-09-21T08:56:20.941078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:12.295923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:02.829284+0000","last_change":"2024-09-21T08:55:02.829284+0000","last_active":"2024-09-21T08:55:02.829284+0000","last_peered":"2024-09-21T08:55:02.829284+0000","last_clean":"2024-09-21T08:55:02.829284+0000","last_became_active":"2024-09-21T08:51:44.151208+0000","last_became_peered":"2024-09-21T08:51:44.151208+0000","last_unstale":"2024-09-21T08:55:02.829284+0000","last_undegraded":"2024-09-21T08:55:02.829284+0000","last_fullsized":"2024-09-21T08:55:02.829284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-21T08:55:02.829144+0000","last_clean_scrub_stamp":"2024-09-21T08:55:02.829144+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:09.593879+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.820070+0000","last_change":"2024-09-21T08:55:04.820070+0000","last_active":"2024-09-21T08:55:04.820070+0000","last_peered":"2024-09-21T08:55:04.820070+0000","last_clean":"2024-09-21T08:55:04.820070+0000","last_became_active":"2024-09-21T08:51:46.147931+0000","last_became_peered":"2024-09-21T08:51:46.147931+0000","last_unstale":"2024-09-21T08:55:04.820070+0000","last_undegraded":"2024-09-21T08:55:04.820070+0000","last_fullsized":"2024-09-21T08:55:04.820070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.819955+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.819955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:13.094734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.834113+0000","last_change":"2024-09-21T08:55:12.834113+0000","last_active":"2024-09-21T08:55:12.834113+0000","last_peered":"2024-09-21T08:55:12.834113+0000","last_clean":"2024-09-21T08:55:12.834113+0000","last_became_active":"2024-09-21T08:51:48.152425+0000","last_became_peered":"2024-09-21T08:51:48.152425+0000","last_unstale":"2024-09-21T08:55:12.834113+0000","last_undegraded":"2024-09-21T08:55:12.834113+0000","last_fullsized":"2024-09-21T08:55:12.834113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.833970+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.833970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:00.715535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.696909+0000","last_change":"2024-09-21T08:55:46.696909+0000","last_active":"2024-09-21T08:55:46.696909+0000","last_peered":"2024-09-21T08:55:46.696909+0000","last_clean":"2024-09-21T08:55:46.696909+0000","last_became_active":"2024-09-21T08:51:48.157626+0000","last_became_peered":"2024-09-21T08:51:48.157626+0000","last_unstale":"2024-09-21T08:55:46.696909+0000","last_undegraded":"2024-09-21T08:55:46.696909+0000","last_fullsized":"2024-09-21T08:55:46.696909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:46.696741+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.696741+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:14.571486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.834410+0000","last_change":"2024-09-21T08:55:17.834410+0000","last_active":"2024-09-21T08:55:17.834410+0000","last_peered":"2024-09-21T08:55:17.834410+0000","last_clean":"2024-09-21T08:55:17.834410+0000","last_became_active":"2024-09-21T08:51:40.143388+0000","last_became_peered":"2024-09-21T08:51:40.143388+0000","last_unstale":"2024-09-21T08:55:17.834410+0000","last_undegraded":"2024-09-21T08:55:17.834410+0000","last_fullsized":"2024-09-21T08:55:17.834410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:17.834243+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.834243+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:49.839934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:01.931962+0000","last_change":"2024-09-21T08:56:01.931962+0000","last_active":"2024-09-21T08:56:01.931962+0000","last_peered":"2024-09-21T08:56:01.931962+0000","last_clean":"2024-09-21T08:56:01.931962+0000","last_became_active":"2024-09-21T08:51:38.136699+0000","last_became_peered":"2024-09-21T08:51:38.136699+0000","last_unstale":"2024-09-21T08:56:01.931962+0000","last_undegraded":"2024-09-21T08:56:01.931962+0000","last_fullsized":"2024-09-21T08:56:01.931962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:01.931841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:01.931841+0000","last_clean_scrub_stamp":"2024-09-21T08:56:01.931841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:36.095636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.275037+0000","last_change":"2024-09-21T08:55:15.275037+0000","last_active":"2024-09-21T08:55:15.275037+0000","last_peered":"2024-09-21T08:55:15.275037+0000","last_clean":"2024-09-21T08:55:15.275037+0000","last_became_active":"2024-09-21T08:51:42.133072+0000","last_became_peered":"2024-09-21T08:51:42.133072+0000","last_unstale":"2024-09-21T08:55:15.275037+0000","last_undegraded":"2024-09-21T08:55:15.275037+0000","last_fullsized":"2024-09-21T08:55:15.275037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.274919+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.274919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:38.364271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.810792+0000","last_change":"2024-09-21T08:55:04.810792+0000","last_active":"2024-09-21T08:55:04.810792+0000","last_peered":"2024-09-21T08:55:04.810792+0000","last_clean":"2024-09-21T08:55:04.810792+0000","last_became_active":"2024-09-21T08:51:44.144556+0000","last_became_peered":"2024-09-21T08:51:44.144556+0000","last_unstale":"2024-09-21T08:55:04.810792+0000","last_undegraded":"2024-09-21T08:55:04.810792+0000","last_fullsized":"2024-09-21T08:55:04.810792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:04.810614+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.810614+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:15.348725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.814755+0000","last_change":"2024-09-21T08:55:28.814755+0000","last_active":"2024-09-21T08:55:28.814755+0000","last_peered":"2024-09-21T08:55:28.814755+0000","last_clean":"2024-09-21T08:55:28.814755+0000","last_became_active":"2024-09-21T08:51:46.157859+0000","last_became_peered":"2024-09-21T08:51:46.157859+0000","last_unstale":"2024-09-21T08:55:28.814755+0000","last_undegraded":"2024-09-21T08:55:28.814755+0000","last_fullsized":"2024-09-21T08:55:28.814755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:28.814626+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.814626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:58.769235+0000","last_change":"2024-09-21T08:55:58.769259+0000","last_active":"2024-09-21T08:55:58.769235+0000","last_peered":"2024-09-21T08:55:58.769235+0000","last_clean":"2024-09-21T08:55:58.769235+0000","last_became_active":"2024-09-21T08:51:48.156643+0000","last_became_peered":"2024-09-21T08:51:48.156643+0000","last_unstale":"2024-09-21T08:55:58.769235+0000","last_undegraded":"2024-09-21T08:55:58.769235+0000","last_fullsized":"2024-09-21T08:55:58.769235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-21T08:55:58.769150+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-21T08:55:58.769150+0000","last_clean_scrub_stamp":"2024-09-21T08:55:58.769150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:00.719466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.379222+0000","last_change":"2024-09-21T08:55:22.379222+0000","last_active":"2024-09-21T08:55:22.379222+0000","last_peered":"2024-09-21T08:55:22.379222+0000","last_clean":"2024-09-21T08:55:22.379222+0000","last_became_active":"2024-09-21T08:51:40.141930+0000","last_became_peered":"2024-09-21T08:51:40.141930+0000","last_unstale":"2024-09-21T08:55:22.379222+0000","last_undegraded":"2024-09-21T08:55:22.379222+0000","last_fullsized":"2024-09-21T08:55:22.379222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:22.379069+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.379069+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:35.825511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.686447+0000","last_change":"2024-09-21T08:55:38.686447+0000","last_active":"2024-09-21T08:55:38.686447+0000","last_peered":"2024-09-21T08:55:38.686447+0000","last_clean":"2024-09-21T08:55:38.686447+0000","last_became_active":"2024-09-21T08:51:38.142977+0000","last_became_peered":"2024-09-21T08:51:38.142977+0000","last_unstale":"2024-09-21T08:55:38.686447+0000","last_undegraded":"2024-09-21T08:55:38.686447+0000","last_fullsized":"2024-09-21T08:55:38.686447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:38.686327+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.686327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:51.215101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.817734+0000","last_change":"2024-09-21T08:55:07.817734+0000","last_active":"2024-09-21T08:55:07.817734+0000","last_peered":"2024-09-21T08:55:07.817734+0000","last_clean":"2024-09-21T08:55:07.817734+0000","last_became_active":"2024-09-21T08:51:42.135965+0000","last_became_peered":"2024-09-21T08:51:42.135965+0000","last_unstale":"2024-09-21T08:55:07.817734+0000","last_undegraded":"2024-09-21T08:55:07.817734+0000","last_fullsized":"2024-09-21T08:55:07.817734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.817604+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.817604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:06.637277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:56.836033+0000","last_change":"2024-09-21T08:54:56.836033+0000","last_active":"2024-09-21T08:54:56.836033+0000","last_peered":"2024-09-21T08:54:56.836033+0000","last_clean":"2024-09-21T08:54:56.836033+0000","last_became_active":"2024-09-21T08:51:44.143997+0000","last_became_peered":"2024-09-21T08:51:44.143997+0000","last_unstale":"2024-09-21T08:54:56.836033+0000","last_undegraded":"2024-09-21T08:54:56.836033+0000","last_fullsized":"2024-09-21T08:54:56.836033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:54:56.835862+0000","last_clean_scrub_stamp":"2024-09-21T08:54:56.835862+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.916858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.824228+0000","last_change":"2024-09-21T08:55:04.824228+0000","last_active":"2024-09-21T08:55:04.824228+0000","last_peered":"2024-09-21T08:55:04.824228+0000","last_clean":"2024-09-21T08:55:04.824228+0000","last_became_active":"2024-09-21T08:51:46.158515+0000","last_became_peered":"2024-09-21T08:51:46.158515+0000","last_unstale":"2024-09-21T08:55:04.824228+0000","last_undegraded":"2024-09-21T08:55:04.824228+0000","last_fullsized":"2024-09-21T08:55:04.824228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.824082+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.824082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:20.883736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.734522+0000","last_change":"2024-09-21T08:55:27.734551+0000","last_active":"2024-09-21T08:55:27.734522+0000","last_peered":"2024-09-21T08:55:27.734522+0000","last_clean":"2024-09-21T08:55:27.734522+0000","last_became_active":"2024-09-21T08:51:48.154627+0000","last_became_peered":"2024-09-21T08:51:48.154627+0000","last_unstale":"2024-09-21T08:55:27.734522+0000","last_undegraded":"2024-09-21T08:55:27.734522+0000","last_fullsized":"2024-09-21T08:55:27.734522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:27.734430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.734430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:25.498043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'18","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:29.674323+0000","last_change":"2024-09-21T08:55:29.674323+0000","last_active":"2024-09-21T08:55:29.674323+0000","last_peered":"2024-09-21T08:55:29.674323+0000","last_clean":"2024-09-21T08:55:29.674323+0000","last_became_active":"2024-09-21T08:51:40.122323+0000","last_became_peered":"2024-09-21T08:51:40.122323+0000","last_unstale":"2024-09-21T08:55:29.674323+0000","last_undegraded":"2024-09-21T08:55:29.674323+0000","last_fullsized":"2024-09-21T08:55:29.674323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-21T08:55:29.674182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:29.674182+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:31.441168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.786127+0000","last_change":"2024-09-21T08:55:41.786127+0000","last_active":"2024-09-21T08:55:41.786127+0000","last_peered":"2024-09-21T08:55:41.786127+0000","last_clean":"2024-09-21T08:55:41.786127+0000","last_became_active":"2024-09-21T08:51:38.144596+0000","last_became_peered":"2024-09-21T08:51:38.144596+0000","last_unstale":"2024-09-21T08:55:41.786127+0000","last_undegraded":"2024-09-21T08:55:41.786127+0000","last_fullsized":"2024-09-21T08:55:41.786127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:41.786001+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.786001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:58.913913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.849035+0000","last_change":"2024-09-21T08:55:13.849035+0000","last_active":"2024-09-21T08:55:13.849035+0000","last_peered":"2024-09-21T08:55:13.849035+0000","last_clean":"2024-09-21T08:55:13.849035+0000","last_became_active":"2024-09-21T08:51:42.138841+0000","last_became_peered":"2024-09-21T08:51:42.138841+0000","last_unstale":"2024-09-21T08:55:13.849035+0000","last_undegraded":"2024-09-21T08:55:13.849035+0000","last_fullsized":"2024-09-21T08:55:13.849035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:13.848927+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.848927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:47.202435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'47","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.833272+0000","last_change":"2024-09-21T08:55:09.833272+0000","last_active":"2024-09-21T08:55:09.833272+0000","last_peered":"2024-09-21T08:55:09.833272+0000","last_clean":"2024-09-21T08:55:09.833272+0000","last_became_active":"2024-09-21T08:51:44.143182+0000","last_became_peered":"2024-09-21T08:51:44.143182+0000","last_unstale":"2024-09-21T08:55:09.833272+0000","last_undegraded":"2024-09-21T08:55:09.833272+0000","last_fullsized":"2024-09-21T08:55:09.833272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-21T08:55:09.833131+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.833131+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:32.922483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:04.298628+0000","last_change":"2024-09-21T08:55:04.298628+0000","last_active":"2024-09-21T08:55:04.298628+0000","last_peered":"2024-09-21T08:55:04.298628+0000","last_clean":"2024-09-21T08:55:04.298628+0000","last_became_active":"2024-09-21T08:51:46.147628+0000","last_became_peered":"2024-09-21T08:51:46.147628+0000","last_unstale":"2024-09-21T08:55:04.298628+0000","last_undegraded":"2024-09-21T08:55:04.298628+0000","last_fullsized":"2024-09-21T08:55:04.298628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:04.298475+0000","last_clean_scrub_stamp":"2024-09-21T08:55:04.298475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:45.675637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:17.988745+0000","last_change":"2024-09-21T08:56:17.988777+0000","last_active":"2024-09-21T08:56:17.988745+0000","last_peered":"2024-09-21T08:56:17.988745+0000","last_clean":"2024-09-21T08:56:17.988745+0000","last_became_active":"2024-09-21T08:51:48.168335+0000","last_became_peered":"2024-09-21T08:51:48.168335+0000","last_unstale":"2024-09-21T08:56:17.988745+0000","last_undegraded":"2024-09-21T08:56:17.988745+0000","last_fullsized":"2024-09-21T08:56:17.988745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:17.988656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:17.988656+0000","last_clean_scrub_stamp":"2024-09-21T08:56:17.988656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:29.591309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.759114+0000","last_change":"2024-09-21T08:55:09.759114+0000","last_active":"2024-09-21T08:55:09.759114+0000","last_peered":"2024-09-21T08:55:09.759114+0000","last_clean":"2024-09-21T08:55:09.759114+0000","last_became_active":"2024-09-21T08:51:40.145311+0000","last_became_peered":"2024-09-21T08:51:40.145311+0000","last_unstale":"2024-09-21T08:55:09.759114+0000","last_undegraded":"2024-09-21T08:55:09.759114+0000","last_fullsized":"2024-09-21T08:55:09.759114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.759005+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.759005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:48:03.833615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"36'3","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.445493+0000","last_change":"2024-09-21T08:55:41.445493+0000","last_active":"2024-09-21T08:55:41.445493+0000","last_peered":"2024-09-21T08:55:41.445493+0000","last_clean":"2024-09-21T08:55:41.445493+0000","last_became_active":"2024-09-21T08:51:38.135840+0000","last_became_peered":"2024-09-21T08:51:38.135840+0000","last_unstale":"2024-09-21T08:55:41.445493+0000","last_undegraded":"2024-09-21T08:55:41.445493+0000","last_fullsized":"2024-09-21T08:55:41.445493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:41.445334+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.445334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:29.306449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.791713+0000","last_change":"2024-09-21T08:55:01.791713+0000","last_active":"2024-09-21T08:55:01.791713+0000","last_peered":"2024-09-21T08:55:01.791713+0000","last_clean":"2024-09-21T08:55:01.791713+0000","last_became_active":"2024-09-21T08:51:42.139125+0000","last_became_peered":"2024-09-21T08:51:42.139125+0000","last_unstale":"2024-09-21T08:55:01.791713+0000","last_undegraded":"2024-09-21T08:55:01.791713+0000","last_fullsized":"2024-09-21T08:55:01.791713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:01.791549+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.791549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:43.781022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.862890+0000","last_change":"2024-09-21T08:55:07.862890+0000","last_active":"2024-09-21T08:55:07.862890+0000","last_peered":"2024-09-21T08:55:07.862890+0000","last_clean":"2024-09-21T08:55:07.862890+0000","last_became_active":"2024-09-21T08:51:44.145402+0000","last_became_peered":"2024-09-21T08:51:44.145402+0000","last_unstale":"2024-09-21T08:55:07.862890+0000","last_undegraded":"2024-09-21T08:55:07.862890+0000","last_fullsized":"2024-09-21T08:55:07.862890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:07.862752+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.862752+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:51.564071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:59.950823+0000","last_change":"2024-09-21T08:54:59.950823+0000","last_active":"2024-09-21T08:54:59.950823+0000","last_peered":"2024-09-21T08:54:59.950823+0000","last_clean":"2024-09-21T08:54:59.950823+0000","last_became_active":"2024-09-21T08:51:46.153230+0000","last_became_peered":"2024-09-21T08:51:46.153230+0000","last_unstale":"2024-09-21T08:54:59.950823+0000","last_undegraded":"2024-09-21T08:54:59.950823+0000","last_fullsized":"2024-09-21T08:54:59.950823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:59.950635+0000","last_clean_scrub_stamp":"2024-09-21T08:54:59.950635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:23.543628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.930606+0000","last_change":"2024-09-21T08:55:45.930606+0000","last_active":"2024-09-21T08:55:45.930606+0000","last_peered":"2024-09-21T08:55:45.930606+0000","last_clean":"2024-09-21T08:55:45.930606+0000","last_became_active":"2024-09-21T08:51:40.130968+0000","last_became_peered":"2024-09-21T08:51:40.130968+0000","last_unstale":"2024-09-21T08:55:45.930606+0000","last_undegraded":"2024-09-21T08:55:45.930606+0000","last_fullsized":"2024-09-21T08:55:45.930606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:45.930470+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.930470+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.552172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:53.771575+0000","last_change":"2024-09-21T08:55:53.771575+0000","last_active":"2024-09-21T08:55:53.771575+0000","last_peered":"2024-09-21T08:55:53.771575+0000","last_clean":"2024-09-21T08:55:53.771575+0000","last_became_active":"2024-09-21T08:51:38.139337+0000","last_became_peered":"2024-09-21T08:51:38.139337+0000","last_unstale":"2024-09-21T08:55:53.771575+0000","last_undegraded":"2024-09-21T08:55:53.771575+0000","last_fullsized":"2024-09-21T08:55:53.771575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:53.771415+0000","last_clean_scrub_stamp":"2024-09-21T08:55:53.771415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:02.063865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:21.788002+0000","last_change":"2024-09-21T08:55:21.788002+0000","last_active":"2024-09-21T08:55:21.788002+0000","last_peered":"2024-09-21T08:55:21.788002+0000","last_clean":"2024-09-21T08:55:21.788002+0000","last_became_active":"2024-09-21T08:51:42.135977+0000","last_became_peered":"2024-09-21T08:51:42.135977+0000","last_unstale":"2024-09-21T08:55:21.788002+0000","last_undegraded":"2024-09-21T08:55:21.788002+0000","last_fullsized":"2024-09-21T08:55:21.788002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:21.787814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:21.787814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:10.823157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'65","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.807924+0000","last_change":"2024-09-21T08:55:08.807971+0000","last_active":"2024-09-21T08:55:08.807924+0000","last_peered":"2024-09-21T08:55:08.807924+0000","last_clean":"2024-09-21T08:55:08.807924+0000","last_became_active":"2024-09-21T08:51:44.146077+0000","last_became_peered":"2024-09-21T08:51:44.146077+0000","last_unstale":"2024-09-21T08:55:08.807924+0000","last_undegraded":"2024-09-21T08:55:08.807924+0000","last_fullsized":"2024-09-21T08:55:08.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'65","last_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_deep_scrub":"36'65","last_deep_scrub_stamp":"2024-09-21T08:55:08.807820+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.807820+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:33.816177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:54:58.013839+0000","last_change":"2024-09-21T08:54:58.013862+0000","last_active":"2024-09-21T08:54:58.013839+0000","last_peered":"2024-09-21T08:54:58.013839+0000","last_clean":"2024-09-21T08:54:58.013839+0000","last_became_active":"2024-09-21T08:51:46.155536+0000","last_became_peered":"2024-09-21T08:51:46.155536+0000","last_unstale":"2024-09-21T08:54:58.013839+0000","last_undegraded":"2024-09-21T08:54:58.013839+0000","last_fullsized":"2024-09-21T08:54:58.013839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:54:58.013702+0000","last_clean_scrub_stamp":"2024-09-21T08:54:58.013702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:15.698435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:56.814958+0000","last_change":"2024-09-21T08:55:56.814958+0000","last_active":"2024-09-21T08:55:56.814958+0000","last_peered":"2024-09-21T08:55:56.814958+0000","last_clean":"2024-09-21T08:55:56.814958+0000","last_became_active":"2024-09-21T08:51:48.156349+0000","last_became_peered":"2024-09-21T08:51:48.156349+0000","last_unstale":"2024-09-21T08:55:56.814958+0000","last_undegraded":"2024-09-21T08:55:56.814958+0000","last_fullsized":"2024-09-21T08:55:56.814958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-21T08:55:56.814833+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-21T08:55:56.814833+0000","last_clean_scrub_stamp":"2024-09-21T08:55:56.814833+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:08:30.799088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:41.822947+0000","last_change":"2024-09-21T08:55:41.822974+0000","last_active":"2024-09-21T08:55:41.822947+0000","last_peered":"2024-09-21T08:55:41.822947+0000","last_clean":"2024-09-21T08:55:41.822947+0000","last_became_active":"2024-09-21T08:51:40.134878+0000","last_became_peered":"2024-09-21T08:51:40.134878+0000","last_unstale":"2024-09-21T08:55:41.822947+0000","last_undegraded":"2024-09-21T08:55:41.822947+0000","last_fullsized":"2024-09-21T08:55:41.822947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:41.822847+0000","last_clean_scrub_stamp":"2024-09-21T08:55:41.822847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:42.546644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.488396+0000","last_change":"2024-09-21T08:55:49.488396+0000","last_active":"2024-09-21T08:55:49.488396+0000","last_peered":"2024-09-21T08:55:49.488396+0000","last_clean":"2024-09-21T08:55:49.488396+0000","last_became_active":"2024-09-21T08:51:38.135378+0000","last_became_peered":"2024-09-21T08:51:38.135378+0000","last_unstale":"2024-09-21T08:55:49.488396+0000","last_undegraded":"2024-09-21T08:55:49.488396+0000","last_fullsized":"2024-09-21T08:55:49.488396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:49.488278+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.488278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:42.503251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:15.841357+0000","last_change":"2024-09-21T08:55:15.841357+0000","last_active":"2024-09-21T08:55:15.841357+0000","last_peered":"2024-09-21T08:55:15.841357+0000","last_clean":"2024-09-21T08:55:15.841357+0000","last_became_active":"2024-09-21T08:51:42.139304+0000","last_became_peered":"2024-09-21T08:51:42.139304+0000","last_unstale":"2024-09-21T08:55:15.841357+0000","last_undegraded":"2024-09-21T08:55:15.841357+0000","last_fullsized":"2024-09-21T08:55:15.841357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:15.841239+0000","last_clean_scrub_stamp":"2024-09-21T08:55:15.841239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:07.982245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.796107+0000","last_change":"2024-09-21T08:55:12.796146+0000","last_active":"2024-09-21T08:55:12.796107+0000","last_peered":"2024-09-21T08:55:12.796107+0000","last_clean":"2024-09-21T08:55:12.796107+0000","last_became_active":"2024-09-21T08:51:44.146016+0000","last_became_peered":"2024-09-21T08:51:44.146016+0000","last_unstale":"2024-09-21T08:55:12.796107+0000","last_undegraded":"2024-09-21T08:55:12.796107+0000","last_fullsized":"2024-09-21T08:55:12.796107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:12.796020+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.796020+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:06.530723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:12.286766+0000","last_change":"2024-09-21T08:55:12.286792+0000","last_active":"2024-09-21T08:55:12.286766+0000","last_peered":"2024-09-21T08:55:12.286766+0000","last_clean":"2024-09-21T08:55:12.286766+0000","last_became_active":"2024-09-21T08:51:46.156144+0000","last_became_peered":"2024-09-21T08:51:46.156144+0000","last_unstale":"2024-09-21T08:55:12.286766+0000","last_undegraded":"2024-09-21T08:55:12.286766+0000","last_fullsized":"2024-09-21T08:55:12.286766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:12.286668+0000","last_clean_scrub_stamp":"2024-09-21T08:55:12.286668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:03.780340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:40.858621+0000","last_change":"2024-09-21T08:55:40.858621+0000","last_active":"2024-09-21T08:55:40.858621+0000","last_peered":"2024-09-21T08:55:40.858621+0000","last_clean":"2024-09-21T08:55:40.858621+0000","last_became_active":"2024-09-21T08:51:48.163020+0000","last_became_peered":"2024-09-21T08:51:48.163020+0000","last_unstale":"2024-09-21T08:55:40.858621+0000","last_undegraded":"2024-09-21T08:55:40.858621+0000","last_fullsized":"2024-09-21T08:55:40.858621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:40.858468+0000","last_clean_scrub_stamp":"2024-09-21T08:55:40.858468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'16","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:13.799865+0000","last_change":"2024-09-21T08:55:13.799916+0000","last_active":"2024-09-21T08:55:13.799865+0000","last_peered":"2024-09-21T08:55:13.799865+0000","last_clean":"2024-09-21T08:55:13.799865+0000","last_became_active":"2024-09-21T08:51:40.142007+0000","last_became_peered":"2024-09-21T08:51:40.142007+0000","last_unstale":"2024-09-21T08:55:13.799865+0000","last_undegraded":"2024-09-21T08:55:13.799865+0000","last_fullsized":"2024-09-21T08:55:13.799865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:13.799748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:13.799748+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.649021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.495607+0000","last_change":"2024-09-21T08:55:44.495655+0000","last_active":"2024-09-21T08:55:44.495607+0000","last_peered":"2024-09-21T08:55:44.495607+0000","last_clean":"2024-09-21T08:55:44.495607+0000","last_became_active":"2024-09-21T08:51:38.127361+0000","last_became_peered":"2024-09-21T08:51:38.127361+0000","last_unstale":"2024-09-21T08:55:44.495607+0000","last_undegraded":"2024-09-21T08:55:44.495607+0000","last_fullsized":"2024-09-21T08:55:44.495607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.495495+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.495495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:38.742724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:14.846050+0000","last_change":"2024-09-21T08:55:14.846074+0000","last_active":"2024-09-21T08:55:14.846050+0000","last_peered":"2024-09-21T08:55:14.846050+0000","last_clean":"2024-09-21T08:55:14.846050+0000","last_became_active":"2024-09-21T08:51:42.139356+0000","last_became_peered":"2024-09-21T08:51:42.139356+0000","last_unstale":"2024-09-21T08:55:14.846050+0000","last_undegraded":"2024-09-21T08:55:14.846050+0000","last_fullsized":"2024-09-21T08:55:14.846050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:14.845959+0000","last_clean_scrub_stamp":"2024-09-21T08:55:14.845959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:24.445746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.829399+0000","last_change":"2024-09-21T08:55:10.829399+0000","last_active":"2024-09-21T08:55:10.829399+0000","last_peered":"2024-09-21T08:55:10.829399+0000","last_clean":"2024-09-21T08:55:10.829399+0000","last_became_active":"2024-09-21T08:51:44.140858+0000","last_became_peered":"2024-09-21T08:51:44.140858+0000","last_unstale":"2024-09-21T08:55:10.829399+0000","last_undegraded":"2024-09-21T08:55:10.829399+0000","last_fullsized":"2024-09-21T08:55:10.829399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:10.829198+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.829198+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:50.856893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.802367+0000","last_change":"2024-09-21T08:55:19.802367+0000","last_active":"2024-09-21T08:55:19.802367+0000","last_peered":"2024-09-21T08:55:19.802367+0000","last_clean":"2024-09-21T08:55:19.802367+0000","last_became_active":"2024-09-21T08:51:46.159179+0000","last_became_peered":"2024-09-21T08:51:46.159179+0000","last_unstale":"2024-09-21T08:55:19.802367+0000","last_undegraded":"2024-09-21T08:55:19.802367+0000","last_fullsized":"2024-09-21T08:55:19.802367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:19.802246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.802246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:41.220445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'8","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:15.976231+0000","last_change":"2024-09-21T08:56:15.976231+0000","last_active":"2024-09-21T08:56:15.976231+0000","last_peered":"2024-09-21T08:56:15.976231+0000","last_clean":"2024-09-21T08:56:15.976231+0000","last_became_active":"2024-09-21T08:51:48.167095+0000","last_became_peered":"2024-09-21T08:51:48.167095+0000","last_unstale":"2024-09-21T08:56:15.976231+0000","last_undegraded":"2024-09-21T08:56:15.976231+0000","last_fullsized":"2024-09-21T08:56:15.976231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:56:15.976108+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:56:15.976108+0000","last_clean_scrub_stamp":"2024-09-21T08:56:15.976108+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:13.940287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:24.775881+0000","last_change":"2024-09-21T08:55:24.775881+0000","last_active":"2024-09-21T08:55:24.775881+0000","last_peered":"2024-09-21T08:55:24.775881+0000","last_clean":"2024-09-21T08:55:24.775881+0000","last_became_active":"2024-09-21T08:51:40.136498+0000","last_became_peered":"2024-09-21T08:51:40.136498+0000","last_unstale":"2024-09-21T08:55:24.775881+0000","last_undegraded":"2024-09-21T08:55:24.775881+0000","last_fullsized":"2024-09-21T08:55:24.775881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:24.775748+0000","last_clean_scrub_stamp":"2024-09-21T08:55:24.775748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:55.003623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:00.941023+0000","last_change":"2024-09-21T08:56:00.941068+0000","last_active":"2024-09-21T08:56:00.941023+0000","last_peered":"2024-09-21T08:56:00.941023+0000","last_clean":"2024-09-21T08:56:00.941023+0000","last_became_active":"2024-09-21T08:51:38.149637+0000","last_became_peered":"2024-09-21T08:51:38.149637+0000","last_unstale":"2024-09-21T08:56:00.941023+0000","last_undegraded":"2024-09-21T08:56:00.941023+0000","last_fullsized":"2024-09-21T08:56:00.941023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:00.940920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:00.940920+0000","last_clean_scrub_stamp":"2024-09-21T08:56:00.940920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:29.670084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.214468+0000","last_change":"2024-09-21T08:55:10.214510+0000","last_active":"2024-09-21T08:55:10.214468+0000","last_peered":"2024-09-21T08:55:10.214468+0000","last_clean":"2024-09-21T08:55:10.214468+0000","last_became_active":"2024-09-21T08:51:42.134893+0000","last_became_peered":"2024-09-21T08:51:42.134893+0000","last_unstale":"2024-09-21T08:55:10.214468+0000","last_undegraded":"2024-09-21T08:55:10.214468+0000","last_fullsized":"2024-09-21T08:55:10.214468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:10.214364+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.214364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:44:53.485342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.804730+0000","last_change":"2024-09-21T08:55:23.804730+0000","last_active":"2024-09-21T08:55:23.804730+0000","last_peered":"2024-09-21T08:55:23.804730+0000","last_clean":"2024-09-21T08:55:23.804730+0000","last_became_active":"2024-09-21T08:51:44.148752+0000","last_became_peered":"2024-09-21T08:51:44.148752+0000","last_unstale":"2024-09-21T08:55:23.804730+0000","last_undegraded":"2024-09-21T08:55:23.804730+0000","last_fullsized":"2024-09-21T08:55:23.804730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-21T08:55:23.804588+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.804588+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:05:44.579024+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:08.852971+0000","last_change":"2024-09-21T08:55:08.852971+0000","last_active":"2024-09-21T08:55:08.852971+0000","last_peered":"2024-09-21T08:55:08.852971+0000","last_clean":"2024-09-21T08:55:08.852971+0000","last_became_active":"2024-09-21T08:51:46.158474+0000","last_became_peered":"2024-09-21T08:51:46.158474+0000","last_unstale":"2024-09-21T08:55:08.852971+0000","last_undegraded":"2024-09-21T08:55:08.852971+0000","last_fullsized":"2024-09-21T08:55:08.852971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-21T08:55:08.852812+0000","last_clean_scrub_stamp":"2024-09-21T08:55:08.852812+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:10.217991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.883638+0000","last_change":"2024-09-21T08:55:44.883638+0000","last_active":"2024-09-21T08:55:44.883638+0000","last_peered":"2024-09-21T08:55:44.883638+0000","last_clean":"2024-09-21T08:55:44.883638+0000","last_became_active":"2024-09-21T08:51:48.162972+0000","last_became_peered":"2024-09-21T08:51:48.162972+0000","last_unstale":"2024-09-21T08:55:44.883638+0000","last_undegraded":"2024-09-21T08:55:44.883638+0000","last_fullsized":"2024-09-21T08:55:44.883638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:44.883511+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.883511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:00.980965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'20","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:22.912827+0000","last_change":"2024-09-21T08:55:22.912859+0000","last_active":"2024-09-21T08:55:22.912827+0000","last_peered":"2024-09-21T08:55:22.912827+0000","last_clean":"2024-09-21T08:55:22.912827+0000","last_became_active":"2024-09-21T08:51:40.133596+0000","last_became_peered":"2024-09-21T08:51:40.133596+0000","last_unstale":"2024-09-21T08:55:22.912827+0000","last_undegraded":"2024-09-21T08:55:22.912827+0000","last_fullsized":"2024-09-21T08:55:22.912827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-21T08:55:22.912725+0000","last_clean_scrub_stamp":"2024-09-21T08:55:22.912725+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:35:41.989671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.507430+0000","last_change":"2024-09-21T08:55:43.507456+0000","last_active":"2024-09-21T08:55:43.507430+0000","last_peered":"2024-09-21T08:55:43.507430+0000","last_clean":"2024-09-21T08:55:43.507430+0000","last_became_active":"2024-09-21T08:51:38.125947+0000","last_became_peered":"2024-09-21T08:51:38.125947+0000","last_unstale":"2024-09-21T08:55:43.507430+0000","last_undegraded":"2024-09-21T08:55:43.507430+0000","last_fullsized":"2024-09-21T08:55:43.507430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:43.507314+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.507314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:19.260233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.250725+0000","last_change":"2024-09-21T08:55:11.250750+0000","last_active":"2024-09-21T08:55:11.250725+0000","last_peered":"2024-09-21T08:55:11.250725+0000","last_clean":"2024-09-21T08:55:11.250725+0000","last_became_active":"2024-09-21T08:51:42.134719+0000","last_became_peered":"2024-09-21T08:51:42.134719+0000","last_unstale":"2024-09-21T08:55:11.250725+0000","last_undegraded":"2024-09-21T08:55:11.250725+0000","last_fullsized":"2024-09-21T08:55:11.250725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.250631+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:35.951433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:01.282405+0000","last_change":"2024-09-21T08:55:01.282405+0000","last_active":"2024-09-21T08:55:01.282405+0000","last_peered":"2024-09-21T08:55:01.282405+0000","last_clean":"2024-09-21T08:55:01.282405+0000","last_became_active":"2024-09-21T08:51:44.146918+0000","last_became_peered":"2024-09-21T08:51:44.146918+0000","last_unstale":"2024-09-21T08:55:01.282405+0000","last_undegraded":"2024-09-21T08:55:01.282405+0000","last_fullsized":"2024-09-21T08:55:01.282405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-21T08:55:01.282245+0000","last_clean_scrub_stamp":"2024-09-21T08:55:01.282245+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:55.435995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:00.731817+0000","last_change":"2024-09-21T08:55:00.731817+0000","last_active":"2024-09-21T08:55:00.731817+0000","last_peered":"2024-09-21T08:55:00.731817+0000","last_clean":"2024-09-21T08:55:00.731817+0000","last_became_active":"2024-09-21T08:51:46.152423+0000","last_became_peered":"2024-09-21T08:51:46.152423+0000","last_unstale":"2024-09-21T08:55:00.731817+0000","last_undegraded":"2024-09-21T08:55:00.731817+0000","last_fullsized":"2024-09-21T08:55:00.731817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:00.731703+0000","last_clean_scrub_stamp":"2024-09-21T08:55:00.731703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:33.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.329562+0000","last_change":"2024-09-21T08:55:20.329590+0000","last_active":"2024-09-21T08:55:20.329562+0000","last_peered":"2024-09-21T08:55:20.329562+0000","last_clean":"2024-09-21T08:55:20.329562+0000","last_became_active":"2024-09-21T08:51:48.155278+0000","last_became_peered":"2024-09-21T08:51:48.155278+0000","last_unstale":"2024-09-21T08:55:20.329562+0000","last_undegraded":"2024-09-21T08:55:20.329562+0000","last_fullsized":"2024-09-21T08:55:20.329562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-21T08:55:20.329430+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.329430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:41.690836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.870236+0000","last_change":"2024-09-21T08:55:18.870267+0000","last_active":"2024-09-21T08:55:18.870236+0000","last_peered":"2024-09-21T08:55:18.870236+0000","last_clean":"2024-09-21T08:55:18.870236+0000","last_became_active":"2024-09-21T08:51:40.132444+0000","last_became_peered":"2024-09-21T08:51:40.132444+0000","last_unstale":"2024-09-21T08:55:18.870236+0000","last_undegraded":"2024-09-21T08:55:18.870236+0000","last_fullsized":"2024-09-21T08:55:18.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:18.870118+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.870118+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:22.956813+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:46.924625+0000","last_change":"2024-09-21T08:55:46.924649+0000","last_active":"2024-09-21T08:55:46.924625+0000","last_peered":"2024-09-21T08:55:46.924625+0000","last_clean":"2024-09-21T08:55:46.924625+0000","last_became_active":"2024-09-21T08:51:38.151371+0000","last_became_peered":"2024-09-21T08:51:38.151371+0000","last_unstale":"2024-09-21T08:55:46.924625+0000","last_undegraded":"2024-09-21T08:55:46.924625+0000","last_fullsized":"2024-09-21T08:55:46.924625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:46.924493+0000","last_clean_scrub_stamp":"2024-09-21T08:55:46.924493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:22.780740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:11.806832+0000","last_change":"2024-09-21T08:55:11.806872+0000","last_active":"2024-09-21T08:55:11.806832+0000","last_peered":"2024-09-21T08:55:11.806832+0000","last_clean":"2024-09-21T08:55:11.806832+0000","last_became_active":"2024-09-21T08:51:42.141882+0000","last_became_peered":"2024-09-21T08:51:42.141882+0000","last_unstale":"2024-09-21T08:55:11.806832+0000","last_undegraded":"2024-09-21T08:55:11.806832+0000","last_fullsized":"2024-09-21T08:55:11.806832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:11.806716+0000","last_clean_scrub_stamp":"2024-09-21T08:55:11.806716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:26.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.872367+0000","last_change":"2024-09-21T08:55:06.872367+0000","last_active":"2024-09-21T08:55:06.872367+0000","last_peered":"2024-09-21T08:55:06.872367+0000","last_clean":"2024-09-21T08:55:06.872367+0000","last_became_active":"2024-09-21T08:51:44.146682+0000","last_became_peered":"2024-09-21T08:51:44.146682+0000","last_unstale":"2024-09-21T08:55:06.872367+0000","last_undegraded":"2024-09-21T08:55:06.872367+0000","last_fullsized":"2024-09-21T08:55:06.872367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-21T08:55:06.872210+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.872210+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:58.365881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:18.754399+0000","last_change":"2024-09-21T08:55:18.754399+0000","last_active":"2024-09-21T08:55:18.754399+0000","last_peered":"2024-09-21T08:55:18.754399+0000","last_clean":"2024-09-21T08:55:18.754399+0000","last_became_active":"2024-09-21T08:51:46.154209+0000","last_became_peered":"2024-09-21T08:51:46.154209+0000","last_unstale":"2024-09-21T08:55:18.754399+0000","last_undegraded":"2024-09-21T08:55:18.754399+0000","last_fullsized":"2024-09-21T08:55:18.754399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:18.754246+0000","last_clean_scrub_stamp":"2024-09-21T08:55:18.754246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:42.773601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:19.972952+0000","last_change":"2024-09-21T08:56:19.972977+0000","last_active":"2024-09-21T08:56:19.972952+0000","last_peered":"2024-09-21T08:56:19.972952+0000","last_clean":"2024-09-21T08:56:19.972952+0000","last_became_active":"2024-09-21T08:51:48.168397+0000","last_became_peered":"2024-09-21T08:51:48.168397+0000","last_unstale":"2024-09-21T08:56:19.972952+0000","last_undegraded":"2024-09-21T08:56:19.972952+0000","last_fullsized":"2024-09-21T08:56:19.972952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:19.972858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:19.972858+0000","last_clean_scrub_stamp":"2024-09-21T08:56:19.972858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:49.504214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:42.929800+0000","last_change":"2024-09-21T08:55:42.929800+0000","last_active":"2024-09-21T08:55:42.929800+0000","last_peered":"2024-09-21T08:55:42.929800+0000","last_clean":"2024-09-21T08:55:42.929800+0000","last_became_active":"2024-09-21T08:51:40.131153+0000","last_became_peered":"2024-09-21T08:51:40.131153+0000","last_unstale":"2024-09-21T08:55:42.929800+0000","last_undegraded":"2024-09-21T08:55:42.929800+0000","last_fullsized":"2024-09-21T08:55:42.929800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:42.929679+0000","last_clean_scrub_stamp":"2024-09-21T08:55:42.929679+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:26.608525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:44.780445+0000","last_change":"2024-09-21T08:55:44.780472+0000","last_active":"2024-09-21T08:55:44.780445+0000","last_peered":"2024-09-21T08:55:44.780445+0000","last_clean":"2024-09-21T08:55:44.780445+0000","last_became_active":"2024-09-21T08:51:38.136786+0000","last_became_peered":"2024-09-21T08:51:38.136786+0000","last_unstale":"2024-09-21T08:55:44.780445+0000","last_undegraded":"2024-09-21T08:55:44.780445+0000","last_fullsized":"2024-09-21T08:55:44.780445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:44.780350+0000","last_clean_scrub_stamp":"2024-09-21T08:55:44.780350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:23.748592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:09.263468+0000","last_change":"2024-09-21T08:55:09.263468+0000","last_active":"2024-09-21T08:55:09.263468+0000","last_peered":"2024-09-21T08:55:09.263468+0000","last_clean":"2024-09-21T08:55:09.263468+0000","last_became_active":"2024-09-21T08:51:42.136785+0000","last_became_peered":"2024-09-21T08:51:42.136785+0000","last_unstale":"2024-09-21T08:55:09.263468+0000","last_undegraded":"2024-09-21T08:55:09.263468+0000","last_fullsized":"2024-09-21T08:55:09.263468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:09.263316+0000","last_clean_scrub_stamp":"2024-09-21T08:55:09.263316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:55.833766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'31","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:10.779617+0000","last_change":"2024-09-21T08:55:10.779651+0000","last_active":"2024-09-21T08:55:10.779617+0000","last_peered":"2024-09-21T08:55:10.779617+0000","last_clean":"2024-09-21T08:55:10.779617+0000","last_became_active":"2024-09-21T08:51:44.145369+0000","last_became_peered":"2024-09-21T08:51:44.145369+0000","last_unstale":"2024-09-21T08:55:10.779617+0000","last_undegraded":"2024-09-21T08:55:10.779617+0000","last_fullsized":"2024-09-21T08:55:10.779617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'31","last_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_deep_scrub":"36'31","last_deep_scrub_stamp":"2024-09-21T08:55:10.779521+0000","last_clean_scrub_stamp":"2024-09-21T08:55:10.779521+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:25:53.739000+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:20.738161+0000","last_change":"2024-09-21T08:55:20.738188+0000","last_active":"2024-09-21T08:55:20.738161+0000","last_peered":"2024-09-21T08:55:20.738161+0000","last_clean":"2024-09-21T08:55:20.738161+0000","last_became_active":"2024-09-21T08:51:46.154337+0000","last_became_peered":"2024-09-21T08:51:46.154337+0000","last_unstale":"2024-09-21T08:55:20.738161+0000","last_undegraded":"2024-09-21T08:55:20.738161+0000","last_fullsized":"2024-09-21T08:55:20.738161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:20.738067+0000","last_clean_scrub_stamp":"2024-09-21T08:55:20.738067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:07.544426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:19.009812+0000","last_change":"2024-09-21T08:56:19.009842+0000","last_active":"2024-09-21T08:56:19.009812+0000","last_peered":"2024-09-21T08:56:19.009812+0000","last_clean":"2024-09-21T08:56:19.009812+0000","last_became_active":"2024-09-21T08:51:48.168329+0000","last_became_peered":"2024-09-21T08:51:48.168329+0000","last_unstale":"2024-09-21T08:56:19.009812+0000","last_undegraded":"2024-09-21T08:56:19.009812+0000","last_fullsized":"2024-09-21T08:56:19.009812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:56:19.009707+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:56:19.009707+0000","last_clean_scrub_stamp":"2024-09-21T08:56:19.009707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:01.050631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.896791+0000","last_change":"2024-09-21T08:55:19.896791+0000","last_active":"2024-09-21T08:55:19.896791+0000","last_peered":"2024-09-21T08:55:19.896791+0000","last_clean":"2024-09-21T08:55:19.896791+0000","last_became_active":"2024-09-21T08:51:40.128427+0000","last_became_peered":"2024-09-21T08:51:40.128427+0000","last_unstale":"2024-09-21T08:55:19.896791+0000","last_undegraded":"2024-09-21T08:55:19.896791+0000","last_fullsized":"2024-09-21T08:55:19.896791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:19.896662+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.896662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:21.710664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.396059+0000","last_change":"2024-09-21T08:55:39.396059+0000","last_active":"2024-09-21T08:55:39.396059+0000","last_peered":"2024-09-21T08:55:39.396059+0000","last_clean":"2024-09-21T08:55:39.396059+0000","last_became_active":"2024-09-21T08:51:38.136268+0000","last_became_peered":"2024-09-21T08:51:38.136268+0000","last_unstale":"2024-09-21T08:55:39.396059+0000","last_undegraded":"2024-09-21T08:55:39.396059+0000","last_fullsized":"2024-09-21T08:55:39.396059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:39.395946+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.395946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:18.811856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:06.318938+0000","last_change":"2024-09-21T08:55:06.318938+0000","last_active":"2024-09-21T08:55:06.318938+0000","last_peered":"2024-09-21T08:55:06.318938+0000","last_clean":"2024-09-21T08:55:06.318938+0000","last_became_active":"2024-09-21T08:51:42.141267+0000","last_became_peered":"2024-09-21T08:51:42.141267+0000","last_unstale":"2024-09-21T08:55:06.318938+0000","last_undegraded":"2024-09-21T08:55:06.318938+0000","last_fullsized":"2024-09-21T08:55:06.318938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-21T08:55:06.318814+0000","last_clean_scrub_stamp":"2024-09-21T08:55:06.318814+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:39.323163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:27.769310+0000","last_change":"2024-09-21T08:55:27.769355+0000","last_active":"2024-09-21T08:55:27.769310+0000","last_peered":"2024-09-21T08:55:27.769310+0000","last_clean":"2024-09-21T08:55:27.769310+0000","last_became_active":"2024-09-21T08:51:44.146753+0000","last_became_peered":"2024-09-21T08:51:44.146753+0000","last_unstale":"2024-09-21T08:55:27.769310+0000","last_undegraded":"2024-09-21T08:55:27.769310+0000","last_fullsized":"2024-09-21T08:55:27.769310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-21T08:55:27.769209+0000","last_clean_scrub_stamp":"2024-09-21T08:55:27.769209+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:37.299421+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:07.839335+0000","last_change":"2024-09-21T08:55:07.839358+0000","last_active":"2024-09-21T08:55:07.839335+0000","last_peered":"2024-09-21T08:55:07.839335+0000","last_clean":"2024-09-21T08:55:07.839335+0000","last_became_active":"2024-09-21T08:51:46.154747+0000","last_became_peered":"2024-09-21T08:51:46.154747+0000","last_unstale":"2024-09-21T08:55:07.839335+0000","last_undegraded":"2024-09-21T08:55:07.839335+0000","last_fullsized":"2024-09-21T08:55:07.839335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:07.839244+0000","last_clean_scrub_stamp":"2024-09-21T08:55:07.839244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:46.238290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:16.961787+0000","last_change":"2024-09-21T08:56:16.961787+0000","last_active":"2024-09-21T08:56:16.961787+0000","last_peered":"2024-09-21T08:56:16.961787+0000","last_clean":"2024-09-21T08:56:16.961787+0000","last_became_active":"2024-09-21T08:51:48.167306+0000","last_became_peered":"2024-09-21T08:51:48.167306+0000","last_unstale":"2024-09-21T08:56:16.961787+0000","last_undegraded":"2024-09-21T08:56:16.961787+0000","last_fullsized":"2024-09-21T08:56:16.961787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:16.961648+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:16.961648+0000","last_clean_scrub_stamp":"2024-09-21T08:56:16.961648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.180502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:19.280368+0000","last_change":"2024-09-21T08:55:19.280368+0000","last_active":"2024-09-21T08:55:19.280368+0000","last_peered":"2024-09-21T08:55:19.280368+0000","last_clean":"2024-09-21T08:55:19.280368+0000","last_became_active":"2024-09-21T08:51:40.142804+0000","last_became_peered":"2024-09-21T08:51:40.142804+0000","last_unstale":"2024-09-21T08:55:19.280368+0000","last_undegraded":"2024-09-21T08:55:19.280368+0000","last_fullsized":"2024-09-21T08:55:19.280368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:19.280205+0000","last_clean_scrub_stamp":"2024-09-21T08:55:19.280205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:48.230211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.707889+0000","last_change":"2024-09-21T08:55:37.707889+0000","last_active":"2024-09-21T08:55:37.707889+0000","last_peered":"2024-09-21T08:55:37.707889+0000","last_clean":"2024-09-21T08:55:37.707889+0000","last_became_active":"2024-09-21T08:51:38.141445+0000","last_became_peered":"2024-09-21T08:51:38.141445+0000","last_unstale":"2024-09-21T08:55:37.707889+0000","last_undegraded":"2024-09-21T08:55:37.707889+0000","last_fullsized":"2024-09-21T08:55:37.707889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.707706+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.707706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:28.506620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:37.745709+0000","last_change":"2024-09-21T08:55:37.745709+0000","last_active":"2024-09-21T08:55:37.745709+0000","last_peered":"2024-09-21T08:55:37.745709+0000","last_clean":"2024-09-21T08:55:37.745709+0000","last_became_active":"2024-09-21T08:51:40.133822+0000","last_became_peered":"2024-09-21T08:51:40.133822+0000","last_unstale":"2024-09-21T08:55:37.745709+0000","last_undegraded":"2024-09-21T08:55:37.745709+0000","last_fullsized":"2024-09-21T08:55:37.745709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:37.745516+0000","last_clean_scrub_stamp":"2024-09-21T08:55:37.745516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:33.659012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:48.871380+0000","last_change":"2024-09-21T08:55:48.871380+0000","last_active":"2024-09-21T08:55:48.871380+0000","last_peered":"2024-09-21T08:55:48.871380+0000","last_clean":"2024-09-21T08:55:48.871380+0000","last_became_active":"2024-09-21T08:51:38.129544+0000","last_became_peered":"2024-09-21T08:51:38.129544+0000","last_unstale":"2024-09-21T08:55:48.871380+0000","last_undegraded":"2024-09-21T08:55:48.871380+0000","last_fullsized":"2024-09-21T08:55:48.871380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:48.871258+0000","last_clean_scrub_stamp":"2024-09-21T08:55:48.871258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:41:46.404775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:43.911547+0000","last_change":"2024-09-21T08:55:43.911547+0000","last_active":"2024-09-21T08:55:43.911547+0000","last_peered":"2024-09-21T08:55:43.911547+0000","last_clean":"2024-09-21T08:55:43.911547+0000","last_became_active":"2024-09-21T08:51:40.130996+0000","last_became_peered":"2024-09-21T08:51:40.130996+0000","last_unstale":"2024-09-21T08:55:43.911547+0000","last_undegraded":"2024-09-21T08:55:43.911547+0000","last_fullsized":"2024-09-21T08:55:43.911547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:43.911438+0000","last_clean_scrub_stamp":"2024-09-21T08:55:43.911438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.834517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:05.992686+0000","last_change":"2024-09-21T08:56:05.992716+0000","last_active":"2024-09-21T08:56:05.992686+0000","last_peered":"2024-09-21T08:56:05.992686+0000","last_clean":"2024-09-21T08:56:05.992686+0000","last_became_active":"2024-09-21T08:51:38.136663+0000","last_became_peered":"2024-09-21T08:51:38.136663+0000","last_unstale":"2024-09-21T08:56:05.992686+0000","last_undegraded":"2024-09-21T08:56:05.992686+0000","last_fullsized":"2024-09-21T08:56:05.992686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:56:05.992593+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:56:05.992593+0000","last_clean_scrub_stamp":"2024-09-21T08:56:05.992593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:35.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'10","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:26.729668+0000","last_change":"2024-09-21T08:55:26.729668+0000","last_active":"2024-09-21T08:55:26.729668+0000","last_peered":"2024-09-21T08:55:26.729668+0000","last_clean":"2024-09-21T08:55:26.729668+0000","last_became_active":"2024-09-21T08:51:40.134423+0000","last_became_peered":"2024-09-21T08:51:40.134423+0000","last_unstale":"2024-09-21T08:55:26.729668+0000","last_undegraded":"2024-09-21T08:55:26.729668+0000","last_fullsized":"2024-09-21T08:55:26.729668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:26.729534+0000","last_clean_scrub_stamp":"2024-09-21T08:55:26.729534+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:03.131761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.759949+0000","last_change":"2024-09-21T08:55:38.759949+0000","last_active":"2024-09-21T08:55:38.759949+0000","last_peered":"2024-09-21T08:55:38.759949+0000","last_clean":"2024-09-21T08:55:38.759949+0000","last_became_active":"2024-09-21T08:51:38.136958+0000","last_became_peered":"2024-09-21T08:51:38.136958+0000","last_unstale":"2024-09-21T08:55:38.759949+0000","last_undegraded":"2024-09-21T08:55:38.759949+0000","last_fullsized":"2024-09-21T08:55:38.759949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:38.759839+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.759839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:25.566198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.701599+0000","last_change":"2024-09-21T08:55:33.701599+0000","last_active":"2024-09-21T08:55:33.701599+0000","last_peered":"2024-09-21T08:55:33.701599+0000","last_clean":"2024-09-21T08:55:33.701599+0000","last_became_active":"2024-09-21T08:51:40.129375+0000","last_became_peered":"2024-09-21T08:51:40.129375+0000","last_unstale":"2024-09-21T08:55:33.701599+0000","last_undegraded":"2024-09-21T08:55:33.701599+0000","last_fullsized":"2024-09-21T08:55:33.701599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:33.701471+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.701471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:14.564757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:52.888675+0000","last_change":"2024-09-21T08:55:52.888675+0000","last_active":"2024-09-21T08:55:52.888675+0000","last_peered":"2024-09-21T08:55:52.888675+0000","last_clean":"2024-09-21T08:55:52.888675+0000","last_became_active":"2024-09-21T08:51:38.132579+0000","last_became_peered":"2024-09-21T08:51:38.132579+0000","last_unstale":"2024-09-21T08:55:52.888675+0000","last_undegraded":"2024-09-21T08:55:52.888675+0000","last_fullsized":"2024-09-21T08:55:52.888675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:52.888547+0000","last_clean_scrub_stamp":"2024-09-21T08:55:52.888547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:38.715655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'22","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.649595+0000","last_change":"2024-09-21T08:55:47.649595+0000","last_active":"2024-09-21T08:55:47.649595+0000","last_peered":"2024-09-21T08:55:47.649595+0000","last_clean":"2024-09-21T08:55:47.649595+0000","last_became_active":"2024-09-21T08:52:14.233588+0000","last_became_peered":"2024-09-21T08:52:14.233588+0000","last_unstale":"2024-09-21T08:55:47.649595+0000","last_undegraded":"2024-09-21T08:55:47.649595+0000","last_fullsized":"2024-09-21T08:55:47.649595+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-21T08:55:47.649463+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.649463+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:43.559888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.366070+0000","last_change":"2024-09-21T08:55:31.366070+0000","last_active":"2024-09-21T08:55:31.366070+0000","last_peered":"2024-09-21T08:55:31.366070+0000","last_clean":"2024-09-21T08:55:31.366070+0000","last_became_active":"2024-09-21T08:51:38.140092+0000","last_became_peered":"2024-09-21T08:51:38.140092+0000","last_unstale":"2024-09-21T08:55:31.366070+0000","last_undegraded":"2024-09-21T08:55:31.366070+0000","last_fullsized":"2024-09-21T08:55:31.366070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:31.365957+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.365957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:46.435495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'4","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:39.794295+0000","last_change":"2024-09-21T08:55:39.794295+0000","last_active":"2024-09-21T08:55:39.794295+0000","last_peered":"2024-09-21T08:55:39.794295+0000","last_clean":"2024-09-21T08:55:39.794295+0000","last_became_active":"2024-09-21T08:51:40.135479+0000","last_became_peered":"2024-09-21T08:51:40.135479+0000","last_unstale":"2024-09-21T08:55:39.794295+0000","last_undegraded":"2024-09-21T08:55:39.794295+0000","last_fullsized":"2024-09-21T08:55:39.794295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:39.794176+0000","last_clean_scrub_stamp":"2024-09-21T08:55:39.794176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:07.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:33.745413+0000","last_change":"2024-09-21T08:55:33.745413+0000","last_active":"2024-09-21T08:55:33.745413+0000","last_peered":"2024-09-21T08:55:33.745413+0000","last_clean":"2024-09-21T08:55:33.745413+0000","last_became_active":"2024-09-21T08:51:38.145174+0000","last_became_peered":"2024-09-21T08:51:38.145174+0000","last_unstale":"2024-09-21T08:55:33.745413+0000","last_undegraded":"2024-09-21T08:55:33.745413+0000","last_fullsized":"2024-09-21T08:55:33.745413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:33.745214+0000","last_clean_scrub_stamp":"2024-09-21T08:55:33.745214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:50.076591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.529069+0000","last_change":"2024-09-21T08:55:50.529097+0000","last_active":"2024-09-21T08:55:50.529069+0000","last_peered":"2024-09-21T08:55:50.529069+0000","last_clean":"2024-09-21T08:55:50.529069+0000","last_became_active":"2024-09-21T08:51:40.138296+0000","last_became_peered":"2024-09-21T08:51:40.138296+0000","last_unstale":"2024-09-21T08:55:50.529069+0000","last_undegraded":"2024-09-21T08:55:50.529069+0000","last_fullsized":"2024-09-21T08:55:50.529069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:50.528965+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.528965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:00.243688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:49.875340+0000","last_change":"2024-09-21T08:55:49.875340+0000","last_active":"2024-09-21T08:55:49.875340+0000","last_peered":"2024-09-21T08:55:49.875340+0000","last_clean":"2024-09-21T08:55:49.875340+0000","last_became_active":"2024-09-21T08:51:38.131046+0000","last_became_peered":"2024-09-21T08:51:38.131046+0000","last_unstale":"2024-09-21T08:55:49.875340+0000","last_undegraded":"2024-09-21T08:55:49.875340+0000","last_fullsized":"2024-09-21T08:55:49.875340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:49.875213+0000","last_clean_scrub_stamp":"2024-09-21T08:55:49.875213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:48.388208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.381089+0000","last_change":"2024-09-21T08:55:28.381089+0000","last_active":"2024-09-21T08:55:28.381089+0000","last_peered":"2024-09-21T08:55:28.381089+0000","last_clean":"2024-09-21T08:55:28.381089+0000","last_became_active":"2024-09-21T08:51:40.134679+0000","last_became_peered":"2024-09-21T08:51:40.134679+0000","last_unstale":"2024-09-21T08:55:28.381089+0000","last_undegraded":"2024-09-21T08:55:28.381089+0000","last_fullsized":"2024-09-21T08:55:28.381089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-21T08:55:28.380951+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.380951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.017937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:50.865741+0000","last_change":"2024-09-21T08:55:50.865741+0000","last_active":"2024-09-21T08:55:50.865741+0000","last_peered":"2024-09-21T08:55:50.865741+0000","last_clean":"2024-09-21T08:55:50.865741+0000","last_became_active":"2024-09-21T08:51:38.141855+0000","last_became_peered":"2024-09-21T08:51:38.141855+0000","last_unstale":"2024-09-21T08:55:50.865741+0000","last_undegraded":"2024-09-21T08:55:50.865741+0000","last_fullsized":"2024-09-21T08:55:50.865741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:50.865620+0000","last_clean_scrub_stamp":"2024-09-21T08:55:50.865620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:02.835614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.895412+0000","last_change":"2024-09-21T08:55:30.895412+0000","last_active":"2024-09-21T08:55:30.895412+0000","last_peered":"2024-09-21T08:55:30.895412+0000","last_clean":"2024-09-21T08:55:30.895412+0000","last_became_active":"2024-09-21T08:51:40.139834+0000","last_became_peered":"2024-09-21T08:51:40.139834+0000","last_unstale":"2024-09-21T08:55:30.895412+0000","last_undegraded":"2024-09-21T08:55:30.895412+0000","last_fullsized":"2024-09-21T08:55:30.895412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-21T08:55:30.895250+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.895250+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:29.408246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:36.721660+0000","last_change":"2024-09-21T08:55:36.721660+0000","last_active":"2024-09-21T08:55:36.721660+0000","last_peered":"2024-09-21T08:55:36.721660+0000","last_clean":"2024-09-21T08:55:36.721660+0000","last_became_active":"2024-09-21T08:51:38.136723+0000","last_became_peered":"2024-09-21T08:51:38.136723+0000","last_unstale":"2024-09-21T08:55:36.721660+0000","last_undegraded":"2024-09-21T08:55:36.721660+0000","last_fullsized":"2024-09-21T08:55:36.721660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:36.721506+0000","last_clean_scrub_stamp":"2024-09-21T08:55:36.721506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:00.740861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.664590+0000","last_change":"2024-09-21T08:55:31.664590+0000","last_active":"2024-09-21T08:55:31.664590+0000","last_peered":"2024-09-21T08:55:31.664590+0000","last_clean":"2024-09-21T08:55:31.664590+0000","last_became_active":"2024-09-21T08:51:40.129438+0000","last_became_peered":"2024-09-21T08:51:40.129438+0000","last_unstale":"2024-09-21T08:55:31.664590+0000","last_undegraded":"2024-09-21T08:55:31.664590+0000","last_fullsized":"2024-09-21T08:55:31.664590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-21T08:55:31.664444+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.664444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:15:52.492905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:45.498308+0000","last_change":"2024-09-21T08:55:45.498308+0000","last_active":"2024-09-21T08:55:45.498308+0000","last_peered":"2024-09-21T08:55:45.498308+0000","last_clean":"2024-09-21T08:55:45.498308+0000","last_became_active":"2024-09-21T08:51:38.129392+0000","last_became_peered":"2024-09-21T08:51:38.129392+0000","last_unstale":"2024-09-21T08:55:45.498308+0000","last_undegraded":"2024-09-21T08:55:45.498308+0000","last_fullsized":"2024-09-21T08:55:45.498308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:45.498182+0000","last_clean_scrub_stamp":"2024-09-21T08:55:45.498182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:32.304541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:38.353841+0000","last_change":"2024-09-21T08:55:38.353841+0000","last_active":"2024-09-21T08:55:38.353841+0000","last_peered":"2024-09-21T08:55:38.353841+0000","last_clean":"2024-09-21T08:55:38.353841+0000","last_became_active":"2024-09-21T08:51:40.138360+0000","last_became_peered":"2024-09-21T08:51:40.138360+0000","last_unstale":"2024-09-21T08:55:38.353841+0000","last_undegraded":"2024-09-21T08:55:38.353841+0000","last_fullsized":"2024-09-21T08:55:38.353841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:38.353694+0000","last_clean_scrub_stamp":"2024-09-21T08:55:38.353694+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:37.227506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:47.479963+0000","last_change":"2024-09-21T08:55:47.479963+0000","last_active":"2024-09-21T08:55:47.479963+0000","last_peered":"2024-09-21T08:55:47.479963+0000","last_clean":"2024-09-21T08:55:47.479963+0000","last_became_active":"2024-09-21T08:51:38.131313+0000","last_became_peered":"2024-09-21T08:51:38.131313+0000","last_unstale":"2024-09-21T08:55:47.479963+0000","last_undegraded":"2024-09-21T08:55:47.479963+0000","last_fullsized":"2024-09-21T08:55:47.479963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:47.479837+0000","last_clean_scrub_stamp":"2024-09-21T08:55:47.479837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:42:40.962501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.415391+0000","last_change":"2024-09-21T08:55:23.415391+0000","last_active":"2024-09-21T08:55:23.415391+0000","last_peered":"2024-09-21T08:55:23.415391+0000","last_clean":"2024-09-21T08:55:23.415391+0000","last_became_active":"2024-09-21T08:51:40.141425+0000","last_became_peered":"2024-09-21T08:51:40.141425+0000","last_unstale":"2024-09-21T08:55:23.415391+0000","last_undegraded":"2024-09-21T08:55:23.415391+0000","last_fullsized":"2024-09-21T08:55:23.415391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-21T08:55:23.415266+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.415266+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:24.858792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:56:14.001468+0000","last_change":"2024-09-21T08:56:14.001513+0000","last_active":"2024-09-21T08:56:14.001468+0000","last_peered":"2024-09-21T08:56:14.001468+0000","last_clean":"2024-09-21T08:56:14.001468+0000","last_became_active":"2024-09-21T08:51:38.130408+0000","last_became_peered":"2024-09-21T08:51:38.130408+0000","last_unstale":"2024-09-21T08:56:14.001468+0000","last_undegraded":"2024-09-21T08:56:14.001468+0000","last_fullsized":"2024-09-21T08:56:14.001468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:56:14.001315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:56:14.001315+0000","last_clean_scrub_stamp":"2024-09-21T08:56:14.001315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:30.781736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:32.320495+0000","last_change":"2024-09-21T08:55:32.320495+0000","last_active":"2024-09-21T08:55:32.320495+0000","last_peered":"2024-09-21T08:55:32.320495+0000","last_clean":"2024-09-21T08:55:32.320495+0000","last_became_active":"2024-09-21T08:51:40.137335+0000","last_became_peered":"2024-09-21T08:51:40.137335+0000","last_unstale":"2024-09-21T08:55:32.320495+0000","last_undegraded":"2024-09-21T08:55:32.320495+0000","last_fullsized":"2024-09-21T08:55:32.320495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-21T08:55:32.320370+0000","last_clean_scrub_stamp":"2024-09-21T08:55:32.320370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:40:31.140044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:55.829772+0000","last_change":"2024-09-21T08:55:55.829772+0000","last_active":"2024-09-21T08:55:55.829772+0000","last_peered":"2024-09-21T08:55:55.829772+0000","last_clean":"2024-09-21T08:55:55.829772+0000","last_became_active":"2024-09-21T08:51:38.137561+0000","last_became_peered":"2024-09-21T08:51:38.137561+0000","last_unstale":"2024-09-21T08:55:55.829772+0000","last_undegraded":"2024-09-21T08:55:55.829772+0000","last_fullsized":"2024-09-21T08:55:55.829772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:55.829606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:55.829606+0000","last_clean_scrub_stamp":"2024-09-21T08:55:55.829606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:18.774505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:31.853399+0000","last_change":"2024-09-21T08:55:31.853399+0000","last_active":"2024-09-21T08:55:31.853399+0000","last_peered":"2024-09-21T08:55:31.853399+0000","last_clean":"2024-09-21T08:55:31.853399+0000","last_became_active":"2024-09-21T08:51:40.138671+0000","last_became_peered":"2024-09-21T08:51:40.138671+0000","last_unstale":"2024-09-21T08:55:31.853399+0000","last_undegraded":"2024-09-21T08:55:31.853399+0000","last_fullsized":"2024-09-21T08:55:31.853399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:31.853253+0000","last_clean_scrub_stamp":"2024-09-21T08:55:31.853253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:24.613477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:23.874414+0000","last_change":"2024-09-21T08:55:23.874414+0000","last_active":"2024-09-21T08:55:23.874414+0000","last_peered":"2024-09-21T08:55:23.874414+0000","last_clean":"2024-09-21T08:55:23.874414+0000","last_became_active":"2024-09-21T08:51:38.149400+0000","last_became_peered":"2024-09-21T08:51:38.149400+0000","last_unstale":"2024-09-21T08:55:23.874414+0000","last_undegraded":"2024-09-21T08:55:23.874414+0000","last_fullsized":"2024-09-21T08:55:23.874414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:23.874282+0000","last_clean_scrub_stamp":"2024-09-21T08:55:23.874282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:43.324372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:25.375781+0000","last_change":"2024-09-21T08:55:25.375781+0000","last_active":"2024-09-21T08:55:25.375781+0000","last_peered":"2024-09-21T08:55:25.375781+0000","last_clean":"2024-09-21T08:55:25.375781+0000","last_became_active":"2024-09-21T08:51:40.139266+0000","last_became_peered":"2024-09-21T08:51:40.139266+0000","last_unstale":"2024-09-21T08:55:25.375781+0000","last_undegraded":"2024-09-21T08:55:25.375781+0000","last_fullsized":"2024-09-21T08:55:25.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:25.375567+0000","last_clean_scrub_stamp":"2024-09-21T08:55:25.375567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:46.793767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:59.913094+0000","last_change":"2024-09-21T08:55:59.913094+0000","last_active":"2024-09-21T08:55:59.913094+0000","last_peered":"2024-09-21T08:55:59.913094+0000","last_clean":"2024-09-21T08:55:59.913094+0000","last_became_active":"2024-09-21T08:51:38.138322+0000","last_became_peered":"2024-09-21T08:51:38.138322+0000","last_unstale":"2024-09-21T08:55:59.913094+0000","last_undegraded":"2024-09-21T08:55:59.913094+0000","last_fullsized":"2024-09-21T08:55:59.913094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-21T08:55:59.912999+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-21T08:55:59.912999+0000","last_clean_scrub_stamp":"2024-09-21T08:55:59.912999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:04:37.990297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:51.826847+0000","last_change":"2024-09-21T08:55:51.826847+0000","last_active":"2024-09-21T08:55:51.826847+0000","last_peered":"2024-09-21T08:55:51.826847+0000","last_clean":"2024-09-21T08:55:51.826847+0000","last_became_active":"2024-09-21T08:51:38.139813+0000","last_became_peered":"2024-09-21T08:51:38.139813+0000","last_unstale":"2024-09-21T08:55:51.826847+0000","last_undegraded":"2024-09-21T08:55:51.826847+0000","last_fullsized":"2024-09-21T08:55:51.826847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:51.826720+0000","last_clean_scrub_stamp":"2024-09-21T08:55:51.826720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:57.054148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:28.688551+0000","last_change":"2024-09-21T08:55:28.688551+0000","last_active":"2024-09-21T08:55:28.688551+0000","last_peered":"2024-09-21T08:55:28.688551+0000","last_clean":"2024-09-21T08:55:28.688551+0000","last_became_active":"2024-09-21T08:51:40.135674+0000","last_became_peered":"2024-09-21T08:51:40.135674+0000","last_unstale":"2024-09-21T08:55:28.688551+0000","last_undegraded":"2024-09-21T08:55:28.688551+0000","last_fullsized":"2024-09-21T08:55:28.688551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:28.688436+0000","last_clean_scrub_stamp":"2024-09-21T08:55:28.688436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:11.647915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:30.696969+0000","last_change":"2024-09-21T08:55:30.696969+0000","last_active":"2024-09-21T08:55:30.696969+0000","last_peered":"2024-09-21T08:55:30.696969+0000","last_clean":"2024-09-21T08:55:30.696969+0000","last_became_active":"2024-09-21T08:51:38.149222+0000","last_became_peered":"2024-09-21T08:51:38.149222+0000","last_unstale":"2024-09-21T08:55:30.696969+0000","last_undegraded":"2024-09-21T08:55:30.696969+0000","last_fullsized":"2024-09-21T08:55:30.696969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T08:55:30.696780+0000","last_clean_scrub_stamp":"2024-09-21T08:55:30.696780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:05:08.152392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T08:55:17.239922+0000","last_change":"2024-09-21T08:55:17.239922+0000","last_active":"2024-09-21T08:55:17.239922+0000","last_peered":"2024-09-21T08:55:17.239922+0000","last_clean":"2024-09-21T08:55:17.239922+0000","last_became_active":"2024-09-21T08:51:40.144465+0000","last_became_peered":"2024-09-21T08:51:40.144465+0000","last_unstale":"2024-09-21T08:55:17.239922+0000","last_undegraded":"2024-09-21T08:55:17.239922+0000","last_fullsized":"2024-09-21T08:55:17.239922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-21T08:55:17.239755+0000","last_clean_scrub_stamp":"2024-09-21T08:55:17.239755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.929519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1610,"num_read_kb":1500,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39992,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331848,"statfs":{"total":96636764160,"available":96595812352,"internally_reserved":0,"allocated":499712,"data_stored":158824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673026,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1024000,"data_stored":747482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673027,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":747728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":466944,"data_stored":158790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T08:56:39.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T08:56:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79d04ed640 1 Processor -- start 2024-09-21T08:56:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79d04ed640 1 -- start start 2024-09-21T08:56:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79d04ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79c812f9d0 0x7f79c8131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79d04ed640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c8071f70 con 0x7f79c812cca0 2024-09-21T08:56:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79d04ed640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f79c806e350 con 0x7f79c812f9d0 2024-09-21T08:56:39.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79cda88640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79c812f9d0 0x7f79c8131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79ce289640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f79c812cca0 0x7f79c812d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52312/0 (socket says 172.21.15.29:52312) 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79cda88640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79c812f9d0 0x7f79c8131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44626/0 (socket says 172.21.15.29:44626) 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.757+0000 7f79ce289640 1 -- 172.21.15.29:0/1823858169 learned_addr learned my addr 172.21.15.29:0/1823858169 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.758+0000 7f79cda88640 1 -- 172.21.15.29:0/1823858169 >> v1:172.21.15.29:6789/0 conn(0x7f79c812cca0 legacy=0x7f79c812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.758+0000 7f79cda88640 1 -- 172.21.15.29:0/1823858169 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c80715c0 con 0x7f79c812f9d0 2024-09-21T08:56:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.758+0000 7f79cd287640 1 -- 172.21.15.29:0/1823858169 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761850284 0 0) 0x7f79c8071f70 con 0x7f79c812cca0 2024-09-21T08:56:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.758+0000 7f79cda88640 1 --2- 172.21.15.29:0/1823858169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812f9d0 0x7f79c8131dc0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009720 tx=0x7f79b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce82ea332fb3300f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79cd287640 1 -- 172.21.15.29:0/1823858169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8037070 con 0x7f79c812f9d0 2024-09-21T08:56:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79cd287640 1 -- 172.21.15.29:0/1823858169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b802ad90 con 0x7f79c812f9d0 2024-09-21T08:56:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79cd287640 1 -- 172.21.15.29:0/1823858169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8032590 con 0x7f79c812f9d0 2024-09-21T08:56:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 -- 172.21.15.29:0/1823858169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812f9d0 msgr2=0x7f79c8131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 --2- 172.21.15.29:0/1823858169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812f9d0 0x7f79c8131dc0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009720 tx=0x7f79b802a110 comp rx=0 tx=0).stop 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 -- 172.21.15.29:0/1823858169 shutdown_connections 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 --2- 172.21.15.29:0/1823858169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812f9d0 0x7f79c8131dc0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 -- 172.21.15.29:0/1823858169 >> 172.21.15.29:0/1823858169 conn(0x7f79c809a890 msgr2=0x7f79c809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 -- 172.21.15.29:0/1823858169 shutdown_connections 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.759+0000 7f79d04ed640 1 -- 172.21.15.29:0/1823858169 wait complete. 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.760+0000 7f79d04ed640 1 Processor -- start 2024-09-21T08:56:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.760+0000 7f79d04ed640 1 -- start start 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79d04ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79d04ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f79c812ca50 con 0x7f79c812cca0 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79ce289640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79ce289640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44638/0 (socket says 172.21.15.29:44638) 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79ce289640 1 -- 172.21.15.29:0/292167530 learned_addr learned my addr 172.21.15.29:0/292167530 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79ce289640 1 -- 172.21.15.29:0/292167530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c8123b60 con 0x7f79c812cca0 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79ce289640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f79c400c370 tx=0x7f79c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4007410 con 0x7f79c812cca0 2024-09-21T08:56:39.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40075d0 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c8125200 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4004950 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.761+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c8129a60 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.762+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f79c4011070 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.762+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c812e200 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.762+0000 7f79beffd640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 0x7f79ac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.762+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f79c404b8f0 con 0x7f79c812cca0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.763+0000 7f79cda88640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 0x7f79ac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:56:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.763+0000 7f79cda88640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 0x7f79ac03a760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009720 tx=0x7f79b802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:56:39.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.767+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f79c401cbd0 con 0x7f79c812cca0 2024-09-21T08:56:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.944+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f79c8123480 con 0x7f79c812cca0 2024-09-21T08:56:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.947+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f79c4004d80 con 0x7f79c812cca0 2024-09-21T08:56:39.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.947+0000 7f79beffd640 1 -- 172.21.15.29:0/292167530 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f79c4051080 con 0x7f79c812cca0 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 msgr2=0x7f79ac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 0x7f79ac03a760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009720 tx=0x7f79b802e000 comp rx=0 tx=0).stop 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 msgr2=0x7f79c8122230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f79c400c370 tx=0x7f79c400c830 comp rx=0 tx=0).stop 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 shutdown_connections 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.196:6824/482734080,v1:172.21.15.196:6825/482734080] conn(0x7f79ac0382a0 0x7f79ac03a760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 --2- 172.21.15.29:0/292167530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c812cca0 0x7f79c8122230 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 >> 172.21.15.29:0/292167530 conn(0x7f79c809a890 msgr2=0x7f79c8130850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 shutdown_connections 2024-09-21T08:56:39.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T08:56:39.949+0000 7f79d04ed640 1 -- 172.21.15.29:0/292167530 wait complete. 2024-09-21T08:56:39.962 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T08:56:39.962 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T08:56:39.962 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T08:56:39.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.002 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T08:56:40.002 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T08:56:40.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.042 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T08:56:40.042 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T08:56:40.042 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.110 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T08:56:40.111 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T08:56:40.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.186 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T08:56:40.186 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T08:56:40.186 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T08:56:40.186 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.257 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T08:56:40.257 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T08:56:40.257 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T08:56:40.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T08:56:40.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-21T08:56:40.269 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T08:56:40.269 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T08:56:40.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-21T08:56:40.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T08:56:40.338 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T08:56:40.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:56:40.517 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T08:56:40.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:56:40.652 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T08:56:40.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:56:40.724 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T08:56:40.790 INFO:tasks.ceph:Archiving mon data... 2024-09-21T08:56:40.791 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/data/mon.a.tgz 2024-09-21T08:56:40.791 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-21T08:56:40.808 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.I0eFghJAyJ 2024-09-21T08:56:40.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.I0eFghJAyJ 2024-09-21T08:56:40.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.I0eFghJAyJ 2024-09-21T08:56:41.042 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.I0eFghJAyJ is 272KB 2024-09-21T08:56:41.137 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.I0eFghJAyJ 2024-09-21T08:56:41.153 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T08:56:41.153 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T08:56:41.195 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T08:56:41.274 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T08:56:41.291 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T08:56:41.292 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T08:56:41.293 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi029/crash 2024-09-21T08:56:41.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T08:56:41.339 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi196/crash 2024-09-21T08:56:41.340 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T08:56:41.383 INFO:tasks.ceph:Compressing logs... 2024-09-21T08:56:41.383 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:56:41.386 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:56:41.408 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T08:56:41.408 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-09-21T08:56:41.408 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31227.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29371.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32314.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31227.log.gz 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32188.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.29371.log: /var/log/ceph/ceph-client.admin.32314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31336.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.29371.log.gz 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32314.log.gz 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32062.log 2024-09-21T08:56:41.425 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31336.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32188.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32524.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31336.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29531.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32062.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32524.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.29531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29531.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30958.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31059.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.30958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32272.log 2024-09-21T08:56:41.426 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31059.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30958.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31059.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32440.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32272.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31714.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32440.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32440.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31504.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31566.log 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-09-21T08:56:41.427 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30823.log 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31566.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31504.log.gz 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31566.log.gz 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.30823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31058.log 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30823.log.gz 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31058.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31058.log.gz 2024-09-21T08:56:41.428 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32356.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32356.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30602.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32356.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31060.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.30602.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27647.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30602.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31060.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31060.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.27647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27647.log.gz 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32482.log 2024-09-21T08:56:41.429 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31228.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30916.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32482.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31394.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31228.log: /var/log/ceph/ceph-client.admin.30916.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30916.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29489.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31394.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.29489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31978.log 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29489.log.gz 2024-09-21T08:56:41.430 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32398.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31978.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31894.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32398.log: /var/log/ceph/ceph-client.admin.31057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31852.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32398.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31894.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30798.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31852.log: /var/log/ceph/ceph-client.admin.31936.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31852.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31672.log 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-09-21T08:56:41.431 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31756.log 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.30798.log: /var/log/ceph/ceph-client.admin.31672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32564.log 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30798.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31672.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.31756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30874.log 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31756.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30742.log 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32564.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32104.log 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.30874.log: /var/log/ceph/ceph-client.admin.30742.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30874.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30742.log.gz 2024-09-21T08:56:41.432 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32104.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32104.log.gz 2024-09-21T08:56:41.460 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39575.log 2024-09-21T08:56:41.461 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72844.log 2024-09-21T08:56:41.462 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.39575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36550.log 2024-09-21T08:56:41.462 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.72844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66794.log 2024-09-21T08:56:41.462 INFO:teuthology.orchestra.run.smithi196.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.39575.log.gz 2024-09-21T08:56:41.462 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.36550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61349.log 2024-09-21T08:56:41.462 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68609.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.66794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92779.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.61349.log: /var/log/ceph/ceph-client.0.68609.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72844.log.gz 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93989.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.36550.log.gz 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip/var/log/ceph/ceph-client.0.92779.log: -5 --verbose -- /var/log/ceph/ceph-client.0.46224.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.93989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48039.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.66794.log.gz 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49854.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.46224.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61349.log.gz 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.48039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55904.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92779.log.gz 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67399.log 2024-09-21T08:56:41.465 INFO:teuthology.orchestra.run.smithi196.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68609.log.gz 2024-09-21T08:56:41.466 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93989.log.gz 2024-09-21T08:56:41.466 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60744.log 2024-09-21T08:56:41.469 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.55904.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46224.log.gz 2024-09-21T08:56:41.469 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.67399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77684.log 2024-09-21T08:56:41.469 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48039.log.gz 2024-09-21T08:56:41.469 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85543.log 2024-09-21T08:56:41.469 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.60744.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49854.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.77684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38970.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55904.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.85543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77079.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67399.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.38970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59534.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60744.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.77079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56509.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85543.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.77684.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.59534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38365.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.56509.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38970.log.gz 2024-09-21T08:56:41.470 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77079.log.gz 2024-09-21T08:56:41.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.38365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55299.log 2024-09-21T08:56:41.471 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57719.log 2024-09-21T08:56:41.471 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59534.log.gz 2024-09-21T08:56:41.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.0.55299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43199.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.57719.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56509.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38365.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66189.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.43199.log: /var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64374.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55299.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57719.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.66189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52274.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.64374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45619.log 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43199.log.gz 2024-09-21T08:56:41.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.52274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92174.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.45619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75869.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66189.log.gz 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.92174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82524.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.75869.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64374.log.gz 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58929.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52274.log.gz 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.82524.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45619.log.gz 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31510.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92174.log.gz 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.58929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63769.log 2024-09-21T08:56:41.479 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75869.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.31510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64979.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.63769.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31510.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82524.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43804.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.64979.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58929.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35756.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74054.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.43804.log: /var/log/ceph/ceph-client.admin.35756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41989.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35756.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63769.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.74054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72239.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.41989.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64979.log.gz 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54694.log 2024-09-21T08:56:41.480 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43804.log.gz 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.72239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89149.log 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.54694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50459.log 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2%/var/log/ceph/ceph-client.0.89149.log: -- replaced with /var/log/ceph/ceph-client.0.41989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.75264.log 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74054.log.gz 2024-09-21T08:56:41.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.50459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57114.log 2024-09-21T08:56:41.510 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.75264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49249.log 91.9% 2024-09-21T08:56:41.510 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.54694.log.gz 2024-09-21T08:56:41.510 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.57114.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35716.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.89149.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72239.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84944.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50459.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94594.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75264.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35716.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.84944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80709.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57114.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.94594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48644.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% 90.4% -- replaced with /var/log/ceph/ceph-client.0.84944.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.49249.log.gz 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.80709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53484.log 2024-09-21T08:56:41.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.48644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35636.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.53484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78894.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94594.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35636.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80709.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60139.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48644.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35636.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.78894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73449.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71634.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.60139.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53484.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:gzip/var/log/ceph/ceph-client.0.73449.log: -5 --verbose -- /var/log/ceph/ceph-client.0.69214.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.71634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68004.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.69214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40174.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78894.log.gz 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.68004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91569.log 2024-09-21T08:56:41.512 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60139.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73449.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose 91.0% -- -- replaced with /var/log/ceph/ceph-client.0.71634.log.gz /var/log/ceph/ceph-client.0.78289.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.40174.log: /var/log/ceph/ceph-client.0.91569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87340.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.78289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61954.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68004.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.87340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44409.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40174.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 90.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.87340.log.gz /var/log/ceph/ceph-client.0.46829.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91569.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.61954.log: /var/log/ceph/ceph-client.0.44409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95199.log 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78289.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.46829.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69214.log.gz 2024-09-21T08:56:41.513 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93384.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71029.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.95199.log: /var/log/ceph/ceph-client.0.93384.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.44409.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.41384.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.71029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86741.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.61954.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.41384.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46829.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65584.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95199.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.86741.log: gzip 91.0% -5 -- replaced with /var/log/ceph/ceph-client.0.93384.log.gz --verbose 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: -- /var/log/ceph/ceph-client.0.37760.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86741.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71029.log.gz 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.65584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79499.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.37760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81919.log 2024-09-21T08:56:41.514 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41384.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.79499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90964.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.81919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45014.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.90964.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65584.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80104.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37760.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31470.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.80104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90359.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79499.log.gz/var/log/ceph/ceph-client.admin.31470.log: 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr: 85.6% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31470.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.90964.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89754.log 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45014.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.90359.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81919.log.gz 2024-09-21T08:56:41.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip/var/log/ceph/ceph-osd.2.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35676.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80104.log.gz 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.89754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58324.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35676.log.gz 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip/var/log/ceph/ceph-client.admin.31590.log: -5 --verbose -- /var/log/ceph/ceph-client.0.74659.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90359.log.gz/var/log/ceph/ceph-client.0.58324.log: 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40779.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89754.log.gz 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.74659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83734.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87939.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.40779.log: /var/log/ceph/ceph-client.0.83734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47434.log 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58324.log.gz 2024-09-21T08:56:41.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5/var/log/ceph/ceph-client.0.87939.log: --verbose -- /var/log/ceph/ceph-client.0.84339.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.74659.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3%/var/log/ceph/ceph-client.0.47434.log: -- replaced with /var/log/ceph/ceph-client.0.40779.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.84339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81314.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37155.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87939.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.81314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83129.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83734.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84339.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.37155.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.47434.log.gz 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69819.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.83129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62559.log 2024-09-21T08:56:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.69819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42594.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.62559.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37155.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83129.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81314.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62559.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69819.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52879.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76474.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.52879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95804.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.76474.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.95804.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42594.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88544.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35596.log 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.0.52879.log.gz 2024-09-21T08:56:41.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.0.88544.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.0.76474.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.96461.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35596.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.95804.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.51064.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35596.log.gz 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.96461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70424.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1%/var/log/ceph/ceph-client.0.51064.log: -- replaced with /var/log/ceph/ceph-client.0.88544.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.70424.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51064.log.gz 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70424.log.gz 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86142.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.31550.log: gzip 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.63164.log 2024-09-21T08:56:41.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.86142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54089.log 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.96461.log.gz 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.63164.log: gzip 90.5% -- replaced with /var/log/ceph/ceph-client.0.86142.log.gz 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.54089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51669.log 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.0.51669.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63164.log.gz 2024-09-21T08:56:41.520 INFO:teuthology.orchestra.run.smithi196.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54089.log.gz 2024-09-21T08:56:41.521 INFO:teuthology.orchestra.run.smithi196.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51669.log.gz 2024-09-21T08:56:41.558 INFO:teuthology.orchestra.run.smithi196.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-21T08:56:41.559 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T08:56:41.600 INFO:teuthology.orchestra.run.smithi029.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T08:56:42.350 INFO:teuthology.orchestra.run.smithi196.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T08:56:42.423 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T08:56:42.424 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-21T08:56:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m1.026s 2024-09-21T08:56:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m1.198s 2024-09-21T08:56:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m0.067s 2024-09-21T08:56:42.507 INFO:teuthology.orchestra.run.smithi196.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T08:56:42.512 INFO:teuthology.orchestra.run.smithi196.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T08:56:42.514 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-21T08:56:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m1.065s 2024-09-21T08:56:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m3.065s 2024-09-21T08:56:42.514 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.205s 2024-09-21T08:56:42.515 INFO:tasks.ceph:Archiving logs... 2024-09-21T08:56:42.515 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi029/log 2024-09-21T08:56:42.516 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:56:42.743 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi196/log 2024-09-21T08:56:42.743 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:56:43.287 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T08:56:43.296 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T08:56:43.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:56:43.299 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:56:43.369 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T08:56:43.379 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T08:56:43.379 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:56:43.382 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:56:43.396 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:56:43.397 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:56:43.401 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:56:43.401 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-09-21T08:56:43.401 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 37 -24us[ -24us] +/- 40ms 2024-09-21T08:56:43.401 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv02.front.sepia.ceph.com 3 6 377 39 +243us[ +260us] +/- 50ms 2024-09-21T08:56:43.402 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -194us[ -194us] +/- 69ms 2024-09-21T08:56:43.402 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:56:43.403 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:56:43.403 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-21T08:56:43.403 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -21us[ -10us] +/- 40ms 2024-09-21T08:56:43.403 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +240us[ +240us] +/- 50ms 2024-09-21T08:56:43.403 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -178us[ -178us] +/- 69ms 2024-09-21T08:56:43.404 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:56:43.404 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T08:56:43.413 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T08:56:43.414 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T08:56:43.423 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:56:43.510 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:56:43.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:56:43.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:43.601 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T08:56:43.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:43.628 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T08:56:43.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T08:56:43.684 INFO:teuthology.task.internal:Duration was 727.556311 seconds 2024-09-21T08:56:43.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T08:56:43.727 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T08:56:43.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:56:43.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:56:43.769 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:56:43.771 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:56:44.099 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T08:56:44.099 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T08:56:44.099 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:56:44.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-09-21T08:56:44.163 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:56:44.189 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T08:56:44.189 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:56:44.206 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:56:44.255 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T08:56:44.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:56:44.277 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:56:44.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T08:56:44.405 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T08:56:44.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:56:44.431 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:56:44.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T08:56:44.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:56:44.473 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:56:44.495 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-09-21T08:56:44.519 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-09-21T08:56:44.561 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:56:44.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:44.588 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:56:44.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:44.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T08:56:44.627 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T08:56:44.628 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi029 2024-09-21T08:56:44.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:56:44.664 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913200/remote/smithi196 2024-09-21T08:56:44.664 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:56:44.697 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T08:56:44.697 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:56:44.700 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:56:44.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T08:56:44.758 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T08:56:44.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T08:56:44.768 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T08:56:44.768 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:56:44.770 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:56:44.783 INFO:teuthology.orchestra.run.smithi029.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:56 /home/ubuntu/cephtest 2024-09-21T08:56:44.802 INFO:teuthology.orchestra.run.smithi196.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:56 /home/ubuntu/cephtest 2024-09-21T08:56:44.803 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T08:56:44.828 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T08:56:44.863 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 727.5563106536865 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T08:56:44.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:56:44.955 INFO:teuthology.run:pass